Sep 06 06:25:16 devstack cinder-volume[76342]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 06 06:25:16 devstack cinder-volume[76342]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 06 06:25:16 devstack cinder-volume[76342]: we strongly recommend against using it for new projects. Sep 06 06:25:16 devstack cinder-volume[76342]: If you are already using Eventlet, we recommend migrating to a different Sep 06 06:25:16 devstack cinder-volume[76342]: framework. For more detail see Sep 06 06:25:16 devstack cinder-volume[76342]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 06 06:25:16 devstack cinder-volume[76342]: import eventlet # noqa Sep 06 06:25:18 devstack cinder-volume[76342]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=76342) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 06 06:25:18 devstack cinder-volume[76342]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=76342) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 06 06:25:18 devstack cinder-volume[76342]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=76342) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 06 06:25:19 devstack cinder-volume[76342]: INFO dbcounter [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] Registered counter for database cinder Sep 06 06:25:19 devstack cinder-volume[76342]: DEBUG oslo_db.sqlalchemy.engines [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76342) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 06 06:25:20 devstack cinder-volume[76342]: DEBUG dbcounter [-] [76342] Writer thread running {{(pid=76342) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 06 06:25:20 devstack cinder-volume[76342]: INFO cinder.rpc [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 06 06:25:20 devstack cinder-volume[76342]: INFO cinder.rpc [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 06 06:25:20 devstack cinder-volume[76342]: DEBUG oslo_db.sqlalchemy.engines [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76342) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 06 06:25:20 devstack cinder-volume[76342]: INFO cinder.volume.manager [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] Determined volume DB was empty at startup. Sep 06 06:25:20 devstack cinder-volume[76342]: DEBUG cinder.volume.manager [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=76342) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 06 06:25:20 devstack cinder-volume[76342]: INFO cinder.volume.manager [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 06 06:25:20 devstack cinder-volume[76342]: WARNING stevedore.named [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 06 06:25:20 devstack cinder-volume[76342]: WARNING castellan.key_manager [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 06 06:25:20 devstack cinder-volume[76342]: WARNING cinder.keymgr.conf_key_mgr [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 06 06:25:20 devstack cinder-volume[76342]: DEBUG cinder.volume.drivers.lvm [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=76342) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Sep 06 06:25:20 devstack cinder-volume[76342]: DEBUG oslo_concurrency.processutils [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=76342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:25:20 devstack cinder-volume[76342]: DEBUG oslo_concurrency.processutils [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] CMD "cinder-rtstool verify" returned: 0 in 0.422s {{(pid=76342) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:25:20 devstack cinder-volume[76342]: DEBUG oslo_db.sqlalchemy.engines [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76342) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 06 06:25:20 devstack cinder-volume[76342]: INFO cinder.rpc [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Sep 06 06:25:20 devstack cinder-volume[76342]: INFO cinder.rpc [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Sep 06 06:25:20 devstack cinder-volume[76342]: WARNING stevedore.named [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 06 06:25:20 devstack cinder-volume[76342]: WARNING castellan.key_manager [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 06 06:25:20 devstack cinder-volume[76342]: INFO cinder.volume.manager [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_db.sqlalchemy.engines [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76342) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 06 06:25:21 devstack cinder-volume[76342]: INFO oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] Starting 1 workers Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] Started child 76493 {{(pid=76342) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] Full set of CONF: {{(pid=76342) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] ******************************************************************************** {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] Configuration options gathered from: {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] ================================================================================ {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] allow_availability_zone_fallback = False {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] allow_compression_on_image_upload = False {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] allowed_direct_url_schemes = [] {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] api_rate_limit = True {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] auth_strategy = keystone {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] az_cache_duration = 3600 {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] backend_availability_zone = None {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] backend_host = None {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] backend_name = None {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] backend_stats_polling_interval = 60 {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] backup_api_class = cinder.backup.api.API {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] backup_name_template = backup-%s {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] backup_use_same_host = False {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] backup_use_temp_snapshot = False {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] chap_password = **** {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] chap_username = {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] cinder_internal_tenant_project_id = 69511bce68954edebef20a9888d2b242 {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] cinder_internal_tenant_user_id = fcaa5131bae141619b30d2fd156dc872 {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] cloned_volume_same_az = True {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] cluster = None {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] compression_format = gzip {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] compute_api_class = cinder.compute.nova.API {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] config_dir = [] {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76493]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] config_source = [] {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] control_exchange = openstack {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] debug = True {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] default_availability_zone = None {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] default_group_type = None {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] default_volume_type = lvmdriver-1 {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] disk_geometry = None {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] driver_client_cert = None {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] driver_client_cert_key = None {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] driver_data_namespace = None {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] driver_ssl_cert_path = None {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] driver_ssl_cert_verify = False {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] driver_use_ssl = False {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] enable_force_upload = False {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] enable_new_services = True {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] enable_unsupported_driver = False {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] enabled_backends = ['lvmdriver-1'] {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] enforce_multipath_for_image_xfer = False {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] filter_function = None {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] glance_api_insecure = False {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] glance_api_servers = ['http://192.168.122.198/image'] {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] glance_api_ssl_compression = False {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] glance_ca_certificates_file = None {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] glance_catalog_info = image:glance:publicURL {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] glance_certfile = None {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] glance_keyfile = None {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] glance_num_retries = 3 {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] glance_request_timeout = None {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] goodness_function = None {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] graceful_shutdown_timeout = 5 {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] group_api_class = cinder.group.api.API {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] host = devstack {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] image_compress_on_upload = True {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] image_conversion_address_space_limit = 1 {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] image_conversion_cpu_limit = 60 {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] image_conversion_disable = False {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] image_upload_use_cinder_backend = False {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] image_upload_use_internal_tenant = False {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] image_volume_cache_enabled = False {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] image_volume_cache_max_count = 0 {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] image_volume_cache_max_size_gb = 0 {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] init_host_max_objects_retrieval = 0 {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] instance_format = [instance: %(uuid)s] {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] iscsi_target_flags = {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] iscsi_write_cache = on {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] iser_helper = tgtadm {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] iser_ip_address = 192.168.122.198 {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] iser_port = 3260 {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] log_color = False {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] log_config_append = None {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] log_dir = None {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] log_file = None {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] log_options = True {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] log_rotate_interval = 1 {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] log_rotate_interval_type = days {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] log_rotation_type = none {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] max_age = 0 {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] max_logfile_count = 30 {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] max_logfile_size_mb = 200 {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] max_over_subscription_ratio = 20.0 {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] message_reap_interval = 86400 {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] message_ttl = 2592000 {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] migration_create_volume_timeout_secs = 300 {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] monkey_patch = False {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] monkey_patch_modules = [] {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] my_ip = 192.168.122.198 {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] no_snapshot_gb_quota = False {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] num_iser_scan_tries = 3 {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] num_shell_tries = 3 {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] num_volume_device_scan_tries = 3 {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] nvmeof_conn_info_version = 1 {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] nvmet_ns_id = 10 {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] nvmet_port_id = 1 {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] osapi_max_limit = 1000 {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] osapi_volume_ext_list = [] {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] osapi_volume_listen = 0.0.0.0 {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] osapi_volume_listen_port = 8776 {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] osapi_volume_use_ssl = False {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] osapi_volume_workers = None {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76493]: INFO cinder.volume.manager [None req-404daedc-1c45-407b-a9e0-ff29b3e5af00 None None] Starting volume driver LVMVolumeDriver (3.0.0) Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] per_volume_size_limit = -1 {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] periodic_fuzzy_delay = 60 {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76493]: DEBUG oslo_concurrency.processutils [None req-404daedc-1c45-407b-a9e0-ff29b3e5af00 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76493) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] periodic_interval = 60 {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] project_id_regex = [0-9a-f\-]+ {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] public_endpoint = None {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] publish_errors = False {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] quota_backup_gigabytes = 1000 {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] quota_backups = 10 {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] quota_gigabytes = 1000 {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] quota_groups = 10 {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] quota_snapshots = 10 {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] quota_volumes = 10 {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] rate_limit_burst = 0 {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] rate_limit_except_level = CRITICAL {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] rate_limit_interval = 0 {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] reinit_driver_count = 3 {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] replication_device = **** {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] report_discard_supported = False {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] report_interval = 120 {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] reservation_clean_interval = 86400 {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] reservation_expire = 86400 {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] reserved_image_namespaces = [] {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] reserved_percentage = 0 {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] rpc_response_timeout = 120 {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] run_external_periodic_tasks = True {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] scst_target_driver = iscsi {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] scst_target_iqn_name = None {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] service_down_time = 720 {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] shell_completion = None {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] snapshot_name_template = snapshot-%s {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] snapshot_same_host = True {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] split_loggers = False {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] state_path = /opt/stack/data/cinder {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] storage_availability_zone = nova {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] storage_protocol = iSCSI {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] syslog_log_facility = LOG_USER {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] target_helper = lioadm {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] target_ip_address = 192.168.122.198 {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] target_port = 3260 {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] target_protocol = iscsi {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] target_secondary_ip_addresses = [] {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] trace_flags = None {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] transfer_api_class = cinder.transfer.api.API {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] transport_url = **** {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] until_refresh = 0 {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] use_chap_auth = False {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] use_default_quota_class = True {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] use_journal = False {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] use_json = False {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] use_multipath_for_image_xfer = False {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] use_stderr = False {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] use_syslog = False {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] verify_glance_signatures = enabled {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] volume_api_class = cinder.volume.api.API {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] volume_backend_name = None {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] volume_clear = zero {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] volume_clear_ionice = None {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] volume_clear_size = 0 {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] volume_copy_bps_limit = 0 {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] volume_dd_blocksize = 1M {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] volume_name_template = volume-%s {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] volume_service_inithost_offload = False {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] volume_usage_audit_period = month {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] zoning_mode = None {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] oslo_concurrency.disable_process_locking = False {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76493]: DEBUG oslo_concurrency.processutils [None req-404daedc-1c45-407b-a9e0-ff29b3e5af00 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.051s {{(pid=76493) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] keystone_authtoken.auth_section = None {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] keystone_authtoken.auth_type = password {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] keystone_authtoken.auth_version = None {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] keystone_authtoken.cache = None {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] keystone_authtoken.certfile = None {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] keystone_authtoken.delay_auth_decision = False {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] keystone_authtoken.http_connect_timeout = None {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] keystone_authtoken.include_service_catalog = True {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76493]: DEBUG oslo_concurrency.processutils [None req-404daedc-1c45-407b-a9e0-ff29b3e5af00 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76493) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] keystone_authtoken.insecure = False {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] keystone_authtoken.interface = public {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] keystone_authtoken.keyfile = None {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] keystone_authtoken.memcache_password = **** {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] keystone_authtoken.memcache_username = None {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] keystone_authtoken.region_name = None {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] keystone_authtoken.service_token_roles_required = True {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] keystone_authtoken.service_type = None {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] keystone_authtoken.token_cache_time = 300 {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.198/identity {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] cache.backend = dogpile.cache.null {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] cache.backend_argument = **** {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] cache.backend_expiration_time = None {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] cache.config_prefix = cache.oslo {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] cache.debug_cache_backend = False {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] cache.enable_retry_client = False {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] cache.enable_socket_keepalive = False {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] cache.enabled = False {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] cache.expiration_time = 600 {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] cache.hashclient_retry_attempts = 2 {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] cache.memcache_dead_retry = 300 {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] cache.memcache_pool_maxsize = 10 {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] cache.memcache_sasl_enabled = False {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] cache.password = **** {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] cache.proxies = [] {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] cache.redis_db = 0 {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] cache.redis_sentinel_service_name = mymaster {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] cache.redis_server = localhost:6379 {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] cache.retry_attempts = 2 {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] cache.retry_delay = 0.0 {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] cache.socket_keepalive_count = 1 {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] cache.socket_keepalive_idle = 1 {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] cache.socket_keepalive_interval = 1 {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] cache.socket_timeout = 1.0 {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] cache.tls_allowed_ciphers = None {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] cache.tls_cafile = None {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] cache.tls_certfile = None {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] cache.tls_enabled = False {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] cache.tls_keyfile = None {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] cache.username = None {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] coordination.backend_url = **** {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] database.asyncio_connection = **** {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] database.asyncio_slave_connection = **** {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] database.backend = sqlalchemy {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] database.connection = **** {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] database.connection_debug = 0 {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] database.connection_parameters = {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] database.connection_recycle_time = 3600 {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] database.connection_trace = False {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] database.db_inc_retry_interval = True {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] database.db_max_retries = 20 {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] database.db_max_retry_interval = 10 {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76493]: DEBUG oslo_concurrency.processutils [None req-404daedc-1c45-407b-a9e0-ff29b3e5af00 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.042s {{(pid=76493) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] database.db_retry_interval = 1 {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] database.max_overflow = 50 {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76493]: DEBUG oslo_concurrency.processutils [None req-404daedc-1c45-407b-a9e0-ff29b3e5af00 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76493) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] database.max_pool_size = 5 {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] database.max_retries = 10 {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] database.mysql_wsrep_sync_wait = None {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] database.pool_timeout = None {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] database.retry_interval = 10 {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] database.slave_connection = **** {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] database.sqlite_synchronous = True {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] database.synchronous_reader = True {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] database.use_db_reconnect = False {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] oslo_messaging_tracing.insecure = False {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] profiler.connection_string = messaging:// {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] profiler.enabled = False {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] profiler.es_doc_type = notification {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] profiler.es_scroll_size = 10000 {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] profiler.es_scroll_time = 2m {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] profiler.filter_error_trace = False {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] profiler.hmac_keys = **** {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] profiler.sentinel_service_name = mymaster {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] profiler.socket_timeout = 0.1 {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] profiler.trace_requests = False {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] profiler.trace_sqlalchemy = False {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] profiler_jaeger.process_tags = {} {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] profiler_jaeger.service_name_prefix = None {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] profiler_otlp.service_name_prefix = None {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] oslo_policy.enforce_new_defaults = True {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] oslo_policy.policy_default_rule = default {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] oslo_policy.policy_file = policy.yaml {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] oslo_policy.remote_timeout = 60.0 {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] privsep_osbrick.group = None {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] privsep_osbrick.helper_command = None {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] privsep_osbrick.user = None {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] cinder_sys_admin.group = None {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] cinder_sys_admin.helper_command = None {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] cinder_sys_admin.user = None {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] service_user.auth_section = None {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] service_user.auth_type = password {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] service_user.cafile = None {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] service_user.certfile = None {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] service_user.collect_timing = False {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] service_user.insecure = False {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] service_user.keyfile = None {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] service_user.send_service_user_token = True {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] service_user.split_loggers = False {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] service_user.timeout = None {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] service_user.tls_ciphers = None {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] service_user.tls_min_version = None {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] glance.auth_section = None {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] glance.auth_type = password {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] glance.certfile = None {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] glance.collect_timing = False {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] glance.insecure = False {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76493]: DEBUG oslo_concurrency.processutils [None req-404daedc-1c45-407b-a9e0-ff29b3e5af00 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.043s {{(pid=76493) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] glance.keyfile = None {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] glance.region_name = None {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76493]: DEBUG oslo_concurrency.processutils [None req-404daedc-1c45-407b-a9e0-ff29b3e5af00 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76493) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] glance.split_loggers = False {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] glance.timeout = None {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] glance.tls_ciphers = None {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] glance.tls_min_version = None {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] backend_defaults.backend_availability_zone = None {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] backend_defaults.chap_password = **** {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] backend_defaults.chap_username = {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] backend_defaults.disk_geometry = None {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] backend_defaults.driver_client_cert = None {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] backend_defaults.driver_client_cert_key = None {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] backend_defaults.driver_data_namespace = None {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] backend_defaults.driver_use_ssl = False {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] backend_defaults.enable_unsupported_driver = False {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] backend_defaults.extra_capabilities = {} {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] backend_defaults.filter_function = None {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] backend_defaults.goodness_function = None {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] backend_defaults.iscsi_target_flags = {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] backend_defaults.iscsi_write_cache = on {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] backend_defaults.iser_helper = tgtadm {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] backend_defaults.iser_ip_address = 192.168.122.198 {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] backend_defaults.iser_port = 3260 {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] backend_defaults.lvm_mirrors = 0 {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] backend_defaults.lvm_share_target = False {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] backend_defaults.lvm_type = auto {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] backend_defaults.num_shell_tries = 3 {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] backend_defaults.nvmet_port_id = 1 {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] backend_defaults.replication_device = **** {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] backend_defaults.report_discard_supported = False {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] backend_defaults.reserved_percentage = 0 {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] backend_defaults.scst_target_driver = iscsi {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] backend_defaults.scst_target_iqn_name = None {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] backend_defaults.storage_protocol = iSCSI {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] backend_defaults.target_helper = tgtadm {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] backend_defaults.target_ip_address = 192.168.122.198 {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] backend_defaults.target_port = 3260 {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] backend_defaults.target_protocol = iscsi {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] backend_defaults.trace_flags = None {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] backend_defaults.unique_fqdn_network = True {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] backend_defaults.use_chap_auth = False {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] backend_defaults.volume_backend_name = None {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] backend_defaults.volume_clear = zero {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] backend_defaults.volume_clear_ionice = None {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] backend_defaults.volume_clear_size = 0 {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] backend_defaults.volume_group = cinder-volumes {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] oslo_reports.file_event_handler = None {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] oslo_reports.log_dir = None {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] lvmdriver-1.backend_availability_zone = None {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] lvmdriver-1.backend_host = None {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] lvmdriver-1.chap_password = **** {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] lvmdriver-1.chap_username = None {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] lvmdriver-1.chiscsi_conf = None {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] lvmdriver-1.disk_geometry = None {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] lvmdriver-1.driver_client_cert = None {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] lvmdriver-1.driver_data_namespace = None {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack sudo[76545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] lvmdriver-1.driver_use_ssl = None {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack sudo[76545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] lvmdriver-1.extra_capabilities = None {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] lvmdriver-1.filter_function = None {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] lvmdriver-1.goodness_function = None {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] lvmdriver-1.iser_helper = None {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] lvmdriver-1.iser_ip_address = None {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] lvmdriver-1.iser_port = None {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] lvmdriver-1.iser_target_prefix = None {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] lvmdriver-1.lvm_conf_file = None {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] lvmdriver-1.lvm_mirrors = None {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] lvmdriver-1.lvm_share_target = None {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] lvmdriver-1.lvm_type = auto {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] lvmdriver-1.num_shell_tries = None {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] lvmdriver-1.nvmet_port_id = None {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] lvmdriver-1.replication_device = **** {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] lvmdriver-1.report_discard_supported = None {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] lvmdriver-1.reserved_percentage = None {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] lvmdriver-1.scst_target_driver = None {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] lvmdriver-1.storage_protocol = None {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] lvmdriver-1.target_helper = lioadm {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] lvmdriver-1.target_ip_address = None {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] lvmdriver-1.target_port = 3260 {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] lvmdriver-1.target_protocol = iscsi {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] lvmdriver-1.trace_flags = None {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] lvmdriver-1.use_chap_auth = None {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] lvmdriver-1.volume_clear = zero {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] lvmdriver-1.volume_clear_size = None {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] lvmdriver-1.volumes_dir = None {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] oslo_messaging_rabbit.ssl = False {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] oslo_messaging_rabbit.ssl_version = {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] oslo_messaging_notifications.driver = [] {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] oslo_messaging_notifications.retry = -1 {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] oslo_messaging_notifications.transport_url = **** {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] key_manager.fixed_key = **** {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] barbican.barbican_api_version = None {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] barbican.barbican_endpoint = None {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] barbican.barbican_endpoint_type = public {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] barbican.barbican_region_name = None {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] barbican.cafile = None {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] barbican.certfile = None {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] barbican.collect_timing = False {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] barbican.insecure = False {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] barbican.keyfile = None {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] barbican.number_of_retries = 60 {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] barbican.retry_delay = 1 {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] barbican.send_service_user_token = False {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] barbican.split_loggers = False {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] barbican.timeout = None {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] barbican.tls_ciphers = None {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] barbican.tls_min_version = None {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] barbican.verify_ssl = True {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] barbican.verify_ssl_path = None {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] barbican_service_user.auth_section = None {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] barbican_service_user.auth_type = None {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] barbican_service_user.cafile = None {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] barbican_service_user.certfile = None {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] barbican_service_user.collect_timing = False {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] barbican_service_user.insecure = False {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] barbican_service_user.keyfile = None {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] barbican_service_user.split_loggers = False {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] barbican_service_user.timeout = None {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] barbican_service_user.tls_ciphers = None {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] barbican_service_user.tls_min_version = None {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] vault.approle_role_id = **** {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] vault.approle_secret_id = **** {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] vault.auth_method = approle {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] vault.auth_path = None {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] vault.kv_mountpoint = secret {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] vault.kv_path = None {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] vault.kv_version = 2 {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] vault.namespace = None {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] vault.root_token_id = **** {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] vault.ssl_ca_crt_file = None {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] vault.timeout = 60.0 {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] vault.token_file = None {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] vault.token_role = None {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] vault.use_ssl = False {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:25:21 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] ******************************************************************************** {{(pid=76342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 06 06:25:21 devstack sudo[76545]: pam_unix(sudo:session): session closed for user root Sep 06 06:25:21 devstack cinder-volume[76493]: DEBUG oslo_concurrency.processutils [None req-404daedc-1c45-407b-a9e0-ff29b3e5af00 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.353s {{(pid=76493) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:25:21 devstack cinder-volume[76493]: DEBUG oslo_concurrency.processutils [None req-404daedc-1c45-407b-a9e0-ff29b3e5af00 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76493) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:25:21 devstack sudo[76671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 06 06:25:21 devstack sudo[76671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:25:21 devstack sudo[76671]: pam_unix(sudo:session): session closed for user root Sep 06 06:25:21 devstack cinder-volume[76493]: DEBUG oslo_concurrency.processutils [None req-404daedc-1c45-407b-a9e0-ff29b3e5af00 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.258s {{(pid=76493) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:25:21 devstack cinder-volume[76493]: DEBUG oslo_concurrency.processutils [None req-404daedc-1c45-407b-a9e0-ff29b3e5af00 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76493) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 06 06:25:21 devstack cinder-volume[76493]: INFO cinder.brick.local_dev.lvm [None req-404daedc-1c45-407b-a9e0-ff29b3e5af00 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Sep 06 06:25:21 devstack cinder-volume[76493]: DEBUG oslo_concurrency.processutils [None req-404daedc-1c45-407b-a9e0-ff29b3e5af00 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76493) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:25:21 devstack cinder-volume[76493]: DEBUG oslo_concurrency.processutils [None req-404daedc-1c45-407b-a9e0-ff29b3e5af00 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=76493) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:25:21 devstack cinder-volume[76493]: DEBUG oslo_concurrency.processutils [None req-404daedc-1c45-407b-a9e0-ff29b3e5af00 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76493) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:25:21 devstack sudo[76755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 06 06:25:21 devstack sudo[76755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:25:22 devstack sudo[76755]: pam_unix(sudo:session): session closed for user root Sep 06 06:25:22 devstack cinder-volume[76493]: DEBUG oslo_concurrency.processutils [None req-404daedc-1c45-407b-a9e0-ff29b3e5af00 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.280s {{(pid=76493) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:25:22 devstack cinder-volume[76493]: DEBUG cinder.brick.local_dev.lvm [None req-404daedc-1c45-407b-a9e0-ff29b3e5af00 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76493) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Sep 06 06:25:22 devstack cinder-volume[76493]: DEBUG oslo_concurrency.processutils [None req-404daedc-1c45-407b-a9e0-ff29b3e5af00 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76493) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:25:22 devstack sudo[76839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 06 06:25:22 devstack sudo[76839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:25:22 devstack sudo[76839]: pam_unix(sudo:session): session closed for user root Sep 06 06:25:22 devstack cinder-volume[76493]: DEBUG oslo_concurrency.processutils [None req-404daedc-1c45-407b-a9e0-ff29b3e5af00 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.514s {{(pid=76493) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:25:22 devstack cinder-volume[76493]: DEBUG oslo_concurrency.processutils [None req-404daedc-1c45-407b-a9e0-ff29b3e5af00 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76493) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:25:22 devstack cinder-volume[76493]: DEBUG oslo_concurrency.processutils [None req-404daedc-1c45-407b-a9e0-ff29b3e5af00 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=76493) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:25:22 devstack cinder-volume[76493]: DEBUG oslo_concurrency.processutils [None req-404daedc-1c45-407b-a9e0-ff29b3e5af00 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76493) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:25:22 devstack sudo[77025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 06 06:25:22 devstack sudo[77025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:25:23 devstack sudo[77025]: pam_unix(sudo:session): session closed for user root Sep 06 06:25:23 devstack cinder-volume[76493]: DEBUG oslo_concurrency.processutils [None req-404daedc-1c45-407b-a9e0-ff29b3e5af00 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.325s {{(pid=76493) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:25:23 devstack cinder-volume[76493]: DEBUG oslo_concurrency.processutils [None req-404daedc-1c45-407b-a9e0-ff29b3e5af00 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76493) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:25:23 devstack cinder-volume[76493]: DEBUG oslo_concurrency.processutils [None req-404daedc-1c45-407b-a9e0-ff29b3e5af00 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=76493) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:25:23 devstack cinder-volume[76493]: DEBUG oslo_concurrency.processutils [None req-404daedc-1c45-407b-a9e0-ff29b3e5af00 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76493) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:25:23 devstack sudo[77105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Sep 06 06:25:23 devstack sudo[77105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:25:23 devstack sudo[77105]: pam_unix(sudo:session): session closed for user root Sep 06 06:25:23 devstack cinder-volume[76493]: DEBUG oslo_concurrency.processutils [None req-404daedc-1c45-407b-a9e0-ff29b3e5af00 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.243s {{(pid=76493) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:25:23 devstack cinder-volume[76493]: DEBUG oslo_concurrency.processutils [None req-404daedc-1c45-407b-a9e0-ff29b3e5af00 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76493) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:25:23 devstack sudo[77112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 06 06:25:23 devstack sudo[77112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:25:23 devstack sudo[77112]: pam_unix(sudo:session): session closed for user root Sep 06 06:25:23 devstack cinder-volume[76493]: DEBUG oslo_concurrency.processutils [None req-404daedc-1c45-407b-a9e0-ff29b3e5af00 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.316s {{(pid=76493) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:25:23 devstack cinder-volume[76493]: DEBUG oslo_concurrency.processutils [None req-404daedc-1c45-407b-a9e0-ff29b3e5af00 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76493) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:25:23 devstack sudo[77192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 06 06:25:23 devstack sudo[77192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:25:23 devstack sudo[77192]: pam_unix(sudo:session): session closed for user root Sep 06 06:25:23 devstack cinder-volume[76493]: DEBUG oslo_concurrency.processutils [None req-404daedc-1c45-407b-a9e0-ff29b3e5af00 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.301s {{(pid=76493) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:25:23 devstack cinder-volume[76493]: DEBUG oslo_concurrency.processutils [None req-404daedc-1c45-407b-a9e0-ff29b3e5af00 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76493) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:25:24 devstack sudo[77200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 06 06:25:24 devstack sudo[77200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:25:24 devstack sudo[77200]: pam_unix(sudo:session): session closed for user root Sep 06 06:25:24 devstack cinder-volume[76493]: DEBUG oslo_concurrency.processutils [None req-404daedc-1c45-407b-a9e0-ff29b3e5af00 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.288s {{(pid=76493) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:25:24 devstack cinder-volume[76493]: DEBUG oslo_concurrency.processutils [None req-404daedc-1c45-407b-a9e0-ff29b3e5af00 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76493) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:25:24 devstack sudo[77279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 06 06:25:24 devstack sudo[77279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:25:24 devstack sudo[77279]: pam_unix(sudo:session): session closed for user root Sep 06 06:25:24 devstack cinder-volume[76493]: DEBUG oslo_concurrency.processutils [None req-404daedc-1c45-407b-a9e0-ff29b3e5af00 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.296s {{(pid=76493) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:25:24 devstack cinder-volume[76493]: DEBUG oslo_concurrency.processutils [None req-404daedc-1c45-407b-a9e0-ff29b3e5af00 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76493) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:25:24 devstack cinder-volume[76493]: DEBUG oslo_concurrency.processutils [None req-404daedc-1c45-407b-a9e0-ff29b3e5af00 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.031s {{(pid=76493) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:25:24 devstack cinder-volume[76493]: DEBUG oslo_concurrency.processutils [None req-404daedc-1c45-407b-a9e0-ff29b3e5af00 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76493) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:25:24 devstack sudo[77294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 06 06:25:24 devstack sudo[77294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:25:24 devstack sudo[77294]: pam_unix(sudo:session): session closed for user root Sep 06 06:25:24 devstack cinder-volume[76493]: DEBUG oslo_concurrency.processutils [None req-404daedc-1c45-407b-a9e0-ff29b3e5af00 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.260s {{(pid=76493) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:25:24 devstack cinder-volume[76493]: INFO cinder.volume.drivers.lvm [None req-404daedc-1c45-407b-a9e0-ff29b3e5af00 None None] Enabling LVM thin provisioning by default because a thin pool exists. Sep 06 06:25:24 devstack cinder-volume[76493]: DEBUG oslo_concurrency.processutils [None req-404daedc-1c45-407b-a9e0-ff29b3e5af00 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76493) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:25:24 devstack cinder-volume[76493]: DEBUG oslo_concurrency.processutils [None req-404daedc-1c45-407b-a9e0-ff29b3e5af00 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=76493) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:25:24 devstack cinder-volume[76493]: DEBUG oslo_concurrency.processutils [None req-404daedc-1c45-407b-a9e0-ff29b3e5af00 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76493) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:25:24 devstack sudo[77298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 06 06:25:24 devstack sudo[77298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:25:25 devstack sudo[77298]: pam_unix(sudo:session): session closed for user root Sep 06 06:25:25 devstack cinder-volume[76493]: DEBUG oslo_concurrency.processutils [None req-404daedc-1c45-407b-a9e0-ff29b3e5af00 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.244s {{(pid=76493) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:25:25 devstack cinder-volume[76493]: DEBUG cinder.volume.drivers.lvm [None req-404daedc-1c45-407b-a9e0-ff29b3e5af00 None None] Updating volume stats {{(pid=76493) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 06 06:25:25 devstack cinder-volume[76493]: DEBUG oslo_concurrency.processutils [None req-404daedc-1c45-407b-a9e0-ff29b3e5af00 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76493) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:25:25 devstack sudo[77301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 06 06:25:25 devstack sudo[77301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:25:25 devstack sudo[77301]: pam_unix(sudo:session): session closed for user root Sep 06 06:25:25 devstack cinder-volume[76493]: DEBUG oslo_concurrency.processutils [None req-404daedc-1c45-407b-a9e0-ff29b3e5af00 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.288s {{(pid=76493) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:25:25 devstack cinder-volume[76493]: DEBUG oslo_concurrency.processutils [None req-404daedc-1c45-407b-a9e0-ff29b3e5af00 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76493) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:25:25 devstack sudo[77338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 06 06:25:25 devstack sudo[77338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:25:25 devstack sudo[77338]: pam_unix(sudo:session): session closed for user root Sep 06 06:25:25 devstack cinder-volume[76493]: DEBUG oslo_concurrency.processutils [None req-404daedc-1c45-407b-a9e0-ff29b3e5af00 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.358s {{(pid=76493) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:25:25 devstack cinder-volume[76493]: DEBUG oslo_concurrency.processutils [None req-404daedc-1c45-407b-a9e0-ff29b3e5af00 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76493) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:25:25 devstack sudo[77343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 06 06:25:25 devstack sudo[77343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:25:26 devstack sudo[77343]: pam_unix(sudo:session): session closed for user root Sep 06 06:25:26 devstack cinder-volume[76493]: DEBUG oslo_concurrency.processutils [None req-404daedc-1c45-407b-a9e0-ff29b3e5af00 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.297s {{(pid=76493) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:25:26 devstack cinder-volume[76493]: DEBUG oslo_concurrency.processutils [None req-404daedc-1c45-407b-a9e0-ff29b3e5af00 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76493) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:25:26 devstack sudo[77346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 06 06:25:26 devstack sudo[77346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:25:26 devstack sudo[77346]: pam_unix(sudo:session): session closed for user root Sep 06 06:25:26 devstack cinder-volume[76493]: DEBUG oslo_concurrency.processutils [None req-404daedc-1c45-407b-a9e0-ff29b3e5af00 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=76493) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:25:26 devstack cinder-volume[76493]: INFO cinder.volume.driver [None req-404daedc-1c45-407b-a9e0-ff29b3e5af00 None None] Driver hasn't implemented _init_vendor_properties() Sep 06 06:25:26 devstack cinder-volume[76493]: DEBUG cinder.volume.driver [None req-404daedc-1c45-407b-a9e0-ff29b3e5af00 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76493) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 06 06:25:26 devstack cinder-volume[76493]: DEBUG oslo_db.sqlalchemy.engines [None req-404daedc-1c45-407b-a9e0-ff29b3e5af00 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76493) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 06 06:25:26 devstack cinder-volume[76493]: DEBUG dbcounter [-] [76493] Writer thread running {{(pid=76493) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 06 06:25:26 devstack cinder-volume[76493]: DEBUG cinder.db.api [None req-404daedc-1c45-407b-a9e0-ff29b3e5af00 None None] Building query based on filter {{(pid=76493) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 06 06:25:26 devstack cinder-volume[76493]: DEBUG cinder.image.image_utils [None req-404daedc-1c45-407b-a9e0-ff29b3e5af00 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76493) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 06 06:25:26 devstack cinder-volume[76493]: INFO cinder.keymgr.migration [None req-1545d199-bf90-4318-b021-ad6ea89d7f69 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 06 06:25:26 devstack cinder-volume[76493]: DEBUG cinder.volume.drivers.lvm [None req-404daedc-1c45-407b-a9e0-ff29b3e5af00 None None] Updating volume stats {{(pid=76493) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 06 06:25:26 devstack cinder-volume[76493]: DEBUG oslo_concurrency.processutils [None req-404daedc-1c45-407b-a9e0-ff29b3e5af00 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76493) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:25:26 devstack sudo[77350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 06 06:25:26 devstack sudo[77350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:25:26 devstack sudo[77350]: pam_unix(sudo:session): session closed for user root Sep 06 06:25:26 devstack cinder-volume[76493]: DEBUG oslo_concurrency.processutils [None req-404daedc-1c45-407b-a9e0-ff29b3e5af00 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.270s {{(pid=76493) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:25:26 devstack cinder-volume[76493]: DEBUG oslo_concurrency.processutils [None req-404daedc-1c45-407b-a9e0-ff29b3e5af00 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76493) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:25:26 devstack sudo[77355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 06 06:25:26 devstack sudo[77355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:25:27 devstack sudo[77355]: pam_unix(sudo:session): session closed for user root Sep 06 06:25:27 devstack cinder-volume[76493]: DEBUG oslo_concurrency.processutils [None req-404daedc-1c45-407b-a9e0-ff29b3e5af00 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.299s {{(pid=76493) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:25:27 devstack cinder-volume[76493]: DEBUG oslo_concurrency.processutils [None req-404daedc-1c45-407b-a9e0-ff29b3e5af00 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76493) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:25:27 devstack sudo[77358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 06 06:25:27 devstack sudo[77358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:25:27 devstack sudo[77358]: pam_unix(sudo:session): session closed for user root Sep 06 06:25:27 devstack cinder-volume[76493]: DEBUG oslo_concurrency.processutils [None req-404daedc-1c45-407b-a9e0-ff29b3e5af00 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.272s {{(pid=76493) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:25:27 devstack cinder-volume[76493]: DEBUG oslo_concurrency.processutils [None req-404daedc-1c45-407b-a9e0-ff29b3e5af00 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76493) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:25:27 devstack sudo[77364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 06 06:25:27 devstack sudo[77364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:25:27 devstack sudo[77364]: pam_unix(sudo:session): session closed for user root Sep 06 06:25:27 devstack cinder-volume[76493]: DEBUG oslo_concurrency.processutils [None req-404daedc-1c45-407b-a9e0-ff29b3e5af00 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.278s {{(pid=76493) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:25:27 devstack cinder-volume[76493]: DEBUG cinder.manager [None req-404daedc-1c45-407b-a9e0-ff29b3e5af00 None None] Notifying Schedulers of capabilities ... {{(pid=76493) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:25:27 devstack cinder-volume[76493]: INFO cinder.volume.manager [None req-404daedc-1c45-407b-a9e0-ff29b3e5af00 None None] Driver initialization completed successfully. Sep 06 06:25:27 devstack cinder-volume[76493]: INFO cinder.manager [None req-404daedc-1c45-407b-a9e0-ff29b3e5af00 None None] Initiating service 2 cleanup Sep 06 06:25:27 devstack cinder-volume[76493]: INFO cinder.manager [None req-404daedc-1c45-407b-a9e0-ff29b3e5af00 None None] Service 2 cleanup completed. Sep 06 06:25:27 devstack cinder-volume[76493]: DEBUG cinder.service [None req-404daedc-1c45-407b-a9e0-ff29b3e5af00 None None] Creating RPC server for service cinder-volume {{(pid=76493) start /opt/stack/cinder/cinder/service.py:231}} Sep 06 06:25:27 devstack cinder-volume[76493]: DEBUG cinder.service [None req-404daedc-1c45-407b-a9e0-ff29b3e5af00 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76493) start /opt/stack/cinder/cinder/service.py:237}} Sep 06 06:25:27 devstack cinder-volume[76493]: INFO cinder.volume.manager [None req-404daedc-1c45-407b-a9e0-ff29b3e5af00 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Sep 06 06:25:27 devstack cinder-volume[76493]: DEBUG cinder.volume.drivers.lvm [None req-404daedc-1c45-407b-a9e0-ff29b3e5af00 None None] Updating volume stats {{(pid=76493) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 06 06:25:27 devstack cinder-volume[76493]: DEBUG oslo_concurrency.processutils [None req-404daedc-1c45-407b-a9e0-ff29b3e5af00 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76493) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:25:27 devstack sudo[77369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 06 06:25:27 devstack sudo[77369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:25:28 devstack sudo[77369]: pam_unix(sudo:session): session closed for user root Sep 06 06:25:28 devstack cinder-volume[76493]: DEBUG oslo_concurrency.processutils [None req-404daedc-1c45-407b-a9e0-ff29b3e5af00 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.283s {{(pid=76493) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:25:28 devstack cinder-volume[76493]: DEBUG oslo_concurrency.processutils [None req-404daedc-1c45-407b-a9e0-ff29b3e5af00 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76493) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:25:28 devstack sudo[77372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 06 06:25:28 devstack sudo[77372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:25:28 devstack sudo[77372]: pam_unix(sudo:session): session closed for user root Sep 06 06:25:28 devstack cinder-volume[76493]: DEBUG oslo_concurrency.processutils [None req-404daedc-1c45-407b-a9e0-ff29b3e5af00 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.274s {{(pid=76493) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:25:28 devstack cinder-volume[76493]: DEBUG oslo_concurrency.processutils [None req-404daedc-1c45-407b-a9e0-ff29b3e5af00 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76493) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:25:28 devstack sudo[77375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 06 06:25:28 devstack sudo[77375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:25:28 devstack sudo[77375]: pam_unix(sudo:session): session closed for user root Sep 06 06:25:28 devstack cinder-volume[76493]: DEBUG oslo_concurrency.processutils [None req-404daedc-1c45-407b-a9e0-ff29b3e5af00 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.258s {{(pid=76493) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:25:28 devstack cinder-volume[76493]: DEBUG oslo_concurrency.processutils [None req-404daedc-1c45-407b-a9e0-ff29b3e5af00 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76493) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:25:28 devstack sudo[77378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 06 06:25:28 devstack sudo[77378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:25:28 devstack sudo[77378]: pam_unix(sudo:session): session closed for user root Sep 06 06:25:28 devstack cinder-volume[76493]: DEBUG oslo_concurrency.processutils [None req-404daedc-1c45-407b-a9e0-ff29b3e5af00 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.299s {{(pid=76493) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:25:28 devstack cinder-volume[76493]: INFO cinder.volume.manager [None req-404daedc-1c45-407b-a9e0-ff29b3e5af00 None None] Driver post RPC initialization completed successfully. Sep 06 06:25:31 devstack cinder-volume[76342]: DEBUG dbcounter [-] [76342] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76342) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 06:25:37 devstack cinder-volume[76493]: DEBUG dbcounter [-] [76493] Writing DB stats cinder:SELECT=3 {{(pid=76493) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 06:25:37 devstack cinder-volume[76493]: DEBUG oslo_service.periodic_task [None req-19e3a007-f19b-4af5-a015-4bfc99725faa None None] Running periodic task VolumeManager._thread_info {{(pid=76493) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 06 06:25:37 devstack cinder-volume[76493]: DEBUG cinder.volume.manager [None req-19e3a007-f19b-4af5-a015-4bfc99725faa None None] thread count: 6 {{(pid=76493) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 06 06:25:37 devstack cinder-volume[76493]: DEBUG cinder.volume.manager [None req-19e3a007-f19b-4af5-a015-4bfc99725faa None None] thread info: [<_MainThread(MainThread, started 128567083372672)>, , , , , ] {{(pid=76493) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 06 06:25:38 devstack cinder-volume[76493]: DEBUG dbcounter [-] [76493] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=76493) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 06:26:37 devstack cinder-volume[76493]: DEBUG oslo_service.periodic_task [None req-19e3a007-f19b-4af5-a015-4bfc99725faa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76493) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 06 06:26:37 devstack cinder-volume[76493]: DEBUG cinder.volume.drivers.lvm [None req-19e3a007-f19b-4af5-a015-4bfc99725faa None None] Updating volume stats {{(pid=76493) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 06 06:26:37 devstack cinder-volume[76493]: DEBUG oslo_concurrency.processutils [None req-19e3a007-f19b-4af5-a015-4bfc99725faa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76493) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:26:37 devstack sudo[79546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 06 06:26:37 devstack sudo[79546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:26:38 devstack sudo[79546]: pam_unix(sudo:session): session closed for user root Sep 06 06:26:38 devstack cinder-volume[76493]: DEBUG oslo_concurrency.processutils [None req-19e3a007-f19b-4af5-a015-4bfc99725faa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.254s {{(pid=76493) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:26:38 devstack cinder-volume[76493]: DEBUG oslo_concurrency.processutils [None req-19e3a007-f19b-4af5-a015-4bfc99725faa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76493) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:26:38 devstack sudo[79598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 06 06:26:38 devstack sudo[79598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:26:38 devstack sudo[79598]: pam_unix(sudo:session): session closed for user root Sep 06 06:26:38 devstack cinder-volume[76493]: DEBUG oslo_concurrency.processutils [None req-19e3a007-f19b-4af5-a015-4bfc99725faa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.238s {{(pid=76493) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:26:38 devstack cinder-volume[76493]: DEBUG oslo_concurrency.processutils [None req-19e3a007-f19b-4af5-a015-4bfc99725faa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76493) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:26:38 devstack sudo[79621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 06 06:26:38 devstack sudo[79621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:26:38 devstack sudo[79621]: pam_unix(sudo:session): session closed for user root Sep 06 06:26:38 devstack cinder-volume[76493]: DEBUG oslo_concurrency.processutils [None req-19e3a007-f19b-4af5-a015-4bfc99725faa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.257s {{(pid=76493) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:26:38 devstack cinder-volume[76493]: DEBUG oslo_concurrency.processutils [None req-19e3a007-f19b-4af5-a015-4bfc99725faa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76493) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:26:38 devstack sudo[79626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 06 06:26:38 devstack sudo[79626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:26:38 devstack sudo[79626]: pam_unix(sudo:session): session closed for user root Sep 06 06:26:38 devstack cinder-volume[76493]: DEBUG oslo_concurrency.processutils [None req-19e3a007-f19b-4af5-a015-4bfc99725faa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.262s {{(pid=76493) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:26:38 devstack cinder-volume[76493]: DEBUG cinder.manager [None req-19e3a007-f19b-4af5-a015-4bfc99725faa None None] Notifying Schedulers of capabilities ... {{(pid=76493) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:26:38 devstack cinder-volume[76493]: DEBUG oslo_service.periodic_task [None req-19e3a007-f19b-4af5-a015-4bfc99725faa None None] Running periodic task VolumeManager._thread_info {{(pid=76493) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 06 06:26:38 devstack cinder-volume[76493]: DEBUG cinder.volume.manager [None req-19e3a007-f19b-4af5-a015-4bfc99725faa None None] thread count: 6 {{(pid=76493) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 06 06:26:39 devstack cinder-volume[76493]: DEBUG cinder.volume.manager [None req-19e3a007-f19b-4af5-a015-4bfc99725faa None None] thread info: [<_MainThread(MainThread, started 128567083372672)>, , , , , ] {{(pid=76493) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 06 06:27:37 devstack cinder-volume[76493]: DEBUG oslo_service.periodic_task [None req-19e3a007-f19b-4af5-a015-4bfc99725faa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76493) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 06 06:27:37 devstack cinder-volume[76493]: DEBUG cinder.volume.drivers.lvm [None req-19e3a007-f19b-4af5-a015-4bfc99725faa None None] Updating volume stats {{(pid=76493) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 06 06:27:37 devstack cinder-volume[76493]: DEBUG oslo_concurrency.processutils [None req-19e3a007-f19b-4af5-a015-4bfc99725faa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76493) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:27:37 devstack sudo[82872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 06 06:27:37 devstack sudo[82872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:27:38 devstack sudo[82872]: pam_unix(sudo:session): session closed for user root Sep 06 06:27:38 devstack cinder-volume[76493]: DEBUG oslo_concurrency.processutils [None req-19e3a007-f19b-4af5-a015-4bfc99725faa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.246s {{(pid=76493) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:27:38 devstack cinder-volume[76493]: DEBUG oslo_concurrency.processutils [None req-19e3a007-f19b-4af5-a015-4bfc99725faa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76493) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:27:38 devstack sudo[82915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 06 06:27:38 devstack sudo[82915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:27:38 devstack sudo[82915]: pam_unix(sudo:session): session closed for user root Sep 06 06:27:38 devstack cinder-volume[76493]: DEBUG oslo_concurrency.processutils [None req-19e3a007-f19b-4af5-a015-4bfc99725faa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=76493) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:27:38 devstack cinder-volume[76493]: DEBUG oslo_concurrency.processutils [None req-19e3a007-f19b-4af5-a015-4bfc99725faa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76493) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:27:38 devstack sudo[82919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 06 06:27:38 devstack sudo[82919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:27:38 devstack sudo[82919]: pam_unix(sudo:session): session closed for user root Sep 06 06:27:38 devstack cinder-volume[76493]: DEBUG oslo_concurrency.processutils [None req-19e3a007-f19b-4af5-a015-4bfc99725faa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.257s {{(pid=76493) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:27:38 devstack cinder-volume[76493]: DEBUG oslo_concurrency.processutils [None req-19e3a007-f19b-4af5-a015-4bfc99725faa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76493) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:27:38 devstack sudo[82927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 06 06:27:38 devstack sudo[82927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:27:38 devstack cinder-volume[76493]: DEBUG dbcounter [-] [76493] Writing DB stats cinder:SELECT=1 {{(pid=76493) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 06:27:38 devstack cinder-volume[76493]: DEBUG dbcounter [-] [76493] Writing DB stats cinder:UPDATE=1 {{(pid=76493) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 06:27:38 devstack sudo[82927]: pam_unix(sudo:session): session closed for user root Sep 06 06:27:39 devstack cinder-volume[76493]: DEBUG oslo_concurrency.processutils [None req-19e3a007-f19b-4af5-a015-4bfc99725faa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.295s {{(pid=76493) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:27:39 devstack cinder-volume[76493]: DEBUG cinder.manager [None req-19e3a007-f19b-4af5-a015-4bfc99725faa None None] Notifying Schedulers of capabilities ... {{(pid=76493) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:27:39 devstack cinder-volume[76493]: DEBUG oslo_service.periodic_task [None req-19e3a007-f19b-4af5-a015-4bfc99725faa None None] Running periodic task VolumeManager._thread_info {{(pid=76493) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 06 06:27:39 devstack cinder-volume[76493]: DEBUG cinder.volume.manager [None req-19e3a007-f19b-4af5-a015-4bfc99725faa None None] thread count: 6 {{(pid=76493) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 06 06:27:39 devstack cinder-volume[76493]: DEBUG cinder.volume.manager [None req-19e3a007-f19b-4af5-a015-4bfc99725faa None None] thread info: [<_MainThread(MainThread, started 128567083372672)>, , , , , ] {{(pid=76493) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 06 06:28:37 devstack cinder-volume[76493]: DEBUG oslo_service.periodic_task [None req-19e3a007-f19b-4af5-a015-4bfc99725faa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76493) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 06 06:28:37 devstack cinder-volume[76493]: DEBUG cinder.volume.drivers.lvm [None req-19e3a007-f19b-4af5-a015-4bfc99725faa None None] Updating volume stats {{(pid=76493) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 06 06:28:37 devstack cinder-volume[76493]: DEBUG oslo_concurrency.processutils [None req-19e3a007-f19b-4af5-a015-4bfc99725faa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76493) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:28:38 devstack sudo[85023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 06 06:28:38 devstack sudo[85023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:28:38 devstack sudo[85023]: pam_unix(sudo:session): session closed for user root Sep 06 06:28:38 devstack cinder-volume[76493]: DEBUG oslo_concurrency.processutils [None req-19e3a007-f19b-4af5-a015-4bfc99725faa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.255s {{(pid=76493) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:28:38 devstack cinder-volume[76493]: DEBUG oslo_concurrency.processutils [None req-19e3a007-f19b-4af5-a015-4bfc99725faa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76493) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:28:38 devstack sudo[85031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 06 06:28:38 devstack sudo[85031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:28:38 devstack sudo[85031]: pam_unix(sudo:session): session closed for user root Sep 06 06:28:38 devstack cinder-volume[76493]: DEBUG oslo_concurrency.processutils [None req-19e3a007-f19b-4af5-a015-4bfc99725faa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.269s {{(pid=76493) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:28:38 devstack cinder-volume[76493]: DEBUG oslo_concurrency.processutils [None req-19e3a007-f19b-4af5-a015-4bfc99725faa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76493) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:28:38 devstack sudo[85050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 06 06:28:38 devstack sudo[85050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:28:38 devstack sudo[85050]: pam_unix(sudo:session): session closed for user root Sep 06 06:28:38 devstack cinder-volume[76493]: DEBUG oslo_concurrency.processutils [None req-19e3a007-f19b-4af5-a015-4bfc99725faa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.263s {{(pid=76493) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:28:38 devstack cinder-volume[76493]: DEBUG oslo_concurrency.processutils [None req-19e3a007-f19b-4af5-a015-4bfc99725faa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76493) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:28:38 devstack sudo[85077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 06 06:28:38 devstack sudo[85077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:28:39 devstack sudo[85077]: pam_unix(sudo:session): session closed for user root Sep 06 06:28:39 devstack cinder-volume[76493]: DEBUG oslo_concurrency.processutils [None req-19e3a007-f19b-4af5-a015-4bfc99725faa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.262s {{(pid=76493) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:28:39 devstack cinder-volume[76493]: DEBUG cinder.manager [None req-19e3a007-f19b-4af5-a015-4bfc99725faa None None] Notifying Schedulers of capabilities ... {{(pid=76493) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:28:39 devstack cinder-volume[76493]: DEBUG oslo_service.periodic_task [None req-19e3a007-f19b-4af5-a015-4bfc99725faa None None] Running periodic task VolumeManager._thread_info {{(pid=76493) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 06 06:28:39 devstack cinder-volume[76493]: DEBUG cinder.volume.manager [None req-19e3a007-f19b-4af5-a015-4bfc99725faa None None] thread count: 6 {{(pid=76493) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 06 06:28:39 devstack cinder-volume[76493]: DEBUG cinder.volume.manager [None req-19e3a007-f19b-4af5-a015-4bfc99725faa None None] thread info: [<_MainThread(MainThread, started 128567083372672)>, , , , , ] {{(pid=76493) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 06 06:29:37 devstack cinder-volume[76493]: DEBUG oslo_service.periodic_task [None req-19e3a007-f19b-4af5-a015-4bfc99725faa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76493) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 06 06:29:37 devstack cinder-volume[76493]: DEBUG cinder.volume.drivers.lvm [None req-19e3a007-f19b-4af5-a015-4bfc99725faa None None] Updating volume stats {{(pid=76493) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 06 06:29:37 devstack cinder-volume[76493]: DEBUG oslo_concurrency.processutils [None req-19e3a007-f19b-4af5-a015-4bfc99725faa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76493) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:29:37 devstack sudo[86204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 06 06:29:37 devstack sudo[86204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:29:38 devstack sudo[86204]: pam_unix(sudo:session): session closed for user root Sep 06 06:29:38 devstack cinder-volume[76493]: DEBUG oslo_concurrency.processutils [None req-19e3a007-f19b-4af5-a015-4bfc99725faa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.256s {{(pid=76493) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:29:38 devstack cinder-volume[76493]: DEBUG oslo_concurrency.processutils [None req-19e3a007-f19b-4af5-a015-4bfc99725faa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76493) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:29:38 devstack sudo[86207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 06 06:29:38 devstack sudo[86207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:29:38 devstack sudo[86207]: pam_unix(sudo:session): session closed for user root Sep 06 06:29:38 devstack cinder-volume[76493]: DEBUG oslo_concurrency.processutils [None req-19e3a007-f19b-4af5-a015-4bfc99725faa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.244s {{(pid=76493) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:29:38 devstack cinder-volume[76493]: DEBUG oslo_concurrency.processutils [None req-19e3a007-f19b-4af5-a015-4bfc99725faa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76493) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:29:38 devstack sudo[86214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 06 06:29:38 devstack sudo[86214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:29:38 devstack sudo[86214]: pam_unix(sudo:session): session closed for user root Sep 06 06:29:38 devstack cinder-volume[76493]: DEBUG oslo_concurrency.processutils [None req-19e3a007-f19b-4af5-a015-4bfc99725faa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.247s {{(pid=76493) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:29:38 devstack cinder-volume[76493]: DEBUG oslo_concurrency.processutils [None req-19e3a007-f19b-4af5-a015-4bfc99725faa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76493) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:29:38 devstack sudo[86227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 06 06:29:38 devstack sudo[86227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:29:38 devstack sudo[86227]: pam_unix(sudo:session): session closed for user root Sep 06 06:29:38 devstack cinder-volume[76493]: DEBUG oslo_concurrency.processutils [None req-19e3a007-f19b-4af5-a015-4bfc99725faa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.247s {{(pid=76493) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:29:38 devstack cinder-volume[76493]: DEBUG cinder.manager [None req-19e3a007-f19b-4af5-a015-4bfc99725faa None None] Notifying Schedulers of capabilities ... {{(pid=76493) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:29:38 devstack cinder-volume[76493]: DEBUG dbcounter [-] [76493] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=76493) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 06:29:44 devstack cinder-volume[76342]: INFO oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] Caught SIGTERM, stopping children Sep 06 06:29:44 devstack cinder-volume[76342]: DEBUG oslo_concurrency.lockutils [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] Acquiring lock "singleton_lock" {{(pid=76342) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 06 06:29:44 devstack cinder-volume[76342]: DEBUG oslo_concurrency.lockutils [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] Acquired lock "singleton_lock" {{(pid=76342) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 06 06:29:44 devstack cinder-volume[76342]: DEBUG oslo_concurrency.lockutils [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] Releasing lock "singleton_lock" {{(pid=76342) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 06 06:29:44 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] Stop services. {{(pid=76342) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 06 06:29:44 devstack cinder-volume[76342]: DEBUG oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] Killing children. {{(pid=76342) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 06 06:29:44 devstack cinder-volume[76342]: INFO oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] Waiting on 1 children to exit Sep 06 06:29:47 devstack cinder-volume[76493]: DEBUG oslo_concurrency.lockutils [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] Acquiring lock "singleton_lock" {{(pid=76493) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 06 06:29:47 devstack cinder-volume[76493]: DEBUG oslo_concurrency.lockutils [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] Acquired lock "singleton_lock" {{(pid=76493) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 06 06:29:47 devstack cinder-volume[76493]: DEBUG oslo_concurrency.lockutils [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] Releasing lock "singleton_lock" {{(pid=76493) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 06 06:29:47 devstack cinder-volume[76493]: WARNING amqp [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 06 06:29:47 devstack cinder-volume[76493]: WARNING amqp [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 06 06:29:47 devstack cinder-volume[76342]: INFO oslo_service.backend._eventlet.service [None req-11b49998-7506-4789-9453-475dc05c2b27 None None] Child 76493 exited with status 0 Sep 06 06:29:48 devstack cinder-volume[86509]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 06 06:29:48 devstack cinder-volume[86509]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 06 06:29:48 devstack cinder-volume[86509]: we strongly recommend against using it for new projects. Sep 06 06:29:48 devstack cinder-volume[86509]: If you are already using Eventlet, we recommend migrating to a different Sep 06 06:29:48 devstack cinder-volume[86509]: framework. For more detail see Sep 06 06:29:48 devstack cinder-volume[86509]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 06 06:29:48 devstack cinder-volume[86509]: import eventlet # noqa Sep 06 06:29:50 devstack cinder-volume[86509]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86509) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 06 06:29:50 devstack cinder-volume[86509]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86509) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 06 06:29:50 devstack cinder-volume[86509]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86509) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 06 06:29:50 devstack cinder-volume[86509]: INFO dbcounter [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] Registered counter for database cinder Sep 06 06:29:50 devstack cinder-volume[86509]: DEBUG oslo_db.sqlalchemy.engines [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86509) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG dbcounter [-] [86509] Writer thread running {{(pid=86509) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 06 06:29:51 devstack cinder-volume[86509]: INFO cinder.rpc [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 06 06:29:51 devstack cinder-volume[86509]: INFO cinder.rpc [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_db.sqlalchemy.engines [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86509) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 06 06:29:51 devstack cinder-volume[86509]: INFO cinder.volume.manager [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] Determined volume DB was empty at startup. Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG cinder.volume.manager [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86509) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 06 06:29:51 devstack cinder-volume[86509]: INFO cinder.volume.manager [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 06 06:29:51 devstack cinder-volume[86509]: WARNING stevedore.named [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 06 06:29:51 devstack cinder-volume[86509]: WARNING castellan.key_manager [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 06 06:29:51 devstack cinder-volume[86509]: WARNING cinder.keymgr.conf_key_mgr [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 06 06:29:51 devstack cinder-volume[86509]: INFO cinder.volume.manager [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_db.sqlalchemy.engines [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86509) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 06 06:29:51 devstack cinder-volume[86509]: INFO oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] Starting 1 workers Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] Started child 86727 {{(pid=86509) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] Full set of CONF: {{(pid=86509) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] ******************************************************************************** {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] Configuration options gathered from: {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] ================================================================================ {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] allow_availability_zone_fallback = False {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] allow_compression_on_image_upload = False {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] allowed_direct_url_schemes = [] {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] api_rate_limit = True {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] auth_strategy = keystone {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] backend_availability_zone = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] backend_host = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] backend_name = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] backend_stats_polling_interval = 60 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] backup_api_class = cinder.backup.api.API {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] backup_name_template = backup-%s {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] backup_use_same_host = False {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] backup_use_temp_snapshot = False {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] chap_password = **** {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] chap_username = {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] cinder_internal_tenant_project_id = 69511bce68954edebef20a9888d2b242 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] cinder_internal_tenant_user_id = fcaa5131bae141619b30d2fd156dc872 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] cluster = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] compression_format = gzip {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] compute_api_class = cinder.compute.nova.API {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] config_dir = [] {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] config_source = [] {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] control_exchange = openstack {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] debug = True {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] default_availability_zone = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] default_group_type = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] default_volume_type = QuobyteHD {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:29:51 devstack cinder-volume[86727]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] disk_geometry = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] driver_client_cert = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] driver_client_cert_key = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] driver_data_namespace = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] driver_ssl_cert_path = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] driver_ssl_cert_verify = False {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] driver_use_ssl = False {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] enable_new_services = True {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] enable_unsupported_driver = False {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] enabled_backends = ['QuobyteHD'] {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] enforce_multipath_for_image_xfer = False {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] filter_function = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] glance_api_insecure = False {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] glance_api_servers = ['http://192.168.122.198/image'] {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] glance_api_ssl_compression = False {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] glance_ca_certificates_file = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] glance_catalog_info = image:glance:publicURL {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] glance_certfile = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] glance_keyfile = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] glance_num_retries = 3 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] glance_request_timeout = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] goodness_function = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] graceful_shutdown_timeout = 5 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] group_api_class = cinder.group.api.API {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] host = devstack {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] image_compress_on_upload = True {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] image_conversion_address_space_limit = 1 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] image_conversion_cpu_limit = 60 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] image_conversion_disable = False {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] image_upload_use_cinder_backend = False {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] image_upload_use_internal_tenant = False {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] image_volume_cache_enabled = False {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] image_volume_cache_max_count = 0 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] image_volume_cache_max_size_gb = 0 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] init_host_max_objects_retrieval = 0 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] instance_format = [instance: %(uuid)s] {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] iscsi_target_flags = {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] iscsi_write_cache = on {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] iser_helper = tgtadm {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] iser_ip_address = 192.168.122.198 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] iser_port = 3260 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] log_color = False {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] log_config_append = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] log_dir = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] log_file = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] log_options = True {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] log_rotate_interval = 1 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] log_rotate_interval_type = days {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] log_rotation_type = none {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] max_age = 0 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] max_logfile_count = 30 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] max_logfile_size_mb = 200 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] max_over_subscription_ratio = 20.0 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] message_reap_interval = 86400 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] message_ttl = 2592000 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] migration_create_volume_timeout_secs = 300 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] monkey_patch = False {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] monkey_patch_modules = [] {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] my_ip = 192.168.122.198 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] no_snapshot_gb_quota = False {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] num_iser_scan_tries = 3 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] num_shell_tries = 3 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] num_volume_device_scan_tries = 3 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] nvmeof_conn_info_version = 1 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] nvmet_ns_id = 10 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] nvmet_port_id = 1 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] osapi_max_limit = 1000 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] osapi_volume_ext_list = [] {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] osapi_volume_listen_port = 8776 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] osapi_volume_use_ssl = False {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] osapi_volume_workers = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] per_volume_size_limit = -1 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] periodic_fuzzy_delay = 60 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] periodic_interval = 60 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] public_endpoint = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] publish_errors = False {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] quota_backup_gigabytes = 1000 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] quota_backups = 10 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] quota_gigabytes = 1000 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] quota_groups = 10 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] quota_snapshots = 10 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] quota_volumes = 10 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] rate_limit_burst = 0 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] rate_limit_except_level = CRITICAL {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] rate_limit_interval = 0 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] reinit_driver_count = 3 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] replication_device = **** {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] report_discard_supported = False {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] report_interval = 120 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] reservation_clean_interval = 86400 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] reservation_expire = 86400 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] reserved_image_namespaces = [] {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] reserved_percentage = 0 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] rpc_response_timeout = 120 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] run_external_periodic_tasks = True {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] scst_target_driver = iscsi {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] scst_target_iqn_name = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] service_down_time = 720 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] shell_completion = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] snapshot_name_template = snapshot-%s {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] split_loggers = False {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] state_path = /opt/stack/data/cinder {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] storage_availability_zone = nova {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] storage_protocol = iSCSI {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] syslog_log_facility = LOG_USER {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] target_helper = lioadm {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] target_ip_address = 192.168.122.198 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] target_port = 3260 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] target_protocol = iscsi {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] target_secondary_ip_addresses = [] {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] trace_flags = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] transport_url = **** {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] until_refresh = 0 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] use_chap_auth = False {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] use_default_quota_class = True {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] use_journal = False {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] use_json = False {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] use_multipath_for_image_xfer = False {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] use_stderr = False {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] use_syslog = False {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] verify_glance_signatures = enabled {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] volume_api_class = cinder.volume.api.API {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] volume_backend_name = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] volume_clear = zero {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] volume_clear_ionice = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] volume_clear_size = 0 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] volume_copy_bps_limit = 0 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] volume_dd_blocksize = 1M {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] volume_name_template = volume-%s {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] volume_service_inithost_offload = False {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] volume_usage_audit_period = month {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] zoning_mode = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] oslo_concurrency.disable_process_locking = False {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] keystone_authtoken.auth_section = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] keystone_authtoken.auth_type = password {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] keystone_authtoken.auth_version = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] keystone_authtoken.cache = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] keystone_authtoken.certfile = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] keystone_authtoken.include_service_catalog = True {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] keystone_authtoken.insecure = False {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] keystone_authtoken.interface = public {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] keystone_authtoken.keyfile = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] keystone_authtoken.memcache_password = **** {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] keystone_authtoken.memcache_username = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] keystone_authtoken.region_name = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] keystone_authtoken.service_type = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.198/identity {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] cache.backend = dogpile.cache.null {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] cache.backend_argument = **** {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] cache.backend_expiration_time = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] cache.config_prefix = cache.oslo {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] cache.debug_cache_backend = False {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] cache.enable_retry_client = False {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] cache.enable_socket_keepalive = False {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] cache.enabled = False {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] cache.expiration_time = 600 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] cache.hashclient_retry_attempts = 2 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] cache.memcache_dead_retry = 300 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] cache.memcache_pool_maxsize = 10 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] cache.memcache_sasl_enabled = False {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] cache.password = **** {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] cache.proxies = [] {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] cache.redis_db = 0 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] cache.redis_server = localhost:6379 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] cache.retry_attempts = 2 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] cache.retry_delay = 0.0 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] cache.socket_keepalive_count = 1 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] cache.socket_keepalive_idle = 1 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] cache.socket_keepalive_interval = 1 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] cache.socket_timeout = 1.0 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] cache.tls_allowed_ciphers = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] cache.tls_cafile = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] cache.tls_certfile = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] cache.tls_enabled = False {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] cache.tls_keyfile = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] cache.username = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] coordination.backend_url = **** {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] database.asyncio_connection = **** {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] database.asyncio_slave_connection = **** {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] database.backend = sqlalchemy {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] database.connection = **** {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] database.connection_debug = 0 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] database.connection_parameters = {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] database.connection_recycle_time = 3600 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] database.connection_trace = False {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] database.db_inc_retry_interval = True {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] database.db_max_retries = 20 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] database.db_max_retry_interval = 10 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] database.db_retry_interval = 1 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] database.max_overflow = 50 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] database.max_pool_size = 5 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] database.max_retries = 10 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86727]: INFO cinder.volume.manager [None req-a9c64758-3df7-4c22-8ad1-16b451f60a17 None None] Starting volume driver QuobyteDriver (1.2.1) Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86727]: DEBUG cinder.volume.drivers.remotefs [None req-a9c64758-3df7-4c22-8ad1-16b451f60a17 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86727) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] database.mysql_wsrep_sync_wait = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] database.pool_timeout = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] database.retry_interval = 10 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] database.slave_connection = **** {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] database.sqlite_synchronous = True {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] database.synchronous_reader = True {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] database.use_db_reconnect = False {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] oslo_messaging_tracing.insecure = False {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] profiler.connection_string = messaging:// {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] profiler.enabled = False {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] profiler.es_doc_type = notification {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] profiler.es_scroll_size = 10000 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] profiler.es_scroll_time = 2m {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] profiler.filter_error_trace = False {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] profiler.hmac_keys = **** {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] profiler.sentinel_service_name = mymaster {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] profiler.socket_timeout = 0.1 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] profiler.trace_requests = False {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] profiler.trace_sqlalchemy = False {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] profiler_jaeger.process_tags = {} {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] profiler_jaeger.service_name_prefix = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] profiler_otlp.service_name_prefix = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] oslo_policy.enforce_new_defaults = True {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] oslo_policy.policy_default_rule = default {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] oslo_policy.policy_file = policy.yaml {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] privsep_osbrick.group = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] privsep_osbrick.helper_command = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] privsep_osbrick.user = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] cinder_sys_admin.group = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] cinder_sys_admin.helper_command = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] cinder_sys_admin.user = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] service_user.auth_section = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] service_user.auth_type = password {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] service_user.cafile = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] service_user.certfile = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] service_user.collect_timing = False {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] service_user.insecure = False {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] service_user.keyfile = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] service_user.send_service_user_token = True {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] service_user.split_loggers = False {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] service_user.timeout = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] service_user.tls_ciphers = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] service_user.tls_min_version = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] glance.auth_section = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] glance.auth_type = password {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] glance.certfile = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] glance.collect_timing = False {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] glance.insecure = False {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] glance.keyfile = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] glance.region_name = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] glance.split_loggers = False {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] glance.timeout = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] glance.tls_ciphers = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] glance.tls_min_version = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] backend_defaults.backend_availability_zone = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] backend_defaults.chap_password = **** {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] backend_defaults.chap_username = {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] backend_defaults.disk_geometry = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] backend_defaults.driver_client_cert = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] backend_defaults.driver_client_cert_key = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] backend_defaults.driver_data_namespace = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] backend_defaults.driver_use_ssl = False {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] backend_defaults.extra_capabilities = {} {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] backend_defaults.filter_function = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] backend_defaults.goodness_function = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] backend_defaults.iscsi_target_flags = {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] backend_defaults.iscsi_write_cache = on {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] backend_defaults.iser_helper = tgtadm {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] backend_defaults.iser_ip_address = 192.168.122.198 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] backend_defaults.iser_port = 3260 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] backend_defaults.nas_host = {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] backend_defaults.nas_login = admin {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] backend_defaults.nas_mount_options = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] backend_defaults.nas_password = **** {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] backend_defaults.nas_private_key = {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] backend_defaults.nas_share_path = {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] backend_defaults.num_shell_tries = 3 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] backend_defaults.quobyte_volume_url = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] backend_defaults.replication_device = **** {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] backend_defaults.report_discard_supported = False {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] backend_defaults.reserved_percentage = 0 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] backend_defaults.target_helper = tgtadm {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] backend_defaults.target_ip_address = 192.168.122.198 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] backend_defaults.target_port = 3260 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] backend_defaults.target_protocol = iscsi {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] backend_defaults.trace_flags = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] backend_defaults.unique_fqdn_network = True {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] backend_defaults.use_chap_auth = False {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] backend_defaults.volume_backend_name = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] backend_defaults.volume_clear = zero {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] backend_defaults.volume_clear_ionice = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] backend_defaults.volume_clear_size = 0 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] oslo_reports.file_event_handler = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] oslo_reports.log_dir = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] QuobyteHD.backend_availability_zone = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] QuobyteHD.backend_host = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] QuobyteHD.chap_password = **** {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] QuobyteHD.chap_username = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] QuobyteHD.chiscsi_conf = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] QuobyteHD.disk_geometry = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] QuobyteHD.driver_client_cert = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] QuobyteHD.driver_data_namespace = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] QuobyteHD.driver_use_ssl = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] QuobyteHD.extra_capabilities = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] QuobyteHD.filter_function = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] QuobyteHD.goodness_function = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] QuobyteHD.iser_helper = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] QuobyteHD.iser_ip_address = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] QuobyteHD.iser_port = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] QuobyteHD.iser_target_prefix = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] QuobyteHD.nas_host = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] QuobyteHD.nas_login = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] QuobyteHD.nas_mount_options = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] QuobyteHD.nas_password = **** {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] QuobyteHD.nas_private_key = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] QuobyteHD.nas_share_path = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] QuobyteHD.nas_ssh_port = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] QuobyteHD.num_shell_tries = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] QuobyteHD.nvmet_port_id = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] QuobyteHD.replication_device = **** {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] QuobyteHD.report_discard_supported = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] QuobyteHD.reserved_percentage = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] QuobyteHD.scst_target_driver = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] QuobyteHD.storage_protocol = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] QuobyteHD.target_helper = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] QuobyteHD.target_ip_address = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] QuobyteHD.target_port = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] QuobyteHD.target_prefix = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] QuobyteHD.target_protocol = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] QuobyteHD.trace_flags = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] QuobyteHD.use_chap_auth = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] QuobyteHD.volume_clear = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] QuobyteHD.volume_clear_size = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] QuobyteHD.volumes_dir = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] oslo_messaging_rabbit.ssl = False {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] oslo_messaging_notifications.driver = [] {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] oslo_messaging_notifications.retry = -1 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] key_manager.fixed_key = **** {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] barbican.barbican_api_version = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] barbican.barbican_endpoint = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] barbican.barbican_endpoint_type = public {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] barbican.barbican_region_name = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] barbican.cafile = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] barbican.certfile = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] barbican.collect_timing = False {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] barbican.insecure = False {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] barbican.keyfile = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] barbican.number_of_retries = 60 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] barbican.retry_delay = 1 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] barbican.send_service_user_token = False {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] barbican.split_loggers = False {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] barbican.timeout = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] barbican.tls_ciphers = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] barbican.tls_min_version = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] barbican.verify_ssl = True {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] barbican.verify_ssl_path = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] barbican_service_user.auth_section = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] barbican_service_user.auth_type = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] barbican_service_user.cafile = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] barbican_service_user.certfile = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] barbican_service_user.collect_timing = False {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] barbican_service_user.insecure = False {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] barbican_service_user.keyfile = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] barbican_service_user.split_loggers = False {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] barbican_service_user.timeout = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] barbican_service_user.tls_ciphers = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] barbican_service_user.tls_min_version = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] vault.approle_role_id = **** {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] vault.approle_secret_id = **** {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] vault.auth_method = approle {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] vault.auth_path = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] vault.kv_mountpoint = secret {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] vault.kv_path = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] vault.kv_version = 2 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] vault.namespace = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] vault.root_token_id = **** {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] vault.ssl_ca_crt_file = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] vault.timeout = 60.0 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] vault.token_file = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] vault.token_role = None {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] vault.use_ssl = False {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:29:51 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] ******************************************************************************** {{(pid=86509) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 06 06:29:51 devstack cinder-volume[86727]: DEBUG cinder.volume.drivers.quobyte [None req-a9c64758-3df7-4c22-8ad1-16b451f60a17 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86727) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 06 06:29:51 devstack cinder-volume[86727]: WARNING cinder.volume.drivers.quobyte [None req-a9c64758-3df7-4c22-8ad1-16b451f60a17 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 06 06:29:51 devstack cinder-volume[86727]: WARNING cinder.volume.drivers.quobyte [None req-a9c64758-3df7-4c22-8ad1-16b451f60a17 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 06 06:29:51 devstack cinder-volume[86727]: DEBUG oslo_concurrency.processutils [None req-a9c64758-3df7-4c22-8ad1-16b451f60a17 None None] Running cmd (subprocess): mount.quobyte {{(pid=86727) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:29:51 devstack quobyte-client[86732]: Reading configuration file: /etc/quobyte/client.cfg Sep 06 06:29:51 devstack quobyte-client[86732]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 06 06:29:51 devstack cinder-volume[86727]: DEBUG oslo_concurrency.processutils [None req-a9c64758-3df7-4c22-8ad1-16b451f60a17 None None] CMD "mount.quobyte" returned: 1 in 0.081s {{(pid=86727) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:29:51 devstack cinder-volume[86727]: DEBUG oslo_concurrency.lockutils [None req-a9c64758-3df7-4c22-8ad1-16b451f60a17 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86727) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:29:51 devstack cinder-volume[86727]: DEBUG oslo_concurrency.lockutils [None req-a9c64758-3df7-4c22-8ad1-16b451f60a17 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86727) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:29:51 devstack cinder-volume[86727]: DEBUG cinder.volume.drivers.quobyte [None req-a9c64758-3df7-4c22-8ad1-16b451f60a17 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=86727) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:29:51 devstack cinder-volume[86727]: INFO cinder.volume.drivers.quobyte [None req-a9c64758-3df7-4c22-8ad1-16b451f60a17 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 ... Sep 06 06:29:51 devstack cinder-volume[86727]: DEBUG oslo_concurrency.processutils [None req-a9c64758-3df7-4c22-8ad1-16b451f60a17 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 -c /etc/quobyte/client-cinder.cfg {{(pid=86727) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:29:51 devstack sudo[86733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 -c /etc/quobyte/client-cinder.cfg Sep 06 06:29:51 devstack sudo[86733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:29:52 devstack sudo[86733]: pam_unix(sudo:session): session closed for user root Sep 06 06:29:52 devstack cinder-volume[86727]: DEBUG oslo_concurrency.processutils [None req-a9c64758-3df7-4c22-8ad1-16b451f60a17 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.404s {{(pid=86727) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:29:52 devstack cinder-volume[86727]: INFO cinder.volume.drivers.quobyte [None req-a9c64758-3df7-4c22-8ad1-16b451f60a17 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 succeeded Sep 06 06:29:52 devstack cinder-volume[86727]: DEBUG cinder.volume.drivers.quobyte [None req-a9c64758-3df7-4c22-8ad1-16b451f60a17 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=86727) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:29:52 devstack cinder-volume[86727]: DEBUG oslo_concurrency.lockutils [None req-a9c64758-3df7-4c22-8ad1-16b451f60a17 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.419s {{(pid=86727) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:29:52 devstack cinder-volume[86727]: DEBUG oslo_concurrency.processutils [None req-a9c64758-3df7-4c22-8ad1-16b451f60a17 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=86727) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:29:52 devstack sudo[86802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:29:52 devstack sudo[86802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:29:52 devstack sudo[86802]: pam_unix(sudo:session): session closed for user root Sep 06 06:29:52 devstack cinder-volume[86727]: DEBUG oslo_concurrency.processutils [None req-a9c64758-3df7-4c22-8ad1-16b451f60a17 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.240s {{(pid=86727) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:29:52 devstack cinder-volume[86727]: INFO cinder.volume.driver [None req-a9c64758-3df7-4c22-8ad1-16b451f60a17 None None] Driver hasn't implemented _init_vendor_properties() Sep 06 06:29:52 devstack cinder-volume[86727]: DEBUG cinder.volume.driver [None req-a9c64758-3df7-4c22-8ad1-16b451f60a17 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.6685256958008, 'free_capacity_gb': 1773.6685256958008, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86727) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 06 06:29:52 devstack cinder-volume[86727]: DEBUG oslo_db.sqlalchemy.engines [None req-a9c64758-3df7-4c22-8ad1-16b451f60a17 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86727) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 06 06:29:52 devstack cinder-volume[86727]: DEBUG dbcounter [-] [86727] Writer thread running {{(pid=86727) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 06 06:29:52 devstack cinder-volume[86727]: DEBUG cinder.db.api [None req-a9c64758-3df7-4c22-8ad1-16b451f60a17 None None] Building query based on filter {{(pid=86727) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 06 06:29:52 devstack cinder-volume[86727]: DEBUG cinder.image.image_utils [None req-a9c64758-3df7-4c22-8ad1-16b451f60a17 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86727) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 06 06:29:52 devstack cinder-volume[86727]: INFO cinder.keymgr.migration [None req-100934d1-9c5f-45ee-bd1c-de10618d523c None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 06 06:29:52 devstack cinder-volume[86727]: DEBUG oslo_concurrency.lockutils [None req-a9c64758-3df7-4c22-8ad1-16b451f60a17 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86727) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:29:52 devstack cinder-volume[86727]: DEBUG oslo_concurrency.lockutils [None req-a9c64758-3df7-4c22-8ad1-16b451f60a17 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86727) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:29:52 devstack cinder-volume[86727]: DEBUG cinder.volume.drivers.quobyte [None req-a9c64758-3df7-4c22-8ad1-16b451f60a17 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=86727) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:29:52 devstack cinder-volume[86727]: DEBUG cinder.volume.drivers.quobyte [None req-a9c64758-3df7-4c22-8ad1-16b451f60a17 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=86727) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:29:52 devstack cinder-volume[86727]: DEBUG oslo_concurrency.lockutils [None req-a9c64758-3df7-4c22-8ad1-16b451f60a17 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86727) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:29:52 devstack cinder-volume[86727]: DEBUG oslo_concurrency.processutils [None req-a9c64758-3df7-4c22-8ad1-16b451f60a17 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=86727) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:29:52 devstack sudo[86805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:29:52 devstack sudo[86805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:29:52 devstack sudo[86805]: pam_unix(sudo:session): session closed for user root Sep 06 06:29:52 devstack cinder-volume[86727]: DEBUG oslo_concurrency.processutils [None req-a9c64758-3df7-4c22-8ad1-16b451f60a17 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.239s {{(pid=86727) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:29:52 devstack cinder-volume[86727]: DEBUG cinder.manager [None req-a9c64758-3df7-4c22-8ad1-16b451f60a17 None None] Notifying Schedulers of capabilities ... {{(pid=86727) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:29:53 devstack cinder-volume[86727]: INFO cinder.volume.manager [None req-a9c64758-3df7-4c22-8ad1-16b451f60a17 None None] Driver initialization completed successfully. Sep 06 06:29:53 devstack cinder-volume[86727]: INFO cinder.manager [None req-a9c64758-3df7-4c22-8ad1-16b451f60a17 None None] Initiating service 3 cleanup Sep 06 06:29:53 devstack cinder-volume[86727]: INFO cinder.manager [None req-a9c64758-3df7-4c22-8ad1-16b451f60a17 None None] Service 3 cleanup completed. Sep 06 06:29:53 devstack cinder-volume[86727]: DEBUG cinder.service [None req-a9c64758-3df7-4c22-8ad1-16b451f60a17 None None] Creating RPC server for service cinder-volume {{(pid=86727) start /opt/stack/cinder/cinder/service.py:231}} Sep 06 06:29:53 devstack cinder-volume[86727]: DEBUG cinder.service [None req-a9c64758-3df7-4c22-8ad1-16b451f60a17 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86727) start /opt/stack/cinder/cinder/service.py:237}} Sep 06 06:29:53 devstack cinder-volume[86727]: INFO cinder.volume.manager [None req-a9c64758-3df7-4c22-8ad1-16b451f60a17 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 06 06:29:53 devstack cinder-volume[86727]: DEBUG oslo_concurrency.lockutils [None req-a9c64758-3df7-4c22-8ad1-16b451f60a17 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86727) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:29:53 devstack cinder-volume[86727]: DEBUG oslo_concurrency.lockutils [None req-a9c64758-3df7-4c22-8ad1-16b451f60a17 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86727) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:29:53 devstack cinder-volume[86727]: DEBUG cinder.volume.drivers.quobyte [None req-a9c64758-3df7-4c22-8ad1-16b451f60a17 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=86727) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:29:53 devstack cinder-volume[86727]: DEBUG cinder.volume.drivers.quobyte [None req-a9c64758-3df7-4c22-8ad1-16b451f60a17 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=86727) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:29:53 devstack cinder-volume[86727]: DEBUG oslo_concurrency.lockutils [None req-a9c64758-3df7-4c22-8ad1-16b451f60a17 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86727) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:29:53 devstack cinder-volume[86727]: DEBUG oslo_concurrency.processutils [None req-a9c64758-3df7-4c22-8ad1-16b451f60a17 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=86727) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:29:53 devstack sudo[86833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:29:53 devstack sudo[86833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:29:53 devstack sudo[86833]: pam_unix(sudo:session): session closed for user root Sep 06 06:29:53 devstack cinder-volume[86727]: DEBUG oslo_concurrency.processutils [None req-a9c64758-3df7-4c22-8ad1-16b451f60a17 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.476s {{(pid=86727) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:29:53 devstack cinder-volume[86727]: INFO cinder.volume.manager [None req-a9c64758-3df7-4c22-8ad1-16b451f60a17 None None] Driver post RPC initialization completed successfully. Sep 06 06:29:57 devstack cinder-volume[86727]: DEBUG oslo_concurrency.lockutils [None req-9e7b539a-0ff0-49b8-adf5-fde19b87a7a9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86727) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:29:57 devstack cinder-volume[86727]: DEBUG oslo_concurrency.lockutils [None req-9e7b539a-0ff0-49b8-adf5-fde19b87a7a9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86727) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:29:57 devstack cinder-volume[86727]: DEBUG cinder.volume.drivers.quobyte [None req-9e7b539a-0ff0-49b8-adf5-fde19b87a7a9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=86727) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:29:57 devstack cinder-volume[86727]: DEBUG cinder.volume.drivers.quobyte [None req-9e7b539a-0ff0-49b8-adf5-fde19b87a7a9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=86727) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:29:57 devstack cinder-volume[86727]: DEBUG oslo_concurrency.lockutils [None req-9e7b539a-0ff0-49b8-adf5-fde19b87a7a9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86727) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:29:57 devstack cinder-volume[86727]: DEBUG oslo_concurrency.processutils [None req-9e7b539a-0ff0-49b8-adf5-fde19b87a7a9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=86727) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:29:57 devstack sudo[86967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:29:57 devstack sudo[86967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:29:57 devstack sudo[86967]: pam_unix(sudo:session): session closed for user root Sep 06 06:29:57 devstack cinder-volume[86727]: DEBUG oslo_concurrency.processutils [None req-9e7b539a-0ff0-49b8-adf5-fde19b87a7a9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.226s {{(pid=86727) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:29:57 devstack cinder-volume[86727]: DEBUG cinder.manager [None req-9e7b539a-0ff0-49b8-adf5-fde19b87a7a9 None None] Notifying Schedulers of capabilities ... {{(pid=86727) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:29:57 devstack cinder-volume[86509]: INFO oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] Caught SIGTERM, stopping children Sep 06 06:29:57 devstack cinder-volume[86509]: DEBUG oslo_concurrency.lockutils [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] Acquiring lock "singleton_lock" {{(pid=86509) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 06 06:29:57 devstack cinder-volume[86509]: DEBUG oslo_concurrency.lockutils [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] Acquired lock "singleton_lock" {{(pid=86509) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 06 06:29:57 devstack cinder-volume[86509]: DEBUG oslo_concurrency.lockutils [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] Releasing lock "singleton_lock" {{(pid=86509) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 06 06:29:57 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] Stop services. {{(pid=86509) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 06 06:29:57 devstack cinder-volume[86509]: DEBUG oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] Killing children. {{(pid=86509) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 06 06:29:57 devstack cinder-volume[86509]: INFO oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] Waiting on 1 children to exit Sep 06 06:30:01 devstack cinder-volume[86727]: DEBUG oslo_concurrency.lockutils [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] Acquiring lock "singleton_lock" {{(pid=86727) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 06 06:30:01 devstack cinder-volume[86727]: DEBUG oslo_concurrency.lockutils [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] Acquired lock "singleton_lock" {{(pid=86727) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 06 06:30:01 devstack cinder-volume[86727]: DEBUG oslo_concurrency.lockutils [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] Releasing lock "singleton_lock" {{(pid=86727) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 06 06:30:01 devstack cinder-volume[86727]: WARNING amqp [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 06 06:30:01 devstack cinder-volume[86727]: WARNING amqp [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 06 06:30:01 devstack cinder-volume[86509]: INFO oslo_service.backend._eventlet.service [None req-a72c3cc5-d901-4e32-b4ea-e9e8d51876e6 None None] Child 86727 exited with status 0 Sep 06 06:30:02 devstack cinder-volume[87027]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 06 06:30:02 devstack cinder-volume[87027]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 06 06:30:02 devstack cinder-volume[87027]: we strongly recommend against using it for new projects. Sep 06 06:30:02 devstack cinder-volume[87027]: If you are already using Eventlet, we recommend migrating to a different Sep 06 06:30:02 devstack cinder-volume[87027]: framework. For more detail see Sep 06 06:30:02 devstack cinder-volume[87027]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 06 06:30:02 devstack cinder-volume[87027]: import eventlet # noqa Sep 06 06:30:04 devstack cinder-volume[87027]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=87027) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 06 06:30:04 devstack cinder-volume[87027]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=87027) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 06 06:30:04 devstack cinder-volume[87027]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=87027) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 06 06:30:05 devstack cinder-volume[87027]: INFO dbcounter [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] Registered counter for database cinder Sep 06 06:30:05 devstack cinder-volume[87027]: DEBUG oslo_db.sqlalchemy.engines [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87027) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 06 06:30:05 devstack cinder-volume[87027]: DEBUG dbcounter [-] [87027] Writer thread running {{(pid=87027) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 06 06:30:05 devstack cinder-volume[87027]: INFO cinder.rpc [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 06 06:30:05 devstack cinder-volume[87027]: INFO cinder.rpc [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_db.sqlalchemy.engines [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87027) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 06 06:30:06 devstack cinder-volume[87027]: INFO cinder.volume.manager [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] Determined volume DB was empty at startup. Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG cinder.volume.manager [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=87027) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 06 06:30:06 devstack cinder-volume[87027]: WARNING stevedore.named [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 06 06:30:06 devstack cinder-volume[87027]: WARNING castellan.key_manager [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 06 06:30:06 devstack cinder-volume[87027]: WARNING cinder.keymgr.conf_key_mgr [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 06 06:30:06 devstack cinder-volume[87027]: INFO cinder.volume.manager [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_db.sqlalchemy.engines [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87027) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 06 06:30:06 devstack cinder-volume[87027]: INFO oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] Starting 1 workers Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] Started child 87329 {{(pid=87027) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] Full set of CONF: {{(pid=87027) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] ******************************************************************************** {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] Configuration options gathered from: {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] ================================================================================ {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] allow_availability_zone_fallback = False {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:30:06 devstack cinder-volume[87329]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] allow_compression_on_image_upload = False {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] allowed_direct_url_schemes = [] {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] api_rate_limit = True {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] auth_strategy = keystone {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] backend_availability_zone = None {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] backend_host = None {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] backend_name = None {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] backend_stats_polling_interval = 60 {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] backup_api_class = cinder.backup.api.API {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] backup_name_template = backup-%s {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] backup_use_same_host = False {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] backup_use_temp_snapshot = False {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] chap_password = **** {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] chap_username = {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] cinder_internal_tenant_project_id = 69511bce68954edebef20a9888d2b242 {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] cinder_internal_tenant_user_id = fcaa5131bae141619b30d2fd156dc872 {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] cluster = None {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] compression_format = gzip {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] compute_api_class = cinder.compute.nova.API {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] config_dir = [] {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] config_source = [] {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] control_exchange = openstack {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] debug = True {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] default_availability_zone = None {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] default_group_type = None {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] default_volume_type = QuobyteHD {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] disk_geometry = None {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] driver_client_cert = None {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] driver_client_cert_key = None {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] driver_data_namespace = None {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] driver_ssl_cert_path = None {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] driver_ssl_cert_verify = False {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] driver_use_ssl = False {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] enable_new_services = True {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] enable_unsupported_driver = False {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] enabled_backends = ['QuobyteHD'] {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] enforce_multipath_for_image_xfer = False {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] filter_function = None {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] glance_api_insecure = False {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] glance_api_servers = ['http://192.168.122.198/image'] {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] glance_api_ssl_compression = False {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] glance_ca_certificates_file = None {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] glance_catalog_info = image:glance:publicURL {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] glance_certfile = None {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] glance_keyfile = None {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] glance_num_retries = 3 {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] glance_request_timeout = None {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] goodness_function = None {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] graceful_shutdown_timeout = 5 {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] group_api_class = cinder.group.api.API {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] host = devstack {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] image_compress_on_upload = True {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] image_conversion_address_space_limit = 1 {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] image_conversion_cpu_limit = 60 {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] image_conversion_disable = False {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] image_upload_use_cinder_backend = False {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] image_upload_use_internal_tenant = False {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] image_volume_cache_enabled = False {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] image_volume_cache_max_count = 0 {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] image_volume_cache_max_size_gb = 0 {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] init_host_max_objects_retrieval = 0 {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] instance_format = [instance: %(uuid)s] {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] iscsi_target_flags = {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] iscsi_write_cache = on {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] iser_helper = tgtadm {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] iser_ip_address = 192.168.122.198 {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] iser_port = 3260 {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] log_color = False {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] log_config_append = None {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] log_dir = None {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:30:06 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-ba9bed82-ae46-44d9-82e2-6ffcc31f2678 None None] Starting volume driver QuobyteDriver (1.2.1) Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] log_file = None {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:30:06 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-ba9bed82-ae46-44d9-82e2-6ffcc31f2678 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87329) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] log_options = True {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] log_rotate_interval = 1 {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] log_rotate_interval_type = days {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] log_rotation_type = none {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] max_age = 0 {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] max_logfile_count = 30 {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] max_logfile_size_mb = 200 {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] max_over_subscription_ratio = 20.0 {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] message_reap_interval = 86400 {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] message_ttl = 2592000 {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] migration_create_volume_timeout_secs = 300 {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] monkey_patch = False {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] monkey_patch_modules = [] {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] my_ip = 192.168.122.198 {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] no_snapshot_gb_quota = False {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] num_iser_scan_tries = 3 {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] num_shell_tries = 3 {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] num_volume_device_scan_tries = 3 {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] nvmeof_conn_info_version = 1 {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] nvmet_ns_id = 10 {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] nvmet_port_id = 1 {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] osapi_max_limit = 1000 {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] osapi_volume_ext_list = [] {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] osapi_volume_listen = 0.0.0.0 {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] osapi_volume_listen_port = 8776 {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] osapi_volume_use_ssl = False {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] osapi_volume_workers = None {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] per_volume_size_limit = -1 {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] periodic_fuzzy_delay = 60 {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] periodic_interval = 60 {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] project_id_regex = [0-9a-f\-]+ {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] public_endpoint = None {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] publish_errors = False {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] quota_backup_gigabytes = 1000 {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] quota_backups = 10 {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] quota_gigabytes = 1000 {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] quota_groups = 10 {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] quota_snapshots = 10 {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] quota_volumes = 10 {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] rate_limit_burst = 0 {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] rate_limit_except_level = CRITICAL {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] rate_limit_interval = 0 {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] reinit_driver_count = 3 {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] replication_device = **** {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] report_discard_supported = False {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] report_interval = 120 {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] reservation_clean_interval = 86400 {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] reservation_expire = 86400 {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] reserved_image_namespaces = [] {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] reserved_percentage = 0 {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] rpc_response_timeout = 120 {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] run_external_periodic_tasks = True {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] scst_target_driver = iscsi {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] scst_target_iqn_name = None {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] service_down_time = 720 {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] shell_completion = None {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] snapshot_name_template = snapshot-%s {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] split_loggers = False {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] state_path = /opt/stack/data/cinder {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] storage_availability_zone = nova {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] storage_protocol = iSCSI {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] syslog_log_facility = LOG_USER {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] target_helper = lioadm {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] target_ip_address = 192.168.122.198 {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] target_port = 3260 {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] target_protocol = iscsi {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] target_secondary_ip_addresses = [] {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] trace_flags = None {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] transfer_api_class = cinder.transfer.api.API {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] transport_url = **** {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] until_refresh = 0 {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] use_chap_auth = False {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] use_default_quota_class = True {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] use_journal = False {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] use_json = False {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] use_multipath_for_image_xfer = False {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] use_stderr = False {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] use_syslog = False {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] verify_glance_signatures = enabled {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] volume_api_class = cinder.volume.api.API {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] volume_backend_name = None {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] volume_clear = zero {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] volume_clear_ionice = None {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] volume_clear_size = 0 {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] volume_copy_bps_limit = 0 {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] volume_dd_blocksize = 1M {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] volume_name_template = volume-%s {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] volume_service_inithost_offload = False {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] volume_usage_audit_period = month {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] zoning_mode = None {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] oslo_concurrency.disable_process_locking = False {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] keystone_authtoken.auth_section = None {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] keystone_authtoken.auth_type = password {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] keystone_authtoken.auth_version = None {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] keystone_authtoken.cache = None {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] keystone_authtoken.certfile = None {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] keystone_authtoken.delay_auth_decision = False {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] keystone_authtoken.http_connect_timeout = None {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] keystone_authtoken.include_service_catalog = True {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] keystone_authtoken.insecure = False {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] keystone_authtoken.interface = public {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] keystone_authtoken.keyfile = None {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] keystone_authtoken.memcache_password = **** {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] keystone_authtoken.memcache_username = None {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] keystone_authtoken.region_name = None {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] keystone_authtoken.service_token_roles_required = True {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] keystone_authtoken.service_type = None {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] keystone_authtoken.token_cache_time = 300 {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.198/identity {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] cache.backend = dogpile.cache.null {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] cache.backend_argument = **** {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] cache.backend_expiration_time = None {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] cache.config_prefix = cache.oslo {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] cache.debug_cache_backend = False {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] cache.enable_retry_client = False {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] cache.enable_socket_keepalive = False {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-ba9bed82-ae46-44d9-82e2-6ffcc31f2678 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87329) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 06 06:30:06 devstack cinder-volume[87329]: WARNING cinder.volume.drivers.quobyte [None req-ba9bed82-ae46-44d9-82e2-6ffcc31f2678 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 06 06:30:06 devstack cinder-volume[87329]: WARNING cinder.volume.drivers.quobyte [None req-ba9bed82-ae46-44d9-82e2-6ffcc31f2678 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] cache.enabled = False {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] cache.expiration_time = 600 {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] cache.hashclient_retry_attempts = 2 {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] cache.memcache_dead_retry = 300 {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] cache.memcache_pool_maxsize = 10 {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-ba9bed82-ae46-44d9-82e2-6ffcc31f2678 None None] Running cmd (subprocess): mount.quobyte {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] cache.memcache_sasl_enabled = False {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] cache.password = **** {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] cache.proxies = [] {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] cache.redis_db = 0 {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] cache.redis_sentinel_service_name = mymaster {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] cache.redis_server = localhost:6379 {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] cache.retry_attempts = 2 {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] cache.retry_delay = 0.0 {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] cache.socket_keepalive_count = 1 {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] cache.socket_keepalive_idle = 1 {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] cache.socket_keepalive_interval = 1 {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] cache.socket_timeout = 1.0 {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] cache.tls_allowed_ciphers = None {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] cache.tls_cafile = None {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] cache.tls_certfile = None {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] cache.tls_enabled = False {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] cache.tls_keyfile = None {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] cache.username = None {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] coordination.backend_url = **** {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] database.asyncio_connection = **** {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] database.asyncio_slave_connection = **** {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] database.backend = sqlalchemy {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] database.connection = **** {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] database.connection_debug = 0 {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] database.connection_parameters = {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] database.connection_recycle_time = 3600 {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] database.connection_trace = False {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] database.db_inc_retry_interval = True {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] database.db_max_retries = 20 {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] database.db_max_retry_interval = 10 {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] database.db_retry_interval = 1 {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] database.max_overflow = 50 {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] database.max_pool_size = 5 {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] database.max_retries = 10 {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] database.mysql_wsrep_sync_wait = None {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] database.pool_timeout = None {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] database.retry_interval = 10 {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] database.slave_connection = **** {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] database.sqlite_synchronous = True {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] database.synchronous_reader = True {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] database.use_db_reconnect = False {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] oslo_messaging_tracing.insecure = False {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] profiler.connection_string = messaging:// {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] profiler.enabled = False {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] profiler.es_doc_type = notification {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] profiler.es_scroll_size = 10000 {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] profiler.es_scroll_time = 2m {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] profiler.filter_error_trace = False {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] profiler.hmac_keys = **** {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] profiler.sentinel_service_name = mymaster {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] profiler.socket_timeout = 0.1 {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] profiler.trace_requests = False {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] profiler.trace_sqlalchemy = False {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] profiler_jaeger.process_tags = {} {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] profiler_jaeger.service_name_prefix = None {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] profiler_otlp.service_name_prefix = None {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] oslo_policy.enforce_new_defaults = True {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] oslo_policy.policy_default_rule = default {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] oslo_policy.policy_file = policy.yaml {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] oslo_policy.remote_timeout = 60.0 {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] privsep_osbrick.group = None {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] privsep_osbrick.helper_command = None {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] privsep_osbrick.user = None {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] cinder_sys_admin.group = None {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] cinder_sys_admin.helper_command = None {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack quobyte-client[87338]: Reading configuration file: /etc/quobyte/client.cfg Sep 06 06:30:06 devstack quobyte-client[87338]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] cinder_sys_admin.user = None {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] service_user.auth_section = None {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] service_user.auth_type = password {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] service_user.cafile = None {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] service_user.certfile = None {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] service_user.collect_timing = False {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] service_user.insecure = False {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] service_user.keyfile = None {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] service_user.send_service_user_token = True {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] service_user.split_loggers = False {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] service_user.timeout = None {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] service_user.tls_ciphers = None {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] service_user.tls_min_version = None {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] glance.auth_section = None {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] glance.auth_type = password {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] glance.certfile = None {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] glance.collect_timing = False {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] glance.insecure = False {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] glance.keyfile = None {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] glance.region_name = None {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] glance.split_loggers = False {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] glance.timeout = None {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] glance.tls_ciphers = None {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] glance.tls_min_version = None {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] backend_defaults.backend_availability_zone = None {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] backend_defaults.chap_password = **** {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-ba9bed82-ae46-44d9-82e2-6ffcc31f2678 None None] CMD "mount.quobyte" returned: 1 in 0.067s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] backend_defaults.chap_username = {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-ba9bed82-ae46-44d9-82e2-6ffcc31f2678 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] backend_defaults.disk_geometry = None {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] backend_defaults.driver_client_cert = None {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] backend_defaults.driver_client_cert_key = None {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-ba9bed82-ae46-44d9-82e2-6ffcc31f2678 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] backend_defaults.driver_data_namespace = None {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-ba9bed82-ae46-44d9-82e2-6ffcc31f2678 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] backend_defaults.driver_use_ssl = False {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] backend_defaults.enable_unsupported_driver = False {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] backend_defaults.extra_capabilities = {} {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] backend_defaults.filter_function = None {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] backend_defaults.goodness_function = None {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] backend_defaults.iscsi_target_flags = {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] backend_defaults.iscsi_write_cache = on {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] backend_defaults.iser_helper = tgtadm {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] backend_defaults.iser_ip_address = 192.168.122.198 {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] backend_defaults.iser_port = 3260 {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] backend_defaults.nas_host = {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] backend_defaults.nas_login = admin {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] backend_defaults.nas_mount_options = None {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] backend_defaults.nas_password = **** {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] backend_defaults.nas_private_key = {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-ba9bed82-ae46-44d9-82e2-6ffcc31f2678 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] backend_defaults.nas_share_path = {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-ba9bed82-ae46-44d9-82e2-6ffcc31f2678 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] backend_defaults.nas_ssh_port = 22 {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-ba9bed82-ae46-44d9-82e2-6ffcc31f2678 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] backend_defaults.num_shell_tries = 3 {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] backend_defaults.nvmet_port_id = 1 {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] backend_defaults.quobyte_client_cfg = None {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] backend_defaults.quobyte_volume_url = None {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] backend_defaults.replication_device = **** {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] backend_defaults.report_discard_supported = False {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] backend_defaults.reserved_percentage = 0 {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] backend_defaults.scst_target_driver = iscsi {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] backend_defaults.scst_target_iqn_name = None {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] backend_defaults.storage_protocol = iSCSI {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] backend_defaults.target_helper = tgtadm {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] backend_defaults.target_ip_address = 192.168.122.198 {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] backend_defaults.target_port = 3260 {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] backend_defaults.target_protocol = iscsi {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] backend_defaults.trace_flags = None {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] backend_defaults.unique_fqdn_network = True {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] backend_defaults.use_chap_auth = False {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] backend_defaults.volume_backend_name = None {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] backend_defaults.volume_clear = zero {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] backend_defaults.volume_clear_ionice = None {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] backend_defaults.volume_clear_size = 0 {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] oslo_reports.file_event_handler = None {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] oslo_reports.log_dir = None {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] QuobyteHD.backend_availability_zone = None {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] QuobyteHD.backend_host = None {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] QuobyteHD.chap_password = **** {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] QuobyteHD.chap_username = None {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] QuobyteHD.chiscsi_conf = None {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] QuobyteHD.disk_geometry = None {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] QuobyteHD.driver_client_cert = None {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] QuobyteHD.driver_client_cert_key = None {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] QuobyteHD.driver_data_namespace = None {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] QuobyteHD.driver_use_ssl = None {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] QuobyteHD.extra_capabilities = None {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] QuobyteHD.filter_function = None {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] QuobyteHD.goodness_function = None {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] QuobyteHD.iscsi_target_flags = None {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] QuobyteHD.iscsi_write_cache = None {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] QuobyteHD.iser_helper = None {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] QuobyteHD.iser_ip_address = None {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] QuobyteHD.iser_port = None {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] QuobyteHD.iser_target_prefix = None {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] QuobyteHD.nas_host = None {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] QuobyteHD.nas_login = None {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] QuobyteHD.nas_mount_options = None {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] QuobyteHD.nas_password = **** {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] QuobyteHD.nas_private_key = None {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] QuobyteHD.nas_share_path = None {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] QuobyteHD.nas_ssh_port = None {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] QuobyteHD.num_shell_tries = None {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] QuobyteHD.nvmet_ns_id = None {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack sudo[87339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] QuobyteHD.nvmet_port_id = None {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack sudo[87339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] QuobyteHD.replication_device = **** {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] QuobyteHD.report_discard_supported = None {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] QuobyteHD.reserved_percentage = None {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] QuobyteHD.scst_target_driver = None {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] QuobyteHD.storage_protocol = None {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] QuobyteHD.target_helper = None {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] QuobyteHD.target_ip_address = None {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] QuobyteHD.target_port = None {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] QuobyteHD.target_prefix = None {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] QuobyteHD.target_protocol = None {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] QuobyteHD.trace_flags = None {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] QuobyteHD.unique_fqdn_network = None {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] QuobyteHD.use_chap_auth = None {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] QuobyteHD.volume_clear = None {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] QuobyteHD.volume_clear_ionice = None {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] QuobyteHD.volume_clear_size = None {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] QuobyteHD.volumes_dir = None {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] oslo_messaging_rabbit.ssl = False {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] oslo_messaging_rabbit.ssl_version = {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] oslo_messaging_notifications.driver = [] {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] oslo_messaging_notifications.retry = -1 {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] oslo_messaging_notifications.transport_url = **** {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] key_manager.fixed_key = **** {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] barbican.barbican_api_version = None {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] barbican.barbican_endpoint = None {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] barbican.barbican_endpoint_type = public {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] barbican.barbican_region_name = None {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] barbican.cafile = None {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] barbican.certfile = None {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] barbican.collect_timing = False {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] barbican.insecure = False {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] barbican.keyfile = None {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] barbican.number_of_retries = 60 {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] barbican.retry_delay = 1 {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] barbican.send_service_user_token = False {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] barbican.split_loggers = False {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] barbican.timeout = None {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] barbican.tls_ciphers = None {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] barbican.tls_min_version = None {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] barbican.verify_ssl = True {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] barbican.verify_ssl_path = None {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] barbican_service_user.auth_section = None {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] barbican_service_user.auth_type = None {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] barbican_service_user.cafile = None {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] barbican_service_user.certfile = None {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] barbican_service_user.collect_timing = False {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] barbican_service_user.insecure = False {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] barbican_service_user.keyfile = None {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] barbican_service_user.split_loggers = False {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] barbican_service_user.timeout = None {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] barbican_service_user.tls_ciphers = None {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] barbican_service_user.tls_min_version = None {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] vault.approle_role_id = **** {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] vault.approle_secret_id = **** {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] vault.auth_method = approle {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] vault.auth_path = None {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] vault.kv_mountpoint = secret {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] vault.kv_path = None {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] vault.kv_version = 2 {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] vault.namespace = None {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] vault.root_token_id = **** {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] vault.ssl_ca_crt_file = None {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] vault.timeout = 60.0 {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] vault.token_file = None {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] vault.token_role = None {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] vault.use_ssl = False {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 06 06:30:06 devstack cinder-volume[87027]: DEBUG oslo_service.backend._eventlet.service [None req-d436f0e4-d1ca-427e-aa19-5bbd2ed73176 None None] ******************************************************************************** {{(pid=87027) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 06 06:30:06 devstack sudo[87339]: pam_unix(sudo:session): session closed for user root Sep 06 06:30:06 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-ba9bed82-ae46-44d9-82e2-6ffcc31f2678 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.253s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:30:06 devstack cinder-volume[87329]: INFO cinder.volume.driver [None req-ba9bed82-ae46-44d9-82e2-6ffcc31f2678 None None] Driver hasn't implemented _init_vendor_properties() Sep 06 06:30:06 devstack cinder-volume[87329]: DEBUG cinder.volume.driver [None req-ba9bed82-ae46-44d9-82e2-6ffcc31f2678 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.6685256958008, 'free_capacity_gb': 1773.6685256958008, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87329) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 06 06:30:06 devstack cinder-volume[87329]: DEBUG oslo_db.sqlalchemy.engines [None req-ba9bed82-ae46-44d9-82e2-6ffcc31f2678 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87329) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 06 06:30:06 devstack cinder-volume[87329]: DEBUG dbcounter [-] [87329] Writer thread running {{(pid=87329) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 06 06:30:06 devstack cinder-volume[87329]: DEBUG cinder.db.api [None req-ba9bed82-ae46-44d9-82e2-6ffcc31f2678 None None] Building query based on filter {{(pid=87329) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 06 06:30:06 devstack cinder-volume[87329]: DEBUG cinder.image.image_utils [None req-ba9bed82-ae46-44d9-82e2-6ffcc31f2678 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87329) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 06 06:30:06 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-ba9bed82-ae46-44d9-82e2-6ffcc31f2678 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:30:06 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-ba9bed82-ae46-44d9-82e2-6ffcc31f2678 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:30:06 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-ba9bed82-ae46-44d9-82e2-6ffcc31f2678 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:30:06 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-ba9bed82-ae46-44d9-82e2-6ffcc31f2678 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:30:06 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-ba9bed82-ae46-44d9-82e2-6ffcc31f2678 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:30:06 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-ba9bed82-ae46-44d9-82e2-6ffcc31f2678 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:30:06 devstack cinder-volume[87329]: INFO cinder.keymgr.migration [None req-07786b29-07cc-45ac-8642-87b5d87f04d4 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 06 06:30:06 devstack sudo[87350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:30:06 devstack sudo[87350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:30:07 devstack sudo[87350]: pam_unix(sudo:session): session closed for user root Sep 06 06:30:07 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-ba9bed82-ae46-44d9-82e2-6ffcc31f2678 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.234s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:30:07 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-ba9bed82-ae46-44d9-82e2-6ffcc31f2678 None None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:30:07 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-ba9bed82-ae46-44d9-82e2-6ffcc31f2678 None None] Driver initialization completed successfully. Sep 06 06:30:07 devstack cinder-volume[87329]: INFO cinder.manager [None req-ba9bed82-ae46-44d9-82e2-6ffcc31f2678 None None] Initiating service 3 cleanup Sep 06 06:30:07 devstack cinder-volume[87329]: INFO cinder.manager [None req-ba9bed82-ae46-44d9-82e2-6ffcc31f2678 None None] Service 3 cleanup completed. Sep 06 06:30:07 devstack cinder-volume[87329]: DEBUG cinder.service [None req-ba9bed82-ae46-44d9-82e2-6ffcc31f2678 None None] Creating RPC server for service cinder-volume {{(pid=87329) start /opt/stack/cinder/cinder/service.py:231}} Sep 06 06:30:07 devstack cinder-volume[87329]: DEBUG cinder.service [None req-ba9bed82-ae46-44d9-82e2-6ffcc31f2678 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87329) start /opt/stack/cinder/cinder/service.py:237}} Sep 06 06:30:07 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-ba9bed82-ae46-44d9-82e2-6ffcc31f2678 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 06 06:30:07 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-ba9bed82-ae46-44d9-82e2-6ffcc31f2678 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:30:07 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-ba9bed82-ae46-44d9-82e2-6ffcc31f2678 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:30:07 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-ba9bed82-ae46-44d9-82e2-6ffcc31f2678 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:30:07 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-ba9bed82-ae46-44d9-82e2-6ffcc31f2678 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:30:07 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-ba9bed82-ae46-44d9-82e2-6ffcc31f2678 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:30:07 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-ba9bed82-ae46-44d9-82e2-6ffcc31f2678 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:30:07 devstack sudo[87363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:30:07 devstack sudo[87363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:30:07 devstack sudo[87363]: pam_unix(sudo:session): session closed for user root Sep 06 06:30:07 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-ba9bed82-ae46-44d9-82e2-6ffcc31f2678 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.237s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:30:07 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-ba9bed82-ae46-44d9-82e2-6ffcc31f2678 None None] Driver post RPC initialization completed successfully. Sep 06 06:30:16 devstack cinder-volume[87027]: DEBUG dbcounter [-] [87027] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=87027) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 06:30:17 devstack cinder-volume[87329]: DEBUG dbcounter [-] [87329] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=87329) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 06:30:17 devstack cinder-volume[87329]: DEBUG dbcounter [-] [87329] Writing DB stats cinder:SELECT=2 {{(pid=87329) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 06:30:48 devstack cinder-volume[87329]: DEBUG oslo_service.periodic_task [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Running periodic task VolumeManager._thread_info {{(pid=87329) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 06 06:30:48 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] thread count: 6 {{(pid=87329) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 06 06:30:48 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] thread info: [<_MainThread(MainThread, started 126855043821696)>, , , , , ] {{(pid=87329) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 06 06:31:04 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4ade546-e053-4029-9c21-8b0a8f18c2dd tempest-TaggedAttachmentsTest-96049891 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87329) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 06:31:04 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-c4ade546-e053-4029-9c21-8b0a8f18c2dd tempest-TaggedAttachmentsTest-96049891 None] Flow 'volume_create_manager' (db40ceaa-2d16-487e-b668-61ba378dd0b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:31:04 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-c4ade546-e053-4029-9c21-8b0a8f18c2dd tempest-TaggedAttachmentsTest-96049891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4642cfa6-b912-4a78-88a0-b85c257a2a46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:31:04 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-c4ade546-e053-4029-9c21-8b0a8f18c2dd tempest-TaggedAttachmentsTest-96049891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4642cfa6-b912-4a78-88a0-b85c257a2a46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:31:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-2075526661',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da67c52e-4b18-405c-af7f-bd77d73bc19f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02be2cc3ec164c3484a23312a298794e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:31:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:31:05Z,use_quota=True,user_id='9e964aa5461d47fdb84f243dea35ea8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:31:04 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-c4ade546-e053-4029-9c21-8b0a8f18c2dd tempest-TaggedAttachmentsTest-96049891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f34e2c71-1d6c-4cb2-9a9f-d9f3d21bd4f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:31:04 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-c4ade546-e053-4029-9c21-8b0a8f18c2dd tempest-TaggedAttachmentsTest-96049891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f34e2c71-1d6c-4cb2-9a9f-d9f3d21bd4f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:31:04 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-c4ade546-e053-4029-9c21-8b0a8f18c2dd tempest-TaggedAttachmentsTest-96049891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f342370-f3ed-467d-885a-a353e02c620a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:31:04 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-c4ade546-e053-4029-9c21-8b0a8f18c2dd tempest-TaggedAttachmentsTest-96049891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f342370-f3ed-467d-885a-a353e02c620a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da67c52e-4b18-405c-af7f-bd77d73bc19f', 'volume_name': 'volume-da67c52e-4b18-405c-af7f-bd77d73bc19f', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:31:04 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-c4ade546-e053-4029-9c21-8b0a8f18c2dd tempest-TaggedAttachmentsTest-96049891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6ee66d1-2834-419d-a955-f3f7671069a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:31:04 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-c4ade546-e053-4029-9c21-8b0a8f18c2dd tempest-TaggedAttachmentsTest-96049891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6ee66d1-2834-419d-a955-f3f7671069a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:31:04 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-c4ade546-e053-4029-9c21-8b0a8f18c2dd tempest-TaggedAttachmentsTest-96049891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b483ae9e-68ad-47dc-a8bc-3145afe7b574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:31:04 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-c4ade546-e053-4029-9c21-8b0a8f18c2dd tempest-TaggedAttachmentsTest-96049891 None] Volume da67c52e-4b18-405c-af7f-bd77d73bc19f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da67c52e-4b18-405c-af7f-bd77d73bc19f', 'volume_size': 1} Sep 06 06:31:04 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-c4ade546-e053-4029-9c21-8b0a8f18c2dd tempest-TaggedAttachmentsTest-96049891 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:31:04 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-c4ade546-e053-4029-9c21-8b0a8f18c2dd tempest-TaggedAttachmentsTest-96049891 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:31:04 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-c4ade546-e053-4029-9c21-8b0a8f18c2dd tempest-TaggedAttachmentsTest-96049891 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:31:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-2075526661',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da67c52e-4b18-405c-af7f-bd77d73bc19f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02be2cc3ec164c3484a23312a298794e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:31:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:31:05Z,use_quota=True,user_id='9e964aa5461d47fdb84f243dea35ea8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)}" {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 06:31:04 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-c4ade546-e053-4029-9c21-8b0a8f18c2dd tempest-TaggedAttachmentsTest-96049891 None] Creating volume da67c52e-4b18-405c-af7f-bd77d73bc19f {{(pid=87329) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 06:31:04 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-c4ade546-e053-4029-9c21-8b0a8f18c2dd tempest-TaggedAttachmentsTest-96049891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:31:04 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-c4ade546-e053-4029-9c21-8b0a8f18c2dd tempest-TaggedAttachmentsTest-96049891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:31:04 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-c4ade546-e053-4029-9c21-8b0a8f18c2dd tempest-TaggedAttachmentsTest-96049891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:31:04 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-c4ade546-e053-4029-9c21-8b0a8f18c2dd tempest-TaggedAttachmentsTest-96049891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:31:04 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-c4ade546-e053-4029-9c21-8b0a8f18c2dd tempest-TaggedAttachmentsTest-96049891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:31:04 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-c4ade546-e053-4029-9c21-8b0a8f18c2dd tempest-TaggedAttachmentsTest-96049891 None] Selected osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 as target Quobyte volume. {{(pid=87329) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 06:31:04 devstack cinder-volume[87329]: INFO cinder.volume.drivers.remotefs [None req-c4ade546-e053-4029-9c21-8b0a8f18c2dd tempest-TaggedAttachmentsTest-96049891 None] casted to osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 Sep 06 06:31:04 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-c4ade546-e053-4029-9c21-8b0a8f18c2dd tempest-TaggedAttachmentsTest-96049891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-da67c52e-4b18-405c-af7f-bd77d73bc19f 1073741824 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:31:04 devstack sudo[87731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-da67c52e-4b18-405c-af7f-bd77d73bc19f 1073741824 Sep 06 06:31:04 devstack sudo[87731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:31:05 devstack sudo[87731]: pam_unix(sudo:session): session closed for user root Sep 06 06:31:05 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-c4ade546-e053-4029-9c21-8b0a8f18c2dd tempest-TaggedAttachmentsTest-96049891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-da67c52e-4b18-405c-af7f-bd77d73bc19f 1073741824" returned: 0 in 0.772s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:31:05 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-c4ade546-e053-4029-9c21-8b0a8f18c2dd tempest-TaggedAttachmentsTest-96049891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-da67c52e-4b18-405c-af7f-bd77d73bc19f {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:31:05 devstack sudo[88062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-da67c52e-4b18-405c-af7f-bd77d73bc19f Sep 06 06:31:05 devstack sudo[88062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:31:06 devstack sudo[88062]: pam_unix(sudo:session): session closed for user root Sep 06 06:31:06 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-c4ade546-e053-4029-9c21-8b0a8f18c2dd tempest-TaggedAttachmentsTest-96049891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-da67c52e-4b18-405c-af7f-bd77d73bc19f" returned: 0 in 0.320s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:31:06 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-c4ade546-e053-4029-9c21-8b0a8f18c2dd tempest-TaggedAttachmentsTest-96049891 None] <== create_volume: return (1201ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'} {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 06:31:06 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-c4ade546-e053-4029-9c21-8b0a8f18c2dd tempest-TaggedAttachmentsTest-96049891 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.204s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:31:06 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-c4ade546-e053-4029-9c21-8b0a8f18c2dd tempest-TaggedAttachmentsTest-96049891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b483ae9e-68ad-47dc-a8bc-3145afe7b574) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da67c52e-4b18-405c-af7f-bd77d73bc19f', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:31:06 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-c4ade546-e053-4029-9c21-8b0a8f18c2dd tempest-TaggedAttachmentsTest-96049891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ddfa3fe-f0e6-4603-8471-8bc49b8ef1e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:31:06 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-c4ade546-e053-4029-9c21-8b0a8f18c2dd tempest-TaggedAttachmentsTest-96049891 None] Volume volume-da67c52e-4b18-405c-af7f-bd77d73bc19f (da67c52e-4b18-405c-af7f-bd77d73bc19f): created successfully Sep 06 06:31:06 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-c4ade546-e053-4029-9c21-8b0a8f18c2dd tempest-TaggedAttachmentsTest-96049891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ddfa3fe-f0e6-4603-8471-8bc49b8ef1e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:31:06 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-c4ade546-e053-4029-9c21-8b0a8f18c2dd tempest-TaggedAttachmentsTest-96049891 None] Flow 'volume_create_manager' (db40ceaa-2d16-487e-b668-61ba378dd0b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:31:06 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-c4ade546-e053-4029-9c21-8b0a8f18c2dd tempest-TaggedAttachmentsTest-96049891 None] Created volume successfully. Sep 06 06:31:16 devstack cinder-volume[87329]: DEBUG dbcounter [-] [87329] Writing DB stats cinder:UPDATE=4,cinder:SELECT=2,cinder:INSERT=1 {{(pid=87329) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 06:31:16 devstack cinder-volume[87329]: DEBUG dbcounter [-] [87329] Writing DB stats cinder:SELECT=2,cinder:UPDATE=2,cinder:DELETE=1 {{(pid=87329) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 06:31:34 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-45332da5-d1e3-45ed-a277-3bdfb1c142cf tempest-VolumesAdminNegativeTest-1646276520 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87329) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 06:31:34 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-45332da5-d1e3-45ed-a277-3bdfb1c142cf tempest-VolumesAdminNegativeTest-1646276520 None] Flow 'volume_create_manager' (968fe5b8-9c65-47ee-b514-f10076020601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:31:34 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-45332da5-d1e3-45ed-a277-3bdfb1c142cf tempest-VolumesAdminNegativeTest-1646276520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8c1fd47-6c2e-4dd8-b772-e497b8d1b41d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:31:34 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-45332da5-d1e3-45ed-a277-3bdfb1c142cf tempest-VolumesAdminNegativeTest-1646276520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8c1fd47-6c2e-4dd8-b772-e497b8d1b41d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:31:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1048961519',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e62053f-5e04-4710-8ef3-631d3f8c54fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='283ac6dae3f04507953fb10b3e70ae91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:31:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:31:34Z,use_quota=True,user_id='3901966140bd49ac8fb4cf83f36e1d4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:31:34 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-45332da5-d1e3-45ed-a277-3bdfb1c142cf tempest-VolumesAdminNegativeTest-1646276520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed605fd9-ba9c-41ad-8e5d-0cb42b7aea6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:31:34 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-45332da5-d1e3-45ed-a277-3bdfb1c142cf tempest-VolumesAdminNegativeTest-1646276520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed605fd9-ba9c-41ad-8e5d-0cb42b7aea6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:31:34 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-45332da5-d1e3-45ed-a277-3bdfb1c142cf tempest-VolumesAdminNegativeTest-1646276520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (505b8203-2499-491f-a07e-49827fb7196a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:31:34 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-45332da5-d1e3-45ed-a277-3bdfb1c142cf tempest-VolumesAdminNegativeTest-1646276520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (505b8203-2499-491f-a07e-49827fb7196a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e62053f-5e04-4710-8ef3-631d3f8c54fe', 'volume_name': 'volume-4e62053f-5e04-4710-8ef3-631d3f8c54fe', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:31:34 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-45332da5-d1e3-45ed-a277-3bdfb1c142cf tempest-VolumesAdminNegativeTest-1646276520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7dbff404-f902-4b85-90cb-2185f8b62504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:31:34 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-45332da5-d1e3-45ed-a277-3bdfb1c142cf tempest-VolumesAdminNegativeTest-1646276520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7dbff404-f902-4b85-90cb-2185f8b62504) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:31:34 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-45332da5-d1e3-45ed-a277-3bdfb1c142cf tempest-VolumesAdminNegativeTest-1646276520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b72ef72-3660-4eba-9d34-7edd3e4b69f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:31:34 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-45332da5-d1e3-45ed-a277-3bdfb1c142cf tempest-VolumesAdminNegativeTest-1646276520 None] Volume 4e62053f-5e04-4710-8ef3-631d3f8c54fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e62053f-5e04-4710-8ef3-631d3f8c54fe', 'volume_size': 1} Sep 06 06:31:34 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-45332da5-d1e3-45ed-a277-3bdfb1c142cf tempest-VolumesAdminNegativeTest-1646276520 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:31:34 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-45332da5-d1e3-45ed-a277-3bdfb1c142cf tempest-VolumesAdminNegativeTest-1646276520 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:31:34 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-45332da5-d1e3-45ed-a277-3bdfb1c142cf tempest-VolumesAdminNegativeTest-1646276520 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:31:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1048961519',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e62053f-5e04-4710-8ef3-631d3f8c54fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='283ac6dae3f04507953fb10b3e70ae91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:31:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:31:34Z,use_quota=True,user_id='3901966140bd49ac8fb4cf83f36e1d4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)}" {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 06:31:34 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-45332da5-d1e3-45ed-a277-3bdfb1c142cf tempest-VolumesAdminNegativeTest-1646276520 None] Creating volume 4e62053f-5e04-4710-8ef3-631d3f8c54fe {{(pid=87329) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 06:31:34 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-45332da5-d1e3-45ed-a277-3bdfb1c142cf tempest-VolumesAdminNegativeTest-1646276520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:31:34 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-45332da5-d1e3-45ed-a277-3bdfb1c142cf tempest-VolumesAdminNegativeTest-1646276520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:31:34 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-45332da5-d1e3-45ed-a277-3bdfb1c142cf tempest-VolumesAdminNegativeTest-1646276520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:31:34 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-45332da5-d1e3-45ed-a277-3bdfb1c142cf tempest-VolumesAdminNegativeTest-1646276520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:31:34 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-45332da5-d1e3-45ed-a277-3bdfb1c142cf tempest-VolumesAdminNegativeTest-1646276520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:31:34 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-45332da5-d1e3-45ed-a277-3bdfb1c142cf tempest-VolumesAdminNegativeTest-1646276520 None] Selected osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 as target Quobyte volume. {{(pid=87329) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 06:31:34 devstack cinder-volume[87329]: INFO cinder.volume.drivers.remotefs [None req-45332da5-d1e3-45ed-a277-3bdfb1c142cf tempest-VolumesAdminNegativeTest-1646276520 None] casted to osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 Sep 06 06:31:34 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-45332da5-d1e3-45ed-a277-3bdfb1c142cf tempest-VolumesAdminNegativeTest-1646276520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-4e62053f-5e04-4710-8ef3-631d3f8c54fe 1073741824 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:31:34 devstack sudo[88589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-4e62053f-5e04-4710-8ef3-631d3f8c54fe 1073741824 Sep 06 06:31:34 devstack sudo[88589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:31:36 devstack sudo[88589]: pam_unix(sudo:session): session closed for user root Sep 06 06:31:36 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-45332da5-d1e3-45ed-a277-3bdfb1c142cf tempest-VolumesAdminNegativeTest-1646276520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-4e62053f-5e04-4710-8ef3-631d3f8c54fe 1073741824" returned: 0 in 1.263s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:31:36 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-45332da5-d1e3-45ed-a277-3bdfb1c142cf tempest-VolumesAdminNegativeTest-1646276520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-4e62053f-5e04-4710-8ef3-631d3f8c54fe {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:31:36 devstack sudo[88596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-4e62053f-5e04-4710-8ef3-631d3f8c54fe Sep 06 06:31:36 devstack sudo[88596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:31:36 devstack sudo[88596]: pam_unix(sudo:session): session closed for user root Sep 06 06:31:36 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-45332da5-d1e3-45ed-a277-3bdfb1c142cf tempest-VolumesAdminNegativeTest-1646276520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-4e62053f-5e04-4710-8ef3-631d3f8c54fe" returned: 0 in 0.557s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:31:36 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-45332da5-d1e3-45ed-a277-3bdfb1c142cf tempest-VolumesAdminNegativeTest-1646276520 None] <== create_volume: return (2080ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'} {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 06:31:36 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-45332da5-d1e3-45ed-a277-3bdfb1c142cf tempest-VolumesAdminNegativeTest-1646276520 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.085s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:31:36 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-45332da5-d1e3-45ed-a277-3bdfb1c142cf tempest-VolumesAdminNegativeTest-1646276520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b72ef72-3660-4eba-9d34-7edd3e4b69f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e62053f-5e04-4710-8ef3-631d3f8c54fe', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:31:36 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-45332da5-d1e3-45ed-a277-3bdfb1c142cf tempest-VolumesAdminNegativeTest-1646276520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec4952e3-329e-4631-8250-2d2c8ed11212) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:31:37 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-45332da5-d1e3-45ed-a277-3bdfb1c142cf tempest-VolumesAdminNegativeTest-1646276520 None] Volume volume-4e62053f-5e04-4710-8ef3-631d3f8c54fe (4e62053f-5e04-4710-8ef3-631d3f8c54fe): created successfully Sep 06 06:31:37 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-45332da5-d1e3-45ed-a277-3bdfb1c142cf tempest-VolumesAdminNegativeTest-1646276520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec4952e3-329e-4631-8250-2d2c8ed11212) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:31:37 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-45332da5-d1e3-45ed-a277-3bdfb1c142cf tempest-VolumesAdminNegativeTest-1646276520 None] Flow 'volume_create_manager' (968fe5b8-9c65-47ee-b514-f10076020601) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:31:37 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-45332da5-d1e3-45ed-a277-3bdfb1c142cf tempest-VolumesAdminNegativeTest-1646276520 None] Created volume successfully. Sep 06 06:31:38 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-561666e2-4cac-46d8-a3c4-c1f5f431663c tempest-VolumesAdminNegativeTest-1646276520 None] Acquiring lock "cinder-4e62053f-5e04-4710-8ef3-631d3f8c54fe-delete_volume" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:31:38 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-561666e2-4cac-46d8-a3c4-c1f5f431663c tempest-VolumesAdminNegativeTest-1646276520 None] Lock "cinder-4e62053f-5e04-4710-8ef3-631d3f8c54fe-delete_volume" acquired by "delete_volume" :: waited 0.073s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:31:38 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-561666e2-4cac-46d8-a3c4-c1f5f431663c tempest-VolumesAdminNegativeTest-1646276520 None] Acquiring lock "cinder-quobyte-4e62053f-5e04-4710-8ef3-631d3f8c54fe" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:31:38 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-561666e2-4cac-46d8-a3c4-c1f5f431663c tempest-VolumesAdminNegativeTest-1646276520 None] Lock "cinder-quobyte-4e62053f-5e04-4710-8ef3-631d3f8c54fe" acquired by "delete_volume" :: waited 0.037s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:31:38 devstack cinder-volume[87329]: INFO oslo.privsep.daemon [None req-561666e2-4cac-46d8-a3c4-c1f5f431663c tempest-VolumesAdminNegativeTest-1646276520 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp3tlhkxbi/privsep.sock'] Sep 06 06:31:38 devstack sudo[88603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp3tlhkxbi/privsep.sock Sep 06 06:31:38 devstack sudo[88603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:31:39 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1b0ce81-9acc-413c-adee-4eeb9dcfd224 tempest-ServerRescueNegativeTestJSON-1235625837 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87329) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 06:31:39 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-f1b0ce81-9acc-413c-adee-4eeb9dcfd224 tempest-ServerRescueNegativeTestJSON-1235625837 None] Flow 'volume_create_manager' (4198e1db-ea89-4f16-ab5d-385309ed9f90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:31:39 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-f1b0ce81-9acc-413c-adee-4eeb9dcfd224 tempest-ServerRescueNegativeTestJSON-1235625837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd65566a-07d7-4265-b0d0-f94cecb746d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:31:39 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-f1b0ce81-9acc-413c-adee-4eeb9dcfd224 tempest-ServerRescueNegativeTestJSON-1235625837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd65566a-07d7-4265-b0d0-f94cecb746d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:31:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-473691844',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be02fafe-f9fb-4636-ba9a-50669d4e76f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c578778d0116489594c90c150989bcc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:31:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:31:39Z,use_quota=True,user_id='d8f993a3bd6540b1b51e3bb633db717c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:31:39 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-f1b0ce81-9acc-413c-adee-4eeb9dcfd224 tempest-ServerRescueNegativeTestJSON-1235625837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cca949ff-5e86-4bd1-8043-e95dd35ed11b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:31:39 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-f1b0ce81-9acc-413c-adee-4eeb9dcfd224 tempest-ServerRescueNegativeTestJSON-1235625837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cca949ff-5e86-4bd1-8043-e95dd35ed11b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:31:39 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-f1b0ce81-9acc-413c-adee-4eeb9dcfd224 tempest-ServerRescueNegativeTestJSON-1235625837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94de71ff-f87d-4033-b940-515ee2788402) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:31:39 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-f1b0ce81-9acc-413c-adee-4eeb9dcfd224 tempest-ServerRescueNegativeTestJSON-1235625837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94de71ff-f87d-4033-b940-515ee2788402) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be02fafe-f9fb-4636-ba9a-50669d4e76f3', 'volume_name': 'volume-be02fafe-f9fb-4636-ba9a-50669d4e76f3', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:31:39 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-f1b0ce81-9acc-413c-adee-4eeb9dcfd224 tempest-ServerRescueNegativeTestJSON-1235625837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5773c32-ff90-485b-85e1-d411036ee1f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:31:39 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-f1b0ce81-9acc-413c-adee-4eeb9dcfd224 tempest-ServerRescueNegativeTestJSON-1235625837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5773c32-ff90-485b-85e1-d411036ee1f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:31:39 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-f1b0ce81-9acc-413c-adee-4eeb9dcfd224 tempest-ServerRescueNegativeTestJSON-1235625837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e97db365-8950-4a3c-aed7-5f7a736f32c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:31:39 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-f1b0ce81-9acc-413c-adee-4eeb9dcfd224 tempest-ServerRescueNegativeTestJSON-1235625837 None] Volume be02fafe-f9fb-4636-ba9a-50669d4e76f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be02fafe-f9fb-4636-ba9a-50669d4e76f3', 'volume_size': 1} Sep 06 06:31:39 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-f1b0ce81-9acc-413c-adee-4eeb9dcfd224 tempest-ServerRescueNegativeTestJSON-1235625837 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:31:39 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-f1b0ce81-9acc-413c-adee-4eeb9dcfd224 tempest-ServerRescueNegativeTestJSON-1235625837 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:31:39 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-f1b0ce81-9acc-413c-adee-4eeb9dcfd224 tempest-ServerRescueNegativeTestJSON-1235625837 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:31:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-473691844',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be02fafe-f9fb-4636-ba9a-50669d4e76f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c578778d0116489594c90c150989bcc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:31:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:31:39Z,use_quota=True,user_id='d8f993a3bd6540b1b51e3bb633db717c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)}" {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 06:31:39 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-f1b0ce81-9acc-413c-adee-4eeb9dcfd224 tempest-ServerRescueNegativeTestJSON-1235625837 None] Creating volume be02fafe-f9fb-4636-ba9a-50669d4e76f3 {{(pid=87329) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 06:31:39 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-f1b0ce81-9acc-413c-adee-4eeb9dcfd224 tempest-ServerRescueNegativeTestJSON-1235625837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:31:39 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-f1b0ce81-9acc-413c-adee-4eeb9dcfd224 tempest-ServerRescueNegativeTestJSON-1235625837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:31:39 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-f1b0ce81-9acc-413c-adee-4eeb9dcfd224 tempest-ServerRescueNegativeTestJSON-1235625837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:31:39 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-f1b0ce81-9acc-413c-adee-4eeb9dcfd224 tempest-ServerRescueNegativeTestJSON-1235625837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:31:39 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-f1b0ce81-9acc-413c-adee-4eeb9dcfd224 tempest-ServerRescueNegativeTestJSON-1235625837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:31:39 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-f1b0ce81-9acc-413c-adee-4eeb9dcfd224 tempest-ServerRescueNegativeTestJSON-1235625837 None] Selected osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 as target Quobyte volume. {{(pid=87329) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 06:31:39 devstack cinder-volume[87329]: INFO cinder.volume.drivers.remotefs [None req-f1b0ce81-9acc-413c-adee-4eeb9dcfd224 tempest-ServerRescueNegativeTestJSON-1235625837 None] casted to osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 Sep 06 06:31:39 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-f1b0ce81-9acc-413c-adee-4eeb9dcfd224 tempest-ServerRescueNegativeTestJSON-1235625837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-be02fafe-f9fb-4636-ba9a-50669d4e76f3 1073741824 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:31:39 devstack sudo[88606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-be02fafe-f9fb-4636-ba9a-50669d4e76f3 1073741824 Sep 06 06:31:39 devstack sudo[88606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:31:40 devstack sudo[88606]: pam_unix(sudo:session): session closed for user root Sep 06 06:31:40 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-f1b0ce81-9acc-413c-adee-4eeb9dcfd224 tempest-ServerRescueNegativeTestJSON-1235625837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-be02fafe-f9fb-4636-ba9a-50669d4e76f3 1073741824" returned: 0 in 1.164s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:31:40 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-f1b0ce81-9acc-413c-adee-4eeb9dcfd224 tempest-ServerRescueNegativeTestJSON-1235625837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-be02fafe-f9fb-4636-ba9a-50669d4e76f3 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:31:40 devstack sudo[88647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-be02fafe-f9fb-4636-ba9a-50669d4e76f3 Sep 06 06:31:40 devstack sudo[88647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:31:41 devstack sudo[88647]: pam_unix(sudo:session): session closed for user root Sep 06 06:31:41 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-f1b0ce81-9acc-413c-adee-4eeb9dcfd224 tempest-ServerRescueNegativeTestJSON-1235625837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-be02fafe-f9fb-4636-ba9a-50669d4e76f3" returned: 0 in 0.545s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:31:41 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-f1b0ce81-9acc-413c-adee-4eeb9dcfd224 tempest-ServerRescueNegativeTestJSON-1235625837 None] <== create_volume: return (1824ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'} {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 06:31:41 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-f1b0ce81-9acc-413c-adee-4eeb9dcfd224 tempest-ServerRescueNegativeTestJSON-1235625837 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.831s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:31:41 devstack cinder-volume[87329]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Sep 06 06:31:41 devstack cinder-volume[87329]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 06 06:31:41 devstack cinder-volume[87329]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Sep 06 06:31:41 devstack cinder-volume[87329]: WARNING oslo.privsep.daemon [-] privsep log: Sep 06 06:31:41 devstack cinder-volume[87329]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Sep 06 06:31:41 devstack cinder-volume[87329]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Sep 06 06:31:41 devstack cinder-volume[87329]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 06 06:31:41 devstack cinder-volume[87329]: WARNING oslo.privsep.daemon [-] privsep log: Sep 06 06:31:41 devstack cinder-volume[87329]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Sep 06 06:31:41 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-f1b0ce81-9acc-413c-adee-4eeb9dcfd224 tempest-ServerRescueNegativeTestJSON-1235625837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e97db365-8950-4a3c-aed7-5f7a736f32c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be02fafe-f9fb-4636-ba9a-50669d4e76f3', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:31:41 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-f1b0ce81-9acc-413c-adee-4eeb9dcfd224 tempest-ServerRescueNegativeTestJSON-1235625837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9bad9d9-901d-449a-9eb4-1230f078fcdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:31:41 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-f1b0ce81-9acc-413c-adee-4eeb9dcfd224 tempest-ServerRescueNegativeTestJSON-1235625837 None] Volume volume-be02fafe-f9fb-4636-ba9a-50669d4e76f3 (be02fafe-f9fb-4636-ba9a-50669d4e76f3): created successfully Sep 06 06:31:41 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-f1b0ce81-9acc-413c-adee-4eeb9dcfd224 tempest-ServerRescueNegativeTestJSON-1235625837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9bad9d9-901d-449a-9eb4-1230f078fcdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:31:41 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-f1b0ce81-9acc-413c-adee-4eeb9dcfd224 tempest-ServerRescueNegativeTestJSON-1235625837 None] Flow 'volume_create_manager' (4198e1db-ea89-4f16-ab5d-385309ed9f90) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:31:41 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-f1b0ce81-9acc-413c-adee-4eeb9dcfd224 tempest-ServerRescueNegativeTestJSON-1235625837 None] Created volume successfully. Sep 06 06:31:41 devstack sudo[88603]: pam_unix(sudo:session): session closed for user root Sep 06 06:31:41 devstack cinder-volume[87329]: INFO oslo.privsep.daemon [None req-561666e2-4cac-46d8-a3c4-c1f5f431663c tempest-VolumesAdminNegativeTest-1646276520 None] Spawned new privsep daemon via rootwrap Sep 06 06:31:41 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [None req-561666e2-4cac-46d8-a3c4-c1f5f431663c tempest-VolumesAdminNegativeTest-1646276520 None] Accepted privsep connection to /tmp/tmp3tlhkxbi/privsep.sock {{(pid=87329) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Sep 06 06:31:41 devstack cinder-volume[87329]: INFO oslo.privsep.daemon [-] privsep daemon starting Sep 06 06:31:41 devstack cinder-volume[87329]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Sep 06 06:31:41 devstack cinder-volume[87329]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Sep 06 06:31:41 devstack cinder-volume[87329]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88651 Sep 06 06:31:41 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a30c375-9d07-4768-9048-50d7f1c5bdc2]: (2,) {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:31:41 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[26b86e4f-a38c-4bb2-9aeb-66631cf83f1b]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:31:41 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-561666e2-4cac-46d8-a3c4-c1f5f431663c tempest-VolumesAdminNegativeTest-1646276520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-4e62053f-5e04-4710-8ef3-631d3f8c54fe {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:31:41 devstack sudo[88653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-4e62053f-5e04-4710-8ef3-631d3f8c54fe Sep 06 06:31:41 devstack sudo[88653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:31:42 devstack sudo[88653]: pam_unix(sudo:session): session closed for user root Sep 06 06:31:42 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-561666e2-4cac-46d8-a3c4-c1f5f431663c tempest-VolumesAdminNegativeTest-1646276520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-4e62053f-5e04-4710-8ef3-631d3f8c54fe" returned: 0 in 0.876s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:31:42 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-561666e2-4cac-46d8-a3c4-c1f5f431663c tempest-VolumesAdminNegativeTest-1646276520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-4e62053f-5e04-4710-8ef3-631d3f8c54fe {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:31:42 devstack sudo[88659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-4e62053f-5e04-4710-8ef3-631d3f8c54fe Sep 06 06:31:42 devstack sudo[88659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:31:43 devstack sudo[88659]: pam_unix(sudo:session): session closed for user root Sep 06 06:31:43 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-561666e2-4cac-46d8-a3c4-c1f5f431663c tempest-VolumesAdminNegativeTest-1646276520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-4e62053f-5e04-4710-8ef3-631d3f8c54fe" returned: 0 in 0.739s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:31:43 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-561666e2-4cac-46d8-a3c4-c1f5f431663c tempest-VolumesAdminNegativeTest-1646276520 None] Lock "cinder-quobyte-4e62053f-5e04-4710-8ef3-631d3f8c54fe" released by "delete_volume" :: held 4.533s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:31:43 devstack cinder-volume[87329]: WARNING cinder.quota [None req-561666e2-4cac-46d8-a3c4-c1f5f431663c tempest-VolumesAdminNegativeTest-1646276520 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 06 06:31:43 devstack cinder-volume[87329]: WARNING cinder.quota [None req-561666e2-4cac-46d8-a3c4-c1f5f431663c tempest-VolumesAdminNegativeTest-1646276520 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 06 06:31:43 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-561666e2-4cac-46d8-a3c4-c1f5f431663c tempest-VolumesAdminNegativeTest-1646276520 None] Created reservations ['de537ff4-ba58-496a-a753-9df4af02358f', '0e5fafcf-f26a-4ea8-8e0f-84bb40c00299', '0ecb3645-4596-491b-bf05-fc9174d9983f', '086f91c1-70ca-46a6-a772-5966d2ed0ff6'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:31:43 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-561666e2-4cac-46d8-a3c4-c1f5f431663c tempest-VolumesAdminNegativeTest-1646276520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:31:43 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-561666e2-4cac-46d8-a3c4-c1f5f431663c tempest-VolumesAdminNegativeTest-1646276520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:31:43 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-561666e2-4cac-46d8-a3c4-c1f5f431663c tempest-VolumesAdminNegativeTest-1646276520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:31:43 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-561666e2-4cac-46d8-a3c4-c1f5f431663c tempest-VolumesAdminNegativeTest-1646276520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:31:43 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-561666e2-4cac-46d8-a3c4-c1f5f431663c tempest-VolumesAdminNegativeTest-1646276520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:31:43 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-561666e2-4cac-46d8-a3c4-c1f5f431663c tempest-VolumesAdminNegativeTest-1646276520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:31:43 devstack sudo[88663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:31:43 devstack sudo[88663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:31:44 devstack sudo[88663]: pam_unix(sudo:session): session closed for user root Sep 06 06:31:44 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-561666e2-4cac-46d8-a3c4-c1f5f431663c tempest-VolumesAdminNegativeTest-1646276520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.374s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:31:44 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-561666e2-4cac-46d8-a3c4-c1f5f431663c tempest-VolumesAdminNegativeTest-1646276520 None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:31:44 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-561666e2-4cac-46d8-a3c4-c1f5f431663c tempest-VolumesAdminNegativeTest-1646276520 None] Deleted volume successfully. Sep 06 06:31:44 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-561666e2-4cac-46d8-a3c4-c1f5f431663c tempest-VolumesAdminNegativeTest-1646276520 None] Lock "cinder-4e62053f-5e04-4710-8ef3-631d3f8c54fe-delete_volume" released by "delete_volume" :: held 5.538s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:31:48 devstack cinder-volume[87329]: DEBUG oslo_service.periodic_task [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87329) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 06 06:31:48 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:31:48 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:31:48 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:31:48 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:31:48 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:31:48 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:31:48 devstack sudo[88696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:31:48 devstack sudo[88696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:31:48 devstack sudo[88696]: pam_unix(sudo:session): session closed for user root Sep 06 06:31:48 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.468s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:31:48 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:31:48 devstack cinder-volume[87329]: DEBUG oslo_service.periodic_task [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Running periodic task VolumeManager._thread_info {{(pid=87329) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 06 06:31:48 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] thread count: 8 {{(pid=87329) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 06 06:31:48 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] thread info: [<_MainThread(MainThread, started 126855043821696)>, , , , , , , ] {{(pid=87329) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 06 06:31:53 devstack cinder-volume[87329]: DEBUG dbcounter [-] [87329] Writing DB stats cinder:SELECT=10,cinder:UPDATE=10,cinder:DELETE=1,cinder:INSERT=2 {{(pid=87329) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 06:31:54 devstack cinder-volume[87329]: DEBUG dbcounter [-] [87329] Writing DB stats cinder:UPDATE=18,cinder:SELECT=8,cinder:INSERT=4,cinder:DELETE=2 {{(pid=87329) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 06:32:01 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-3f547a62-524a-45d2-bb89-140ae5495cd9 tempest-ServerRescueNegativeTestJSON-1235625837 None] Acquiring lock "cinder-be02fafe-f9fb-4636-ba9a-50669d4e76f3-delete_volume" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:32:01 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-3f547a62-524a-45d2-bb89-140ae5495cd9 tempest-ServerRescueNegativeTestJSON-1235625837 None] Lock "cinder-be02fafe-f9fb-4636-ba9a-50669d4e76f3-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:32:01 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-3f547a62-524a-45d2-bb89-140ae5495cd9 tempest-ServerRescueNegativeTestJSON-1235625837 None] Acquiring lock "cinder-quobyte-be02fafe-f9fb-4636-ba9a-50669d4e76f3" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:32:01 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-3f547a62-524a-45d2-bb89-140ae5495cd9 tempest-ServerRescueNegativeTestJSON-1235625837 None] Lock "cinder-quobyte-be02fafe-f9fb-4636-ba9a-50669d4e76f3" acquired by "delete_volume" :: waited 0.027s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:32:01 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cf76804-c9dc-42e6-ad12-79d976c6ed28]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:32:01 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-3f547a62-524a-45d2-bb89-140ae5495cd9 tempest-ServerRescueNegativeTestJSON-1235625837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-be02fafe-f9fb-4636-ba9a-50669d4e76f3 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:32:01 devstack sudo[88862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-be02fafe-f9fb-4636-ba9a-50669d4e76f3 Sep 06 06:32:01 devstack sudo[88862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:32:01 devstack sudo[88862]: pam_unix(sudo:session): session closed for user root Sep 06 06:32:01 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-3f547a62-524a-45d2-bb89-140ae5495cd9 tempest-ServerRescueNegativeTestJSON-1235625837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-be02fafe-f9fb-4636-ba9a-50669d4e76f3" returned: 0 in 0.446s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:32:01 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-3f547a62-524a-45d2-bb89-140ae5495cd9 tempest-ServerRescueNegativeTestJSON-1235625837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-be02fafe-f9fb-4636-ba9a-50669d4e76f3 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:32:01 devstack sudo[88867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-be02fafe-f9fb-4636-ba9a-50669d4e76f3 Sep 06 06:32:01 devstack sudo[88867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:32:01 devstack sudo[88867]: pam_unix(sudo:session): session closed for user root Sep 06 06:32:01 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-3f547a62-524a-45d2-bb89-140ae5495cd9 tempest-ServerRescueNegativeTestJSON-1235625837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-be02fafe-f9fb-4636-ba9a-50669d4e76f3" returned: 0 in 0.270s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:32:01 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-3f547a62-524a-45d2-bb89-140ae5495cd9 tempest-ServerRescueNegativeTestJSON-1235625837 None] Lock "cinder-quobyte-be02fafe-f9fb-4636-ba9a-50669d4e76f3" released by "delete_volume" :: held 0.780s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:32:01 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-3f547a62-524a-45d2-bb89-140ae5495cd9 tempest-ServerRescueNegativeTestJSON-1235625837 None] Created reservations ['a4668ae2-162e-4661-bf62-f775a23f1400', 'fa694c7c-cc34-46b1-8c36-66074598a537', '0ef7ab37-cd65-4a5f-ba81-e612a3820bd4', '7f58cb5f-ad84-445f-9ee7-eedb7486eec6'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:32:02 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-3f547a62-524a-45d2-bb89-140ae5495cd9 tempest-ServerRescueNegativeTestJSON-1235625837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:32:02 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-3f547a62-524a-45d2-bb89-140ae5495cd9 tempest-ServerRescueNegativeTestJSON-1235625837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:32:02 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-3f547a62-524a-45d2-bb89-140ae5495cd9 tempest-ServerRescueNegativeTestJSON-1235625837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:32:02 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-3f547a62-524a-45d2-bb89-140ae5495cd9 tempest-ServerRescueNegativeTestJSON-1235625837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:32:02 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-3f547a62-524a-45d2-bb89-140ae5495cd9 tempest-ServerRescueNegativeTestJSON-1235625837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:32:02 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-3f547a62-524a-45d2-bb89-140ae5495cd9 tempest-ServerRescueNegativeTestJSON-1235625837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:32:02 devstack sudo[88879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:32:02 devstack sudo[88879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:32:02 devstack sudo[88879]: pam_unix(sudo:session): session closed for user root Sep 06 06:32:02 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-3f547a62-524a-45d2-bb89-140ae5495cd9 tempest-ServerRescueNegativeTestJSON-1235625837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.470s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:32:02 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-3f547a62-524a-45d2-bb89-140ae5495cd9 tempest-ServerRescueNegativeTestJSON-1235625837 None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:32:02 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-3f547a62-524a-45d2-bb89-140ae5495cd9 tempest-ServerRescueNegativeTestJSON-1235625837 None] Deleted volume successfully. Sep 06 06:32:02 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-3f547a62-524a-45d2-bb89-140ae5495cd9 tempest-ServerRescueNegativeTestJSON-1235625837 None] Lock "cinder-be02fafe-f9fb-4636-ba9a-50669d4e76f3-delete_volume" released by "delete_volume" :: held 1.687s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:32:12 devstack cinder-volume[87329]: DEBUG dbcounter [-] [87329] Writing DB stats cinder:SELECT=7,cinder:INSERT=2,cinder:UPDATE=6,cinder:DELETE=1 {{(pid=87329) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 06:32:17 devstack cinder-volume[87329]: DEBUG dbcounter [-] [87329] Writing DB stats cinder:UPDATE=11,cinder:SELECT=4,cinder:INSERT=2 {{(pid=87329) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 06:32:20 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-27b67b8e-e228-4037-9611-35007aaafb97 tempest-DeleteServersTestJSON-117609295 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87329) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 06:32:20 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-27b67b8e-e228-4037-9611-35007aaafb97 tempest-DeleteServersTestJSON-117609295 None] Flow 'volume_create_manager' (591225ac-0934-4796-ab44-c4b33ee1b5fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:32:21 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-27b67b8e-e228-4037-9611-35007aaafb97 tempest-DeleteServersTestJSON-117609295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cec8ce4d-116f-4c01-8726-fb7287c60f90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:32:21 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-27b67b8e-e228-4037-9611-35007aaafb97 tempest-DeleteServersTestJSON-117609295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cec8ce4d-116f-4c01-8726-fb7287c60f90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:32:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1349146750',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3fa7ca3-1e01-4aea-8e10-9915f01cc7b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='972fab40247b4ac7bab05fea0c76554f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:32:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:32:21Z,use_quota=True,user_id='73fc51c1872b4d8d90953e1ef28c2501',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:32:21 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-27b67b8e-e228-4037-9611-35007aaafb97 tempest-DeleteServersTestJSON-117609295 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bc28628-25a8-46f9-be36-b54f0478087c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:32:21 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-27b67b8e-e228-4037-9611-35007aaafb97 tempest-DeleteServersTestJSON-117609295 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bc28628-25a8-46f9-be36-b54f0478087c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:32:21 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-27b67b8e-e228-4037-9611-35007aaafb97 tempest-DeleteServersTestJSON-117609295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (427d7504-95ba-4b09-9b07-dd5e6243007a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:32:21 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-27b67b8e-e228-4037-9611-35007aaafb97 tempest-DeleteServersTestJSON-117609295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (427d7504-95ba-4b09-9b07-dd5e6243007a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3fa7ca3-1e01-4aea-8e10-9915f01cc7b2', 'volume_name': 'volume-e3fa7ca3-1e01-4aea-8e10-9915f01cc7b2', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:32:21 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-27b67b8e-e228-4037-9611-35007aaafb97 tempest-DeleteServersTestJSON-117609295 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dba58cbe-4735-466f-bc00-e270dced9028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:32:21 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-27b67b8e-e228-4037-9611-35007aaafb97 tempest-DeleteServersTestJSON-117609295 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dba58cbe-4735-466f-bc00-e270dced9028) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:32:21 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-27b67b8e-e228-4037-9611-35007aaafb97 tempest-DeleteServersTestJSON-117609295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6eb5ab2-3bcb-47f4-978d-f5629feb4fab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:32:21 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-27b67b8e-e228-4037-9611-35007aaafb97 tempest-DeleteServersTestJSON-117609295 None] Volume e3fa7ca3-1e01-4aea-8e10-9915f01cc7b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3fa7ca3-1e01-4aea-8e10-9915f01cc7b2', 'volume_size': 1} Sep 06 06:32:21 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-27b67b8e-e228-4037-9611-35007aaafb97 tempest-DeleteServersTestJSON-117609295 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:32:21 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-27b67b8e-e228-4037-9611-35007aaafb97 tempest-DeleteServersTestJSON-117609295 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:32:21 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-27b67b8e-e228-4037-9611-35007aaafb97 tempest-DeleteServersTestJSON-117609295 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:32:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1349146750',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3fa7ca3-1e01-4aea-8e10-9915f01cc7b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='972fab40247b4ac7bab05fea0c76554f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:32:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:32:21Z,use_quota=True,user_id='73fc51c1872b4d8d90953e1ef28c2501',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)}" {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 06:32:21 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-27b67b8e-e228-4037-9611-35007aaafb97 tempest-DeleteServersTestJSON-117609295 None] Creating volume e3fa7ca3-1e01-4aea-8e10-9915f01cc7b2 {{(pid=87329) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 06:32:21 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-27b67b8e-e228-4037-9611-35007aaafb97 tempest-DeleteServersTestJSON-117609295 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:32:21 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-27b67b8e-e228-4037-9611-35007aaafb97 tempest-DeleteServersTestJSON-117609295 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:32:21 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-27b67b8e-e228-4037-9611-35007aaafb97 tempest-DeleteServersTestJSON-117609295 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:32:21 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-27b67b8e-e228-4037-9611-35007aaafb97 tempest-DeleteServersTestJSON-117609295 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:32:21 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-27b67b8e-e228-4037-9611-35007aaafb97 tempest-DeleteServersTestJSON-117609295 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:32:21 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-27b67b8e-e228-4037-9611-35007aaafb97 tempest-DeleteServersTestJSON-117609295 None] Selected osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 as target Quobyte volume. {{(pid=87329) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 06:32:21 devstack cinder-volume[87329]: INFO cinder.volume.drivers.remotefs [None req-27b67b8e-e228-4037-9611-35007aaafb97 tempest-DeleteServersTestJSON-117609295 None] casted to osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 Sep 06 06:32:21 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-27b67b8e-e228-4037-9611-35007aaafb97 tempest-DeleteServersTestJSON-117609295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e3fa7ca3-1e01-4aea-8e10-9915f01cc7b2 1073741824 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:32:21 devstack sudo[89070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e3fa7ca3-1e01-4aea-8e10-9915f01cc7b2 1073741824 Sep 06 06:32:21 devstack sudo[89070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:32:21 devstack sudo[89070]: pam_unix(sudo:session): session closed for user root Sep 06 06:32:21 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-27b67b8e-e228-4037-9611-35007aaafb97 tempest-DeleteServersTestJSON-117609295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e3fa7ca3-1e01-4aea-8e10-9915f01cc7b2 1073741824" returned: 0 in 0.806s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:32:22 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-27b67b8e-e228-4037-9611-35007aaafb97 tempest-DeleteServersTestJSON-117609295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e3fa7ca3-1e01-4aea-8e10-9915f01cc7b2 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:32:22 devstack sudo[89078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e3fa7ca3-1e01-4aea-8e10-9915f01cc7b2 Sep 06 06:32:22 devstack sudo[89078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:32:22 devstack sudo[89078]: pam_unix(sudo:session): session closed for user root Sep 06 06:32:22 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-27b67b8e-e228-4037-9611-35007aaafb97 tempest-DeleteServersTestJSON-117609295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e3fa7ca3-1e01-4aea-8e10-9915f01cc7b2" returned: 0 in 0.438s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:32:22 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-27b67b8e-e228-4037-9611-35007aaafb97 tempest-DeleteServersTestJSON-117609295 None] <== create_volume: return (1328ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'} {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 06:32:22 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-27b67b8e-e228-4037-9611-35007aaafb97 tempest-DeleteServersTestJSON-117609295 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.331s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:32:22 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-27b67b8e-e228-4037-9611-35007aaafb97 tempest-DeleteServersTestJSON-117609295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6eb5ab2-3bcb-47f4-978d-f5629feb4fab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3fa7ca3-1e01-4aea-8e10-9915f01cc7b2', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:32:22 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-27b67b8e-e228-4037-9611-35007aaafb97 tempest-DeleteServersTestJSON-117609295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3308b5e6-4349-4f92-b08f-eeac6d4d2551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:32:22 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-27b67b8e-e228-4037-9611-35007aaafb97 tempest-DeleteServersTestJSON-117609295 None] Volume volume-e3fa7ca3-1e01-4aea-8e10-9915f01cc7b2 (e3fa7ca3-1e01-4aea-8e10-9915f01cc7b2): created successfully Sep 06 06:32:22 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-27b67b8e-e228-4037-9611-35007aaafb97 tempest-DeleteServersTestJSON-117609295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3308b5e6-4349-4f92-b08f-eeac6d4d2551) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:32:22 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-27b67b8e-e228-4037-9611-35007aaafb97 tempest-DeleteServersTestJSON-117609295 None] Flow 'volume_create_manager' (591225ac-0934-4796-ab44-c4b33ee1b5fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:32:22 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-27b67b8e-e228-4037-9611-35007aaafb97 tempest-DeleteServersTestJSON-117609295 None] Created volume successfully. Sep 06 06:32:24 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-84118969-793a-4991-820b-53fb8732dfb1 tempest-BackendsCapabilitiesAdminTestsJSON-1274488776 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.6685256958008, 'free_capacity_gb': 1773.6685256958008, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87329) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 06 06:32:24 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-33ab1f68-90a9-41cf-a611-d4cb1674ee8a tempest-BackendsCapabilitiesAdminTestsJSON-1274488776 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.6685256958008, 'free_capacity_gb': 1773.6685256958008, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87329) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 06 06:32:27 devstack cinder-volume[87329]: WARNING py.warnings [req-7389f6f0-5707-4549-95dd-aea62433f168 req-7f12c9e2-8033-4317-8bea-8200d98a0ae6 tempest-DeleteServersTestJSON-117609295 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1". Apply join condition(s) between each element to resolve. Sep 06 06:32:27 devstack cinder-volume[87329]: .first() Sep 06 06:32:27 devstack cinder-volume[87329]: Sep 06 06:32:27 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [req-7389f6f0-5707-4549-95dd-aea62433f168 req-7f12c9e2-8033-4317-8bea-8200d98a0ae6 tempest-DeleteServersTestJSON-117609295 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:32:27 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [req-7389f6f0-5707-4549-95dd-aea62433f168 req-7f12c9e2-8033-4317-8bea-8200d98a0ae6 tempest-DeleteServersTestJSON-117609295 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:32:27 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [req-7389f6f0-5707-4549-95dd-aea62433f168 req-7f12c9e2-8033-4317-8bea-8200d98a0ae6 tempest-DeleteServersTestJSON-117609295 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.049s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:32:27 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [req-7389f6f0-5707-4549-95dd-aea62433f168 req-7f12c9e2-8033-4317-8bea-8200d98a0ae6 tempest-DeleteServersTestJSON-117609295 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6', 'name': 'volume-e3fa7ca3-1e01-4aea-8e10-9915f01cc7b2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f82fcde3-cae6-4a21-a368-274e972250bd', 'enforce_multipath': True} {{(pid=87329) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 06 06:32:28 devstack cinder-volume[87329]: INFO cinder.volume.manager [req-7389f6f0-5707-4549-95dd-aea62433f168 req-7f12c9e2-8033-4317-8bea-8200d98a0ae6 tempest-DeleteServersTestJSON-117609295 None] attachment_update completed successfully. Sep 06 06:32:32 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [req-1106ffbf-328a-4ecc-86b9-15905977fcd1 req-57b8ae5e-5c9a-4ef2-9da6-2a6240c2785a tempest-TaggedAttachmentsTest-96049891 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:32:32 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [req-1106ffbf-328a-4ecc-86b9-15905977fcd1 req-57b8ae5e-5c9a-4ef2-9da6-2a6240c2785a tempest-TaggedAttachmentsTest-96049891 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:32:32 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [req-1106ffbf-328a-4ecc-86b9-15905977fcd1 req-57b8ae5e-5c9a-4ef2-9da6-2a6240c2785a tempest-TaggedAttachmentsTest-96049891 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:32:32 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [req-1106ffbf-328a-4ecc-86b9-15905977fcd1 req-57b8ae5e-5c9a-4ef2-9da6-2a6240c2785a tempest-TaggedAttachmentsTest-96049891 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6', 'name': 'volume-da67c52e-4b18-405c-af7f-bd77d73bc19f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e9271df4-ff6b-4dba-8bd6-dc8e77ee523f', 'enforce_multipath': True} {{(pid=87329) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 06 06:32:32 devstack cinder-volume[87329]: INFO cinder.volume.manager [req-1106ffbf-328a-4ecc-86b9-15905977fcd1 req-57b8ae5e-5c9a-4ef2-9da6-2a6240c2785a tempest-TaggedAttachmentsTest-96049891 None] attachment_update completed successfully. Sep 06 06:32:34 devstack cinder-volume[87329]: INFO cinder.volume.manager [req-44fc3007-3787-467b-a3a5-84717d5d67a9 req-89be6b01-3fd9-4fdb-8333-d0dcf57526a6 tempest-DeleteServersTestJSON-117609295 None] Terminate volume connection completed successfully. Sep 06 06:32:34 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [req-44fc3007-3787-467b-a3a5-84717d5d67a9 req-89be6b01-3fd9-4fdb-8333-d0dcf57526a6 tempest-DeleteServersTestJSON-117609295 None] Deleting attachment f82fcde3-cae6-4a21-a368-274e972250bd. {{(pid=87329) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 06 06:32:36 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-c0144f03-5900-4895-95a2-8db3fa11f3c8 tempest-DeleteServersTestJSON-117609295 None] Acquiring lock "cinder-e3fa7ca3-1e01-4aea-8e10-9915f01cc7b2-delete_volume" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:32:36 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-c0144f03-5900-4895-95a2-8db3fa11f3c8 tempest-DeleteServersTestJSON-117609295 None] Lock "cinder-e3fa7ca3-1e01-4aea-8e10-9915f01cc7b2-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:32:36 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-c0144f03-5900-4895-95a2-8db3fa11f3c8 tempest-DeleteServersTestJSON-117609295 None] Acquiring lock "cinder-quobyte-e3fa7ca3-1e01-4aea-8e10-9915f01cc7b2" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:32:36 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-c0144f03-5900-4895-95a2-8db3fa11f3c8 tempest-DeleteServersTestJSON-117609295 None] Lock "cinder-quobyte-e3fa7ca3-1e01-4aea-8e10-9915f01cc7b2" acquired by "delete_volume" :: waited 0.017s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:32:36 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2b8aa52-f048-4e2e-8532-364b7d540c8c]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:32:36 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-c0144f03-5900-4895-95a2-8db3fa11f3c8 tempest-DeleteServersTestJSON-117609295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e3fa7ca3-1e01-4aea-8e10-9915f01cc7b2 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:32:36 devstack sudo[90031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e3fa7ca3-1e01-4aea-8e10-9915f01cc7b2 Sep 06 06:32:36 devstack sudo[90031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:32:36 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b2f0934-d6f1-4bc5-8285-1f9875fced8b tempest-VolumeRetypeWithoutMigrationTest-1208683717 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87329) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 06:32:36 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-4b2f0934-d6f1-4bc5-8285-1f9875fced8b tempest-VolumeRetypeWithoutMigrationTest-1208683717 None] Flow 'volume_create_manager' (80b7fe52-11ab-4be2-adab-8b118b7b661c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:32:36 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-4b2f0934-d6f1-4bc5-8285-1f9875fced8b tempest-VolumeRetypeWithoutMigrationTest-1208683717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (278678fd-f42f-4c7c-8087-8b15b29181f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:32:36 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-4b2f0934-d6f1-4bc5-8285-1f9875fced8b tempest-VolumeRetypeWithoutMigrationTest-1208683717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (278678fd-f42f-4c7c-8087-8b15b29181f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:32:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1081453117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4acdf4e9-0fbe-46c1-a171-b7e667b0eba9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a28dddd9e6e4faa8ae190dc861da102',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:32:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:32:36Z,use_quota=True,user_id='f7d32e39fce84617b3ebf3fb8a1b6573',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7709d97d-49e4-41c0-87a9-63a1f6a6b7b5),volume_type_id=7709d97d-49e4-41c0-87a9-63a1f6a6b7b5)' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:32:36 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-4b2f0934-d6f1-4bc5-8285-1f9875fced8b tempest-VolumeRetypeWithoutMigrationTest-1208683717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8dc10b0f-73e4-4f4d-b63f-358ec58e9856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:32:36 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-4b2f0934-d6f1-4bc5-8285-1f9875fced8b tempest-VolumeRetypeWithoutMigrationTest-1208683717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8dc10b0f-73e4-4f4d-b63f-358ec58e9856) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:32:36 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-4b2f0934-d6f1-4bc5-8285-1f9875fced8b tempest-VolumeRetypeWithoutMigrationTest-1208683717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2372abbc-6f71-4aed-99f6-837a84515290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:32:36 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-4b2f0934-d6f1-4bc5-8285-1f9875fced8b tempest-VolumeRetypeWithoutMigrationTest-1208683717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2372abbc-6f71-4aed-99f6-837a84515290) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4acdf4e9-0fbe-46c1-a171-b7e667b0eba9', 'volume_name': 'volume-4acdf4e9-0fbe-46c1-a171-b7e667b0eba9', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:32:36 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-4b2f0934-d6f1-4bc5-8285-1f9875fced8b tempest-VolumeRetypeWithoutMigrationTest-1208683717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f36a18ef-d31b-40bf-b978-aa8f480f0036) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:32:36 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-4b2f0934-d6f1-4bc5-8285-1f9875fced8b tempest-VolumeRetypeWithoutMigrationTest-1208683717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f36a18ef-d31b-40bf-b978-aa8f480f0036) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:32:36 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-4b2f0934-d6f1-4bc5-8285-1f9875fced8b tempest-VolumeRetypeWithoutMigrationTest-1208683717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71746ee1-9593-491a-9ea0-a42f9c306ded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:32:36 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-4b2f0934-d6f1-4bc5-8285-1f9875fced8b tempest-VolumeRetypeWithoutMigrationTest-1208683717 None] Volume 4acdf4e9-0fbe-46c1-a171-b7e667b0eba9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4acdf4e9-0fbe-46c1-a171-b7e667b0eba9', 'volume_size': 1} Sep 06 06:32:36 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-4b2f0934-d6f1-4bc5-8285-1f9875fced8b tempest-VolumeRetypeWithoutMigrationTest-1208683717 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:32:36 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-4b2f0934-d6f1-4bc5-8285-1f9875fced8b tempest-VolumeRetypeWithoutMigrationTest-1208683717 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:32:36 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-4b2f0934-d6f1-4bc5-8285-1f9875fced8b tempest-VolumeRetypeWithoutMigrationTest-1208683717 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:32:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1081453117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4acdf4e9-0fbe-46c1-a171-b7e667b0eba9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a28dddd9e6e4faa8ae190dc861da102',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:32:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:32:36Z,use_quota=True,user_id='f7d32e39fce84617b3ebf3fb8a1b6573',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7709d97d-49e4-41c0-87a9-63a1f6a6b7b5),volume_type_id=7709d97d-49e4-41c0-87a9-63a1f6a6b7b5)}" {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 06:32:36 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-4b2f0934-d6f1-4bc5-8285-1f9875fced8b tempest-VolumeRetypeWithoutMigrationTest-1208683717 None] Creating volume 4acdf4e9-0fbe-46c1-a171-b7e667b0eba9 {{(pid=87329) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 06:32:36 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-4b2f0934-d6f1-4bc5-8285-1f9875fced8b tempest-VolumeRetypeWithoutMigrationTest-1208683717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:32:36 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-4b2f0934-d6f1-4bc5-8285-1f9875fced8b tempest-VolumeRetypeWithoutMigrationTest-1208683717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:32:36 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-4b2f0934-d6f1-4bc5-8285-1f9875fced8b tempest-VolumeRetypeWithoutMigrationTest-1208683717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:32:36 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-4b2f0934-d6f1-4bc5-8285-1f9875fced8b tempest-VolumeRetypeWithoutMigrationTest-1208683717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:32:36 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-4b2f0934-d6f1-4bc5-8285-1f9875fced8b tempest-VolumeRetypeWithoutMigrationTest-1208683717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:32:36 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-4b2f0934-d6f1-4bc5-8285-1f9875fced8b tempest-VolumeRetypeWithoutMigrationTest-1208683717 None] Selected osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 as target Quobyte volume. {{(pid=87329) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 06:32:36 devstack cinder-volume[87329]: INFO cinder.volume.drivers.remotefs [None req-4b2f0934-d6f1-4bc5-8285-1f9875fced8b tempest-VolumeRetypeWithoutMigrationTest-1208683717 None] casted to osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 Sep 06 06:32:36 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-4b2f0934-d6f1-4bc5-8285-1f9875fced8b tempest-VolumeRetypeWithoutMigrationTest-1208683717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-4acdf4e9-0fbe-46c1-a171-b7e667b0eba9 1073741824 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:32:36 devstack sudo[90033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-4acdf4e9-0fbe-46c1-a171-b7e667b0eba9 1073741824 Sep 06 06:32:36 devstack sudo[90033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:32:36 devstack sudo[90031]: pam_unix(sudo:session): session closed for user root Sep 06 06:32:36 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-c0144f03-5900-4895-95a2-8db3fa11f3c8 tempest-DeleteServersTestJSON-117609295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e3fa7ca3-1e01-4aea-8e10-9915f01cc7b2" returned: 0 in 0.544s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:32:36 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-c0144f03-5900-4895-95a2-8db3fa11f3c8 tempest-DeleteServersTestJSON-117609295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e3fa7ca3-1e01-4aea-8e10-9915f01cc7b2 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:32:36 devstack sudo[90039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e3fa7ca3-1e01-4aea-8e10-9915f01cc7b2 Sep 06 06:32:36 devstack sudo[90039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:32:37 devstack sudo[90039]: pam_unix(sudo:session): session closed for user root Sep 06 06:32:37 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-c0144f03-5900-4895-95a2-8db3fa11f3c8 tempest-DeleteServersTestJSON-117609295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e3fa7ca3-1e01-4aea-8e10-9915f01cc7b2" returned: 0 in 0.352s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:32:37 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-c0144f03-5900-4895-95a2-8db3fa11f3c8 tempest-DeleteServersTestJSON-117609295 None] Lock "cinder-quobyte-e3fa7ca3-1e01-4aea-8e10-9915f01cc7b2" released by "delete_volume" :: held 0.984s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:32:37 devstack sudo[90033]: pam_unix(sudo:session): session closed for user root Sep 06 06:32:37 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-c0144f03-5900-4895-95a2-8db3fa11f3c8 tempest-DeleteServersTestJSON-117609295 None] Created reservations ['f6074e94-81d2-4bc4-8311-478a43163989', '6340a12c-2be3-4b47-87e8-3a965b327cd8', 'b3a4cdbd-a2e4-44cd-b4e7-b9cfd4f71f31', '90635363-23e8-4ca8-a464-725d97501360'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:32:37 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-4b2f0934-d6f1-4bc5-8285-1f9875fced8b tempest-VolumeRetypeWithoutMigrationTest-1208683717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-4acdf4e9-0fbe-46c1-a171-b7e667b0eba9 1073741824" returned: 0 in 0.866s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:32:37 devstack cinder-volume[87329]: INFO cinder.volume.manager [req-9eed2b63-ed1d-42c3-b574-f9b444912067 req-316b2c2d-7c64-42ef-b0ab-d2181f86df7c tempest-TaggedAttachmentsTest-96049891 None] Terminate volume connection completed successfully. Sep 06 06:32:37 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [req-9eed2b63-ed1d-42c3-b574-f9b444912067 req-316b2c2d-7c64-42ef-b0ab-d2181f86df7c tempest-TaggedAttachmentsTest-96049891 None] Deleting attachment e9271df4-ff6b-4dba-8bd6-dc8e77ee523f. {{(pid=87329) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 06 06:32:37 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-4b2f0934-d6f1-4bc5-8285-1f9875fced8b tempest-VolumeRetypeWithoutMigrationTest-1208683717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-4acdf4e9-0fbe-46c1-a171-b7e667b0eba9 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:32:37 devstack sudo[90074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-4acdf4e9-0fbe-46c1-a171-b7e667b0eba9 Sep 06 06:32:37 devstack sudo[90074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:32:37 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-c0144f03-5900-4895-95a2-8db3fa11f3c8 tempest-DeleteServersTestJSON-117609295 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:32:37 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-c0144f03-5900-4895-95a2-8db3fa11f3c8 tempest-DeleteServersTestJSON-117609295 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:32:37 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-c0144f03-5900-4895-95a2-8db3fa11f3c8 tempest-DeleteServersTestJSON-117609295 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:32:37 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-c0144f03-5900-4895-95a2-8db3fa11f3c8 tempest-DeleteServersTestJSON-117609295 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:32:37 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-c0144f03-5900-4895-95a2-8db3fa11f3c8 tempest-DeleteServersTestJSON-117609295 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:32:37 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-c0144f03-5900-4895-95a2-8db3fa11f3c8 tempest-DeleteServersTestJSON-117609295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:32:37 devstack sudo[90076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:32:37 devstack sudo[90076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:32:37 devstack sudo[90076]: pam_unix(sudo:session): session closed for user root Sep 06 06:32:37 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-c0144f03-5900-4895-95a2-8db3fa11f3c8 tempest-DeleteServersTestJSON-117609295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.387s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:32:37 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-c0144f03-5900-4895-95a2-8db3fa11f3c8 tempest-DeleteServersTestJSON-117609295 None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:32:37 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-4b2f0934-d6f1-4bc5-8285-1f9875fced8b tempest-VolumeRetypeWithoutMigrationTest-1208683717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-4acdf4e9-0fbe-46c1-a171-b7e667b0eba9" returned: 0 in 0.449s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:32:37 devstack sudo[90074]: pam_unix(sudo:session): session closed for user root Sep 06 06:32:37 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-4b2f0934-d6f1-4bc5-8285-1f9875fced8b tempest-VolumeRetypeWithoutMigrationTest-1208683717 None] <== create_volume: return (1461ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'} {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 06:32:37 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-4b2f0934-d6f1-4bc5-8285-1f9875fced8b tempest-VolumeRetypeWithoutMigrationTest-1208683717 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.466s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:32:37 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-c0144f03-5900-4895-95a2-8db3fa11f3c8 tempest-DeleteServersTestJSON-117609295 None] Deleted volume successfully. Sep 06 06:32:38 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-4b2f0934-d6f1-4bc5-8285-1f9875fced8b tempest-VolumeRetypeWithoutMigrationTest-1208683717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71746ee1-9593-491a-9ea0-a42f9c306ded) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4acdf4e9-0fbe-46c1-a171-b7e667b0eba9', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:32:38 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-4b2f0934-d6f1-4bc5-8285-1f9875fced8b tempest-VolumeRetypeWithoutMigrationTest-1208683717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ee6a740-7bcd-4332-b98d-66f403157cbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:32:38 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-c0144f03-5900-4895-95a2-8db3fa11f3c8 tempest-DeleteServersTestJSON-117609295 None] Lock "cinder-e3fa7ca3-1e01-4aea-8e10-9915f01cc7b2-delete_volume" released by "delete_volume" :: held 1.902s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:32:38 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-4b2f0934-d6f1-4bc5-8285-1f9875fced8b tempest-VolumeRetypeWithoutMigrationTest-1208683717 None] Volume volume-4acdf4e9-0fbe-46c1-a171-b7e667b0eba9 (4acdf4e9-0fbe-46c1-a171-b7e667b0eba9): created successfully Sep 06 06:32:38 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-4b2f0934-d6f1-4bc5-8285-1f9875fced8b tempest-VolumeRetypeWithoutMigrationTest-1208683717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ee6a740-7bcd-4332-b98d-66f403157cbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:32:38 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-4b2f0934-d6f1-4bc5-8285-1f9875fced8b tempest-VolumeRetypeWithoutMigrationTest-1208683717 None] Flow 'volume_create_manager' (80b7fe52-11ab-4be2-adab-8b118b7b661c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:32:38 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-4b2f0934-d6f1-4bc5-8285-1f9875fced8b tempest-VolumeRetypeWithoutMigrationTest-1208683717 None] Created volume successfully. Sep 06 06:32:39 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-4a321200-d2b2-4eef-a746-338634586cdf tempest-VolumeRetypeWithoutMigrationTest-1208683717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:32:39 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-4a321200-d2b2-4eef-a746-338634586cdf tempest-VolumeRetypeWithoutMigrationTest-1208683717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:32:39 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-4a321200-d2b2-4eef-a746-338634586cdf tempest-VolumeRetypeWithoutMigrationTest-1208683717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:32:39 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-4a321200-d2b2-4eef-a746-338634586cdf tempest-VolumeRetypeWithoutMigrationTest-1208683717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:32:39 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-4a321200-d2b2-4eef-a746-338634586cdf tempest-VolumeRetypeWithoutMigrationTest-1208683717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:32:39 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-4a321200-d2b2-4eef-a746-338634586cdf tempest-VolumeRetypeWithoutMigrationTest-1208683717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:32:39 devstack sudo[90100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:32:39 devstack sudo[90100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:32:39 devstack sudo[90100]: pam_unix(sudo:session): session closed for user root Sep 06 06:32:39 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-4a321200-d2b2-4eef-a746-338634586cdf tempest-VolumeRetypeWithoutMigrationTest-1208683717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.320s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:32:39 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-4a321200-d2b2-4eef-a746-338634586cdf tempest-VolumeRetypeWithoutMigrationTest-1208683717 None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:32:39 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-4a321200-d2b2-4eef-a746-338634586cdf tempest-VolumeRetypeWithoutMigrationTest-1208683717 None] Retype volume completed successfully. Sep 06 06:32:40 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-5571974b-6d6c-4cf0-9de9-677e4522e14c tempest-VolumeRetypeWithoutMigrationTest-1208683717 None] Acquiring lock "cinder-4acdf4e9-0fbe-46c1-a171-b7e667b0eba9-delete_volume" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:32:40 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-5571974b-6d6c-4cf0-9de9-677e4522e14c tempest-VolumeRetypeWithoutMigrationTest-1208683717 None] Lock "cinder-4acdf4e9-0fbe-46c1-a171-b7e667b0eba9-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:32:40 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-5571974b-6d6c-4cf0-9de9-677e4522e14c tempest-VolumeRetypeWithoutMigrationTest-1208683717 None] Acquiring lock "cinder-quobyte-4acdf4e9-0fbe-46c1-a171-b7e667b0eba9" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:32:40 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-5571974b-6d6c-4cf0-9de9-677e4522e14c tempest-VolumeRetypeWithoutMigrationTest-1208683717 None] Lock "cinder-quobyte-4acdf4e9-0fbe-46c1-a171-b7e667b0eba9" acquired by "delete_volume" :: waited 0.020s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:32:41 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5518f8c-0ecb-4c5d-aa76-0fc49ea97f92]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:32:41 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-5571974b-6d6c-4cf0-9de9-677e4522e14c tempest-VolumeRetypeWithoutMigrationTest-1208683717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-4acdf4e9-0fbe-46c1-a171-b7e667b0eba9 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:32:41 devstack sudo[90106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-4acdf4e9-0fbe-46c1-a171-b7e667b0eba9 Sep 06 06:32:41 devstack sudo[90106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:32:41 devstack sudo[90106]: pam_unix(sudo:session): session closed for user root Sep 06 06:32:41 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-5571974b-6d6c-4cf0-9de9-677e4522e14c tempest-VolumeRetypeWithoutMigrationTest-1208683717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-4acdf4e9-0fbe-46c1-a171-b7e667b0eba9" returned: 0 in 0.420s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:32:41 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-5571974b-6d6c-4cf0-9de9-677e4522e14c tempest-VolumeRetypeWithoutMigrationTest-1208683717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-4acdf4e9-0fbe-46c1-a171-b7e667b0eba9 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:32:41 devstack sudo[90114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-4acdf4e9-0fbe-46c1-a171-b7e667b0eba9 Sep 06 06:32:41 devstack sudo[90114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:32:41 devstack sudo[90114]: pam_unix(sudo:session): session closed for user root Sep 06 06:32:41 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-5571974b-6d6c-4cf0-9de9-677e4522e14c tempest-VolumeRetypeWithoutMigrationTest-1208683717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-4acdf4e9-0fbe-46c1-a171-b7e667b0eba9" returned: 0 in 0.289s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:32:41 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-5571974b-6d6c-4cf0-9de9-677e4522e14c tempest-VolumeRetypeWithoutMigrationTest-1208683717 None] Lock "cinder-quobyte-4acdf4e9-0fbe-46c1-a171-b7e667b0eba9" released by "delete_volume" :: held 0.756s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:32:41 devstack cinder-volume[87329]: WARNING cinder.quota [None req-5571974b-6d6c-4cf0-9de9-677e4522e14c tempest-VolumeRetypeWithoutMigrationTest-1208683717 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 06 06:32:41 devstack cinder-volume[87329]: WARNING cinder.quota [None req-5571974b-6d6c-4cf0-9de9-677e4522e14c tempest-VolumeRetypeWithoutMigrationTest-1208683717 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 06 06:32:41 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-5571974b-6d6c-4cf0-9de9-677e4522e14c tempest-VolumeRetypeWithoutMigrationTest-1208683717 None] Created reservations ['53bd171b-7d3a-4910-b52b-40f16a44098a', 'a3ba201b-aefd-43c6-8ae7-f60de7141590', '4b5b1531-6a58-4883-bcc8-a1ba8ba05aac', 'd7d756ce-53e6-4eab-83f6-c6d3d15e8e83'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:32:41 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-5571974b-6d6c-4cf0-9de9-677e4522e14c tempest-VolumeRetypeWithoutMigrationTest-1208683717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:32:41 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-5571974b-6d6c-4cf0-9de9-677e4522e14c tempest-VolumeRetypeWithoutMigrationTest-1208683717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:32:41 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-5571974b-6d6c-4cf0-9de9-677e4522e14c tempest-VolumeRetypeWithoutMigrationTest-1208683717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:32:41 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-5571974b-6d6c-4cf0-9de9-677e4522e14c tempest-VolumeRetypeWithoutMigrationTest-1208683717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:32:41 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-5571974b-6d6c-4cf0-9de9-677e4522e14c tempest-VolumeRetypeWithoutMigrationTest-1208683717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:32:41 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-5571974b-6d6c-4cf0-9de9-677e4522e14c tempest-VolumeRetypeWithoutMigrationTest-1208683717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:32:41 devstack sudo[90117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:32:41 devstack sudo[90117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:32:42 devstack sudo[90117]: pam_unix(sudo:session): session closed for user root Sep 06 06:32:42 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-5571974b-6d6c-4cf0-9de9-677e4522e14c tempest-VolumeRetypeWithoutMigrationTest-1208683717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.352s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:32:42 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-5571974b-6d6c-4cf0-9de9-677e4522e14c tempest-VolumeRetypeWithoutMigrationTest-1208683717 None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:32:42 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-5571974b-6d6c-4cf0-9de9-677e4522e14c tempest-VolumeRetypeWithoutMigrationTest-1208683717 None] Deleted volume successfully. Sep 06 06:32:42 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-5571974b-6d6c-4cf0-9de9-677e4522e14c tempest-VolumeRetypeWithoutMigrationTest-1208683717 None] Lock "cinder-4acdf4e9-0fbe-46c1-a171-b7e667b0eba9-delete_volume" released by "delete_volume" :: held 1.414s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:32:48 devstack cinder-volume[87329]: DEBUG oslo_service.periodic_task [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87329) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 06 06:32:48 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:32:48 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:32:48 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:32:48 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:32:48 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:32:48 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:32:48 devstack sudo[90171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:32:48 devstack sudo[90171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:32:48 devstack sudo[90171]: pam_unix(sudo:session): session closed for user root Sep 06 06:32:48 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.278s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:32:48 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:32:51 devstack cinder-volume[87329]: DEBUG dbcounter [-] [87329] Writing DB stats cinder:UPDATE=31,cinder:SELECT=35,cinder:INSERT=7,cinder:DELETE=2 {{(pid=87329) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 06:32:52 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [req-f935b9ce-0841-4b49-97de-9f8e4d6fcb6f req-0e278da0-da69-4926-8e6d-d1611b45fdb8 tempest-VolumesGetTestJSON-1515560047 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87329) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 06:32:52 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [req-f935b9ce-0841-4b49-97de-9f8e4d6fcb6f req-0e278da0-da69-4926-8e6d-d1611b45fdb8 tempest-VolumesGetTestJSON-1515560047 None] Flow 'volume_create_manager' (ae0363a5-95c9-41fa-a04a-c48758c13e6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:32:52 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [req-f935b9ce-0841-4b49-97de-9f8e4d6fcb6f req-0e278da0-da69-4926-8e6d-d1611b45fdb8 tempest-VolumesGetTestJSON-1515560047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05165a60-2e4b-4f41-9d63-30da423cf823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:32:52 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [req-f935b9ce-0841-4b49-97de-9f8e4d6fcb6f req-0e278da0-da69-4926-8e6d-d1611b45fdb8 tempest-VolumesGetTestJSON-1515560047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05165a60-2e4b-4f41-9d63-30da423cf823) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:32:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-488266964',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d01b413-5a72-4bd6-b857-22251e1398fa,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1dc24be8f70c49dc995774468b4b06eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:32:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:32:52Z,use_quota=True,user_id='c1eaf26c88f744f2b07954963d31efc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:32:52 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [req-f935b9ce-0841-4b49-97de-9f8e4d6fcb6f req-0e278da0-da69-4926-8e6d-d1611b45fdb8 tempest-VolumesGetTestJSON-1515560047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a860a9b-cae5-4f4f-895b-7b3ba14bad58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:32:52 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [req-f935b9ce-0841-4b49-97de-9f8e4d6fcb6f req-0e278da0-da69-4926-8e6d-d1611b45fdb8 tempest-VolumesGetTestJSON-1515560047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a860a9b-cae5-4f4f-895b-7b3ba14bad58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:32:52 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [req-f935b9ce-0841-4b49-97de-9f8e4d6fcb6f req-0e278da0-da69-4926-8e6d-d1611b45fdb8 tempest-VolumesGetTestJSON-1515560047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (430c1b39-00e4-4b7d-829e-0f5029c10aa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:32:52 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [req-f935b9ce-0841-4b49-97de-9f8e4d6fcb6f req-0e278da0-da69-4926-8e6d-d1611b45fdb8 tempest-VolumesGetTestJSON-1515560047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (430c1b39-00e4-4b7d-829e-0f5029c10aa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d01b413-5a72-4bd6-b857-22251e1398fa', 'volume_name': 'volume-1d01b413-5a72-4bd6-b857-22251e1398fa', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:32:52 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [req-f935b9ce-0841-4b49-97de-9f8e4d6fcb6f req-0e278da0-da69-4926-8e6d-d1611b45fdb8 tempest-VolumesGetTestJSON-1515560047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d94a523f-0c83-4e82-85bd-04907c2f75ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:32:52 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [req-f935b9ce-0841-4b49-97de-9f8e4d6fcb6f req-0e278da0-da69-4926-8e6d-d1611b45fdb8 tempest-VolumesGetTestJSON-1515560047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d94a523f-0c83-4e82-85bd-04907c2f75ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:32:52 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [req-f935b9ce-0841-4b49-97de-9f8e4d6fcb6f req-0e278da0-da69-4926-8e6d-d1611b45fdb8 tempest-VolumesGetTestJSON-1515560047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d22303f2-4d3d-409b-98ce-0fe49f31fd4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:32:52 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [req-f935b9ce-0841-4b49-97de-9f8e4d6fcb6f req-0e278da0-da69-4926-8e6d-d1611b45fdb8 tempest-VolumesGetTestJSON-1515560047 None] Volume 1d01b413-5a72-4bd6-b857-22251e1398fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d01b413-5a72-4bd6-b857-22251e1398fa', 'volume_size': 1} Sep 06 06:32:52 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [req-f935b9ce-0841-4b49-97de-9f8e4d6fcb6f req-0e278da0-da69-4926-8e6d-d1611b45fdb8 tempest-VolumesGetTestJSON-1515560047 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:32:52 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [req-f935b9ce-0841-4b49-97de-9f8e4d6fcb6f req-0e278da0-da69-4926-8e6d-d1611b45fdb8 tempest-VolumesGetTestJSON-1515560047 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:32:52 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [req-f935b9ce-0841-4b49-97de-9f8e4d6fcb6f req-0e278da0-da69-4926-8e6d-d1611b45fdb8 tempest-VolumesGetTestJSON-1515560047 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:32:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-488266964',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d01b413-5a72-4bd6-b857-22251e1398fa,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1dc24be8f70c49dc995774468b4b06eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:32:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:32:52Z,use_quota=True,user_id='c1eaf26c88f744f2b07954963d31efc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)}" {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 06:32:52 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [req-f935b9ce-0841-4b49-97de-9f8e4d6fcb6f req-0e278da0-da69-4926-8e6d-d1611b45fdb8 tempest-VolumesGetTestJSON-1515560047 None] Creating volume 1d01b413-5a72-4bd6-b857-22251e1398fa {{(pid=87329) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 06:32:52 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [req-f935b9ce-0841-4b49-97de-9f8e4d6fcb6f req-0e278da0-da69-4926-8e6d-d1611b45fdb8 tempest-VolumesGetTestJSON-1515560047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:32:52 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [req-f935b9ce-0841-4b49-97de-9f8e4d6fcb6f req-0e278da0-da69-4926-8e6d-d1611b45fdb8 tempest-VolumesGetTestJSON-1515560047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:32:52 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [req-f935b9ce-0841-4b49-97de-9f8e4d6fcb6f req-0e278da0-da69-4926-8e6d-d1611b45fdb8 tempest-VolumesGetTestJSON-1515560047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:32:52 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [req-f935b9ce-0841-4b49-97de-9f8e4d6fcb6f req-0e278da0-da69-4926-8e6d-d1611b45fdb8 tempest-VolumesGetTestJSON-1515560047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:32:52 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [req-f935b9ce-0841-4b49-97de-9f8e4d6fcb6f req-0e278da0-da69-4926-8e6d-d1611b45fdb8 tempest-VolumesGetTestJSON-1515560047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:32:52 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [req-f935b9ce-0841-4b49-97de-9f8e4d6fcb6f req-0e278da0-da69-4926-8e6d-d1611b45fdb8 tempest-VolumesGetTestJSON-1515560047 None] Selected osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 as target Quobyte volume. {{(pid=87329) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 06:32:52 devstack cinder-volume[87329]: INFO cinder.volume.drivers.remotefs [req-f935b9ce-0841-4b49-97de-9f8e4d6fcb6f req-0e278da0-da69-4926-8e6d-d1611b45fdb8 tempest-VolumesGetTestJSON-1515560047 None] casted to osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 Sep 06 06:32:52 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [req-f935b9ce-0841-4b49-97de-9f8e4d6fcb6f req-0e278da0-da69-4926-8e6d-d1611b45fdb8 tempest-VolumesGetTestJSON-1515560047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-1d01b413-5a72-4bd6-b857-22251e1398fa 1073741824 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:32:52 devstack sudo[90246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-1d01b413-5a72-4bd6-b857-22251e1398fa 1073741824 Sep 06 06:32:52 devstack sudo[90246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:32:53 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-465505c2-2502-4523-bcd5-8a98f779dc88 tempest-TaggedAttachmentsTest-96049891 None] Acquiring lock "cinder-da67c52e-4b18-405c-af7f-bd77d73bc19f-delete_volume" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:32:53 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-465505c2-2502-4523-bcd5-8a98f779dc88 tempest-TaggedAttachmentsTest-96049891 None] Lock "cinder-da67c52e-4b18-405c-af7f-bd77d73bc19f-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:32:53 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-465505c2-2502-4523-bcd5-8a98f779dc88 tempest-TaggedAttachmentsTest-96049891 None] Acquiring lock "cinder-quobyte-da67c52e-4b18-405c-af7f-bd77d73bc19f" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:32:53 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-465505c2-2502-4523-bcd5-8a98f779dc88 tempest-TaggedAttachmentsTest-96049891 None] Lock "cinder-quobyte-da67c52e-4b18-405c-af7f-bd77d73bc19f" acquired by "delete_volume" :: waited 0.043s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:32:53 devstack sudo[90246]: pam_unix(sudo:session): session closed for user root Sep 06 06:32:53 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [req-f935b9ce-0841-4b49-97de-9f8e4d6fcb6f req-0e278da0-da69-4926-8e6d-d1611b45fdb8 tempest-VolumesGetTestJSON-1515560047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-1d01b413-5a72-4bd6-b857-22251e1398fa 1073741824" returned: 0 in 0.889s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:32:53 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6084429-deff-44f6-8bf3-0dd81de1c0de]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:32:53 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-465505c2-2502-4523-bcd5-8a98f779dc88 tempest-TaggedAttachmentsTest-96049891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-da67c52e-4b18-405c-af7f-bd77d73bc19f {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:32:53 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [req-f935b9ce-0841-4b49-97de-9f8e4d6fcb6f req-0e278da0-da69-4926-8e6d-d1611b45fdb8 tempest-VolumesGetTestJSON-1515560047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-1d01b413-5a72-4bd6-b857-22251e1398fa {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:32:53 devstack sudo[90256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-1d01b413-5a72-4bd6-b857-22251e1398fa Sep 06 06:32:53 devstack sudo[90256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:32:53 devstack sudo[90255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-da67c52e-4b18-405c-af7f-bd77d73bc19f Sep 06 06:32:53 devstack sudo[90255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:32:53 devstack sudo[90256]: pam_unix(sudo:session): session closed for user root Sep 06 06:32:53 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [req-f935b9ce-0841-4b49-97de-9f8e4d6fcb6f req-0e278da0-da69-4926-8e6d-d1611b45fdb8 tempest-VolumesGetTestJSON-1515560047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-1d01b413-5a72-4bd6-b857-22251e1398fa" returned: 0 in 0.354s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:32:53 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [req-f935b9ce-0841-4b49-97de-9f8e4d6fcb6f req-0e278da0-da69-4926-8e6d-d1611b45fdb8 tempest-VolumesGetTestJSON-1515560047 None] <== create_volume: return (1357ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'} {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 06:32:53 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [req-f935b9ce-0841-4b49-97de-9f8e4d6fcb6f req-0e278da0-da69-4926-8e6d-d1611b45fdb8 tempest-VolumesGetTestJSON-1515560047 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.368s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:32:53 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [req-f935b9ce-0841-4b49-97de-9f8e4d6fcb6f req-0e278da0-da69-4926-8e6d-d1611b45fdb8 tempest-VolumesGetTestJSON-1515560047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d22303f2-4d3d-409b-98ce-0fe49f31fd4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d01b413-5a72-4bd6-b857-22251e1398fa', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:32:53 devstack sudo[90255]: pam_unix(sudo:session): session closed for user root Sep 06 06:32:53 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [req-f935b9ce-0841-4b49-97de-9f8e4d6fcb6f req-0e278da0-da69-4926-8e6d-d1611b45fdb8 tempest-VolumesGetTestJSON-1515560047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad67022f-7b53-450b-9cd1-cc453339a113) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:32:53 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-465505c2-2502-4523-bcd5-8a98f779dc88 tempest-TaggedAttachmentsTest-96049891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-da67c52e-4b18-405c-af7f-bd77d73bc19f" returned: 0 in 0.512s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:32:53 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-465505c2-2502-4523-bcd5-8a98f779dc88 tempest-TaggedAttachmentsTest-96049891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-da67c52e-4b18-405c-af7f-bd77d73bc19f {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:32:53 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [req-f935b9ce-0841-4b49-97de-9f8e4d6fcb6f req-0e278da0-da69-4926-8e6d-d1611b45fdb8 tempest-VolumesGetTestJSON-1515560047 None] Volume volume-1d01b413-5a72-4bd6-b857-22251e1398fa (1d01b413-5a72-4bd6-b857-22251e1398fa): created successfully Sep 06 06:32:53 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [req-f935b9ce-0841-4b49-97de-9f8e4d6fcb6f req-0e278da0-da69-4926-8e6d-d1611b45fdb8 tempest-VolumesGetTestJSON-1515560047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad67022f-7b53-450b-9cd1-cc453339a113) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:32:53 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [req-f935b9ce-0841-4b49-97de-9f8e4d6fcb6f req-0e278da0-da69-4926-8e6d-d1611b45fdb8 tempest-VolumesGetTestJSON-1515560047 None] Flow 'volume_create_manager' (ae0363a5-95c9-41fa-a04a-c48758c13e6c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:32:53 devstack sudo[90264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-da67c52e-4b18-405c-af7f-bd77d73bc19f Sep 06 06:32:53 devstack sudo[90264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:32:53 devstack cinder-volume[87329]: INFO cinder.volume.manager [req-f935b9ce-0841-4b49-97de-9f8e4d6fcb6f req-0e278da0-da69-4926-8e6d-d1611b45fdb8 tempest-VolumesGetTestJSON-1515560047 None] Created volume successfully. Sep 06 06:32:54 devstack sudo[90264]: pam_unix(sudo:session): session closed for user root Sep 06 06:32:54 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-465505c2-2502-4523-bcd5-8a98f779dc88 tempest-TaggedAttachmentsTest-96049891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-da67c52e-4b18-405c-af7f-bd77d73bc19f" returned: 0 in 0.361s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:32:54 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-465505c2-2502-4523-bcd5-8a98f779dc88 tempest-TaggedAttachmentsTest-96049891 None] Lock "cinder-quobyte-da67c52e-4b18-405c-af7f-bd77d73bc19f" released by "delete_volume" :: held 0.942s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:32:54 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-465505c2-2502-4523-bcd5-8a98f779dc88 tempest-TaggedAttachmentsTest-96049891 None] Created reservations ['3d6fbe87-df9d-409e-b0c5-982a5139a1f1', 'eb3c2627-c300-482a-a33a-051827de1964', '2fcec3b4-3d1b-4dd5-af9c-f38d5c30f6ad', '9b057681-3ee7-4ce8-a02a-9fcd3cee7b1e'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:32:54 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-465505c2-2502-4523-bcd5-8a98f779dc88 tempest-TaggedAttachmentsTest-96049891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:32:54 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-465505c2-2502-4523-bcd5-8a98f779dc88 tempest-TaggedAttachmentsTest-96049891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:32:54 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-465505c2-2502-4523-bcd5-8a98f779dc88 tempest-TaggedAttachmentsTest-96049891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:32:54 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-465505c2-2502-4523-bcd5-8a98f779dc88 tempest-TaggedAttachmentsTest-96049891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:32:54 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-465505c2-2502-4523-bcd5-8a98f779dc88 tempest-TaggedAttachmentsTest-96049891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:32:54 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-465505c2-2502-4523-bcd5-8a98f779dc88 tempest-TaggedAttachmentsTest-96049891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:32:54 devstack sudo[90267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:32:54 devstack sudo[90267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:32:54 devstack sudo[90267]: pam_unix(sudo:session): session closed for user root Sep 06 06:32:54 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-465505c2-2502-4523-bcd5-8a98f779dc88 tempest-TaggedAttachmentsTest-96049891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.384s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:32:54 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-465505c2-2502-4523-bcd5-8a98f779dc88 tempest-TaggedAttachmentsTest-96049891 None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:32:54 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-465505c2-2502-4523-bcd5-8a98f779dc88 tempest-TaggedAttachmentsTest-96049891 None] Deleted volume successfully. Sep 06 06:32:54 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-465505c2-2502-4523-bcd5-8a98f779dc88 tempest-TaggedAttachmentsTest-96049891 None] Lock "cinder-da67c52e-4b18-405c-af7f-bd77d73bc19f-delete_volume" released by "delete_volume" :: held 1.644s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:32:55 devstack cinder-volume[87329]: DEBUG cinder.coordination [req-4f9d2086-3b90-4a06-95c4-289d267c088c req-fb2d89c3-529e-469e-bcfa-1d7720614bc5 tempest-VolumesGetTestJSON-1515560047 None] Acquiring lock "cinder-1d01b413-5a72-4bd6-b857-22251e1398fa-delete_volume" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:32:55 devstack cinder-volume[87329]: DEBUG cinder.coordination [req-4f9d2086-3b90-4a06-95c4-289d267c088c req-fb2d89c3-529e-469e-bcfa-1d7720614bc5 tempest-VolumesGetTestJSON-1515560047 None] Lock "cinder-1d01b413-5a72-4bd6-b857-22251e1398fa-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:32:55 devstack cinder-volume[87329]: DEBUG cinder.coordination [req-4f9d2086-3b90-4a06-95c4-289d267c088c req-fb2d89c3-529e-469e-bcfa-1d7720614bc5 tempest-VolumesGetTestJSON-1515560047 None] Acquiring lock "cinder-quobyte-1d01b413-5a72-4bd6-b857-22251e1398fa" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:32:55 devstack cinder-volume[87329]: DEBUG cinder.coordination [req-4f9d2086-3b90-4a06-95c4-289d267c088c req-fb2d89c3-529e-469e-bcfa-1d7720614bc5 tempest-VolumesGetTestJSON-1515560047 None] Lock "cinder-quobyte-1d01b413-5a72-4bd6-b857-22251e1398fa" acquired by "delete_volume" :: waited 0.027s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:32:55 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[76915a8c-64e3-436d-bb5d-d2e61d0104e0]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:32:55 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [req-4f9d2086-3b90-4a06-95c4-289d267c088c req-fb2d89c3-529e-469e-bcfa-1d7720614bc5 tempest-VolumesGetTestJSON-1515560047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-1d01b413-5a72-4bd6-b857-22251e1398fa {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:32:55 devstack sudo[90273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-1d01b413-5a72-4bd6-b857-22251e1398fa Sep 06 06:32:55 devstack sudo[90273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:32:55 devstack sudo[90273]: pam_unix(sudo:session): session closed for user root Sep 06 06:32:55 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [req-4f9d2086-3b90-4a06-95c4-289d267c088c req-fb2d89c3-529e-469e-bcfa-1d7720614bc5 tempest-VolumesGetTestJSON-1515560047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-1d01b413-5a72-4bd6-b857-22251e1398fa" returned: 0 in 0.498s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:32:55 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [req-4f9d2086-3b90-4a06-95c4-289d267c088c req-fb2d89c3-529e-469e-bcfa-1d7720614bc5 tempest-VolumesGetTestJSON-1515560047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-1d01b413-5a72-4bd6-b857-22251e1398fa {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:32:55 devstack sudo[90279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-1d01b413-5a72-4bd6-b857-22251e1398fa Sep 06 06:32:55 devstack sudo[90279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:32:56 devstack sudo[90279]: pam_unix(sudo:session): session closed for user root Sep 06 06:32:56 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [req-4f9d2086-3b90-4a06-95c4-289d267c088c req-fb2d89c3-529e-469e-bcfa-1d7720614bc5 tempest-VolumesGetTestJSON-1515560047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-1d01b413-5a72-4bd6-b857-22251e1398fa" returned: 0 in 0.432s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:32:56 devstack cinder-volume[87329]: DEBUG cinder.coordination [req-4f9d2086-3b90-4a06-95c4-289d267c088c req-fb2d89c3-529e-469e-bcfa-1d7720614bc5 tempest-VolumesGetTestJSON-1515560047 None] Lock "cinder-quobyte-1d01b413-5a72-4bd6-b857-22251e1398fa" released by "delete_volume" :: held 0.996s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:32:56 devstack cinder-volume[87329]: DEBUG cinder.quota [req-4f9d2086-3b90-4a06-95c4-289d267c088c req-fb2d89c3-529e-469e-bcfa-1d7720614bc5 tempest-VolumesGetTestJSON-1515560047 None] Created reservations ['306565b0-b77a-47e5-bdee-81b459ae1b4a', '8c433f4f-ea8c-4ec5-b3c4-b2e428b3004f', '7d6c4ac1-924b-4c7c-8e26-65bb538861d5', 'b2f25afe-5642-4382-8ad0-3d839465c52c'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:32:56 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [req-4f9d2086-3b90-4a06-95c4-289d267c088c req-fb2d89c3-529e-469e-bcfa-1d7720614bc5 tempest-VolumesGetTestJSON-1515560047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:32:56 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [req-4f9d2086-3b90-4a06-95c4-289d267c088c req-fb2d89c3-529e-469e-bcfa-1d7720614bc5 tempest-VolumesGetTestJSON-1515560047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:32:56 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [req-4f9d2086-3b90-4a06-95c4-289d267c088c req-fb2d89c3-529e-469e-bcfa-1d7720614bc5 tempest-VolumesGetTestJSON-1515560047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:32:56 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [req-4f9d2086-3b90-4a06-95c4-289d267c088c req-fb2d89c3-529e-469e-bcfa-1d7720614bc5 tempest-VolumesGetTestJSON-1515560047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:32:56 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [req-4f9d2086-3b90-4a06-95c4-289d267c088c req-fb2d89c3-529e-469e-bcfa-1d7720614bc5 tempest-VolumesGetTestJSON-1515560047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:32:56 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [req-4f9d2086-3b90-4a06-95c4-289d267c088c req-fb2d89c3-529e-469e-bcfa-1d7720614bc5 tempest-VolumesGetTestJSON-1515560047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:32:56 devstack sudo[90288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:32:56 devstack sudo[90288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:32:56 devstack sudo[90288]: pam_unix(sudo:session): session closed for user root Sep 06 06:32:56 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [req-4f9d2086-3b90-4a06-95c4-289d267c088c req-fb2d89c3-529e-469e-bcfa-1d7720614bc5 tempest-VolumesGetTestJSON-1515560047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.351s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:32:56 devstack cinder-volume[87329]: DEBUG cinder.manager [req-4f9d2086-3b90-4a06-95c4-289d267c088c req-fb2d89c3-529e-469e-bcfa-1d7720614bc5 tempest-VolumesGetTestJSON-1515560047 None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:32:56 devstack cinder-volume[87329]: INFO cinder.volume.manager [req-4f9d2086-3b90-4a06-95c4-289d267c088c req-fb2d89c3-529e-469e-bcfa-1d7720614bc5 tempest-VolumesGetTestJSON-1515560047 None] Deleted volume successfully. Sep 06 06:32:56 devstack cinder-volume[87329]: DEBUG cinder.coordination [req-4f9d2086-3b90-4a06-95c4-289d267c088c req-fb2d89c3-529e-469e-bcfa-1d7720614bc5 tempest-VolumesGetTestJSON-1515560047 None] Lock "cinder-1d01b413-5a72-4bd6-b857-22251e1398fa-delete_volume" released by "delete_volume" :: held 1.699s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:33:04 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-51c7d386-c385-48b2-98fa-e819b41800e3 tempest-GroupSnapshotsTest-1381895959 None] Group tempest-GroupSnapshotsTest-Group-131597594: creating Sep 06 06:33:04 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-51c7d386-c385-48b2-98fa-e819b41800e3 tempest-GroupSnapshotsTest-1381895959 None] Group tempest-GroupSnapshotsTest-Group-131597594: created successfully Sep 06 06:33:04 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-51c7d386-c385-48b2-98fa-e819b41800e3 tempest-GroupSnapshotsTest-1381895959 None] Create group completed successfully. Sep 06 06:33:06 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce298f12-cbe1-4d2a-b831-9d6e3e9d3dd5 tempest-GroupSnapshotsTest-1381895959 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87329) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 06:33:06 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-ce298f12-cbe1-4d2a-b831-9d6e3e9d3dd5 tempest-GroupSnapshotsTest-1381895959 None] Flow 'volume_create_manager' (3b07d583-1e1c-4d7b-8613-d4a97be0fe18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:33:06 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-ce298f12-cbe1-4d2a-b831-9d6e3e9d3dd5 tempest-GroupSnapshotsTest-1381895959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38fb5e66-587b-4d2a-825e-07f4335b9aee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:33:06 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-ce298f12-cbe1-4d2a-b831-9d6e3e9d3dd5 tempest-GroupSnapshotsTest-1381895959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38fb5e66-587b-4d2a-825e-07f4335b9aee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:33:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1042608462',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9af147a7-e73e-4a15-81ec-480bc9119526,host='devstack@QuobyteHD#QuobyteHD',id=9996d60e-ea00-49a3-a6eb-1456ded75600,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be1988e2a2c84f20ab9ef621b3b61699',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:33:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:33:06Z,use_quota=True,user_id='79054ac364294b7d9a926ce72e15dde0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0442d23-76c3-496f-ab6c-88d96fc21e22),volume_type_id=b0442d23-76c3-496f-ab6c-88d96fc21e22)' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:33:06 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-ce298f12-cbe1-4d2a-b831-9d6e3e9d3dd5 tempest-GroupSnapshotsTest-1381895959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2352d87-3143-4e2d-9caa-ac61daf9577f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:33:06 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-ce298f12-cbe1-4d2a-b831-9d6e3e9d3dd5 tempest-GroupSnapshotsTest-1381895959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2352d87-3143-4e2d-9caa-ac61daf9577f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:33:06 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-ce298f12-cbe1-4d2a-b831-9d6e3e9d3dd5 tempest-GroupSnapshotsTest-1381895959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90008cf7-32c0-4486-82ef-4cbbbb3aa29e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:33:06 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-ce298f12-cbe1-4d2a-b831-9d6e3e9d3dd5 tempest-GroupSnapshotsTest-1381895959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90008cf7-32c0-4486-82ef-4cbbbb3aa29e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9996d60e-ea00-49a3-a6eb-1456ded75600', 'volume_name': 'volume-9996d60e-ea00-49a3-a6eb-1456ded75600', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:33:06 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-ce298f12-cbe1-4d2a-b831-9d6e3e9d3dd5 tempest-GroupSnapshotsTest-1381895959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dece628f-4b06-4735-83ad-b2047fe77f55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:33:06 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-ce298f12-cbe1-4d2a-b831-9d6e3e9d3dd5 tempest-GroupSnapshotsTest-1381895959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dece628f-4b06-4735-83ad-b2047fe77f55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:33:06 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-ce298f12-cbe1-4d2a-b831-9d6e3e9d3dd5 tempest-GroupSnapshotsTest-1381895959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (042b6407-e392-4021-a0a1-d9f07e63c0be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:33:06 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-ce298f12-cbe1-4d2a-b831-9d6e3e9d3dd5 tempest-GroupSnapshotsTest-1381895959 None] Volume 9996d60e-ea00-49a3-a6eb-1456ded75600: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9996d60e-ea00-49a3-a6eb-1456ded75600', 'volume_size': 1} Sep 06 06:33:06 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-ce298f12-cbe1-4d2a-b831-9d6e3e9d3dd5 tempest-GroupSnapshotsTest-1381895959 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:33:06 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-ce298f12-cbe1-4d2a-b831-9d6e3e9d3dd5 tempest-GroupSnapshotsTest-1381895959 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:33:06 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-ce298f12-cbe1-4d2a-b831-9d6e3e9d3dd5 tempest-GroupSnapshotsTest-1381895959 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=9af147a7-e73e-4a15-81ec-480bc9119526,created_at=2026-09-06T04:33:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1042608462',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9af147a7-e73e-4a15-81ec-480bc9119526,host='devstack@QuobyteHD#QuobyteHD',id=9996d60e-ea00-49a3-a6eb-1456ded75600,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be1988e2a2c84f20ab9ef621b3b61699',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:33:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:33:06Z,use_quota=True,user_id='79054ac364294b7d9a926ce72e15dde0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0442d23-76c3-496f-ab6c-88d96fc21e22),volume_type_id=b0442d23-76c3-496f-ab6c-88d96fc21e22)}" {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 06:33:06 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-ce298f12-cbe1-4d2a-b831-9d6e3e9d3dd5 tempest-GroupSnapshotsTest-1381895959 None] Creating volume 9996d60e-ea00-49a3-a6eb-1456ded75600 {{(pid=87329) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 06:33:06 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-ce298f12-cbe1-4d2a-b831-9d6e3e9d3dd5 tempest-GroupSnapshotsTest-1381895959 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:33:06 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-ce298f12-cbe1-4d2a-b831-9d6e3e9d3dd5 tempest-GroupSnapshotsTest-1381895959 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:33:06 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-ce298f12-cbe1-4d2a-b831-9d6e3e9d3dd5 tempest-GroupSnapshotsTest-1381895959 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:33:06 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-ce298f12-cbe1-4d2a-b831-9d6e3e9d3dd5 tempest-GroupSnapshotsTest-1381895959 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:33:06 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-ce298f12-cbe1-4d2a-b831-9d6e3e9d3dd5 tempest-GroupSnapshotsTest-1381895959 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:33:06 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-ce298f12-cbe1-4d2a-b831-9d6e3e9d3dd5 tempest-GroupSnapshotsTest-1381895959 None] Selected osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 as target Quobyte volume. {{(pid=87329) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 06:33:06 devstack cinder-volume[87329]: INFO cinder.volume.drivers.remotefs [None req-ce298f12-cbe1-4d2a-b831-9d6e3e9d3dd5 tempest-GroupSnapshotsTest-1381895959 None] casted to osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 Sep 06 06:33:06 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-ce298f12-cbe1-4d2a-b831-9d6e3e9d3dd5 tempest-GroupSnapshotsTest-1381895959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-9996d60e-ea00-49a3-a6eb-1456ded75600 1073741824 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:33:06 devstack sudo[90325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-9996d60e-ea00-49a3-a6eb-1456ded75600 1073741824 Sep 06 06:33:06 devstack sudo[90325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:33:06 devstack sudo[90325]: pam_unix(sudo:session): session closed for user root Sep 06 06:33:06 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-ce298f12-cbe1-4d2a-b831-9d6e3e9d3dd5 tempest-GroupSnapshotsTest-1381895959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-9996d60e-ea00-49a3-a6eb-1456ded75600 1073741824" returned: 0 in 0.463s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:33:07 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-ce298f12-cbe1-4d2a-b831-9d6e3e9d3dd5 tempest-GroupSnapshotsTest-1381895959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-9996d60e-ea00-49a3-a6eb-1456ded75600 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:33:07 devstack sudo[90331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-9996d60e-ea00-49a3-a6eb-1456ded75600 Sep 06 06:33:07 devstack sudo[90331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:33:07 devstack sudo[90331]: pam_unix(sudo:session): session closed for user root Sep 06 06:33:07 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-ce298f12-cbe1-4d2a-b831-9d6e3e9d3dd5 tempest-GroupSnapshotsTest-1381895959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-9996d60e-ea00-49a3-a6eb-1456ded75600" returned: 0 in 0.244s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:33:07 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-ce298f12-cbe1-4d2a-b831-9d6e3e9d3dd5 tempest-GroupSnapshotsTest-1381895959 None] <== create_volume: return (776ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'} {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 06:33:07 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-ce298f12-cbe1-4d2a-b831-9d6e3e9d3dd5 tempest-GroupSnapshotsTest-1381895959 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.778s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:33:07 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-ce298f12-cbe1-4d2a-b831-9d6e3e9d3dd5 tempest-GroupSnapshotsTest-1381895959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (042b6407-e392-4021-a0a1-d9f07e63c0be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9996d60e-ea00-49a3-a6eb-1456ded75600', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:33:07 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-ce298f12-cbe1-4d2a-b831-9d6e3e9d3dd5 tempest-GroupSnapshotsTest-1381895959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51a9b85a-d991-4c69-9e9c-5138eb0aa0a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:33:07 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-ce298f12-cbe1-4d2a-b831-9d6e3e9d3dd5 tempest-GroupSnapshotsTest-1381895959 None] Volume volume-9996d60e-ea00-49a3-a6eb-1456ded75600 (9996d60e-ea00-49a3-a6eb-1456ded75600): created successfully Sep 06 06:33:07 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-ce298f12-cbe1-4d2a-b831-9d6e3e9d3dd5 tempest-GroupSnapshotsTest-1381895959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51a9b85a-d991-4c69-9e9c-5138eb0aa0a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:33:07 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-ce298f12-cbe1-4d2a-b831-9d6e3e9d3dd5 tempest-GroupSnapshotsTest-1381895959 None] Flow 'volume_create_manager' (3b07d583-1e1c-4d7b-8613-d4a97be0fe18) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:33:07 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-ce298f12-cbe1-4d2a-b831-9d6e3e9d3dd5 tempest-GroupSnapshotsTest-1381895959 None] Created volume successfully. Sep 06 06:33:08 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-a517c12c-1cac-4174-875b-b0634523ee16 tempest-GroupSnapshotsTest-1381895959 None] GroupSnapshot 40003a9d-8b5a-49dd-89ab-909fbdc61561: creating. Sep 06 06:33:08 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-a517c12c-1cac-4174-875b-b0634523ee16 tempest-GroupSnapshotsTest-1381895959 None] Group snapshot 40003a9d-8b5a-49dd-89ab-909fbdc61561: creating. {{(pid=87329) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 06 06:33:08 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-a517c12c-1cac-4174-875b-b0634523ee16 tempest-GroupSnapshotsTest-1381895959 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:33:08 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-a517c12c-1cac-4174-875b-b0634523ee16 tempest-GroupSnapshotsTest-1381895959 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:33:08 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-a517c12c-1cac-4174-875b-b0634523ee16 tempest-GroupSnapshotsTest-1381895959 None] Creating offline snapshot 403a65da-371f-4d53-9892-8bca8bd9d7ff of volume 9996d60e-ea00-49a3-a6eb-1456ded75600 {{(pid=87329) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 06 06:33:08 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[059faab2-5b4c-4899-923e-84a18e5ef5ad]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:33:08 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-a517c12c-1cac-4174-875b-b0634523ee16 tempest-GroupSnapshotsTest-1381895959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-9996d60e-ea00-49a3-a6eb-1456ded75600 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:33:08 devstack sudo[90334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-9996d60e-ea00-49a3-a6eb-1456ded75600 Sep 06 06:33:08 devstack sudo[90334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:33:08 devstack sudo[90334]: pam_unix(sudo:session): session closed for user root Sep 06 06:33:08 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-a517c12c-1cac-4174-875b-b0634523ee16 tempest-GroupSnapshotsTest-1381895959 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-9996d60e-ea00-49a3-a6eb-1456ded75600" returned: 0 in 0.419s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:33:08 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-a517c12c-1cac-4174-875b-b0634523ee16 tempest-GroupSnapshotsTest-1381895959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-9996d60e-ea00-49a3-a6eb-1456ded75600,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-9996d60e-ea00-49a3-a6eb-1456ded75600.403a65da-371f-4d53-9892-8bca8bd9d7ff 1G {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:33:08 devstack sudo[90339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-9996d60e-ea00-49a3-a6eb-1456ded75600,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-9996d60e-ea00-49a3-a6eb-1456ded75600.403a65da-371f-4d53-9892-8bca8bd9d7ff 1G Sep 06 06:33:08 devstack sudo[90339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:33:08 devstack sudo[90339]: pam_unix(sudo:session): session closed for user root Sep 06 06:33:08 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-a517c12c-1cac-4174-875b-b0634523ee16 tempest-GroupSnapshotsTest-1381895959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-9996d60e-ea00-49a3-a6eb-1456ded75600,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-9996d60e-ea00-49a3-a6eb-1456ded75600.403a65da-371f-4d53-9892-8bca8bd9d7ff 1G" returned: 0 in 0.429s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:33:08 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-a517c12c-1cac-4174-875b-b0634523ee16 tempest-GroupSnapshotsTest-1381895959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9996d60e-ea00-49a3-a6eb-1456ded75600 -F qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-9996d60e-ea00-49a3-a6eb-1456ded75600.403a65da-371f-4d53-9892-8bca8bd9d7ff {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:33:08 devstack sudo[90345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9996d60e-ea00-49a3-a6eb-1456ded75600 -F qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-9996d60e-ea00-49a3-a6eb-1456ded75600.403a65da-371f-4d53-9892-8bca8bd9d7ff Sep 06 06:33:08 devstack sudo[90345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:33:09 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-58b6de30-7c4e-42fd-8708-554fdc87dbb2 tempest-VolumesMetadataTest-1267468473 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87329) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 06:33:09 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-58b6de30-7c4e-42fd-8708-554fdc87dbb2 tempest-VolumesMetadataTest-1267468473 None] Flow 'volume_create_manager' (834c0dfc-ff06-41bc-a4f6-4321f11ce623) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:33:09 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-58b6de30-7c4e-42fd-8708-554fdc87dbb2 tempest-VolumesMetadataTest-1267468473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ae9bb4e-e924-4267-883a-2eecb55f450b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:33:09 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-58b6de30-7c4e-42fd-8708-554fdc87dbb2 tempest-VolumesMetadataTest-1267468473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ae9bb4e-e924-4267-883a-2eecb55f450b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:33:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-182733958',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bddc4999-6467-4878-90ec-24a0f26e3083,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e373644278564f1f8ce18dd87941216b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:33:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:33:09Z,use_quota=True,user_id='330a61edd41a4de285f0299754e1ca0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:33:09 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-58b6de30-7c4e-42fd-8708-554fdc87dbb2 tempest-VolumesMetadataTest-1267468473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (832b18ee-ad76-4471-aeca-4545644b6d27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:33:09 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-58b6de30-7c4e-42fd-8708-554fdc87dbb2 tempest-VolumesMetadataTest-1267468473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (832b18ee-ad76-4471-aeca-4545644b6d27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:33:09 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-58b6de30-7c4e-42fd-8708-554fdc87dbb2 tempest-VolumesMetadataTest-1267468473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bfd9e68-6dc7-45c9-80bc-d55076a5357c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:33:09 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-58b6de30-7c4e-42fd-8708-554fdc87dbb2 tempest-VolumesMetadataTest-1267468473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bfd9e68-6dc7-45c9-80bc-d55076a5357c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bddc4999-6467-4878-90ec-24a0f26e3083', 'volume_name': 'volume-bddc4999-6467-4878-90ec-24a0f26e3083', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:33:09 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-58b6de30-7c4e-42fd-8708-554fdc87dbb2 tempest-VolumesMetadataTest-1267468473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f3e2f72-fafd-443a-b6f6-aacc524feaf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:33:09 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-58b6de30-7c4e-42fd-8708-554fdc87dbb2 tempest-VolumesMetadataTest-1267468473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f3e2f72-fafd-443a-b6f6-aacc524feaf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:33:09 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-58b6de30-7c4e-42fd-8708-554fdc87dbb2 tempest-VolumesMetadataTest-1267468473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fef1dec-00e6-4045-8afa-cacab1f22413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:33:09 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-58b6de30-7c4e-42fd-8708-554fdc87dbb2 tempest-VolumesMetadataTest-1267468473 None] Volume bddc4999-6467-4878-90ec-24a0f26e3083: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bddc4999-6467-4878-90ec-24a0f26e3083', 'volume_size': 1} Sep 06 06:33:09 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-58b6de30-7c4e-42fd-8708-554fdc87dbb2 tempest-VolumesMetadataTest-1267468473 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:33:09 devstack sudo[90345]: pam_unix(sudo:session): session closed for user root Sep 06 06:33:09 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-a517c12c-1cac-4174-875b-b0634523ee16 tempest-GroupSnapshotsTest-1381895959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9996d60e-ea00-49a3-a6eb-1456ded75600 -F qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-9996d60e-ea00-49a3-a6eb-1456ded75600.403a65da-371f-4d53-9892-8bca8bd9d7ff" returned: 0 in 0.372s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:33:09 devstack cinder-volume[87329]: WARNING cinder.volume.drivers.remotefs [None req-a517c12c-1cac-4174-875b-b0634523ee16 tempest-GroupSnapshotsTest-1381895959 None] /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-9996d60e-ea00-49a3-a6eb-1456ded75600.403a65da-371f-4d53-9892-8bca8bd9d7ff is being set with open permissions: ugo+rw: NotImplementedError Sep 06 06:33:09 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-a517c12c-1cac-4174-875b-b0634523ee16 tempest-GroupSnapshotsTest-1381895959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-9996d60e-ea00-49a3-a6eb-1456ded75600.403a65da-371f-4d53-9892-8bca8bd9d7ff {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:33:09 devstack sudo[90351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-9996d60e-ea00-49a3-a6eb-1456ded75600.403a65da-371f-4d53-9892-8bca8bd9d7ff Sep 06 06:33:09 devstack sudo[90351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:33:09 devstack sudo[90351]: pam_unix(sudo:session): session closed for user root Sep 06 06:33:09 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-a517c12c-1cac-4174-875b-b0634523ee16 tempest-GroupSnapshotsTest-1381895959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-9996d60e-ea00-49a3-a6eb-1456ded75600.403a65da-371f-4d53-9892-8bca8bd9d7ff" returned: 0 in 0.274s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:33:09 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-a517c12c-1cac-4174-875b-b0634523ee16 tempest-GroupSnapshotsTest-1381895959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-9996d60e-ea00-49a3-a6eb-1456ded75600.info {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:33:09 devstack sudo[90354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-9996d60e-ea00-49a3-a6eb-1456ded75600.info Sep 06 06:33:09 devstack sudo[90354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:33:09 devstack sudo[90354]: pam_unix(sudo:session): session closed for user root Sep 06 06:33:09 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-a517c12c-1cac-4174-875b-b0634523ee16 tempest-GroupSnapshotsTest-1381895959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-9996d60e-ea00-49a3-a6eb-1456ded75600.info" returned: 0 in 0.250s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:33:09 devstack cinder-volume[87329]: WARNING cinder.volume.drivers.remotefs [None req-a517c12c-1cac-4174-875b-b0634523ee16 tempest-GroupSnapshotsTest-1381895959 None] /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-9996d60e-ea00-49a3-a6eb-1456ded75600.info is being set with open permissions: ugo+rw: NotImplementedError Sep 06 06:33:09 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-a517c12c-1cac-4174-875b-b0634523ee16 tempest-GroupSnapshotsTest-1381895959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-9996d60e-ea00-49a3-a6eb-1456ded75600.info {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:33:09 devstack sudo[90357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-9996d60e-ea00-49a3-a6eb-1456ded75600.info Sep 06 06:33:09 devstack sudo[90357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:33:10 devstack sudo[90357]: pam_unix(sudo:session): session closed for user root Sep 06 06:33:10 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-a517c12c-1cac-4174-875b-b0634523ee16 tempest-GroupSnapshotsTest-1381895959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-9996d60e-ea00-49a3-a6eb-1456ded75600.info" returned: 0 in 0.295s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:33:10 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-a517c12c-1cac-4174-875b-b0634523ee16 tempest-GroupSnapshotsTest-1381895959 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.132s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:33:10 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-58b6de30-7c4e-42fd-8708-554fdc87dbb2 tempest-VolumesMetadataTest-1267468473 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.906s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:33:10 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-58b6de30-7c4e-42fd-8708-554fdc87dbb2 tempest-VolumesMetadataTest-1267468473 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:33:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-182733958',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bddc4999-6467-4878-90ec-24a0f26e3083,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e373644278564f1f8ce18dd87941216b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:33:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:33:09Z,use_quota=True,user_id='330a61edd41a4de285f0299754e1ca0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)}" {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 06:33:10 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-58b6de30-7c4e-42fd-8708-554fdc87dbb2 tempest-VolumesMetadataTest-1267468473 None] Creating volume bddc4999-6467-4878-90ec-24a0f26e3083 {{(pid=87329) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 06:33:10 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-58b6de30-7c4e-42fd-8708-554fdc87dbb2 tempest-VolumesMetadataTest-1267468473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:33:10 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-58b6de30-7c4e-42fd-8708-554fdc87dbb2 tempest-VolumesMetadataTest-1267468473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:33:10 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-58b6de30-7c4e-42fd-8708-554fdc87dbb2 tempest-VolumesMetadataTest-1267468473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:33:10 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-58b6de30-7c4e-42fd-8708-554fdc87dbb2 tempest-VolumesMetadataTest-1267468473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:33:10 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-58b6de30-7c4e-42fd-8708-554fdc87dbb2 tempest-VolumesMetadataTest-1267468473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:33:10 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-58b6de30-7c4e-42fd-8708-554fdc87dbb2 tempest-VolumesMetadataTest-1267468473 None] Selected osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 as target Quobyte volume. {{(pid=87329) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 06:33:10 devstack cinder-volume[87329]: INFO cinder.volume.drivers.remotefs [None req-58b6de30-7c4e-42fd-8708-554fdc87dbb2 tempest-VolumesMetadataTest-1267468473 None] casted to osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 Sep 06 06:33:10 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-58b6de30-7c4e-42fd-8708-554fdc87dbb2 tempest-VolumesMetadataTest-1267468473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bddc4999-6467-4878-90ec-24a0f26e3083 1073741824 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:33:10 devstack sudo[90360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bddc4999-6467-4878-90ec-24a0f26e3083 1073741824 Sep 06 06:33:10 devstack sudo[90360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:33:10 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-a517c12c-1cac-4174-875b-b0634523ee16 tempest-GroupSnapshotsTest-1381895959 None] group_snapshot 40003a9d-8b5a-49dd-89ab-909fbdc61561: created successfully Sep 06 06:33:10 devstack sudo[90360]: pam_unix(sudo:session): session closed for user root Sep 06 06:33:10 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-58b6de30-7c4e-42fd-8708-554fdc87dbb2 tempest-VolumesMetadataTest-1267468473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bddc4999-6467-4878-90ec-24a0f26e3083 1073741824" returned: 0 in 0.451s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:33:10 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-58b6de30-7c4e-42fd-8708-554fdc87dbb2 tempest-VolumesMetadataTest-1267468473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bddc4999-6467-4878-90ec-24a0f26e3083 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:33:10 devstack sudo[90366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bddc4999-6467-4878-90ec-24a0f26e3083 Sep 06 06:33:10 devstack sudo[90366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:33:10 devstack sudo[90366]: pam_unix(sudo:session): session closed for user root Sep 06 06:33:10 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-58b6de30-7c4e-42fd-8708-554fdc87dbb2 tempest-VolumesMetadataTest-1267468473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bddc4999-6467-4878-90ec-24a0f26e3083" returned: 0 in 0.278s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:33:10 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-58b6de30-7c4e-42fd-8708-554fdc87dbb2 tempest-VolumesMetadataTest-1267468473 None] <== create_volume: return (771ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'} {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 06:33:10 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-58b6de30-7c4e-42fd-8708-554fdc87dbb2 tempest-VolumesMetadataTest-1267468473 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.773s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:33:10 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-58b6de30-7c4e-42fd-8708-554fdc87dbb2 tempest-VolumesMetadataTest-1267468473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fef1dec-00e6-4045-8afa-cacab1f22413) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bddc4999-6467-4878-90ec-24a0f26e3083', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:33:10 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-58b6de30-7c4e-42fd-8708-554fdc87dbb2 tempest-VolumesMetadataTest-1267468473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea96278c-632c-4240-a209-3fb4b8ca3ba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:33:10 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-58b6de30-7c4e-42fd-8708-554fdc87dbb2 tempest-VolumesMetadataTest-1267468473 None] Volume volume-bddc4999-6467-4878-90ec-24a0f26e3083 (bddc4999-6467-4878-90ec-24a0f26e3083): created successfully Sep 06 06:33:11 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-58b6de30-7c4e-42fd-8708-554fdc87dbb2 tempest-VolumesMetadataTest-1267468473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea96278c-632c-4240-a209-3fb4b8ca3ba7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:33:11 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-58b6de30-7c4e-42fd-8708-554fdc87dbb2 tempest-VolumesMetadataTest-1267468473 None] Flow 'volume_create_manager' (834c0dfc-ff06-41bc-a4f6-4321f11ce623) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:33:11 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-58b6de30-7c4e-42fd-8708-554fdc87dbb2 tempest-VolumesMetadataTest-1267468473 None] Created volume successfully. Sep 06 06:33:12 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-11547375-7e75-454a-8e51-448e458e620f tempest-GroupSnapshotsTest-1381895959 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:33:12 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-11547375-7e75-454a-8e51-448e458e620f tempest-GroupSnapshotsTest-1381895959 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:33:12 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-11547375-7e75-454a-8e51-448e458e620f tempest-GroupSnapshotsTest-1381895959 None] Acquiring lock "cinder-quobyte-403a65da-371f-4d53-9892-8bca8bd9d7ff-bc8d3d7f-2fda-4794-99e0-ae8933cf0d5a" by "_create_volume_from_snapshot" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:33:12 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-11547375-7e75-454a-8e51-448e458e620f tempest-GroupSnapshotsTest-1381895959 None] Lock "cinder-quobyte-403a65da-371f-4d53-9892-8bca8bd9d7ff-bc8d3d7f-2fda-4794-99e0-ae8933cf0d5a" acquired by "_create_volume_from_snapshot" :: waited 0.027s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:33:12 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-11547375-7e75-454a-8e51-448e458e620f tempest-GroupSnapshotsTest-1381895959 None] Creating volume bc8d3d7f-2fda-4794-99e0-ae8933cf0d5a from snapshot 403a65da-371f-4d53-9892-8bca8bd9d7ff {{(pid=87329) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 06 06:33:12 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-11547375-7e75-454a-8e51-448e458e620f tempest-GroupSnapshotsTest-1381895959 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:33:12 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-11547375-7e75-454a-8e51-448e458e620f tempest-GroupSnapshotsTest-1381895959 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:33:12 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-11547375-7e75-454a-8e51-448e458e620f tempest-GroupSnapshotsTest-1381895959 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:33:12 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-11547375-7e75-454a-8e51-448e458e620f tempest-GroupSnapshotsTest-1381895959 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:33:12 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-11547375-7e75-454a-8e51-448e458e620f tempest-GroupSnapshotsTest-1381895959 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:33:12 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-11547375-7e75-454a-8e51-448e458e620f tempest-GroupSnapshotsTest-1381895959 None] Selected osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 as target Quobyte volume. {{(pid=87329) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 06:33:12 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-11547375-7e75-454a-8e51-448e458e620f tempest-GroupSnapshotsTest-1381895959 None] Acquiring lock "cinder-quobyte-bc8d3d7f-2fda-4794-99e0-ae8933cf0d5a" by "_copy_volume_from_snapshot" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:33:12 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-11547375-7e75-454a-8e51-448e458e620f tempest-GroupSnapshotsTest-1381895959 None] Lock "cinder-quobyte-bc8d3d7f-2fda-4794-99e0-ae8933cf0d5a" acquired by "_copy_volume_from_snapshot" :: waited 0.029s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:33:12 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-11547375-7e75-454a-8e51-448e458e620f tempest-GroupSnapshotsTest-1381895959 None] snapshot: 403a65da-371f-4d53-9892-8bca8bd9d7ff, volume: bc8d3d7f-2fda-4794-99e0-ae8933cf0d5a, {{(pid=87329) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 06 06:33:12 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-11547375-7e75-454a-8e51-448e458e620f tempest-GroupSnapshotsTest-1381895959 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:33:12 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-11547375-7e75-454a-8e51-448e458e620f tempest-GroupSnapshotsTest-1381895959 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:33:12 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-11547375-7e75-454a-8e51-448e458e620f tempest-GroupSnapshotsTest-1381895959 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:33:12 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-11547375-7e75-454a-8e51-448e458e620f tempest-GroupSnapshotsTest-1381895959 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:33:12 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-11547375-7e75-454a-8e51-448e458e620f tempest-GroupSnapshotsTest-1381895959 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:33:12 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[41c989b6-55cb-4e47-a21d-c3591e5983f3]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:33:12 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-11547375-7e75-454a-8e51-448e458e620f tempest-GroupSnapshotsTest-1381895959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-9996d60e-ea00-49a3-a6eb-1456ded75600.403a65da-371f-4d53-9892-8bca8bd9d7ff {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:33:12 devstack sudo[90369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-9996d60e-ea00-49a3-a6eb-1456ded75600.403a65da-371f-4d53-9892-8bca8bd9d7ff Sep 06 06:33:12 devstack sudo[90369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:33:12 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-c3ea5538-b5c7-44ee-a64e-e8abf5a39e70 tempest-VolumesMetadataTest-1267468473 None] Acquiring lock "cinder-bddc4999-6467-4878-90ec-24a0f26e3083-delete_volume" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:33:12 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-c3ea5538-b5c7-44ee-a64e-e8abf5a39e70 tempest-VolumesMetadataTest-1267468473 None] Lock "cinder-bddc4999-6467-4878-90ec-24a0f26e3083-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:33:12 devstack cinder-volume[87329]: DEBUG dbcounter [-] [87329] Writing DB stats cinder:SELECT=67,cinder:UPDATE=53,cinder:INSERT=10,cinder:DELETE=5 {{(pid=87329) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 06:33:12 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-c3ea5538-b5c7-44ee-a64e-e8abf5a39e70 tempest-VolumesMetadataTest-1267468473 None] Acquiring lock "cinder-quobyte-bddc4999-6467-4878-90ec-24a0f26e3083" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:33:12 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-c3ea5538-b5c7-44ee-a64e-e8abf5a39e70 tempest-VolumesMetadataTest-1267468473 None] Lock "cinder-quobyte-bddc4999-6467-4878-90ec-24a0f26e3083" acquired by "delete_volume" :: waited 0.040s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:33:12 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfdd6b3b-d62e-4ef1-8739-42ee9fcdb30c]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:33:12 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-c3ea5538-b5c7-44ee-a64e-e8abf5a39e70 tempest-VolumesMetadataTest-1267468473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bddc4999-6467-4878-90ec-24a0f26e3083 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:33:12 devstack sudo[90369]: pam_unix(sudo:session): session closed for user root Sep 06 06:33:12 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-11547375-7e75-454a-8e51-448e458e620f tempest-GroupSnapshotsTest-1381895959 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-9996d60e-ea00-49a3-a6eb-1456ded75600.403a65da-371f-4d53-9892-8bca8bd9d7ff" returned: 0 in 0.612s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:33:12 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-11547375-7e75-454a-8e51-448e458e620f tempest-GroupSnapshotsTest-1381895959 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9996d60e-ea00-49a3-a6eb-1456ded75600(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87329) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 06:33:12 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[33d2cc9b-e08f-4c53-99cf-bde06a49ccf6]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:33:12 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-11547375-7e75-454a-8e51-448e458e620f tempest-GroupSnapshotsTest-1381895959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-9996d60e-ea00-49a3-a6eb-1456ded75600 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:33:12 devstack sudo[90375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bddc4999-6467-4878-90ec-24a0f26e3083 Sep 06 06:33:12 devstack sudo[90375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:33:13 devstack sudo[90376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-9996d60e-ea00-49a3-a6eb-1456ded75600 Sep 06 06:33:13 devstack sudo[90376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:33:13 devstack sudo[90375]: pam_unix(sudo:session): session closed for user root Sep 06 06:33:13 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-c3ea5538-b5c7-44ee-a64e-e8abf5a39e70 tempest-VolumesMetadataTest-1267468473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bddc4999-6467-4878-90ec-24a0f26e3083" returned: 0 in 0.470s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:33:13 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-c3ea5538-b5c7-44ee-a64e-e8abf5a39e70 tempest-VolumesMetadataTest-1267468473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bddc4999-6467-4878-90ec-24a0f26e3083 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:33:13 devstack sudo[90376]: pam_unix(sudo:session): session closed for user root Sep 06 06:33:13 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-11547375-7e75-454a-8e51-448e458e620f tempest-GroupSnapshotsTest-1381895959 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-9996d60e-ea00-49a3-a6eb-1456ded75600" returned: 0 in 0.374s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:33:13 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-11547375-7e75-454a-8e51-448e458e620f tempest-GroupSnapshotsTest-1381895959 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-9996d60e-ea00-49a3-a6eb-1456ded75600 {{(pid=87329) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 06 06:33:13 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-11547375-7e75-454a-8e51-448e458e620f tempest-GroupSnapshotsTest-1381895959 None] Creating direct copy from snapshot {{(pid=87329) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 06 06:33:13 devstack sudo[90385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bddc4999-6467-4878-90ec-24a0f26e3083 Sep 06 06:33:13 devstack cinder-volume[87329]: DEBUG cinder.utils [None req-11547375-7e75-454a-8e51-448e458e620f tempest-GroupSnapshotsTest-1381895959 None] Path /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bc8d3d7f-2fda-4794-99e0-ae8933cf0d5a not found in is_blk_device check {{(pid=87329) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 06 06:33:13 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-11547375-7e75-454a-8e51-448e458e620f tempest-GroupSnapshotsTest-1381895959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-9996d60e-ea00-49a3-a6eb-1456ded75600 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bc8d3d7f-2fda-4794-99e0-ae8933cf0d5a {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:33:13 devstack sudo[90385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:33:13 devstack sudo[90387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-9996d60e-ea00-49a3-a6eb-1456ded75600 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bc8d3d7f-2fda-4794-99e0-ae8933cf0d5a Sep 06 06:33:13 devstack sudo[90387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:33:13 devstack sudo[90385]: pam_unix(sudo:session): session closed for user root Sep 06 06:33:13 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-c3ea5538-b5c7-44ee-a64e-e8abf5a39e70 tempest-VolumesMetadataTest-1267468473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bddc4999-6467-4878-90ec-24a0f26e3083" returned: 0 in 0.260s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:33:13 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-c3ea5538-b5c7-44ee-a64e-e8abf5a39e70 tempest-VolumesMetadataTest-1267468473 None] Lock "cinder-quobyte-bddc4999-6467-4878-90ec-24a0f26e3083" released by "delete_volume" :: held 0.788s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:33:13 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-c3ea5538-b5c7-44ee-a64e-e8abf5a39e70 tempest-VolumesMetadataTest-1267468473 None] Created reservations ['60e7ad92-c465-4003-851f-518b8de5f79f', 'f3c4efa6-23e6-4fae-accb-b4159049c75c', '56640f6a-4167-4772-9eb7-a1f234e5f008', 'f78a766a-5e28-421c-b642-2ccb41666306'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:33:13 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-c3ea5538-b5c7-44ee-a64e-e8abf5a39e70 tempest-VolumesMetadataTest-1267468473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:33:13 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-c3ea5538-b5c7-44ee-a64e-e8abf5a39e70 tempest-VolumesMetadataTest-1267468473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:33:13 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-c3ea5538-b5c7-44ee-a64e-e8abf5a39e70 tempest-VolumesMetadataTest-1267468473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:33:13 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-c3ea5538-b5c7-44ee-a64e-e8abf5a39e70 tempest-VolumesMetadataTest-1267468473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:33:13 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-c3ea5538-b5c7-44ee-a64e-e8abf5a39e70 tempest-VolumesMetadataTest-1267468473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:33:13 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-c3ea5538-b5c7-44ee-a64e-e8abf5a39e70 tempest-VolumesMetadataTest-1267468473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:33:13 devstack sudo[90394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:33:13 devstack sudo[90394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:33:14 devstack sudo[90394]: pam_unix(sudo:session): session closed for user root Sep 06 06:33:14 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-c3ea5538-b5c7-44ee-a64e-e8abf5a39e70 tempest-VolumesMetadataTest-1267468473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.630s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:33:14 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-c3ea5538-b5c7-44ee-a64e-e8abf5a39e70 tempest-VolumesMetadataTest-1267468473 None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:33:14 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-c3ea5538-b5c7-44ee-a64e-e8abf5a39e70 tempest-VolumesMetadataTest-1267468473 None] Deleted volume successfully. Sep 06 06:33:14 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-c3ea5538-b5c7-44ee-a64e-e8abf5a39e70 tempest-VolumesMetadataTest-1267468473 None] Lock "cinder-bddc4999-6467-4878-90ec-24a0f26e3083-delete_volume" released by "delete_volume" :: held 1.798s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:33:16 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5c7c681-4179-4d18-8625-21eee748c329 tempest-AttachVolumeNegativeTest-1315254098 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87329) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 06:33:16 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-d5c7c681-4179-4d18-8625-21eee748c329 tempest-AttachVolumeNegativeTest-1315254098 None] Flow 'volume_create_manager' (9377a623-29e9-4893-b67d-66c78466a761) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:33:16 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-d5c7c681-4179-4d18-8625-21eee748c329 tempest-AttachVolumeNegativeTest-1315254098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bdf1a1b-34b5-47cc-9d97-3b017ae32cfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:33:16 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-d5c7c681-4179-4d18-8625-21eee748c329 tempest-AttachVolumeNegativeTest-1315254098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bdf1a1b-34b5-47cc-9d97-3b017ae32cfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:33:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1806404269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f5d94d9-f8f2-4389-af2d-5dc4d869a9c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ca696acace14cfdab93b2b90cc77cee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:33:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:33:16Z,use_quota=True,user_id='3df09a7695104f7595ec6e6d40af53be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:33:16 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-d5c7c681-4179-4d18-8625-21eee748c329 tempest-AttachVolumeNegativeTest-1315254098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (202bb541-8aeb-41f5-9051-5590c39253ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:33:16 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-d5c7c681-4179-4d18-8625-21eee748c329 tempest-AttachVolumeNegativeTest-1315254098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (202bb541-8aeb-41f5-9051-5590c39253ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:33:16 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-d5c7c681-4179-4d18-8625-21eee748c329 tempest-AttachVolumeNegativeTest-1315254098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (081f5f93-a37f-4534-9f5d-708076de141e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:33:16 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-d5c7c681-4179-4d18-8625-21eee748c329 tempest-AttachVolumeNegativeTest-1315254098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (081f5f93-a37f-4534-9f5d-708076de141e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f5d94d9-f8f2-4389-af2d-5dc4d869a9c4', 'volume_name': 'volume-0f5d94d9-f8f2-4389-af2d-5dc4d869a9c4', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:33:16 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-d5c7c681-4179-4d18-8625-21eee748c329 tempest-AttachVolumeNegativeTest-1315254098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e8b8bf2-d559-4566-a745-8b8bef0d0efd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:33:16 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-d5c7c681-4179-4d18-8625-21eee748c329 tempest-AttachVolumeNegativeTest-1315254098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e8b8bf2-d559-4566-a745-8b8bef0d0efd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:33:16 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-d5c7c681-4179-4d18-8625-21eee748c329 tempest-AttachVolumeNegativeTest-1315254098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39cfd01e-5730-476d-bd8a-c53a5797eed0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:33:16 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-d5c7c681-4179-4d18-8625-21eee748c329 tempest-AttachVolumeNegativeTest-1315254098 None] Volume 0f5d94d9-f8f2-4389-af2d-5dc4d869a9c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f5d94d9-f8f2-4389-af2d-5dc4d869a9c4', 'volume_size': 1} Sep 06 06:33:16 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-d5c7c681-4179-4d18-8625-21eee748c329 tempest-AttachVolumeNegativeTest-1315254098 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:33:19 devstack sudo[90387]: pam_unix(sudo:session): session closed for user root Sep 06 06:33:19 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-11547375-7e75-454a-8e51-448e458e620f tempest-GroupSnapshotsTest-1381895959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-9996d60e-ea00-49a3-a6eb-1456ded75600 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bc8d3d7f-2fda-4794-99e0-ae8933cf0d5a" returned: 0 in 6.061s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:33:19 devstack cinder-volume[87329]: DEBUG cinder.image.image_utils [None req-11547375-7e75-454a-8e51-448e458e620f tempest-GroupSnapshotsTest-1381895959 None] Image conversion details: src /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-9996d60e-ea00-49a3-a6eb-1456ded75600, size 1024.00 MB, duration 6.06 sec, destination /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bc8d3d7f-2fda-4794-99e0-ae8933cf0d5a {{(pid=87329) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 06 06:33:19 devstack cinder-volume[87329]: INFO cinder.image.image_utils [None req-11547375-7e75-454a-8e51-448e458e620f tempest-GroupSnapshotsTest-1381895959 None] Converted 1024.00 MB image at 168.93 MB/s Sep 06 06:33:19 devstack cinder-volume[87329]: WARNING cinder.volume.drivers.remotefs [None req-11547375-7e75-454a-8e51-448e458e620f tempest-GroupSnapshotsTest-1381895959 None] /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bc8d3d7f-2fda-4794-99e0-ae8933cf0d5a is being set with open permissions: ugo+rw: NotImplementedError Sep 06 06:33:19 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-11547375-7e75-454a-8e51-448e458e620f tempest-GroupSnapshotsTest-1381895959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bc8d3d7f-2fda-4794-99e0-ae8933cf0d5a {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:33:19 devstack sudo[90422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bc8d3d7f-2fda-4794-99e0-ae8933cf0d5a Sep 06 06:33:19 devstack sudo[90422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:33:19 devstack sudo[90422]: pam_unix(sudo:session): session closed for user root Sep 06 06:33:19 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-11547375-7e75-454a-8e51-448e458e620f tempest-GroupSnapshotsTest-1381895959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bc8d3d7f-2fda-4794-99e0-ae8933cf0d5a" returned: 0 in 0.290s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:33:19 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-11547375-7e75-454a-8e51-448e458e620f tempest-GroupSnapshotsTest-1381895959 None] Lock "cinder-quobyte-bc8d3d7f-2fda-4794-99e0-ae8933cf0d5a" released by "_copy_volume_from_snapshot" :: held 7.429s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:33:19 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-11547375-7e75-454a-8e51-448e458e620f tempest-GroupSnapshotsTest-1381895959 None] Lock "cinder-quobyte-403a65da-371f-4d53-9892-8bca8bd9d7ff-bc8d3d7f-2fda-4794-99e0-ae8933cf0d5a" released by "_create_volume_from_snapshot" :: held 7.521s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:33:19 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-11547375-7e75-454a-8e51-448e458e620f tempest-GroupSnapshotsTest-1381895959 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.550s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:33:19 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-d5c7c681-4179-4d18-8625-21eee748c329 tempest-AttachVolumeNegativeTest-1315254098 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.232s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:33:19 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-d5c7c681-4179-4d18-8625-21eee748c329 tempest-AttachVolumeNegativeTest-1315254098 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:33:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1806404269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f5d94d9-f8f2-4389-af2d-5dc4d869a9c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ca696acace14cfdab93b2b90cc77cee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:33:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:33:16Z,use_quota=True,user_id='3df09a7695104f7595ec6e6d40af53be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)}" {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 06:33:19 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-d5c7c681-4179-4d18-8625-21eee748c329 tempest-AttachVolumeNegativeTest-1315254098 None] Creating volume 0f5d94d9-f8f2-4389-af2d-5dc4d869a9c4 {{(pid=87329) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 06:33:19 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-d5c7c681-4179-4d18-8625-21eee748c329 tempest-AttachVolumeNegativeTest-1315254098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:33:19 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-d5c7c681-4179-4d18-8625-21eee748c329 tempest-AttachVolumeNegativeTest-1315254098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:33:19 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-d5c7c681-4179-4d18-8625-21eee748c329 tempest-AttachVolumeNegativeTest-1315254098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:33:19 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-d5c7c681-4179-4d18-8625-21eee748c329 tempest-AttachVolumeNegativeTest-1315254098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:33:19 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-d5c7c681-4179-4d18-8625-21eee748c329 tempest-AttachVolumeNegativeTest-1315254098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:33:19 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-d5c7c681-4179-4d18-8625-21eee748c329 tempest-AttachVolumeNegativeTest-1315254098 None] Selected osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 as target Quobyte volume. {{(pid=87329) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 06:33:19 devstack cinder-volume[87329]: INFO cinder.volume.drivers.remotefs [None req-d5c7c681-4179-4d18-8625-21eee748c329 tempest-AttachVolumeNegativeTest-1315254098 None] casted to osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 Sep 06 06:33:19 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-d5c7c681-4179-4d18-8625-21eee748c329 tempest-AttachVolumeNegativeTest-1315254098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-0f5d94d9-f8f2-4389-af2d-5dc4d869a9c4 1073741824 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:33:19 devstack sudo[90425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-0f5d94d9-f8f2-4389-af2d-5dc4d869a9c4 1073741824 Sep 06 06:33:19 devstack sudo[90425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:33:19 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-11547375-7e75-454a-8e51-448e458e620f tempest-GroupSnapshotsTest-1381895959 None] Create group from source-snapshot-40003a9d-8b5a-49dd-89ab-909fbdc61561 completed successfully. Sep 06 06:33:20 devstack sudo[90425]: pam_unix(sudo:session): session closed for user root Sep 06 06:33:20 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-d5c7c681-4179-4d18-8625-21eee748c329 tempest-AttachVolumeNegativeTest-1315254098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-0f5d94d9-f8f2-4389-af2d-5dc4d869a9c4 1073741824" returned: 0 in 0.546s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:33:20 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-d5c7c681-4179-4d18-8625-21eee748c329 tempest-AttachVolumeNegativeTest-1315254098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-0f5d94d9-f8f2-4389-af2d-5dc4d869a9c4 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:33:20 devstack sudo[90431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-0f5d94d9-f8f2-4389-af2d-5dc4d869a9c4 Sep 06 06:33:20 devstack sudo[90431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:33:20 devstack sudo[90431]: pam_unix(sudo:session): session closed for user root Sep 06 06:33:20 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-d5c7c681-4179-4d18-8625-21eee748c329 tempest-AttachVolumeNegativeTest-1315254098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-0f5d94d9-f8f2-4389-af2d-5dc4d869a9c4" returned: 0 in 0.335s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:33:20 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-d5c7c681-4179-4d18-8625-21eee748c329 tempest-AttachVolumeNegativeTest-1315254098 None] <== create_volume: return (946ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'} {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 06:33:20 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-d5c7c681-4179-4d18-8625-21eee748c329 tempest-AttachVolumeNegativeTest-1315254098 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.949s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:33:20 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-d5c7c681-4179-4d18-8625-21eee748c329 tempest-AttachVolumeNegativeTest-1315254098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39cfd01e-5730-476d-bd8a-c53a5797eed0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f5d94d9-f8f2-4389-af2d-5dc4d869a9c4', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:33:20 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-d5c7c681-4179-4d18-8625-21eee748c329 tempest-AttachVolumeNegativeTest-1315254098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2575d4e4-bccc-4ac6-9a41-60fcd5622792) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:33:20 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-d5c7c681-4179-4d18-8625-21eee748c329 tempest-AttachVolumeNegativeTest-1315254098 None] Volume volume-0f5d94d9-f8f2-4389-af2d-5dc4d869a9c4 (0f5d94d9-f8f2-4389-af2d-5dc4d869a9c4): created successfully Sep 06 06:33:20 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-d5c7c681-4179-4d18-8625-21eee748c329 tempest-AttachVolumeNegativeTest-1315254098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2575d4e4-bccc-4ac6-9a41-60fcd5622792) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:33:20 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-d5c7c681-4179-4d18-8625-21eee748c329 tempest-AttachVolumeNegativeTest-1315254098 None] Flow 'volume_create_manager' (9377a623-29e9-4893-b67d-66c78466a761) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:33:20 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-d5c7c681-4179-4d18-8625-21eee748c329 tempest-AttachVolumeNegativeTest-1315254098 None] Created volume successfully. Sep 06 06:33:20 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-bbd6bb8f-7d0a-4838-b615-b27278e6bd45 tempest-GroupSnapshotsTest-1381895959 None] Acquiring lock "cinder-quobyte-bc8d3d7f-2fda-4794-99e0-ae8933cf0d5a" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:33:20 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-bbd6bb8f-7d0a-4838-b615-b27278e6bd45 tempest-GroupSnapshotsTest-1381895959 None] Lock "cinder-quobyte-bc8d3d7f-2fda-4794-99e0-ae8933cf0d5a" acquired by "delete_volume" :: waited 0.026s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:33:20 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8a7caeb-bcc8-4653-ac6c-aab69d47ed4c]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:33:20 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-bbd6bb8f-7d0a-4838-b615-b27278e6bd45 tempest-GroupSnapshotsTest-1381895959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bc8d3d7f-2fda-4794-99e0-ae8933cf0d5a {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:33:21 devstack sudo[90434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bc8d3d7f-2fda-4794-99e0-ae8933cf0d5a Sep 06 06:33:21 devstack sudo[90434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:33:21 devstack sudo[90434]: pam_unix(sudo:session): session closed for user root Sep 06 06:33:21 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-bbd6bb8f-7d0a-4838-b615-b27278e6bd45 tempest-GroupSnapshotsTest-1381895959 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bc8d3d7f-2fda-4794-99e0-ae8933cf0d5a" returned: 0 in 0.429s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:33:21 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-bbd6bb8f-7d0a-4838-b615-b27278e6bd45 tempest-GroupSnapshotsTest-1381895959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bc8d3d7f-2fda-4794-99e0-ae8933cf0d5a {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:33:21 devstack sudo[90439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bc8d3d7f-2fda-4794-99e0-ae8933cf0d5a Sep 06 06:33:21 devstack sudo[90439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:33:21 devstack sudo[90439]: pam_unix(sudo:session): session closed for user root Sep 06 06:33:21 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-bbd6bb8f-7d0a-4838-b615-b27278e6bd45 tempest-GroupSnapshotsTest-1381895959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bc8d3d7f-2fda-4794-99e0-ae8933cf0d5a" returned: 0 in 0.275s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:33:21 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-bbd6bb8f-7d0a-4838-b615-b27278e6bd45 tempest-GroupSnapshotsTest-1381895959 None] Lock "cinder-quobyte-bc8d3d7f-2fda-4794-99e0-ae8933cf0d5a" released by "delete_volume" :: held 0.766s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:33:21 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-bbd6bb8f-7d0a-4838-b615-b27278e6bd45 tempest-GroupSnapshotsTest-1381895959 None] Created reservations ['98f09152-0832-492c-a42d-b1adc6213fcb'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:33:21 devstack cinder-volume[87329]: WARNING cinder.quota [None req-bbd6bb8f-7d0a-4838-b615-b27278e6bd45 tempest-GroupSnapshotsTest-1381895959 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-77671465 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-77671465, it is now deprecated. Please use the default quota class for default quota. Sep 06 06:33:21 devstack cinder-volume[87329]: WARNING cinder.quota [None req-bbd6bb8f-7d0a-4838-b615-b27278e6bd45 tempest-GroupSnapshotsTest-1381895959 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-77671465 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-77671465, it is now deprecated. Please use the default quota class for default quota. Sep 06 06:33:21 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-bbd6bb8f-7d0a-4838-b615-b27278e6bd45 tempest-GroupSnapshotsTest-1381895959 None] Created reservations ['eb237566-35e9-466e-9817-6095f593126d', 'e522e9cb-0906-4924-9fa7-3c68bf897a53', '6ee66134-36fb-4fde-903d-6ab3e12bae8a', '69339e21-5fef-4970-ad19-299fabcdd1e5'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:33:21 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-bbd6bb8f-7d0a-4838-b615-b27278e6bd45 tempest-GroupSnapshotsTest-1381895959 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:33:21 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-bbd6bb8f-7d0a-4838-b615-b27278e6bd45 tempest-GroupSnapshotsTest-1381895959 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:33:21 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-bbd6bb8f-7d0a-4838-b615-b27278e6bd45 tempest-GroupSnapshotsTest-1381895959 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:33:21 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-bbd6bb8f-7d0a-4838-b615-b27278e6bd45 tempest-GroupSnapshotsTest-1381895959 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:33:21 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-bbd6bb8f-7d0a-4838-b615-b27278e6bd45 tempest-GroupSnapshotsTest-1381895959 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:33:21 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-bbd6bb8f-7d0a-4838-b615-b27278e6bd45 tempest-GroupSnapshotsTest-1381895959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:33:22 devstack sudo[90447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:33:22 devstack sudo[90447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:33:22 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-a99f9afd-7aff-4851-b230-619023264f7b tempest-GroupSnapshotsTest-1381895959 None] group_snapshot 40003a9d-8b5a-49dd-89ab-909fbdc61561: deleting Sep 06 06:33:22 devstack sudo[90447]: pam_unix(sudo:session): session closed for user root Sep 06 06:33:22 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-bbd6bb8f-7d0a-4838-b615-b27278e6bd45 tempest-GroupSnapshotsTest-1381895959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.402s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:33:22 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-bbd6bb8f-7d0a-4838-b615-b27278e6bd45 tempest-GroupSnapshotsTest-1381895959 None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:33:22 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-bbd6bb8f-7d0a-4838-b615-b27278e6bd45 tempest-GroupSnapshotsTest-1381895959 None] Delete group completed successfully. Sep 06 06:33:22 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-a99f9afd-7aff-4851-b230-619023264f7b tempest-GroupSnapshotsTest-1381895959 None] group_snapshot 40003a9d-8b5a-49dd-89ab-909fbdc61561: deleting {{(pid=87329) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 06 06:33:22 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-a99f9afd-7aff-4851-b230-619023264f7b tempest-GroupSnapshotsTest-1381895959 None] Acquiring lock "cinder-quobyte-9996d60e-ea00-49a3-a6eb-1456ded75600" by "delete_snapshot" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:33:22 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-a99f9afd-7aff-4851-b230-619023264f7b tempest-GroupSnapshotsTest-1381895959 None] Lock "cinder-quobyte-9996d60e-ea00-49a3-a6eb-1456ded75600" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:33:22 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-a99f9afd-7aff-4851-b230-619023264f7b tempest-GroupSnapshotsTest-1381895959 None] Acquiring lock "cinder-quobyte-403a65da-371f-4d53-9892-8bca8bd9d7ff" by "_delete_snapshot" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:33:22 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-a99f9afd-7aff-4851-b230-619023264f7b tempest-GroupSnapshotsTest-1381895959 None] Lock "cinder-quobyte-403a65da-371f-4d53-9892-8bca8bd9d7ff" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:33:22 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-a99f9afd-7aff-4851-b230-619023264f7b tempest-GroupSnapshotsTest-1381895959 None] Deleting offline snapshot 403a65da-371f-4d53-9892-8bca8bd9d7ff of volume 9996d60e-ea00-49a3-a6eb-1456ded75600 {{(pid=87329) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 06 06:33:22 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-a99f9afd-7aff-4851-b230-619023264f7b tempest-GroupSnapshotsTest-1381895959 None] snapshot_file for this snap is: volume-9996d60e-ea00-49a3-a6eb-1456ded75600.403a65da-371f-4d53-9892-8bca8bd9d7ff {{(pid=87329) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 06 06:33:22 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a4a6cc3-c19c-4b9a-8544-400252f34bad]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:33:22 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-a99f9afd-7aff-4851-b230-619023264f7b tempest-GroupSnapshotsTest-1381895959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-9996d60e-ea00-49a3-a6eb-1456ded75600.403a65da-371f-4d53-9892-8bca8bd9d7ff {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:33:22 devstack sudo[90451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-9996d60e-ea00-49a3-a6eb-1456ded75600.403a65da-371f-4d53-9892-8bca8bd9d7ff Sep 06 06:33:22 devstack sudo[90451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:33:23 devstack sudo[90451]: pam_unix(sudo:session): session closed for user root Sep 06 06:33:23 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-a99f9afd-7aff-4851-b230-619023264f7b tempest-GroupSnapshotsTest-1381895959 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-9996d60e-ea00-49a3-a6eb-1456ded75600.403a65da-371f-4d53-9892-8bca8bd9d7ff" returned: 0 in 0.453s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:33:23 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-a99f9afd-7aff-4851-b230-619023264f7b tempest-GroupSnapshotsTest-1381895959 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9996d60e-ea00-49a3-a6eb-1456ded75600(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87329) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 06:33:23 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef53117b-eb36-443b-97df-aa2fcaf5935b]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:33:23 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-a99f9afd-7aff-4851-b230-619023264f7b tempest-GroupSnapshotsTest-1381895959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-9996d60e-ea00-49a3-a6eb-1456ded75600 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:33:23 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [req-17aca2f6-ec25-414c-b21b-bc495bbd550a req-a70851a9-4450-4949-b79d-7b7d30bc07af tempest-AttachVolumeNegativeTest-1315254098 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:33:23 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [req-17aca2f6-ec25-414c-b21b-bc495bbd550a req-a70851a9-4450-4949-b79d-7b7d30bc07af tempest-AttachVolumeNegativeTest-1315254098 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:33:23 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [req-17aca2f6-ec25-414c-b21b-bc495bbd550a req-a70851a9-4450-4949-b79d-7b7d30bc07af tempest-AttachVolumeNegativeTest-1315254098 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:33:23 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [req-17aca2f6-ec25-414c-b21b-bc495bbd550a req-a70851a9-4450-4949-b79d-7b7d30bc07af tempest-AttachVolumeNegativeTest-1315254098 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6', 'name': 'volume-0f5d94d9-f8f2-4389-af2d-5dc4d869a9c4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ce713349-8acb-4c04-8a80-9e0ae07e7371', 'enforce_multipath': True} {{(pid=87329) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 06 06:33:23 devstack sudo[90464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-9996d60e-ea00-49a3-a6eb-1456ded75600 Sep 06 06:33:23 devstack sudo[90464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:33:23 devstack cinder-volume[87329]: INFO cinder.volume.manager [req-17aca2f6-ec25-414c-b21b-bc495bbd550a req-a70851a9-4450-4949-b79d-7b7d30bc07af tempest-AttachVolumeNegativeTest-1315254098 None] attachment_update completed successfully. Sep 06 06:33:23 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-603db634-cab8-4542-8653-0c4826e16b3b tempest-VolumesTransfersTest-1085228910 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87329) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 06:33:23 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-603db634-cab8-4542-8653-0c4826e16b3b tempest-VolumesTransfersTest-1085228910 None] Flow 'volume_create_manager' (f4dd4a39-dbd6-4046-b810-2efce5c83362) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:33:23 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-603db634-cab8-4542-8653-0c4826e16b3b tempest-VolumesTransfersTest-1085228910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24ade157-bc6e-4de9-aaac-43868b5c2eee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:33:23 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-603db634-cab8-4542-8653-0c4826e16b3b tempest-VolumesTransfersTest-1085228910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24ade157-bc6e-4de9-aaac-43868b5c2eee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:33:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-2073519903',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cff845e7-48f8-4b06-ba29-8140e496cfcf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af56aadea8de45caaa6f1d734f96b746',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:33:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:33:24Z,use_quota=True,user_id='761b1f62194b44fdbafb52d2ccddf163',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:33:23 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-603db634-cab8-4542-8653-0c4826e16b3b tempest-VolumesTransfersTest-1085228910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4e2b28e-3c50-4685-88e5-390c920e64e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:33:23 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-603db634-cab8-4542-8653-0c4826e16b3b tempest-VolumesTransfersTest-1085228910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4e2b28e-3c50-4685-88e5-390c920e64e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:33:23 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-603db634-cab8-4542-8653-0c4826e16b3b tempest-VolumesTransfersTest-1085228910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b03a0f81-b54a-45ad-bd3f-4f2cfb352638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:33:23 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-603db634-cab8-4542-8653-0c4826e16b3b tempest-VolumesTransfersTest-1085228910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b03a0f81-b54a-45ad-bd3f-4f2cfb352638) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cff845e7-48f8-4b06-ba29-8140e496cfcf', 'volume_name': 'volume-cff845e7-48f8-4b06-ba29-8140e496cfcf', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:33:23 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-603db634-cab8-4542-8653-0c4826e16b3b tempest-VolumesTransfersTest-1085228910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2837531c-49d7-4ae5-9fc6-e6999cdea301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:33:23 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-603db634-cab8-4542-8653-0c4826e16b3b tempest-VolumesTransfersTest-1085228910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2837531c-49d7-4ae5-9fc6-e6999cdea301) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:33:23 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-603db634-cab8-4542-8653-0c4826e16b3b tempest-VolumesTransfersTest-1085228910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c07955fd-59bf-41da-b870-48ff2f210c51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:33:23 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-603db634-cab8-4542-8653-0c4826e16b3b tempest-VolumesTransfersTest-1085228910 None] Volume cff845e7-48f8-4b06-ba29-8140e496cfcf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cff845e7-48f8-4b06-ba29-8140e496cfcf', 'volume_size': 1} Sep 06 06:33:23 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-603db634-cab8-4542-8653-0c4826e16b3b tempest-VolumesTransfersTest-1085228910 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:33:23 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-603db634-cab8-4542-8653-0c4826e16b3b tempest-VolumesTransfersTest-1085228910 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:33:23 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-603db634-cab8-4542-8653-0c4826e16b3b tempest-VolumesTransfersTest-1085228910 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:33:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-2073519903',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cff845e7-48f8-4b06-ba29-8140e496cfcf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af56aadea8de45caaa6f1d734f96b746',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:33:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:33:24Z,use_quota=True,user_id='761b1f62194b44fdbafb52d2ccddf163',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)}" {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 06:33:23 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-603db634-cab8-4542-8653-0c4826e16b3b tempest-VolumesTransfersTest-1085228910 None] Creating volume cff845e7-48f8-4b06-ba29-8140e496cfcf {{(pid=87329) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 06:33:23 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-603db634-cab8-4542-8653-0c4826e16b3b tempest-VolumesTransfersTest-1085228910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:33:23 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-603db634-cab8-4542-8653-0c4826e16b3b tempest-VolumesTransfersTest-1085228910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:33:23 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-603db634-cab8-4542-8653-0c4826e16b3b tempest-VolumesTransfersTest-1085228910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:33:23 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-603db634-cab8-4542-8653-0c4826e16b3b tempest-VolumesTransfersTest-1085228910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:33:23 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-603db634-cab8-4542-8653-0c4826e16b3b tempest-VolumesTransfersTest-1085228910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:33:23 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-603db634-cab8-4542-8653-0c4826e16b3b tempest-VolumesTransfersTest-1085228910 None] Selected osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 as target Quobyte volume. {{(pid=87329) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 06:33:23 devstack cinder-volume[87329]: INFO cinder.volume.drivers.remotefs [None req-603db634-cab8-4542-8653-0c4826e16b3b tempest-VolumesTransfersTest-1085228910 None] casted to osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 Sep 06 06:33:23 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-603db634-cab8-4542-8653-0c4826e16b3b tempest-VolumesTransfersTest-1085228910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-cff845e7-48f8-4b06-ba29-8140e496cfcf 1073741824 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:33:23 devstack sudo[90608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-cff845e7-48f8-4b06-ba29-8140e496cfcf 1073741824 Sep 06 06:33:23 devstack sudo[90608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:33:23 devstack sudo[90464]: pam_unix(sudo:session): session closed for user root Sep 06 06:33:23 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-a99f9afd-7aff-4851-b230-619023264f7b tempest-GroupSnapshotsTest-1381895959 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-9996d60e-ea00-49a3-a6eb-1456ded75600" returned: 0 in 0.903s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:33:23 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-a99f9afd-7aff-4851-b230-619023264f7b tempest-GroupSnapshotsTest-1381895959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-9996d60e-ea00-49a3-a6eb-1456ded75600.403a65da-371f-4d53-9892-8bca8bd9d7ff {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:33:24 devstack sudo[90853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-9996d60e-ea00-49a3-a6eb-1456ded75600.403a65da-371f-4d53-9892-8bca8bd9d7ff Sep 06 06:33:24 devstack sudo[90853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:33:24 devstack sudo[90608]: pam_unix(sudo:session): session closed for user root Sep 06 06:33:24 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-603db634-cab8-4542-8653-0c4826e16b3b tempest-VolumesTransfersTest-1085228910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-cff845e7-48f8-4b06-ba29-8140e496cfcf 1073741824" returned: 0 in 0.737s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:33:24 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-603db634-cab8-4542-8653-0c4826e16b3b tempest-VolumesTransfersTest-1085228910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-cff845e7-48f8-4b06-ba29-8140e496cfcf {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:33:24 devstack sudo[90861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-cff845e7-48f8-4b06-ba29-8140e496cfcf Sep 06 06:33:24 devstack sudo[90861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:33:24 devstack sudo[90853]: pam_unix(sudo:session): session closed for user root Sep 06 06:33:24 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-a99f9afd-7aff-4851-b230-619023264f7b tempest-GroupSnapshotsTest-1381895959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-9996d60e-ea00-49a3-a6eb-1456ded75600.403a65da-371f-4d53-9892-8bca8bd9d7ff" returned: 0 in 0.635s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:33:24 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-a99f9afd-7aff-4851-b230-619023264f7b tempest-GroupSnapshotsTest-1381895959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-9996d60e-ea00-49a3-a6eb-1456ded75600.403a65da-371f-4d53-9892-8bca8bd9d7ff {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:33:24 devstack sudo[90863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-9996d60e-ea00-49a3-a6eb-1456ded75600.403a65da-371f-4d53-9892-8bca8bd9d7ff Sep 06 06:33:24 devstack sudo[90863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:33:24 devstack sudo[90861]: pam_unix(sudo:session): session closed for user root Sep 06 06:33:24 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-603db634-cab8-4542-8653-0c4826e16b3b tempest-VolumesTransfersTest-1085228910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-cff845e7-48f8-4b06-ba29-8140e496cfcf" returned: 0 in 0.301s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:33:24 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-603db634-cab8-4542-8653-0c4826e16b3b tempest-VolumesTransfersTest-1085228910 None] <== create_volume: return (1101ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'} {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 06:33:24 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-603db634-cab8-4542-8653-0c4826e16b3b tempest-VolumesTransfersTest-1085228910 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.104s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:33:24 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-603db634-cab8-4542-8653-0c4826e16b3b tempest-VolumesTransfersTest-1085228910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c07955fd-59bf-41da-b870-48ff2f210c51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cff845e7-48f8-4b06-ba29-8140e496cfcf', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:33:24 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-603db634-cab8-4542-8653-0c4826e16b3b tempest-VolumesTransfersTest-1085228910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8722c4cd-1a35-4e93-8eff-5e9f0f43792f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:33:24 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-603db634-cab8-4542-8653-0c4826e16b3b tempest-VolumesTransfersTest-1085228910 None] Volume volume-cff845e7-48f8-4b06-ba29-8140e496cfcf (cff845e7-48f8-4b06-ba29-8140e496cfcf): created successfully Sep 06 06:33:24 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-603db634-cab8-4542-8653-0c4826e16b3b tempest-VolumesTransfersTest-1085228910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8722c4cd-1a35-4e93-8eff-5e9f0f43792f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:33:24 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-603db634-cab8-4542-8653-0c4826e16b3b tempest-VolumesTransfersTest-1085228910 None] Flow 'volume_create_manager' (f4dd4a39-dbd6-4046-b810-2efce5c83362) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:33:24 devstack sudo[90863]: pam_unix(sudo:session): session closed for user root Sep 06 06:33:24 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-a99f9afd-7aff-4851-b230-619023264f7b tempest-GroupSnapshotsTest-1381895959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-9996d60e-ea00-49a3-a6eb-1456ded75600.403a65da-371f-4d53-9892-8bca8bd9d7ff" returned: 0 in 0.284s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:33:24 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-a99f9afd-7aff-4851-b230-619023264f7b tempest-GroupSnapshotsTest-1381895959 None] Lock "cinder-quobyte-403a65da-371f-4d53-9892-8bca8bd9d7ff" released by "_delete_snapshot" :: held 2.419s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:33:24 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-603db634-cab8-4542-8653-0c4826e16b3b tempest-VolumesTransfersTest-1085228910 None] Created volume successfully. Sep 06 06:33:24 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-a99f9afd-7aff-4851-b230-619023264f7b tempest-GroupSnapshotsTest-1381895959 None] Lock "cinder-quobyte-9996d60e-ea00-49a3-a6eb-1456ded75600" released by "delete_snapshot" :: held 2.458s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:33:25 devstack cinder-volume[87329]: WARNING cinder.quota [None req-a99f9afd-7aff-4851-b230-619023264f7b tempest-GroupSnapshotsTest-1381895959 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-77671465 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-77671465, it is now deprecated. Please use the default quota class for default quota. Sep 06 06:33:25 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-a99f9afd-7aff-4851-b230-619023264f7b tempest-GroupSnapshotsTest-1381895959 None] Created reservations ['55078a97-d48a-4892-a952-a6bfeb1ca20f', 'cf7e7e82-caa1-49fc-9546-187c1808b634', '109f80a0-1b78-4123-873b-6afb26e90437', '80766f6c-ed5d-4a29-93d8-9f0310ab591d'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:33:25 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-a99f9afd-7aff-4851-b230-619023264f7b tempest-GroupSnapshotsTest-1381895959 None] group_snapshot 40003a9d-8b5a-49dd-89ab-909fbdc61561: deleted successfully Sep 06 06:33:26 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-98ab32ad-9be7-4ac1-b298-84fe94400d30 tempest-GroupSnapshotsTest-1381895959 None] Acquiring lock "cinder-quobyte-9996d60e-ea00-49a3-a6eb-1456ded75600" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:33:26 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-98ab32ad-9be7-4ac1-b298-84fe94400d30 tempest-GroupSnapshotsTest-1381895959 None] Lock "cinder-quobyte-9996d60e-ea00-49a3-a6eb-1456ded75600" acquired by "delete_volume" :: waited 0.027s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:33:26 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[bafd500b-97f7-4960-88f0-df89ab934ccf]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:33:26 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-98ab32ad-9be7-4ac1-b298-84fe94400d30 tempest-GroupSnapshotsTest-1381895959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-9996d60e-ea00-49a3-a6eb-1456ded75600 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:33:26 devstack sudo[90868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-9996d60e-ea00-49a3-a6eb-1456ded75600 Sep 06 06:33:26 devstack sudo[90868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:33:26 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-229ae9ea-6394-44a9-9316-e6c3087d591d tempest-VolumesTransfersTest-1808922432 None] Transfer volume completed successfully. Sep 06 06:33:26 devstack sudo[90868]: pam_unix(sudo:session): session closed for user root Sep 06 06:33:26 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-98ab32ad-9be7-4ac1-b298-84fe94400d30 tempest-GroupSnapshotsTest-1381895959 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-9996d60e-ea00-49a3-a6eb-1456ded75600" returned: 0 in 0.514s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:33:26 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-98ab32ad-9be7-4ac1-b298-84fe94400d30 tempest-GroupSnapshotsTest-1381895959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-9996d60e-ea00-49a3-a6eb-1456ded75600 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:33:27 devstack sudo[90874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-9996d60e-ea00-49a3-a6eb-1456ded75600 Sep 06 06:33:27 devstack sudo[90874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:33:27 devstack sudo[90874]: pam_unix(sudo:session): session closed for user root Sep 06 06:33:27 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-98ab32ad-9be7-4ac1-b298-84fe94400d30 tempest-GroupSnapshotsTest-1381895959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-9996d60e-ea00-49a3-a6eb-1456ded75600" returned: 0 in 0.320s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:33:27 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-98ab32ad-9be7-4ac1-b298-84fe94400d30 tempest-GroupSnapshotsTest-1381895959 None] Lock "cinder-quobyte-9996d60e-ea00-49a3-a6eb-1456ded75600" released by "delete_volume" :: held 0.926s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:33:27 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-98ab32ad-9be7-4ac1-b298-84fe94400d30 tempest-GroupSnapshotsTest-1381895959 None] Created reservations ['66c0a207-1910-4eab-925a-a3a51411c4b9'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:33:27 devstack cinder-volume[87329]: WARNING cinder.db.api [None req-98ab32ad-9be7-4ac1-b298-84fe94400d30 tempest-GroupSnapshotsTest-1381895959 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-77671465'] Sep 06 06:33:27 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-98ab32ad-9be7-4ac1-b298-84fe94400d30 tempest-GroupSnapshotsTest-1381895959 None] Created reservations ['476c03a4-ff2d-4ada-ab30-2189cff95a9c', '17a171c2-4fb4-48af-8c33-8c61eaf54d96', 'deaa36b9-8957-4ca5-9241-34cab361c70d', '4941d63e-44db-41c1-83f1-b52fe2446d26'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:33:27 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-b0989b33-2017-423b-86a9-2df7d20dbfa9 tempest-VolumesTransfersTest-1730724130 None] Acquiring lock "cinder-cff845e7-48f8-4b06-ba29-8140e496cfcf-delete_volume" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:33:27 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-b0989b33-2017-423b-86a9-2df7d20dbfa9 tempest-VolumesTransfersTest-1730724130 None] Lock "cinder-cff845e7-48f8-4b06-ba29-8140e496cfcf-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:33:27 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-b0989b33-2017-423b-86a9-2df7d20dbfa9 tempest-VolumesTransfersTest-1730724130 None] Acquiring lock "cinder-quobyte-cff845e7-48f8-4b06-ba29-8140e496cfcf" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:33:27 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-b0989b33-2017-423b-86a9-2df7d20dbfa9 tempest-VolumesTransfersTest-1730724130 None] Lock "cinder-quobyte-cff845e7-48f8-4b06-ba29-8140e496cfcf" acquired by "delete_volume" :: waited 0.024s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:33:27 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e47fa97-aa21-40a4-bf68-3221e13ab6b9]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:33:27 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-b0989b33-2017-423b-86a9-2df7d20dbfa9 tempest-VolumesTransfersTest-1730724130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-cff845e7-48f8-4b06-ba29-8140e496cfcf {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:33:27 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-98ab32ad-9be7-4ac1-b298-84fe94400d30 tempest-GroupSnapshotsTest-1381895959 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:33:27 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-98ab32ad-9be7-4ac1-b298-84fe94400d30 tempest-GroupSnapshotsTest-1381895959 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:33:27 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-98ab32ad-9be7-4ac1-b298-84fe94400d30 tempest-GroupSnapshotsTest-1381895959 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:33:27 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-98ab32ad-9be7-4ac1-b298-84fe94400d30 tempest-GroupSnapshotsTest-1381895959 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:33:27 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-98ab32ad-9be7-4ac1-b298-84fe94400d30 tempest-GroupSnapshotsTest-1381895959 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:33:27 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-98ab32ad-9be7-4ac1-b298-84fe94400d30 tempest-GroupSnapshotsTest-1381895959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:33:27 devstack sudo[90878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:33:27 devstack sudo[90878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:33:27 devstack sudo[90877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-cff845e7-48f8-4b06-ba29-8140e496cfcf Sep 06 06:33:27 devstack sudo[90877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:33:28 devstack sudo[90878]: pam_unix(sudo:session): session closed for user root Sep 06 06:33:28 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-98ab32ad-9be7-4ac1-b298-84fe94400d30 tempest-GroupSnapshotsTest-1381895959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.431s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:33:28 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-98ab32ad-9be7-4ac1-b298-84fe94400d30 tempest-GroupSnapshotsTest-1381895959 None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:33:28 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-98ab32ad-9be7-4ac1-b298-84fe94400d30 tempest-GroupSnapshotsTest-1381895959 None] Delete group completed successfully. Sep 06 06:33:28 devstack sudo[90877]: pam_unix(sudo:session): session closed for user root Sep 06 06:33:28 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-b0989b33-2017-423b-86a9-2df7d20dbfa9 tempest-VolumesTransfersTest-1730724130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-cff845e7-48f8-4b06-ba29-8140e496cfcf" returned: 0 in 0.584s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:33:28 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-b0989b33-2017-423b-86a9-2df7d20dbfa9 tempest-VolumesTransfersTest-1730724130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-cff845e7-48f8-4b06-ba29-8140e496cfcf {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:33:28 devstack sudo[90886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-cff845e7-48f8-4b06-ba29-8140e496cfcf Sep 06 06:33:28 devstack sudo[90886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:33:28 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-35dec5fb-2147-430c-a082-6dfb6673bf21 tempest-GroupSnapshotsTest-1381895959 None] Group tempest-GroupSnapshotsTest-Group-1837659429: creating Sep 06 06:33:28 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-35dec5fb-2147-430c-a082-6dfb6673bf21 tempest-GroupSnapshotsTest-1381895959 None] Group tempest-GroupSnapshotsTest-Group-1837659429: created successfully Sep 06 06:33:28 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-35dec5fb-2147-430c-a082-6dfb6673bf21 tempest-GroupSnapshotsTest-1381895959 None] Create group completed successfully. Sep 06 06:33:28 devstack sudo[90886]: pam_unix(sudo:session): session closed for user root Sep 06 06:33:28 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-b0989b33-2017-423b-86a9-2df7d20dbfa9 tempest-VolumesTransfersTest-1730724130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-cff845e7-48f8-4b06-ba29-8140e496cfcf" returned: 0 in 0.304s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:33:28 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-b0989b33-2017-423b-86a9-2df7d20dbfa9 tempest-VolumesTransfersTest-1730724130 None] Lock "cinder-quobyte-cff845e7-48f8-4b06-ba29-8140e496cfcf" released by "delete_volume" :: held 0.939s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:33:28 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-b0989b33-2017-423b-86a9-2df7d20dbfa9 tempest-VolumesTransfersTest-1730724130 None] Created reservations ['fd5d9714-f3aa-4672-bdcb-414483d8e117', '0041fc31-f505-4be3-bbdb-cdb91cefb187', 'dfc5de43-054d-444b-9d12-1e50a5df7115', '8e64df4c-6a94-4533-9c04-b11f3ecc7ecc'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:33:28 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-b0989b33-2017-423b-86a9-2df7d20dbfa9 tempest-VolumesTransfersTest-1730724130 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:33:28 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-b0989b33-2017-423b-86a9-2df7d20dbfa9 tempest-VolumesTransfersTest-1730724130 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:33:28 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-b0989b33-2017-423b-86a9-2df7d20dbfa9 tempest-VolumesTransfersTest-1730724130 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:33:28 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-b0989b33-2017-423b-86a9-2df7d20dbfa9 tempest-VolumesTransfersTest-1730724130 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:33:28 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-b0989b33-2017-423b-86a9-2df7d20dbfa9 tempest-VolumesTransfersTest-1730724130 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:33:28 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-b0989b33-2017-423b-86a9-2df7d20dbfa9 tempest-VolumesTransfersTest-1730724130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:33:28 devstack sudo[90889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:33:28 devstack sudo[90889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:33:28 devstack sudo[90889]: pam_unix(sudo:session): session closed for user root Sep 06 06:33:28 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-b0989b33-2017-423b-86a9-2df7d20dbfa9 tempest-VolumesTransfersTest-1730724130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.316s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:33:28 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-b0989b33-2017-423b-86a9-2df7d20dbfa9 tempest-VolumesTransfersTest-1730724130 None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:33:29 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-b0989b33-2017-423b-86a9-2df7d20dbfa9 tempest-VolumesTransfersTest-1730724130 None] Deleted volume successfully. Sep 06 06:33:29 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-b0989b33-2017-423b-86a9-2df7d20dbfa9 tempest-VolumesTransfersTest-1730724130 None] Lock "cinder-cff845e7-48f8-4b06-ba29-8140e496cfcf-delete_volume" released by "delete_volume" :: held 1.527s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:33:30 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0d7f4b4-fb72-4d17-b0c9-5fe96eb8c660 tempest-GroupSnapshotsTest-1381895959 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87329) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 06:33:30 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-c0d7f4b4-fb72-4d17-b0c9-5fe96eb8c660 tempest-GroupSnapshotsTest-1381895959 None] Flow 'volume_create_manager' (80e77593-5933-46f3-857b-fee7bea9198a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:33:30 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-c0d7f4b4-fb72-4d17-b0c9-5fe96eb8c660 tempest-GroupSnapshotsTest-1381895959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e78c4a4d-4af2-4694-9ccf-4013bfe57170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:33:30 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-c0d7f4b4-fb72-4d17-b0c9-5fe96eb8c660 tempest-GroupSnapshotsTest-1381895959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e78c4a4d-4af2-4694-9ccf-4013bfe57170) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:33:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2072745860',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=37f7e445-a0e9-4024-b885-416dd7c61454,host='devstack@QuobyteHD#QuobyteHD',id=e7ce1c99-8f80-4fcd-a0a3-c358d505c6a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be1988e2a2c84f20ab9ef621b3b61699',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:33:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:33:30Z,use_quota=True,user_id='79054ac364294b7d9a926ce72e15dde0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06ec28b0-6e3b-4ef9-b8b1-8253c5c0ac92),volume_type_id=06ec28b0-6e3b-4ef9-b8b1-8253c5c0ac92)' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:33:30 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-c0d7f4b4-fb72-4d17-b0c9-5fe96eb8c660 tempest-GroupSnapshotsTest-1381895959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb931706-1476-43ad-9826-2cc366f7d86d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:33:30 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-c0d7f4b4-fb72-4d17-b0c9-5fe96eb8c660 tempest-GroupSnapshotsTest-1381895959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb931706-1476-43ad-9826-2cc366f7d86d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:33:30 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-c0d7f4b4-fb72-4d17-b0c9-5fe96eb8c660 tempest-GroupSnapshotsTest-1381895959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a94c7ec9-1557-48bd-9330-b0699ab0dafe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:33:30 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-c0d7f4b4-fb72-4d17-b0c9-5fe96eb8c660 tempest-GroupSnapshotsTest-1381895959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a94c7ec9-1557-48bd-9330-b0699ab0dafe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7ce1c99-8f80-4fcd-a0a3-c358d505c6a5', 'volume_name': 'volume-e7ce1c99-8f80-4fcd-a0a3-c358d505c6a5', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:33:30 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-c0d7f4b4-fb72-4d17-b0c9-5fe96eb8c660 tempest-GroupSnapshotsTest-1381895959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e059fd2-b04c-4918-b1a0-469e647f287f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:33:30 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-c0d7f4b4-fb72-4d17-b0c9-5fe96eb8c660 tempest-GroupSnapshotsTest-1381895959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e059fd2-b04c-4918-b1a0-469e647f287f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:33:30 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-c0d7f4b4-fb72-4d17-b0c9-5fe96eb8c660 tempest-GroupSnapshotsTest-1381895959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08814f04-4c0c-4d91-b738-16a47860021e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:33:30 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-c0d7f4b4-fb72-4d17-b0c9-5fe96eb8c660 tempest-GroupSnapshotsTest-1381895959 None] Volume e7ce1c99-8f80-4fcd-a0a3-c358d505c6a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7ce1c99-8f80-4fcd-a0a3-c358d505c6a5', 'volume_size': 1} Sep 06 06:33:30 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-c0d7f4b4-fb72-4d17-b0c9-5fe96eb8c660 tempest-GroupSnapshotsTest-1381895959 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:33:30 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-c0d7f4b4-fb72-4d17-b0c9-5fe96eb8c660 tempest-GroupSnapshotsTest-1381895959 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:33:30 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-c0d7f4b4-fb72-4d17-b0c9-5fe96eb8c660 tempest-GroupSnapshotsTest-1381895959 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=37f7e445-a0e9-4024-b885-416dd7c61454,created_at=2026-09-06T04:33:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2072745860',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=37f7e445-a0e9-4024-b885-416dd7c61454,host='devstack@QuobyteHD#QuobyteHD',id=e7ce1c99-8f80-4fcd-a0a3-c358d505c6a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be1988e2a2c84f20ab9ef621b3b61699',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:33:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:33:30Z,use_quota=True,user_id='79054ac364294b7d9a926ce72e15dde0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06ec28b0-6e3b-4ef9-b8b1-8253c5c0ac92),volume_type_id=06ec28b0-6e3b-4ef9-b8b1-8253c5c0ac92)}" {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 06:33:30 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-c0d7f4b4-fb72-4d17-b0c9-5fe96eb8c660 tempest-GroupSnapshotsTest-1381895959 None] Creating volume e7ce1c99-8f80-4fcd-a0a3-c358d505c6a5 {{(pid=87329) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 06:33:30 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-c0d7f4b4-fb72-4d17-b0c9-5fe96eb8c660 tempest-GroupSnapshotsTest-1381895959 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:33:30 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-c0d7f4b4-fb72-4d17-b0c9-5fe96eb8c660 tempest-GroupSnapshotsTest-1381895959 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:33:30 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-c0d7f4b4-fb72-4d17-b0c9-5fe96eb8c660 tempest-GroupSnapshotsTest-1381895959 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:33:30 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-c0d7f4b4-fb72-4d17-b0c9-5fe96eb8c660 tempest-GroupSnapshotsTest-1381895959 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:33:30 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-c0d7f4b4-fb72-4d17-b0c9-5fe96eb8c660 tempest-GroupSnapshotsTest-1381895959 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:33:30 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-c0d7f4b4-fb72-4d17-b0c9-5fe96eb8c660 tempest-GroupSnapshotsTest-1381895959 None] Selected osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 as target Quobyte volume. {{(pid=87329) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 06:33:30 devstack cinder-volume[87329]: INFO cinder.volume.drivers.remotefs [None req-c0d7f4b4-fb72-4d17-b0c9-5fe96eb8c660 tempest-GroupSnapshotsTest-1381895959 None] casted to osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 Sep 06 06:33:30 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-c0d7f4b4-fb72-4d17-b0c9-5fe96eb8c660 tempest-GroupSnapshotsTest-1381895959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e7ce1c99-8f80-4fcd-a0a3-c358d505c6a5 1073741824 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:33:30 devstack sudo[90905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e7ce1c99-8f80-4fcd-a0a3-c358d505c6a5 1073741824 Sep 06 06:33:30 devstack sudo[90905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:33:30 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-9459d60f-5404-454e-9c34-a97ea14ab325 tempest-VolumesTransfersTest-1085228910 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87329) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 06:33:30 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-9459d60f-5404-454e-9c34-a97ea14ab325 tempest-VolumesTransfersTest-1085228910 None] Flow 'volume_create_manager' (f7d67244-bfe4-4324-b8f5-b0ceb95c4d19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:33:30 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-9459d60f-5404-454e-9c34-a97ea14ab325 tempest-VolumesTransfersTest-1085228910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (244487d3-6be5-4740-bd51-5888a7b8fd73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:33:30 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-9459d60f-5404-454e-9c34-a97ea14ab325 tempest-VolumesTransfersTest-1085228910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (244487d3-6be5-4740-bd51-5888a7b8fd73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:33:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1246915474',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=508783b7-0f34-4b42-81cf-570c7371007e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af56aadea8de45caaa6f1d734f96b746',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:33:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:33:31Z,use_quota=True,user_id='761b1f62194b44fdbafb52d2ccddf163',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:33:30 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-9459d60f-5404-454e-9c34-a97ea14ab325 tempest-VolumesTransfersTest-1085228910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (012900f5-0007-4dc0-a6ad-f20b164958f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:33:30 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-9459d60f-5404-454e-9c34-a97ea14ab325 tempest-VolumesTransfersTest-1085228910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (012900f5-0007-4dc0-a6ad-f20b164958f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:33:30 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-9459d60f-5404-454e-9c34-a97ea14ab325 tempest-VolumesTransfersTest-1085228910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d51a4825-cdd3-4d6b-93e5-4fe3c09aad40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:33:30 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-9459d60f-5404-454e-9c34-a97ea14ab325 tempest-VolumesTransfersTest-1085228910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d51a4825-cdd3-4d6b-93e5-4fe3c09aad40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '508783b7-0f34-4b42-81cf-570c7371007e', 'volume_name': 'volume-508783b7-0f34-4b42-81cf-570c7371007e', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:33:30 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-9459d60f-5404-454e-9c34-a97ea14ab325 tempest-VolumesTransfersTest-1085228910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6ea4383-886c-4010-ad54-74cc7864bf3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:33:30 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-9459d60f-5404-454e-9c34-a97ea14ab325 tempest-VolumesTransfersTest-1085228910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6ea4383-886c-4010-ad54-74cc7864bf3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:33:30 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-9459d60f-5404-454e-9c34-a97ea14ab325 tempest-VolumesTransfersTest-1085228910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78fbd8dd-8eef-4c54-99cc-9731130a0b45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:33:30 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-9459d60f-5404-454e-9c34-a97ea14ab325 tempest-VolumesTransfersTest-1085228910 None] Volume 508783b7-0f34-4b42-81cf-570c7371007e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-508783b7-0f34-4b42-81cf-570c7371007e', 'volume_size': 1} Sep 06 06:33:30 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-9459d60f-5404-454e-9c34-a97ea14ab325 tempest-VolumesTransfersTest-1085228910 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:33:31 devstack sudo[90905]: pam_unix(sudo:session): session closed for user root Sep 06 06:33:31 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-c0d7f4b4-fb72-4d17-b0c9-5fe96eb8c660 tempest-GroupSnapshotsTest-1381895959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e7ce1c99-8f80-4fcd-a0a3-c358d505c6a5 1073741824" returned: 0 in 0.737s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:33:31 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-c0d7f4b4-fb72-4d17-b0c9-5fe96eb8c660 tempest-GroupSnapshotsTest-1381895959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e7ce1c99-8f80-4fcd-a0a3-c358d505c6a5 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:33:31 devstack sudo[90934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e7ce1c99-8f80-4fcd-a0a3-c358d505c6a5 Sep 06 06:33:31 devstack sudo[90934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:33:31 devstack sudo[90934]: pam_unix(sudo:session): session closed for user root Sep 06 06:33:31 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-c0d7f4b4-fb72-4d17-b0c9-5fe96eb8c660 tempest-GroupSnapshotsTest-1381895959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e7ce1c99-8f80-4fcd-a0a3-c358d505c6a5" returned: 0 in 0.446s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:33:31 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-c0d7f4b4-fb72-4d17-b0c9-5fe96eb8c660 tempest-GroupSnapshotsTest-1381895959 None] <== create_volume: return (1272ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'} {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 06:33:31 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-c0d7f4b4-fb72-4d17-b0c9-5fe96eb8c660 tempest-GroupSnapshotsTest-1381895959 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.275s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:33:31 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-9459d60f-5404-454e-9c34-a97ea14ab325 tempest-VolumesTransfersTest-1085228910 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.959s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:33:31 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-9459d60f-5404-454e-9c34-a97ea14ab325 tempest-VolumesTransfersTest-1085228910 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:33:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1246915474',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=508783b7-0f34-4b42-81cf-570c7371007e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af56aadea8de45caaa6f1d734f96b746',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:33:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:33:31Z,use_quota=True,user_id='761b1f62194b44fdbafb52d2ccddf163',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)}" {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 06:33:31 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-9459d60f-5404-454e-9c34-a97ea14ab325 tempest-VolumesTransfersTest-1085228910 None] Creating volume 508783b7-0f34-4b42-81cf-570c7371007e {{(pid=87329) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 06:33:31 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-9459d60f-5404-454e-9c34-a97ea14ab325 tempest-VolumesTransfersTest-1085228910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:33:31 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-9459d60f-5404-454e-9c34-a97ea14ab325 tempest-VolumesTransfersTest-1085228910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:33:31 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-9459d60f-5404-454e-9c34-a97ea14ab325 tempest-VolumesTransfersTest-1085228910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:33:31 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-9459d60f-5404-454e-9c34-a97ea14ab325 tempest-VolumesTransfersTest-1085228910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:33:31 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-9459d60f-5404-454e-9c34-a97ea14ab325 tempest-VolumesTransfersTest-1085228910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:33:31 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-9459d60f-5404-454e-9c34-a97ea14ab325 tempest-VolumesTransfersTest-1085228910 None] Selected osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 as target Quobyte volume. {{(pid=87329) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 06:33:31 devstack cinder-volume[87329]: INFO cinder.volume.drivers.remotefs [None req-9459d60f-5404-454e-9c34-a97ea14ab325 tempest-VolumesTransfersTest-1085228910 None] casted to osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 Sep 06 06:33:31 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-9459d60f-5404-454e-9c34-a97ea14ab325 tempest-VolumesTransfersTest-1085228910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-508783b7-0f34-4b42-81cf-570c7371007e 1073741824 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:33:31 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-c0d7f4b4-fb72-4d17-b0c9-5fe96eb8c660 tempest-GroupSnapshotsTest-1381895959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08814f04-4c0c-4d91-b738-16a47860021e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7ce1c99-8f80-4fcd-a0a3-c358d505c6a5', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:33:31 devstack sudo[90972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-508783b7-0f34-4b42-81cf-570c7371007e 1073741824 Sep 06 06:33:31 devstack sudo[90972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:33:31 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-c0d7f4b4-fb72-4d17-b0c9-5fe96eb8c660 tempest-GroupSnapshotsTest-1381895959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ada319e-ab37-43bb-8d5e-31c340adef6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:33:31 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-c0d7f4b4-fb72-4d17-b0c9-5fe96eb8c660 tempest-GroupSnapshotsTest-1381895959 None] Volume volume-e7ce1c99-8f80-4fcd-a0a3-c358d505c6a5 (e7ce1c99-8f80-4fcd-a0a3-c358d505c6a5): created successfully Sep 06 06:33:31 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-c0d7f4b4-fb72-4d17-b0c9-5fe96eb8c660 tempest-GroupSnapshotsTest-1381895959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ada319e-ab37-43bb-8d5e-31c340adef6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:33:31 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-c0d7f4b4-fb72-4d17-b0c9-5fe96eb8c660 tempest-GroupSnapshotsTest-1381895959 None] Flow 'volume_create_manager' (80e77593-5933-46f3-857b-fee7bea9198a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:33:31 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-c0d7f4b4-fb72-4d17-b0c9-5fe96eb8c660 tempest-GroupSnapshotsTest-1381895959 None] Created volume successfully. Sep 06 06:33:32 devstack sudo[90972]: pam_unix(sudo:session): session closed for user root Sep 06 06:33:32 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-9459d60f-5404-454e-9c34-a97ea14ab325 tempest-VolumesTransfersTest-1085228910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-508783b7-0f34-4b42-81cf-570c7371007e 1073741824" returned: 0 in 0.696s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:33:32 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-9459d60f-5404-454e-9c34-a97ea14ab325 tempest-VolumesTransfersTest-1085228910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-508783b7-0f34-4b42-81cf-570c7371007e {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:33:32 devstack sudo[90987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-508783b7-0f34-4b42-81cf-570c7371007e Sep 06 06:33:32 devstack sudo[90987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:33:32 devstack sudo[90987]: pam_unix(sudo:session): session closed for user root Sep 06 06:33:32 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-9459d60f-5404-454e-9c34-a97ea14ab325 tempest-VolumesTransfersTest-1085228910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-508783b7-0f34-4b42-81cf-570c7371007e" returned: 0 in 0.279s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:33:32 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-9459d60f-5404-454e-9c34-a97ea14ab325 tempest-VolumesTransfersTest-1085228910 None] <== create_volume: return (1028ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'} {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 06:33:32 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-9459d60f-5404-454e-9c34-a97ea14ab325 tempest-VolumesTransfersTest-1085228910 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.034s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:33:32 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-9459d60f-5404-454e-9c34-a97ea14ab325 tempest-VolumesTransfersTest-1085228910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78fbd8dd-8eef-4c54-99cc-9731130a0b45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-508783b7-0f34-4b42-81cf-570c7371007e', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:33:32 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-9459d60f-5404-454e-9c34-a97ea14ab325 tempest-VolumesTransfersTest-1085228910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d42ada1c-1fa3-4655-b0b0-d70606d819da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:33:32 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-9459d60f-5404-454e-9c34-a97ea14ab325 tempest-VolumesTransfersTest-1085228910 None] Volume volume-508783b7-0f34-4b42-81cf-570c7371007e (508783b7-0f34-4b42-81cf-570c7371007e): created successfully Sep 06 06:33:32 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-9459d60f-5404-454e-9c34-a97ea14ab325 tempest-VolumesTransfersTest-1085228910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d42ada1c-1fa3-4655-b0b0-d70606d819da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:33:32 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-9459d60f-5404-454e-9c34-a97ea14ab325 tempest-VolumesTransfersTest-1085228910 None] Flow 'volume_create_manager' (f7d67244-bfe4-4324-b8f5-b0ceb95c4d19) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:33:32 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-9459d60f-5404-454e-9c34-a97ea14ab325 tempest-VolumesTransfersTest-1085228910 None] Created volume successfully. Sep 06 06:33:33 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a005876-69d2-42ef-bd52-358122396d9b tempest-GroupSnapshotsTest-1381895959 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87329) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 06:33:33 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-3a005876-69d2-42ef-bd52-358122396d9b tempest-GroupSnapshotsTest-1381895959 None] Flow 'volume_create_manager' (00a1d905-bf1d-4df4-8e05-d9129f09de58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:33:33 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-3a005876-69d2-42ef-bd52-358122396d9b tempest-GroupSnapshotsTest-1381895959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (711e927f-8cb7-4878-85f5-7dd3ae497ae1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:33:33 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-3a005876-69d2-42ef-bd52-358122396d9b tempest-GroupSnapshotsTest-1381895959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (711e927f-8cb7-4878-85f5-7dd3ae497ae1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:33:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1040963568',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=37f7e445-a0e9-4024-b885-416dd7c61454,host='devstack@QuobyteHD#QuobyteHD',id=9f40f16d-e504-4087-88ff-86d542fda7bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be1988e2a2c84f20ab9ef621b3b61699',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:33:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:33:33Z,use_quota=True,user_id='79054ac364294b7d9a926ce72e15dde0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06ec28b0-6e3b-4ef9-b8b1-8253c5c0ac92),volume_type_id=06ec28b0-6e3b-4ef9-b8b1-8253c5c0ac92)' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:33:33 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-3a005876-69d2-42ef-bd52-358122396d9b tempest-GroupSnapshotsTest-1381895959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f84a8f7-ad8d-46db-b8af-ff9b0f8f2cec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:33:33 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-3a005876-69d2-42ef-bd52-358122396d9b tempest-GroupSnapshotsTest-1381895959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f84a8f7-ad8d-46db-b8af-ff9b0f8f2cec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:33:33 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-3a005876-69d2-42ef-bd52-358122396d9b tempest-GroupSnapshotsTest-1381895959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (726ebaeb-46f4-4643-9b0c-6276e344458b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:33:33 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-3a005876-69d2-42ef-bd52-358122396d9b tempest-GroupSnapshotsTest-1381895959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (726ebaeb-46f4-4643-9b0c-6276e344458b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f40f16d-e504-4087-88ff-86d542fda7bb', 'volume_name': 'volume-9f40f16d-e504-4087-88ff-86d542fda7bb', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:33:33 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-3a005876-69d2-42ef-bd52-358122396d9b tempest-GroupSnapshotsTest-1381895959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (564267c1-1e6b-4c61-83ee-1a3361a0d93d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:33:33 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-3a005876-69d2-42ef-bd52-358122396d9b tempest-GroupSnapshotsTest-1381895959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (564267c1-1e6b-4c61-83ee-1a3361a0d93d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:33:33 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-3a005876-69d2-42ef-bd52-358122396d9b tempest-GroupSnapshotsTest-1381895959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49c087a5-16bd-48d4-9a46-9d3bc4e3e913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:33:33 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-3a005876-69d2-42ef-bd52-358122396d9b tempest-GroupSnapshotsTest-1381895959 None] Volume 9f40f16d-e504-4087-88ff-86d542fda7bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f40f16d-e504-4087-88ff-86d542fda7bb', 'volume_size': 1} Sep 06 06:33:33 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-3a005876-69d2-42ef-bd52-358122396d9b tempest-GroupSnapshotsTest-1381895959 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:33:33 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-3a005876-69d2-42ef-bd52-358122396d9b tempest-GroupSnapshotsTest-1381895959 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:33:33 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-3a005876-69d2-42ef-bd52-358122396d9b tempest-GroupSnapshotsTest-1381895959 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=37f7e445-a0e9-4024-b885-416dd7c61454,created_at=2026-09-06T04:33:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1040963568',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=37f7e445-a0e9-4024-b885-416dd7c61454,host='devstack@QuobyteHD#QuobyteHD',id=9f40f16d-e504-4087-88ff-86d542fda7bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be1988e2a2c84f20ab9ef621b3b61699',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:33:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:33:33Z,use_quota=True,user_id='79054ac364294b7d9a926ce72e15dde0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(06ec28b0-6e3b-4ef9-b8b1-8253c5c0ac92),volume_type_id=06ec28b0-6e3b-4ef9-b8b1-8253c5c0ac92)}" {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 06:33:33 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-3a005876-69d2-42ef-bd52-358122396d9b tempest-GroupSnapshotsTest-1381895959 None] Creating volume 9f40f16d-e504-4087-88ff-86d542fda7bb {{(pid=87329) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 06:33:33 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-3a005876-69d2-42ef-bd52-358122396d9b tempest-GroupSnapshotsTest-1381895959 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:33:33 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-3a005876-69d2-42ef-bd52-358122396d9b tempest-GroupSnapshotsTest-1381895959 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:33:33 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-3a005876-69d2-42ef-bd52-358122396d9b tempest-GroupSnapshotsTest-1381895959 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:33:33 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-3a005876-69d2-42ef-bd52-358122396d9b tempest-GroupSnapshotsTest-1381895959 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:33:33 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-3a005876-69d2-42ef-bd52-358122396d9b tempest-GroupSnapshotsTest-1381895959 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:33:33 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-3a005876-69d2-42ef-bd52-358122396d9b tempest-GroupSnapshotsTest-1381895959 None] Selected osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 as target Quobyte volume. {{(pid=87329) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 06:33:33 devstack cinder-volume[87329]: INFO cinder.volume.drivers.remotefs [None req-3a005876-69d2-42ef-bd52-358122396d9b tempest-GroupSnapshotsTest-1381895959 None] casted to osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 Sep 06 06:33:33 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-3a005876-69d2-42ef-bd52-358122396d9b tempest-GroupSnapshotsTest-1381895959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-9f40f16d-e504-4087-88ff-86d542fda7bb 1073741824 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:33:33 devstack sudo[90992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-9f40f16d-e504-4087-88ff-86d542fda7bb 1073741824 Sep 06 06:33:33 devstack sudo[90992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:33:34 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-a64ae4e1-3fa4-46eb-bdde-45fb39a10433 tempest-VolumesTransfersTest-1730724130 None] Acquiring lock "cinder-508783b7-0f34-4b42-81cf-570c7371007e-delete_volume" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:33:34 devstack sudo[90992]: pam_unix(sudo:session): session closed for user root Sep 06 06:33:34 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-a64ae4e1-3fa4-46eb-bdde-45fb39a10433 tempest-VolumesTransfersTest-1730724130 None] Lock "cinder-508783b7-0f34-4b42-81cf-570c7371007e-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:33:34 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-3a005876-69d2-42ef-bd52-358122396d9b tempest-GroupSnapshotsTest-1381895959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-9f40f16d-e504-4087-88ff-86d542fda7bb 1073741824" returned: 0 in 0.623s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:33:34 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-a64ae4e1-3fa4-46eb-bdde-45fb39a10433 tempest-VolumesTransfersTest-1730724130 None] Acquiring lock "cinder-quobyte-508783b7-0f34-4b42-81cf-570c7371007e" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:33:34 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-3a005876-69d2-42ef-bd52-358122396d9b tempest-GroupSnapshotsTest-1381895959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-9f40f16d-e504-4087-88ff-86d542fda7bb {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:33:34 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-a64ae4e1-3fa4-46eb-bdde-45fb39a10433 tempest-VolumesTransfersTest-1730724130 None] Lock "cinder-quobyte-508783b7-0f34-4b42-81cf-570c7371007e" acquired by "delete_volume" :: waited 0.035s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:33:34 devstack sudo[90999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-9f40f16d-e504-4087-88ff-86d542fda7bb Sep 06 06:33:34 devstack sudo[90999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:33:34 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6853b18-a7f9-4062-a95b-6bab096f6f29]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:33:34 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-a64ae4e1-3fa4-46eb-bdde-45fb39a10433 tempest-VolumesTransfersTest-1730724130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-508783b7-0f34-4b42-81cf-570c7371007e {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:33:34 devstack sudo[91001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-508783b7-0f34-4b42-81cf-570c7371007e Sep 06 06:33:34 devstack sudo[91001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:33:34 devstack sudo[90999]: pam_unix(sudo:session): session closed for user root Sep 06 06:33:34 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-3a005876-69d2-42ef-bd52-358122396d9b tempest-GroupSnapshotsTest-1381895959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-9f40f16d-e504-4087-88ff-86d542fda7bb" returned: 0 in 0.573s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:33:34 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-3a005876-69d2-42ef-bd52-358122396d9b tempest-GroupSnapshotsTest-1381895959 None] <== create_volume: return (1276ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'} {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 06:33:34 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-3a005876-69d2-42ef-bd52-358122396d9b tempest-GroupSnapshotsTest-1381895959 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.291s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:33:35 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-3a005876-69d2-42ef-bd52-358122396d9b tempest-GroupSnapshotsTest-1381895959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49c087a5-16bd-48d4-9a46-9d3bc4e3e913) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f40f16d-e504-4087-88ff-86d542fda7bb', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:33:35 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-3a005876-69d2-42ef-bd52-358122396d9b tempest-GroupSnapshotsTest-1381895959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e782611-9431-4b54-aaa5-048be21ecc33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:33:35 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-3a005876-69d2-42ef-bd52-358122396d9b tempest-GroupSnapshotsTest-1381895959 None] Volume volume-9f40f16d-e504-4087-88ff-86d542fda7bb (9f40f16d-e504-4087-88ff-86d542fda7bb): created successfully Sep 06 06:33:35 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-3a005876-69d2-42ef-bd52-358122396d9b tempest-GroupSnapshotsTest-1381895959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e782611-9431-4b54-aaa5-048be21ecc33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:33:35 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-3a005876-69d2-42ef-bd52-358122396d9b tempest-GroupSnapshotsTest-1381895959 None] Flow 'volume_create_manager' (00a1d905-bf1d-4df4-8e05-d9129f09de58) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:33:35 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-3a005876-69d2-42ef-bd52-358122396d9b tempest-GroupSnapshotsTest-1381895959 None] Created volume successfully. Sep 06 06:33:35 devstack sudo[91001]: pam_unix(sudo:session): session closed for user root Sep 06 06:33:35 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-a64ae4e1-3fa4-46eb-bdde-45fb39a10433 tempest-VolumesTransfersTest-1730724130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-508783b7-0f34-4b42-81cf-570c7371007e" returned: 0 in 0.960s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:33:35 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-a64ae4e1-3fa4-46eb-bdde-45fb39a10433 tempest-VolumesTransfersTest-1730724130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-508783b7-0f34-4b42-81cf-570c7371007e {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:33:35 devstack sudo[91080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-508783b7-0f34-4b42-81cf-570c7371007e Sep 06 06:33:35 devstack sudo[91080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:33:36 devstack sudo[91080]: pam_unix(sudo:session): session closed for user root Sep 06 06:33:36 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-a64ae4e1-3fa4-46eb-bdde-45fb39a10433 tempest-VolumesTransfersTest-1730724130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-508783b7-0f34-4b42-81cf-570c7371007e" returned: 0 in 0.619s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:33:36 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-a64ae4e1-3fa4-46eb-bdde-45fb39a10433 tempest-VolumesTransfersTest-1730724130 None] Lock "cinder-quobyte-508783b7-0f34-4b42-81cf-570c7371007e" released by "delete_volume" :: held 1.673s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:33:36 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-a64ae4e1-3fa4-46eb-bdde-45fb39a10433 tempest-VolumesTransfersTest-1730724130 None] Created reservations ['4de31fcc-f000-4796-a70a-dc52f6cde097', '3509dee4-9c8d-470a-b8fc-7eb5cb520531', '3f22b92c-5ff4-4db6-a4ee-29a9ad3b9561', 'e773755b-d8dd-4812-b72b-c2bed1af4753'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:33:36 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-a64ae4e1-3fa4-46eb-bdde-45fb39a10433 tempest-VolumesTransfersTest-1730724130 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:33:36 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-a64ae4e1-3fa4-46eb-bdde-45fb39a10433 tempest-VolumesTransfersTest-1730724130 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:33:36 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-a64ae4e1-3fa4-46eb-bdde-45fb39a10433 tempest-VolumesTransfersTest-1730724130 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:33:36 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-a64ae4e1-3fa4-46eb-bdde-45fb39a10433 tempest-VolumesTransfersTest-1730724130 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:33:36 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-a64ae4e1-3fa4-46eb-bdde-45fb39a10433 tempest-VolumesTransfersTest-1730724130 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:33:36 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-a64ae4e1-3fa4-46eb-bdde-45fb39a10433 tempest-VolumesTransfersTest-1730724130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:33:36 devstack sudo[91108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:33:36 devstack sudo[91108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:33:36 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-0722eca6-c96b-4a65-be20-783387b45a25 tempest-GroupSnapshotsTest-1381895959 None] Update group completed successfully. Sep 06 06:33:36 devstack sudo[91108]: pam_unix(sudo:session): session closed for user root Sep 06 06:33:36 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-a64ae4e1-3fa4-46eb-bdde-45fb39a10433 tempest-VolumesTransfersTest-1730724130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.562s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:33:36 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-a64ae4e1-3fa4-46eb-bdde-45fb39a10433 tempest-VolumesTransfersTest-1730724130 None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:33:36 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-a64ae4e1-3fa4-46eb-bdde-45fb39a10433 tempest-VolumesTransfersTest-1730724130 None] Deleted volume successfully. Sep 06 06:33:37 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-a64ae4e1-3fa4-46eb-bdde-45fb39a10433 tempest-VolumesTransfersTest-1730724130 None] Lock "cinder-508783b7-0f34-4b42-81cf-570c7371007e-delete_volume" released by "delete_volume" :: held 2.681s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:33:37 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-95d7dcd9-42a9-4aa9-ab25-7a2531cc7dae tempest-GroupSnapshotsTest-1381895959 None] Update group completed successfully. Sep 06 06:33:39 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-d5e902f5-f366-49b7-8cfa-0a834ab3ca91 tempest-GroupSnapshotsTest-1381895959 None] Update group completed successfully. Sep 06 06:33:40 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-35fe7ae1-0e2f-457f-907b-bdcb853d29da tempest-GroupSnapshotsTest-1381895959 None] Update group completed successfully. Sep 06 06:33:42 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-7f882ec7-fcc0-4d61-8fe1-0c805d697681 tempest-GroupSnapshotsTest-1381895959 None] GroupSnapshot f038225d-e1a3-47dd-a889-4d7254148088: creating. Sep 06 06:33:42 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-7f882ec7-fcc0-4d61-8fe1-0c805d697681 tempest-GroupSnapshotsTest-1381895959 None] Group snapshot f038225d-e1a3-47dd-a889-4d7254148088: creating. {{(pid=87329) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 06 06:33:42 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-7f882ec7-fcc0-4d61-8fe1-0c805d697681 tempest-GroupSnapshotsTest-1381895959 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:33:42 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-7f882ec7-fcc0-4d61-8fe1-0c805d697681 tempest-GroupSnapshotsTest-1381895959 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:33:42 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-7f882ec7-fcc0-4d61-8fe1-0c805d697681 tempest-GroupSnapshotsTest-1381895959 None] Creating offline snapshot 02012b37-5434-4106-bac1-7efd730e0f3a of volume e7ce1c99-8f80-4fcd-a0a3-c358d505c6a5 {{(pid=87329) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 06 06:33:42 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[72f43c6f-c99c-438c-8bf9-a8a8c88009a8]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:33:42 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-7f882ec7-fcc0-4d61-8fe1-0c805d697681 tempest-GroupSnapshotsTest-1381895959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e7ce1c99-8f80-4fcd-a0a3-c358d505c6a5 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:33:43 devstack sudo[91130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e7ce1c99-8f80-4fcd-a0a3-c358d505c6a5 Sep 06 06:33:43 devstack sudo[91130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:33:43 devstack sudo[91130]: pam_unix(sudo:session): session closed for user root Sep 06 06:33:43 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-7f882ec7-fcc0-4d61-8fe1-0c805d697681 tempest-GroupSnapshotsTest-1381895959 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e7ce1c99-8f80-4fcd-a0a3-c358d505c6a5" returned: 0 in 0.672s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:33:43 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-7f882ec7-fcc0-4d61-8fe1-0c805d697681 tempest-GroupSnapshotsTest-1381895959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e7ce1c99-8f80-4fcd-a0a3-c358d505c6a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e7ce1c99-8f80-4fcd-a0a3-c358d505c6a5.02012b37-5434-4106-bac1-7efd730e0f3a 1G {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:33:43 devstack sudo[91135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e7ce1c99-8f80-4fcd-a0a3-c358d505c6a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e7ce1c99-8f80-4fcd-a0a3-c358d505c6a5.02012b37-5434-4106-bac1-7efd730e0f3a 1G Sep 06 06:33:43 devstack sudo[91135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:33:44 devstack sudo[91135]: pam_unix(sudo:session): session closed for user root Sep 06 06:33:44 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-7f882ec7-fcc0-4d61-8fe1-0c805d697681 tempest-GroupSnapshotsTest-1381895959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e7ce1c99-8f80-4fcd-a0a3-c358d505c6a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e7ce1c99-8f80-4fcd-a0a3-c358d505c6a5.02012b37-5434-4106-bac1-7efd730e0f3a 1G" returned: 0 in 0.667s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:33:44 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-7f882ec7-fcc0-4d61-8fe1-0c805d697681 tempest-GroupSnapshotsTest-1381895959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7ce1c99-8f80-4fcd-a0a3-c358d505c6a5 -F qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e7ce1c99-8f80-4fcd-a0a3-c358d505c6a5.02012b37-5434-4106-bac1-7efd730e0f3a {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:33:44 devstack sudo[91165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7ce1c99-8f80-4fcd-a0a3-c358d505c6a5 -F qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e7ce1c99-8f80-4fcd-a0a3-c358d505c6a5.02012b37-5434-4106-bac1-7efd730e0f3a Sep 06 06:33:44 devstack sudo[91165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:33:44 devstack sudo[91165]: pam_unix(sudo:session): session closed for user root Sep 06 06:33:44 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-7f882ec7-fcc0-4d61-8fe1-0c805d697681 tempest-GroupSnapshotsTest-1381895959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7ce1c99-8f80-4fcd-a0a3-c358d505c6a5 -F qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e7ce1c99-8f80-4fcd-a0a3-c358d505c6a5.02012b37-5434-4106-bac1-7efd730e0f3a" returned: 0 in 0.454s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:33:44 devstack cinder-volume[87329]: WARNING cinder.volume.drivers.remotefs [None req-7f882ec7-fcc0-4d61-8fe1-0c805d697681 tempest-GroupSnapshotsTest-1381895959 None] /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e7ce1c99-8f80-4fcd-a0a3-c358d505c6a5.02012b37-5434-4106-bac1-7efd730e0f3a is being set with open permissions: ugo+rw: NotImplementedError Sep 06 06:33:44 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-7f882ec7-fcc0-4d61-8fe1-0c805d697681 tempest-GroupSnapshotsTest-1381895959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e7ce1c99-8f80-4fcd-a0a3-c358d505c6a5.02012b37-5434-4106-bac1-7efd730e0f3a {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:33:44 devstack sudo[91172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e7ce1c99-8f80-4fcd-a0a3-c358d505c6a5.02012b37-5434-4106-bac1-7efd730e0f3a Sep 06 06:33:44 devstack sudo[91172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:33:45 devstack sudo[91172]: pam_unix(sudo:session): session closed for user root Sep 06 06:33:45 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-7f882ec7-fcc0-4d61-8fe1-0c805d697681 tempest-GroupSnapshotsTest-1381895959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e7ce1c99-8f80-4fcd-a0a3-c358d505c6a5.02012b37-5434-4106-bac1-7efd730e0f3a" returned: 0 in 0.527s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:33:45 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-7f882ec7-fcc0-4d61-8fe1-0c805d697681 tempest-GroupSnapshotsTest-1381895959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e7ce1c99-8f80-4fcd-a0a3-c358d505c6a5.info {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:33:45 devstack sudo[91177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e7ce1c99-8f80-4fcd-a0a3-c358d505c6a5.info Sep 06 06:33:45 devstack sudo[91177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:33:45 devstack sudo[91177]: pam_unix(sudo:session): session closed for user root Sep 06 06:33:45 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-7f882ec7-fcc0-4d61-8fe1-0c805d697681 tempest-GroupSnapshotsTest-1381895959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e7ce1c99-8f80-4fcd-a0a3-c358d505c6a5.info" returned: 0 in 0.370s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:33:45 devstack cinder-volume[87329]: WARNING cinder.volume.drivers.remotefs [None req-7f882ec7-fcc0-4d61-8fe1-0c805d697681 tempest-GroupSnapshotsTest-1381895959 None] /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e7ce1c99-8f80-4fcd-a0a3-c358d505c6a5.info is being set with open permissions: ugo+rw: NotImplementedError Sep 06 06:33:45 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-7f882ec7-fcc0-4d61-8fe1-0c805d697681 tempest-GroupSnapshotsTest-1381895959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e7ce1c99-8f80-4fcd-a0a3-c358d505c6a5.info {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:33:45 devstack sudo[91180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e7ce1c99-8f80-4fcd-a0a3-c358d505c6a5.info Sep 06 06:33:45 devstack sudo[91180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:33:46 devstack sudo[91180]: pam_unix(sudo:session): session closed for user root Sep 06 06:33:46 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-7f882ec7-fcc0-4d61-8fe1-0c805d697681 tempest-GroupSnapshotsTest-1381895959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e7ce1c99-8f80-4fcd-a0a3-c358d505c6a5.info" returned: 0 in 0.603s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:33:46 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-7f882ec7-fcc0-4d61-8fe1-0c805d697681 tempest-GroupSnapshotsTest-1381895959 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.492s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:33:46 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-7f882ec7-fcc0-4d61-8fe1-0c805d697681 tempest-GroupSnapshotsTest-1381895959 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:33:46 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-7f882ec7-fcc0-4d61-8fe1-0c805d697681 tempest-GroupSnapshotsTest-1381895959 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:33:46 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-7f882ec7-fcc0-4d61-8fe1-0c805d697681 tempest-GroupSnapshotsTest-1381895959 None] Creating offline snapshot 767a659e-70f9-4336-ad03-aecceb6c695f of volume 9f40f16d-e504-4087-88ff-86d542fda7bb {{(pid=87329) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 06 06:33:46 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6eab561-9cd1-4498-ad30-3972e1be5eaa]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:33:46 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-7f882ec7-fcc0-4d61-8fe1-0c805d697681 tempest-GroupSnapshotsTest-1381895959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-9f40f16d-e504-4087-88ff-86d542fda7bb {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:33:46 devstack sudo[91183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-9f40f16d-e504-4087-88ff-86d542fda7bb Sep 06 06:33:46 devstack sudo[91183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:33:46 devstack sudo[91183]: pam_unix(sudo:session): session closed for user root Sep 06 06:33:46 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-7f882ec7-fcc0-4d61-8fe1-0c805d697681 tempest-GroupSnapshotsTest-1381895959 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-9f40f16d-e504-4087-88ff-86d542fda7bb" returned: 0 in 0.502s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:33:46 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-7f882ec7-fcc0-4d61-8fe1-0c805d697681 tempest-GroupSnapshotsTest-1381895959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-9f40f16d-e504-4087-88ff-86d542fda7bb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-9f40f16d-e504-4087-88ff-86d542fda7bb.767a659e-70f9-4336-ad03-aecceb6c695f 1G {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:33:46 devstack sudo[91188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-9f40f16d-e504-4087-88ff-86d542fda7bb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-9f40f16d-e504-4087-88ff-86d542fda7bb.767a659e-70f9-4336-ad03-aecceb6c695f 1G Sep 06 06:33:46 devstack sudo[91188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:33:47 devstack sudo[91188]: pam_unix(sudo:session): session closed for user root Sep 06 06:33:47 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-7f882ec7-fcc0-4d61-8fe1-0c805d697681 tempest-GroupSnapshotsTest-1381895959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-9f40f16d-e504-4087-88ff-86d542fda7bb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-9f40f16d-e504-4087-88ff-86d542fda7bb.767a659e-70f9-4336-ad03-aecceb6c695f 1G" returned: 0 in 0.622s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:33:47 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-7f882ec7-fcc0-4d61-8fe1-0c805d697681 tempest-GroupSnapshotsTest-1381895959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f40f16d-e504-4087-88ff-86d542fda7bb -F qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-9f40f16d-e504-4087-88ff-86d542fda7bb.767a659e-70f9-4336-ad03-aecceb6c695f {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:33:47 devstack sudo[91193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f40f16d-e504-4087-88ff-86d542fda7bb -F qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-9f40f16d-e504-4087-88ff-86d542fda7bb.767a659e-70f9-4336-ad03-aecceb6c695f Sep 06 06:33:47 devstack sudo[91193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:33:47 devstack sudo[91193]: pam_unix(sudo:session): session closed for user root Sep 06 06:33:47 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-7f882ec7-fcc0-4d61-8fe1-0c805d697681 tempest-GroupSnapshotsTest-1381895959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f40f16d-e504-4087-88ff-86d542fda7bb -F qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-9f40f16d-e504-4087-88ff-86d542fda7bb.767a659e-70f9-4336-ad03-aecceb6c695f" returned: 0 in 0.489s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:33:47 devstack cinder-volume[87329]: WARNING cinder.volume.drivers.remotefs [None req-7f882ec7-fcc0-4d61-8fe1-0c805d697681 tempest-GroupSnapshotsTest-1381895959 None] /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-9f40f16d-e504-4087-88ff-86d542fda7bb.767a659e-70f9-4336-ad03-aecceb6c695f is being set with open permissions: ugo+rw: NotImplementedError Sep 06 06:33:47 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-7f882ec7-fcc0-4d61-8fe1-0c805d697681 tempest-GroupSnapshotsTest-1381895959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-9f40f16d-e504-4087-88ff-86d542fda7bb.767a659e-70f9-4336-ad03-aecceb6c695f {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:33:47 devstack sudo[91199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-9f40f16d-e504-4087-88ff-86d542fda7bb.767a659e-70f9-4336-ad03-aecceb6c695f Sep 06 06:33:48 devstack sudo[91199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:33:48 devstack sudo[91199]: pam_unix(sudo:session): session closed for user root Sep 06 06:33:48 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-7f882ec7-fcc0-4d61-8fe1-0c805d697681 tempest-GroupSnapshotsTest-1381895959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-9f40f16d-e504-4087-88ff-86d542fda7bb.767a659e-70f9-4336-ad03-aecceb6c695f" returned: 0 in 0.426s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:33:48 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-7f882ec7-fcc0-4d61-8fe1-0c805d697681 tempest-GroupSnapshotsTest-1381895959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-9f40f16d-e504-4087-88ff-86d542fda7bb.info {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:33:48 devstack sudo[91202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-9f40f16d-e504-4087-88ff-86d542fda7bb.info Sep 06 06:33:48 devstack sudo[91202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:33:48 devstack cinder-volume[87329]: DEBUG oslo_service.periodic_task [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87329) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 06 06:33:48 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:33:48 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:33:48 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:33:48 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:33:48 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:33:48 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:33:48 devstack sudo[91204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:33:48 devstack sudo[91204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:33:48 devstack sudo[91202]: pam_unix(sudo:session): session closed for user root Sep 06 06:33:48 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-7f882ec7-fcc0-4d61-8fe1-0c805d697681 tempest-GroupSnapshotsTest-1381895959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-9f40f16d-e504-4087-88ff-86d542fda7bb.info" returned: 0 in 0.451s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:33:48 devstack cinder-volume[87329]: WARNING cinder.volume.drivers.remotefs [None req-7f882ec7-fcc0-4d61-8fe1-0c805d697681 tempest-GroupSnapshotsTest-1381895959 None] /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-9f40f16d-e504-4087-88ff-86d542fda7bb.info is being set with open permissions: ugo+rw: NotImplementedError Sep 06 06:33:48 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-7f882ec7-fcc0-4d61-8fe1-0c805d697681 tempest-GroupSnapshotsTest-1381895959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-9f40f16d-e504-4087-88ff-86d542fda7bb.info {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:33:48 devstack sudo[91204]: pam_unix(sudo:session): session closed for user root Sep 06 06:33:48 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.415s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:33:48 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:33:48 devstack cinder-volume[87329]: DEBUG oslo_service.periodic_task [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Running periodic task VolumeManager._thread_info {{(pid=87329) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 06 06:33:48 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] thread count: 8 {{(pid=87329) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 06 06:33:48 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] thread info: [<_MainThread(MainThread, started 126855043821696)>, , , , , , , ] {{(pid=87329) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 06 06:33:48 devstack sudo[91208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-9f40f16d-e504-4087-88ff-86d542fda7bb.info Sep 06 06:33:48 devstack sudo[91208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:33:49 devstack sudo[91208]: pam_unix(sudo:session): session closed for user root Sep 06 06:33:49 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-7f882ec7-fcc0-4d61-8fe1-0c805d697681 tempest-GroupSnapshotsTest-1381895959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-9f40f16d-e504-4087-88ff-86d542fda7bb.info" returned: 0 in 0.295s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:33:49 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-7f882ec7-fcc0-4d61-8fe1-0c805d697681 tempest-GroupSnapshotsTest-1381895959 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.930s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:33:49 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-7f882ec7-fcc0-4d61-8fe1-0c805d697681 tempest-GroupSnapshotsTest-1381895959 None] group_snapshot f038225d-e1a3-47dd-a889-4d7254148088: created successfully Sep 06 06:33:50 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-db816e98-02eb-48f5-b4fa-851a4a52d635 tempest-GroupSnapshotsTest-1381895959 None] group_snapshot f038225d-e1a3-47dd-a889-4d7254148088: deleting Sep 06 06:33:50 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-db816e98-02eb-48f5-b4fa-851a4a52d635 tempest-GroupSnapshotsTest-1381895959 None] group_snapshot f038225d-e1a3-47dd-a889-4d7254148088: deleting {{(pid=87329) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 06 06:33:50 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-db816e98-02eb-48f5-b4fa-851a4a52d635 tempest-GroupSnapshotsTest-1381895959 None] Acquiring lock "cinder-quobyte-e7ce1c99-8f80-4fcd-a0a3-c358d505c6a5" by "delete_snapshot" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:33:50 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-db816e98-02eb-48f5-b4fa-851a4a52d635 tempest-GroupSnapshotsTest-1381895959 None] Lock "cinder-quobyte-e7ce1c99-8f80-4fcd-a0a3-c358d505c6a5" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:33:50 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-db816e98-02eb-48f5-b4fa-851a4a52d635 tempest-GroupSnapshotsTest-1381895959 None] Acquiring lock "cinder-quobyte-02012b37-5434-4106-bac1-7efd730e0f3a" by "_delete_snapshot" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:33:50 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-db816e98-02eb-48f5-b4fa-851a4a52d635 tempest-GroupSnapshotsTest-1381895959 None] Lock "cinder-quobyte-02012b37-5434-4106-bac1-7efd730e0f3a" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:33:50 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-db816e98-02eb-48f5-b4fa-851a4a52d635 tempest-GroupSnapshotsTest-1381895959 None] Deleting offline snapshot 02012b37-5434-4106-bac1-7efd730e0f3a of volume e7ce1c99-8f80-4fcd-a0a3-c358d505c6a5 {{(pid=87329) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 06 06:33:50 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-db816e98-02eb-48f5-b4fa-851a4a52d635 tempest-GroupSnapshotsTest-1381895959 None] snapshot_file for this snap is: volume-e7ce1c99-8f80-4fcd-a0a3-c358d505c6a5.02012b37-5434-4106-bac1-7efd730e0f3a {{(pid=87329) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 06 06:33:50 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[59f5b7b6-f3b0-475d-a570-fb759468f89f]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:33:50 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-db816e98-02eb-48f5-b4fa-851a4a52d635 tempest-GroupSnapshotsTest-1381895959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e7ce1c99-8f80-4fcd-a0a3-c358d505c6a5.02012b37-5434-4106-bac1-7efd730e0f3a {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:33:50 devstack sudo[91232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e7ce1c99-8f80-4fcd-a0a3-c358d505c6a5.02012b37-5434-4106-bac1-7efd730e0f3a Sep 06 06:33:50 devstack sudo[91232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:33:51 devstack sudo[91232]: pam_unix(sudo:session): session closed for user root Sep 06 06:33:51 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-db816e98-02eb-48f5-b4fa-851a4a52d635 tempest-GroupSnapshotsTest-1381895959 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e7ce1c99-8f80-4fcd-a0a3-c358d505c6a5.02012b37-5434-4106-bac1-7efd730e0f3a" returned: 0 in 0.515s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:33:51 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-db816e98-02eb-48f5-b4fa-851a4a52d635 tempest-GroupSnapshotsTest-1381895959 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e7ce1c99-8f80-4fcd-a0a3-c358d505c6a5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87329) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 06:33:51 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed040cba-ce7b-49ea-a12b-e02957c74b08]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:33:51 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-db816e98-02eb-48f5-b4fa-851a4a52d635 tempest-GroupSnapshotsTest-1381895959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e7ce1c99-8f80-4fcd-a0a3-c358d505c6a5 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:33:51 devstack sudo[91237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e7ce1c99-8f80-4fcd-a0a3-c358d505c6a5 Sep 06 06:33:51 devstack sudo[91237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:33:51 devstack sudo[91237]: pam_unix(sudo:session): session closed for user root Sep 06 06:33:51 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-db816e98-02eb-48f5-b4fa-851a4a52d635 tempest-GroupSnapshotsTest-1381895959 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e7ce1c99-8f80-4fcd-a0a3-c358d505c6a5" returned: 0 in 0.489s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:33:51 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-db816e98-02eb-48f5-b4fa-851a4a52d635 tempest-GroupSnapshotsTest-1381895959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e7ce1c99-8f80-4fcd-a0a3-c358d505c6a5.02012b37-5434-4106-bac1-7efd730e0f3a {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:33:51 devstack sudo[91242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e7ce1c99-8f80-4fcd-a0a3-c358d505c6a5.02012b37-5434-4106-bac1-7efd730e0f3a Sep 06 06:33:51 devstack sudo[91242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:33:52 devstack sudo[91242]: pam_unix(sudo:session): session closed for user root Sep 06 06:33:52 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-db816e98-02eb-48f5-b4fa-851a4a52d635 tempest-GroupSnapshotsTest-1381895959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e7ce1c99-8f80-4fcd-a0a3-c358d505c6a5.02012b37-5434-4106-bac1-7efd730e0f3a" returned: 0 in 0.357s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:33:52 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-db816e98-02eb-48f5-b4fa-851a4a52d635 tempest-GroupSnapshotsTest-1381895959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e7ce1c99-8f80-4fcd-a0a3-c358d505c6a5.02012b37-5434-4106-bac1-7efd730e0f3a {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:33:52 devstack sudo[91247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e7ce1c99-8f80-4fcd-a0a3-c358d505c6a5.02012b37-5434-4106-bac1-7efd730e0f3a Sep 06 06:33:52 devstack sudo[91247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:33:52 devstack sudo[91247]: pam_unix(sudo:session): session closed for user root Sep 06 06:33:52 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-db816e98-02eb-48f5-b4fa-851a4a52d635 tempest-GroupSnapshotsTest-1381895959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e7ce1c99-8f80-4fcd-a0a3-c358d505c6a5.02012b37-5434-4106-bac1-7efd730e0f3a" returned: 0 in 0.277s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:33:52 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-db816e98-02eb-48f5-b4fa-851a4a52d635 tempest-GroupSnapshotsTest-1381895959 None] Lock "cinder-quobyte-02012b37-5434-4106-bac1-7efd730e0f3a" released by "_delete_snapshot" :: held 1.783s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:33:52 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-db816e98-02eb-48f5-b4fa-851a4a52d635 tempest-GroupSnapshotsTest-1381895959 None] Lock "cinder-quobyte-e7ce1c99-8f80-4fcd-a0a3-c358d505c6a5" released by "delete_snapshot" :: held 1.819s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:33:52 devstack cinder-volume[87329]: DEBUG dbcounter [-] [87329] Writing DB stats cinder:UPDATE=106,cinder:SELECT=101,cinder:INSERT=17,cinder:DELETE=9 {{(pid=87329) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 06:33:52 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-db816e98-02eb-48f5-b4fa-851a4a52d635 tempest-GroupSnapshotsTest-1381895959 None] Acquiring lock "cinder-quobyte-9f40f16d-e504-4087-88ff-86d542fda7bb" by "delete_snapshot" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:33:52 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-db816e98-02eb-48f5-b4fa-851a4a52d635 tempest-GroupSnapshotsTest-1381895959 None] Lock "cinder-quobyte-9f40f16d-e504-4087-88ff-86d542fda7bb" acquired by "delete_snapshot" :: waited 0.063s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:33:52 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-db816e98-02eb-48f5-b4fa-851a4a52d635 tempest-GroupSnapshotsTest-1381895959 None] Acquiring lock "cinder-quobyte-767a659e-70f9-4336-ad03-aecceb6c695f" by "_delete_snapshot" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:33:52 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-db816e98-02eb-48f5-b4fa-851a4a52d635 tempest-GroupSnapshotsTest-1381895959 None] Lock "cinder-quobyte-767a659e-70f9-4336-ad03-aecceb6c695f" acquired by "_delete_snapshot" :: waited 0.071s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:33:52 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-db816e98-02eb-48f5-b4fa-851a4a52d635 tempest-GroupSnapshotsTest-1381895959 None] Deleting offline snapshot 767a659e-70f9-4336-ad03-aecceb6c695f of volume 9f40f16d-e504-4087-88ff-86d542fda7bb {{(pid=87329) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 06 06:33:52 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-db816e98-02eb-48f5-b4fa-851a4a52d635 tempest-GroupSnapshotsTest-1381895959 None] snapshot_file for this snap is: volume-9f40f16d-e504-4087-88ff-86d542fda7bb.767a659e-70f9-4336-ad03-aecceb6c695f {{(pid=87329) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 06 06:33:52 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cc54d86-a0c2-4072-93f0-a8ac0bec5aae]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:33:52 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-db816e98-02eb-48f5-b4fa-851a4a52d635 tempest-GroupSnapshotsTest-1381895959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-9f40f16d-e504-4087-88ff-86d542fda7bb.767a659e-70f9-4336-ad03-aecceb6c695f {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:33:52 devstack sudo[91265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-9f40f16d-e504-4087-88ff-86d542fda7bb.767a659e-70f9-4336-ad03-aecceb6c695f Sep 06 06:33:52 devstack sudo[91265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:33:53 devstack sudo[91265]: pam_unix(sudo:session): session closed for user root Sep 06 06:33:53 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-db816e98-02eb-48f5-b4fa-851a4a52d635 tempest-GroupSnapshotsTest-1381895959 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-9f40f16d-e504-4087-88ff-86d542fda7bb.767a659e-70f9-4336-ad03-aecceb6c695f" returned: 0 in 0.494s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:33:53 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-db816e98-02eb-48f5-b4fa-851a4a52d635 tempest-GroupSnapshotsTest-1381895959 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9f40f16d-e504-4087-88ff-86d542fda7bb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87329) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 06:33:53 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc2ab417-9497-40a9-8b57-48fbabceacac]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:33:53 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-db816e98-02eb-48f5-b4fa-851a4a52d635 tempest-GroupSnapshotsTest-1381895959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-9f40f16d-e504-4087-88ff-86d542fda7bb {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:33:53 devstack sudo[91273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-9f40f16d-e504-4087-88ff-86d542fda7bb Sep 06 06:33:53 devstack sudo[91273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:33:53 devstack sudo[91273]: pam_unix(sudo:session): session closed for user root Sep 06 06:33:53 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-db816e98-02eb-48f5-b4fa-851a4a52d635 tempest-GroupSnapshotsTest-1381895959 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-9f40f16d-e504-4087-88ff-86d542fda7bb" returned: 0 in 0.356s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:33:53 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-db816e98-02eb-48f5-b4fa-851a4a52d635 tempest-GroupSnapshotsTest-1381895959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-9f40f16d-e504-4087-88ff-86d542fda7bb.767a659e-70f9-4336-ad03-aecceb6c695f {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:33:53 devstack sudo[91279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-9f40f16d-e504-4087-88ff-86d542fda7bb.767a659e-70f9-4336-ad03-aecceb6c695f Sep 06 06:33:53 devstack sudo[91279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:33:53 devstack sudo[91279]: pam_unix(sudo:session): session closed for user root Sep 06 06:33:53 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-db816e98-02eb-48f5-b4fa-851a4a52d635 tempest-GroupSnapshotsTest-1381895959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-9f40f16d-e504-4087-88ff-86d542fda7bb.767a659e-70f9-4336-ad03-aecceb6c695f" returned: 0 in 0.348s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:33:53 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-db816e98-02eb-48f5-b4fa-851a4a52d635 tempest-GroupSnapshotsTest-1381895959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-9f40f16d-e504-4087-88ff-86d542fda7bb.767a659e-70f9-4336-ad03-aecceb6c695f {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:33:53 devstack sudo[91284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-9f40f16d-e504-4087-88ff-86d542fda7bb.767a659e-70f9-4336-ad03-aecceb6c695f Sep 06 06:33:53 devstack sudo[91284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:33:54 devstack sudo[91284]: pam_unix(sudo:session): session closed for user root Sep 06 06:33:54 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-db816e98-02eb-48f5-b4fa-851a4a52d635 tempest-GroupSnapshotsTest-1381895959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-9f40f16d-e504-4087-88ff-86d542fda7bb.767a659e-70f9-4336-ad03-aecceb6c695f" returned: 0 in 0.264s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:33:54 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-db816e98-02eb-48f5-b4fa-851a4a52d635 tempest-GroupSnapshotsTest-1381895959 None] Lock "cinder-quobyte-767a659e-70f9-4336-ad03-aecceb6c695f" released by "_delete_snapshot" :: held 1.624s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:33:54 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-db816e98-02eb-48f5-b4fa-851a4a52d635 tempest-GroupSnapshotsTest-1381895959 None] Lock "cinder-quobyte-9f40f16d-e504-4087-88ff-86d542fda7bb" released by "delete_snapshot" :: held 1.711s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:33:54 devstack cinder-volume[87329]: WARNING cinder.quota [None req-db816e98-02eb-48f5-b4fa-851a4a52d635 tempest-GroupSnapshotsTest-1381895959 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1961165656 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1961165656, it is now deprecated. Please use the default quota class for default quota. Sep 06 06:33:54 devstack cinder-volume[87329]: WARNING cinder.quota [None req-db816e98-02eb-48f5-b4fa-851a4a52d635 tempest-GroupSnapshotsTest-1381895959 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1961165656 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1961165656, it is now deprecated. Please use the default quota class for default quota. Sep 06 06:33:54 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-db816e98-02eb-48f5-b4fa-851a4a52d635 tempest-GroupSnapshotsTest-1381895959 None] Created reservations ['192c7594-79b1-453a-bbcb-ee3ec9d5731f', '542709c9-23c4-4ada-a732-fbc759691a66', '8cc2384f-c17f-44cc-aa34-7d581ebf8bcc', 'ff314e47-991d-4389-97f4-7edfbb832da6'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:33:54 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-db816e98-02eb-48f5-b4fa-851a4a52d635 tempest-GroupSnapshotsTest-1381895959 None] Created reservations ['0dff66ce-b705-444c-aac7-e464651d5ad8', '31dc9476-35a6-4ee3-9e47-2fa7f1140d6d', 'ffc769e3-dfb6-4b5c-8414-e3eefe6a4184', 'f9297f83-1f7a-4c64-9b4f-a226401874a5'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:33:54 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-db816e98-02eb-48f5-b4fa-851a4a52d635 tempest-GroupSnapshotsTest-1381895959 None] group_snapshot f038225d-e1a3-47dd-a889-4d7254148088: deleted successfully Sep 06 06:33:55 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-6bec3803-9e31-406f-b30d-95a67a583819 tempest-GroupSnapshotsTest-1381895959 None] Acquiring lock "cinder-quobyte-9f40f16d-e504-4087-88ff-86d542fda7bb" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:33:55 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-6bec3803-9e31-406f-b30d-95a67a583819 tempest-GroupSnapshotsTest-1381895959 None] Lock "cinder-quobyte-9f40f16d-e504-4087-88ff-86d542fda7bb" acquired by "delete_volume" :: waited 0.020s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:33:55 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd40d569-d826-4071-a8e0-e6ba4df98b74]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:33:55 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-6bec3803-9e31-406f-b30d-95a67a583819 tempest-GroupSnapshotsTest-1381895959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-9f40f16d-e504-4087-88ff-86d542fda7bb {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:33:55 devstack sudo[91287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-9f40f16d-e504-4087-88ff-86d542fda7bb Sep 06 06:33:55 devstack sudo[91287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:33:56 devstack sudo[91287]: pam_unix(sudo:session): session closed for user root Sep 06 06:33:56 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-6bec3803-9e31-406f-b30d-95a67a583819 tempest-GroupSnapshotsTest-1381895959 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-9f40f16d-e504-4087-88ff-86d542fda7bb" returned: 0 in 0.366s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:33:56 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-6bec3803-9e31-406f-b30d-95a67a583819 tempest-GroupSnapshotsTest-1381895959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-9f40f16d-e504-4087-88ff-86d542fda7bb {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:33:56 devstack sudo[91292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-9f40f16d-e504-4087-88ff-86d542fda7bb Sep 06 06:33:56 devstack sudo[91292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:33:56 devstack sudo[91292]: pam_unix(sudo:session): session closed for user root Sep 06 06:33:56 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-6bec3803-9e31-406f-b30d-95a67a583819 tempest-GroupSnapshotsTest-1381895959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-9f40f16d-e504-4087-88ff-86d542fda7bb" returned: 0 in 0.244s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:33:56 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-6bec3803-9e31-406f-b30d-95a67a583819 tempest-GroupSnapshotsTest-1381895959 None] Lock "cinder-quobyte-9f40f16d-e504-4087-88ff-86d542fda7bb" released by "delete_volume" :: held 0.683s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:33:56 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-6bec3803-9e31-406f-b30d-95a67a583819 tempest-GroupSnapshotsTest-1381895959 None] Acquiring lock "cinder-quobyte-e7ce1c99-8f80-4fcd-a0a3-c358d505c6a5" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:33:56 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-6bec3803-9e31-406f-b30d-95a67a583819 tempest-GroupSnapshotsTest-1381895959 None] Lock "cinder-quobyte-e7ce1c99-8f80-4fcd-a0a3-c358d505c6a5" acquired by "delete_volume" :: waited 0.022s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:33:56 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffed32fb-5e24-4c6a-a306-bf2459ecb2b7]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:33:56 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-6bec3803-9e31-406f-b30d-95a67a583819 tempest-GroupSnapshotsTest-1381895959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e7ce1c99-8f80-4fcd-a0a3-c358d505c6a5 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:33:56 devstack sudo[91301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e7ce1c99-8f80-4fcd-a0a3-c358d505c6a5 Sep 06 06:33:56 devstack sudo[91301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:33:56 devstack sudo[91301]: pam_unix(sudo:session): session closed for user root Sep 06 06:33:56 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-6bec3803-9e31-406f-b30d-95a67a583819 tempest-GroupSnapshotsTest-1381895959 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e7ce1c99-8f80-4fcd-a0a3-c358d505c6a5" returned: 0 in 0.463s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:33:56 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-6bec3803-9e31-406f-b30d-95a67a583819 tempest-GroupSnapshotsTest-1381895959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e7ce1c99-8f80-4fcd-a0a3-c358d505c6a5 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:33:56 devstack sudo[91307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e7ce1c99-8f80-4fcd-a0a3-c358d505c6a5 Sep 06 06:33:56 devstack sudo[91307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:33:57 devstack sudo[91307]: pam_unix(sudo:session): session closed for user root Sep 06 06:33:57 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-6bec3803-9e31-406f-b30d-95a67a583819 tempest-GroupSnapshotsTest-1381895959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e7ce1c99-8f80-4fcd-a0a3-c358d505c6a5" returned: 0 in 0.333s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:33:57 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-6bec3803-9e31-406f-b30d-95a67a583819 tempest-GroupSnapshotsTest-1381895959 None] Lock "cinder-quobyte-e7ce1c99-8f80-4fcd-a0a3-c358d505c6a5" released by "delete_volume" :: held 0.906s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:33:57 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-6bec3803-9e31-406f-b30d-95a67a583819 tempest-GroupSnapshotsTest-1381895959 None] Created reservations ['981e9023-c6ae-48ac-9033-5c26fc88c4f5'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:33:57 devstack cinder-volume[87329]: WARNING cinder.quota [None req-6bec3803-9e31-406f-b30d-95a67a583819 tempest-GroupSnapshotsTest-1381895959 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1961165656 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1961165656, it is now deprecated. Please use the default quota class for default quota. Sep 06 06:33:57 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-6bec3803-9e31-406f-b30d-95a67a583819 tempest-GroupSnapshotsTest-1381895959 None] Created reservations ['216d39df-f354-4e7c-bcb8-0ceb82ba5da3', 'b146e37a-64e2-4d5e-937c-745aac9e0f7d', 'cf6be54d-c0ef-47a7-8e3c-aa41db232758', 'c8dc0167-aef1-4cfe-baa1-51810954cb93'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:33:57 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-6bec3803-9e31-406f-b30d-95a67a583819 tempest-GroupSnapshotsTest-1381895959 None] Created reservations ['b253f586-8ba2-4bb5-b532-fd2d391a797f', '291ee6b5-adbd-4cfa-8805-053c52f0b29d', 'f708d0b4-31a4-45e2-a272-e5c47512349b', 'e602397e-0c0d-4fb1-b878-1436bc1ed208'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:33:57 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-6bec3803-9e31-406f-b30d-95a67a583819 tempest-GroupSnapshotsTest-1381895959 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:33:57 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-6bec3803-9e31-406f-b30d-95a67a583819 tempest-GroupSnapshotsTest-1381895959 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:33:57 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-6bec3803-9e31-406f-b30d-95a67a583819 tempest-GroupSnapshotsTest-1381895959 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:33:57 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-6bec3803-9e31-406f-b30d-95a67a583819 tempest-GroupSnapshotsTest-1381895959 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:33:57 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-6bec3803-9e31-406f-b30d-95a67a583819 tempest-GroupSnapshotsTest-1381895959 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:33:57 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-6bec3803-9e31-406f-b30d-95a67a583819 tempest-GroupSnapshotsTest-1381895959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:33:57 devstack sudo[91310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:33:57 devstack sudo[91310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:33:57 devstack sudo[91310]: pam_unix(sudo:session): session closed for user root Sep 06 06:33:57 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-6bec3803-9e31-406f-b30d-95a67a583819 tempest-GroupSnapshotsTest-1381895959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.258s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:33:57 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-6bec3803-9e31-406f-b30d-95a67a583819 tempest-GroupSnapshotsTest-1381895959 None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:33:57 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-6bec3803-9e31-406f-b30d-95a67a583819 tempest-GroupSnapshotsTest-1381895959 None] Delete group completed successfully. Sep 06 06:33:58 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-3decb5d5-37c0-48dd-a14e-0786bd16d4f6 tempest-GroupSnapshotsTest-1381895959 None] Group tempest-GroupSnapshotsTest-Group-1232413586: creating Sep 06 06:33:58 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-3decb5d5-37c0-48dd-a14e-0786bd16d4f6 tempest-GroupSnapshotsTest-1381895959 None] Group tempest-GroupSnapshotsTest-Group-1232413586: created successfully Sep 06 06:33:58 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-3decb5d5-37c0-48dd-a14e-0786bd16d4f6 tempest-GroupSnapshotsTest-1381895959 None] Create group completed successfully. Sep 06 06:34:00 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9eae397-2de9-490f-963f-e29adb5fd062 tempest-VolumesActionsTest-852331485 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87329) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 06:34:00 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-e9eae397-2de9-490f-963f-e29adb5fd062 tempest-VolumesActionsTest-852331485 None] Flow 'volume_create_manager' (82cea5ac-7730-4008-9868-a124c03664d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:34:00 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-e9eae397-2de9-490f-963f-e29adb5fd062 tempest-VolumesActionsTest-852331485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b2a7273-7194-4723-b0cb-6d568e49009d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:34:00 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-e9eae397-2de9-490f-963f-e29adb5fd062 tempest-VolumesActionsTest-852331485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b2a7273-7194-4723-b0cb-6d568e49009d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:34:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1665129185',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cd2ddce-dd8e-40eb-b54e-df7057ba58f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='390201170c344af68e57e2383bc61d2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:34:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:34:00Z,use_quota=True,user_id='75bab86df95249d785af776d0fa034b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:34:00 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-e9eae397-2de9-490f-963f-e29adb5fd062 tempest-VolumesActionsTest-852331485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33394d3f-b1ad-4826-a165-d9b7e3e25c06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:34:00 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-e9eae397-2de9-490f-963f-e29adb5fd062 tempest-VolumesActionsTest-852331485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33394d3f-b1ad-4826-a165-d9b7e3e25c06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:34:00 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-e9eae397-2de9-490f-963f-e29adb5fd062 tempest-VolumesActionsTest-852331485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e53331f-27aa-4430-9dd2-2f659df2fb06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:34:00 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-e9eae397-2de9-490f-963f-e29adb5fd062 tempest-VolumesActionsTest-852331485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e53331f-27aa-4430-9dd2-2f659df2fb06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3cd2ddce-dd8e-40eb-b54e-df7057ba58f2', 'volume_name': 'volume-3cd2ddce-dd8e-40eb-b54e-df7057ba58f2', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:34:00 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-e9eae397-2de9-490f-963f-e29adb5fd062 tempest-VolumesActionsTest-852331485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f3031e7-3e36-4713-bca3-f6e453d328c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:34:00 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-e9eae397-2de9-490f-963f-e29adb5fd062 tempest-VolumesActionsTest-852331485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f3031e7-3e36-4713-bca3-f6e453d328c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:34:00 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-e9eae397-2de9-490f-963f-e29adb5fd062 tempest-VolumesActionsTest-852331485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6debca47-0b79-4661-bfe9-4a68210b9697) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:34:00 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-e9eae397-2de9-490f-963f-e29adb5fd062 tempest-VolumesActionsTest-852331485 None] Volume 3cd2ddce-dd8e-40eb-b54e-df7057ba58f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3cd2ddce-dd8e-40eb-b54e-df7057ba58f2', 'volume_size': 1} Sep 06 06:34:00 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-e9eae397-2de9-490f-963f-e29adb5fd062 tempest-VolumesActionsTest-852331485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:34:00 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-e9eae397-2de9-490f-963f-e29adb5fd062 tempest-VolumesActionsTest-852331485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:34:00 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-e9eae397-2de9-490f-963f-e29adb5fd062 tempest-VolumesActionsTest-852331485 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:34:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1665129185',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cd2ddce-dd8e-40eb-b54e-df7057ba58f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='390201170c344af68e57e2383bc61d2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:34:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:34:00Z,use_quota=True,user_id='75bab86df95249d785af776d0fa034b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)}" {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 06:34:00 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-e9eae397-2de9-490f-963f-e29adb5fd062 tempest-VolumesActionsTest-852331485 None] Creating volume 3cd2ddce-dd8e-40eb-b54e-df7057ba58f2 {{(pid=87329) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 06:34:00 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-e9eae397-2de9-490f-963f-e29adb5fd062 tempest-VolumesActionsTest-852331485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:34:00 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-e9eae397-2de9-490f-963f-e29adb5fd062 tempest-VolumesActionsTest-852331485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:34:00 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-e9eae397-2de9-490f-963f-e29adb5fd062 tempest-VolumesActionsTest-852331485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:34:00 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-e9eae397-2de9-490f-963f-e29adb5fd062 tempest-VolumesActionsTest-852331485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:34:00 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-e9eae397-2de9-490f-963f-e29adb5fd062 tempest-VolumesActionsTest-852331485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:34:00 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-e9eae397-2de9-490f-963f-e29adb5fd062 tempest-VolumesActionsTest-852331485 None] Selected osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 as target Quobyte volume. {{(pid=87329) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 06:34:00 devstack cinder-volume[87329]: INFO cinder.volume.drivers.remotefs [None req-e9eae397-2de9-490f-963f-e29adb5fd062 tempest-VolumesActionsTest-852331485 None] casted to osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 Sep 06 06:34:00 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-e9eae397-2de9-490f-963f-e29adb5fd062 tempest-VolumesActionsTest-852331485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-3cd2ddce-dd8e-40eb-b54e-df7057ba58f2 1073741824 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:34:00 devstack sudo[91314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-3cd2ddce-dd8e-40eb-b54e-df7057ba58f2 1073741824 Sep 06 06:34:00 devstack sudo[91314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:34:00 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e82c860-f532-4b01-b6b4-f2c4df155897 tempest-GroupSnapshotsTest-1381895959 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87329) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 06:34:00 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-6e82c860-f532-4b01-b6b4-f2c4df155897 tempest-GroupSnapshotsTest-1381895959 None] Flow 'volume_create_manager' (6d9cf948-a98e-48e2-acb1-3510fe894ba8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:34:00 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-6e82c860-f532-4b01-b6b4-f2c4df155897 tempest-GroupSnapshotsTest-1381895959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68e513af-cdab-4775-ae26-a7079f018f8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:34:00 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-6e82c860-f532-4b01-b6b4-f2c4df155897 tempest-GroupSnapshotsTest-1381895959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68e513af-cdab-4775-ae26-a7079f018f8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:34:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-161979311',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c923634a-0213-4c24-9a77-f3675bbed6ae,host='devstack@QuobyteHD#QuobyteHD',id=b83726ee-11ba-423c-8be9-9273a802ade4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be1988e2a2c84f20ab9ef621b3b61699',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:34:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:34:00Z,use_quota=True,user_id='79054ac364294b7d9a926ce72e15dde0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(40af0606-0922-4ebc-bbe9-89e52f7b020d),volume_type_id=40af0606-0922-4ebc-bbe9-89e52f7b020d)' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:34:00 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-6e82c860-f532-4b01-b6b4-f2c4df155897 tempest-GroupSnapshotsTest-1381895959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3327ae3-e840-4ffb-9d5b-c0ad716d699a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:34:00 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-6e82c860-f532-4b01-b6b4-f2c4df155897 tempest-GroupSnapshotsTest-1381895959 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3327ae3-e840-4ffb-9d5b-c0ad716d699a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:34:00 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-6e82c860-f532-4b01-b6b4-f2c4df155897 tempest-GroupSnapshotsTest-1381895959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f4f8ea3-cec2-4d8d-88f9-a120b44a07d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:34:00 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-6e82c860-f532-4b01-b6b4-f2c4df155897 tempest-GroupSnapshotsTest-1381895959 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f4f8ea3-cec2-4d8d-88f9-a120b44a07d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b83726ee-11ba-423c-8be9-9273a802ade4', 'volume_name': 'volume-b83726ee-11ba-423c-8be9-9273a802ade4', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:34:00 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-6e82c860-f532-4b01-b6b4-f2c4df155897 tempest-GroupSnapshotsTest-1381895959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1464765c-d7e9-44dc-aa9e-9796a392e845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:34:00 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-6e82c860-f532-4b01-b6b4-f2c4df155897 tempest-GroupSnapshotsTest-1381895959 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1464765c-d7e9-44dc-aa9e-9796a392e845) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:34:00 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-6e82c860-f532-4b01-b6b4-f2c4df155897 tempest-GroupSnapshotsTest-1381895959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3810dfb7-4951-4852-bc42-92a0026d2451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:34:00 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-6e82c860-f532-4b01-b6b4-f2c4df155897 tempest-GroupSnapshotsTest-1381895959 None] Volume b83726ee-11ba-423c-8be9-9273a802ade4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b83726ee-11ba-423c-8be9-9273a802ade4', 'volume_size': 1} Sep 06 06:34:00 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-6e82c860-f532-4b01-b6b4-f2c4df155897 tempest-GroupSnapshotsTest-1381895959 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:34:00 devstack sudo[91314]: pam_unix(sudo:session): session closed for user root Sep 06 06:34:00 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-e9eae397-2de9-490f-963f-e29adb5fd062 tempest-VolumesActionsTest-852331485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-3cd2ddce-dd8e-40eb-b54e-df7057ba58f2 1073741824" returned: 0 in 0.527s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:34:00 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-e9eae397-2de9-490f-963f-e29adb5fd062 tempest-VolumesActionsTest-852331485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-3cd2ddce-dd8e-40eb-b54e-df7057ba58f2 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:34:00 devstack sudo[91320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-3cd2ddce-dd8e-40eb-b54e-df7057ba58f2 Sep 06 06:34:00 devstack sudo[91320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:34:00 devstack sudo[91320]: pam_unix(sudo:session): session closed for user root Sep 06 06:34:00 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-e9eae397-2de9-490f-963f-e29adb5fd062 tempest-VolumesActionsTest-852331485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-3cd2ddce-dd8e-40eb-b54e-df7057ba58f2" returned: 0 in 0.252s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:34:00 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-e9eae397-2de9-490f-963f-e29adb5fd062 tempest-VolumesActionsTest-852331485 None] <== create_volume: return (825ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'} {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 06:34:00 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-e9eae397-2de9-490f-963f-e29adb5fd062 tempest-VolumesActionsTest-852331485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.828s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:34:00 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-6e82c860-f532-4b01-b6b4-f2c4df155897 tempest-GroupSnapshotsTest-1381895959 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.534s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:34:00 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-6e82c860-f532-4b01-b6b4-f2c4df155897 tempest-GroupSnapshotsTest-1381895959 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=c923634a-0213-4c24-9a77-f3675bbed6ae,created_at=2026-09-06T04:34:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-161979311',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c923634a-0213-4c24-9a77-f3675bbed6ae,host='devstack@QuobyteHD#QuobyteHD',id=b83726ee-11ba-423c-8be9-9273a802ade4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be1988e2a2c84f20ab9ef621b3b61699',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:34:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:34:00Z,use_quota=True,user_id='79054ac364294b7d9a926ce72e15dde0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(40af0606-0922-4ebc-bbe9-89e52f7b020d),volume_type_id=40af0606-0922-4ebc-bbe9-89e52f7b020d)}" {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 06:34:00 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-6e82c860-f532-4b01-b6b4-f2c4df155897 tempest-GroupSnapshotsTest-1381895959 None] Creating volume b83726ee-11ba-423c-8be9-9273a802ade4 {{(pid=87329) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 06:34:00 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-6e82c860-f532-4b01-b6b4-f2c4df155897 tempest-GroupSnapshotsTest-1381895959 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:34:00 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-6e82c860-f532-4b01-b6b4-f2c4df155897 tempest-GroupSnapshotsTest-1381895959 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:34:00 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-6e82c860-f532-4b01-b6b4-f2c4df155897 tempest-GroupSnapshotsTest-1381895959 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:34:00 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-6e82c860-f532-4b01-b6b4-f2c4df155897 tempest-GroupSnapshotsTest-1381895959 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:34:00 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-6e82c860-f532-4b01-b6b4-f2c4df155897 tempest-GroupSnapshotsTest-1381895959 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:34:00 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-6e82c860-f532-4b01-b6b4-f2c4df155897 tempest-GroupSnapshotsTest-1381895959 None] Selected osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 as target Quobyte volume. {{(pid=87329) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 06:34:00 devstack cinder-volume[87329]: INFO cinder.volume.drivers.remotefs [None req-6e82c860-f532-4b01-b6b4-f2c4df155897 tempest-GroupSnapshotsTest-1381895959 None] casted to osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 Sep 06 06:34:00 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-6e82c860-f532-4b01-b6b4-f2c4df155897 tempest-GroupSnapshotsTest-1381895959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b83726ee-11ba-423c-8be9-9273a802ade4 1073741824 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:34:00 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-e9eae397-2de9-490f-963f-e29adb5fd062 tempest-VolumesActionsTest-852331485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6debca47-0b79-4661-bfe9-4a68210b9697) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3cd2ddce-dd8e-40eb-b54e-df7057ba58f2', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:34:00 devstack sudo[91323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b83726ee-11ba-423c-8be9-9273a802ade4 1073741824 Sep 06 06:34:00 devstack sudo[91323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:34:00 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-e9eae397-2de9-490f-963f-e29adb5fd062 tempest-VolumesActionsTest-852331485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (342e4b5c-1793-49c1-9229-0f80827897cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:34:00 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-e9eae397-2de9-490f-963f-e29adb5fd062 tempest-VolumesActionsTest-852331485 None] Volume volume-3cd2ddce-dd8e-40eb-b54e-df7057ba58f2 (3cd2ddce-dd8e-40eb-b54e-df7057ba58f2): created successfully Sep 06 06:34:01 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-e9eae397-2de9-490f-963f-e29adb5fd062 tempest-VolumesActionsTest-852331485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (342e4b5c-1793-49c1-9229-0f80827897cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:34:01 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-e9eae397-2de9-490f-963f-e29adb5fd062 tempest-VolumesActionsTest-852331485 None] Flow 'volume_create_manager' (82cea5ac-7730-4008-9868-a124c03664d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:34:01 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-e9eae397-2de9-490f-963f-e29adb5fd062 tempest-VolumesActionsTest-852331485 None] Created volume successfully. Sep 06 06:34:01 devstack sudo[91323]: pam_unix(sudo:session): session closed for user root Sep 06 06:34:01 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-6e82c860-f532-4b01-b6b4-f2c4df155897 tempest-GroupSnapshotsTest-1381895959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b83726ee-11ba-423c-8be9-9273a802ade4 1073741824" returned: 0 in 0.453s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:34:01 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-6e82c860-f532-4b01-b6b4-f2c4df155897 tempest-GroupSnapshotsTest-1381895959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b83726ee-11ba-423c-8be9-9273a802ade4 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:34:01 devstack sudo[91336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b83726ee-11ba-423c-8be9-9273a802ade4 Sep 06 06:34:01 devstack sudo[91336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:34:01 devstack sudo[91336]: pam_unix(sudo:session): session closed for user root Sep 06 06:34:01 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-6e82c860-f532-4b01-b6b4-f2c4df155897 tempest-GroupSnapshotsTest-1381895959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b83726ee-11ba-423c-8be9-9273a802ade4" returned: 0 in 0.253s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:34:01 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-6e82c860-f532-4b01-b6b4-f2c4df155897 tempest-GroupSnapshotsTest-1381895959 None] <== create_volume: return (755ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'} {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 06:34:01 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-6e82c860-f532-4b01-b6b4-f2c4df155897 tempest-GroupSnapshotsTest-1381895959 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.760s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:34:01 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-6e82c860-f532-4b01-b6b4-f2c4df155897 tempest-GroupSnapshotsTest-1381895959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3810dfb7-4951-4852-bc42-92a0026d2451) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b83726ee-11ba-423c-8be9-9273a802ade4', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:34:01 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-6e82c860-f532-4b01-b6b4-f2c4df155897 tempest-GroupSnapshotsTest-1381895959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0197174b-682c-451d-8c79-c87ad7f67a7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:34:01 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-6e82c860-f532-4b01-b6b4-f2c4df155897 tempest-GroupSnapshotsTest-1381895959 None] Volume volume-b83726ee-11ba-423c-8be9-9273a802ade4 (b83726ee-11ba-423c-8be9-9273a802ade4): created successfully Sep 06 06:34:01 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-6e82c860-f532-4b01-b6b4-f2c4df155897 tempest-GroupSnapshotsTest-1381895959 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0197174b-682c-451d-8c79-c87ad7f67a7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:34:01 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-6e82c860-f532-4b01-b6b4-f2c4df155897 tempest-GroupSnapshotsTest-1381895959 None] Flow 'volume_create_manager' (6d9cf948-a98e-48e2-acb1-3510fe894ba8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:34:01 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-6e82c860-f532-4b01-b6b4-f2c4df155897 tempest-GroupSnapshotsTest-1381895959 None] Created volume successfully. Sep 06 06:34:02 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-a6debbcb-fbdc-4c42-890d-1f6faba46536 tempest-GroupSnapshotsTest-1381895959 None] GroupSnapshot 5654a126-518d-447f-9477-50ce3c87b0ac: creating. Sep 06 06:34:02 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-a6debbcb-fbdc-4c42-890d-1f6faba46536 tempest-GroupSnapshotsTest-1381895959 None] Group snapshot 5654a126-518d-447f-9477-50ce3c87b0ac: creating. {{(pid=87329) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 06 06:34:03 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-a6debbcb-fbdc-4c42-890d-1f6faba46536 tempest-GroupSnapshotsTest-1381895959 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:34:03 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-a6debbcb-fbdc-4c42-890d-1f6faba46536 tempest-GroupSnapshotsTest-1381895959 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:34:03 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-a6debbcb-fbdc-4c42-890d-1f6faba46536 tempest-GroupSnapshotsTest-1381895959 None] Creating offline snapshot d3255d03-b6c3-48dc-bafb-4e48a88e729c of volume b83726ee-11ba-423c-8be9-9273a802ade4 {{(pid=87329) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 06 06:34:03 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e762051-76d8-4eb3-9e27-c7433e394ca8]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:34:03 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-a6debbcb-fbdc-4c42-890d-1f6faba46536 tempest-GroupSnapshotsTest-1381895959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b83726ee-11ba-423c-8be9-9273a802ade4 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:34:03 devstack sudo[91356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b83726ee-11ba-423c-8be9-9273a802ade4 Sep 06 06:34:03 devstack sudo[91356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:34:03 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ccb4aa0-c78f-4c06-ac8a-2a39928414f2 tempest-ServerActionsTestOtherA-968672787 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87329) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 06:34:03 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-8ccb4aa0-c78f-4c06-ac8a-2a39928414f2 tempest-ServerActionsTestOtherA-968672787 None] Flow 'volume_create_manager' (889a14e9-2600-4ce6-93a9-3ad962f9eea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:34:03 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-8ccb4aa0-c78f-4c06-ac8a-2a39928414f2 tempest-ServerActionsTestOtherA-968672787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5019266e-4d4f-4bb3-8959-4081efc506f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:34:03 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-8ccb4aa0-c78f-4c06-ac8a-2a39928414f2 tempest-ServerActionsTestOtherA-968672787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5019266e-4d4f-4bb3-8959-4081efc506f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:34:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1787018041',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=052783c6-7634-4422-9227-0f9e115dea08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='474e425101c84d91a4f761bb638bd56f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:34:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:34:03Z,use_quota=True,user_id='f6eb0730f9b946dd9ee3c21c75d4566e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:34:03 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-8ccb4aa0-c78f-4c06-ac8a-2a39928414f2 tempest-ServerActionsTestOtherA-968672787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca77760d-ee31-41b5-b386-8713e04b90d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:34:03 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-8ccb4aa0-c78f-4c06-ac8a-2a39928414f2 tempest-ServerActionsTestOtherA-968672787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca77760d-ee31-41b5-b386-8713e04b90d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:34:03 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-8ccb4aa0-c78f-4c06-ac8a-2a39928414f2 tempest-ServerActionsTestOtherA-968672787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68726b28-8162-42fa-8b0c-89b50c10d5bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:34:03 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-8ccb4aa0-c78f-4c06-ac8a-2a39928414f2 tempest-ServerActionsTestOtherA-968672787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68726b28-8162-42fa-8b0c-89b50c10d5bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '052783c6-7634-4422-9227-0f9e115dea08', 'volume_name': 'volume-052783c6-7634-4422-9227-0f9e115dea08', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:34:03 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-8ccb4aa0-c78f-4c06-ac8a-2a39928414f2 tempest-ServerActionsTestOtherA-968672787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7b00da1-d223-4774-8e04-94285794c512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:34:03 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-8ccb4aa0-c78f-4c06-ac8a-2a39928414f2 tempest-ServerActionsTestOtherA-968672787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7b00da1-d223-4774-8e04-94285794c512) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:34:03 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-8ccb4aa0-c78f-4c06-ac8a-2a39928414f2 tempest-ServerActionsTestOtherA-968672787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4a31227-981a-43e9-8356-087f88a8bccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:34:03 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-8ccb4aa0-c78f-4c06-ac8a-2a39928414f2 tempest-ServerActionsTestOtherA-968672787 None] Volume 052783c6-7634-4422-9227-0f9e115dea08: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-052783c6-7634-4422-9227-0f9e115dea08', 'volume_size': 1} Sep 06 06:34:03 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-8ccb4aa0-c78f-4c06-ac8a-2a39928414f2 tempest-ServerActionsTestOtherA-968672787 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:34:03 devstack sudo[91356]: pam_unix(sudo:session): session closed for user root Sep 06 06:34:03 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-a6debbcb-fbdc-4c42-890d-1f6faba46536 tempest-GroupSnapshotsTest-1381895959 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b83726ee-11ba-423c-8be9-9273a802ade4" returned: 0 in 0.451s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:34:03 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-a6debbcb-fbdc-4c42-890d-1f6faba46536 tempest-GroupSnapshotsTest-1381895959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b83726ee-11ba-423c-8be9-9273a802ade4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b83726ee-11ba-423c-8be9-9273a802ade4.d3255d03-b6c3-48dc-bafb-4e48a88e729c 1G {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:34:03 devstack sudo[91363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b83726ee-11ba-423c-8be9-9273a802ade4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b83726ee-11ba-423c-8be9-9273a802ade4.d3255d03-b6c3-48dc-bafb-4e48a88e729c 1G Sep 06 06:34:03 devstack sudo[91363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:34:04 devstack sudo[91363]: pam_unix(sudo:session): session closed for user root Sep 06 06:34:04 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-a6debbcb-fbdc-4c42-890d-1f6faba46536 tempest-GroupSnapshotsTest-1381895959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b83726ee-11ba-423c-8be9-9273a802ade4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b83726ee-11ba-423c-8be9-9273a802ade4.d3255d03-b6c3-48dc-bafb-4e48a88e729c 1G" returned: 0 in 0.533s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:34:04 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-a6debbcb-fbdc-4c42-890d-1f6faba46536 tempest-GroupSnapshotsTest-1381895959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b83726ee-11ba-423c-8be9-9273a802ade4 -F qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b83726ee-11ba-423c-8be9-9273a802ade4.d3255d03-b6c3-48dc-bafb-4e48a88e729c {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:34:04 devstack sudo[91371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b83726ee-11ba-423c-8be9-9273a802ade4 -F qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b83726ee-11ba-423c-8be9-9273a802ade4.d3255d03-b6c3-48dc-bafb-4e48a88e729c Sep 06 06:34:04 devstack sudo[91371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:34:04 devstack sudo[91371]: pam_unix(sudo:session): session closed for user root Sep 06 06:34:04 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-a6debbcb-fbdc-4c42-890d-1f6faba46536 tempest-GroupSnapshotsTest-1381895959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b83726ee-11ba-423c-8be9-9273a802ade4 -F qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b83726ee-11ba-423c-8be9-9273a802ade4.d3255d03-b6c3-48dc-bafb-4e48a88e729c" returned: 0 in 0.371s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:34:04 devstack cinder-volume[87329]: WARNING cinder.volume.drivers.remotefs [None req-a6debbcb-fbdc-4c42-890d-1f6faba46536 tempest-GroupSnapshotsTest-1381895959 None] /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b83726ee-11ba-423c-8be9-9273a802ade4.d3255d03-b6c3-48dc-bafb-4e48a88e729c is being set with open permissions: ugo+rw: NotImplementedError Sep 06 06:34:04 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-a6debbcb-fbdc-4c42-890d-1f6faba46536 tempest-GroupSnapshotsTest-1381895959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b83726ee-11ba-423c-8be9-9273a802ade4.d3255d03-b6c3-48dc-bafb-4e48a88e729c {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:34:04 devstack sudo[91376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b83726ee-11ba-423c-8be9-9273a802ade4.d3255d03-b6c3-48dc-bafb-4e48a88e729c Sep 06 06:34:04 devstack sudo[91376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:34:04 devstack sudo[91376]: pam_unix(sudo:session): session closed for user root Sep 06 06:34:04 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-a6debbcb-fbdc-4c42-890d-1f6faba46536 tempest-GroupSnapshotsTest-1381895959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b83726ee-11ba-423c-8be9-9273a802ade4.d3255d03-b6c3-48dc-bafb-4e48a88e729c" returned: 0 in 0.268s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:34:04 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-a6debbcb-fbdc-4c42-890d-1f6faba46536 tempest-GroupSnapshotsTest-1381895959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b83726ee-11ba-423c-8be9-9273a802ade4.info {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:34:04 devstack sudo[91381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b83726ee-11ba-423c-8be9-9273a802ade4.info Sep 06 06:34:04 devstack sudo[91381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:34:05 devstack sudo[91381]: pam_unix(sudo:session): session closed for user root Sep 06 06:34:05 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-a6debbcb-fbdc-4c42-890d-1f6faba46536 tempest-GroupSnapshotsTest-1381895959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b83726ee-11ba-423c-8be9-9273a802ade4.info" returned: 0 in 0.411s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:34:05 devstack cinder-volume[87329]: WARNING cinder.volume.drivers.remotefs [None req-a6debbcb-fbdc-4c42-890d-1f6faba46536 tempest-GroupSnapshotsTest-1381895959 None] /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b83726ee-11ba-423c-8be9-9273a802ade4.info is being set with open permissions: ugo+rw: NotImplementedError Sep 06 06:34:05 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-a6debbcb-fbdc-4c42-890d-1f6faba46536 tempest-GroupSnapshotsTest-1381895959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b83726ee-11ba-423c-8be9-9273a802ade4.info {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:34:05 devstack sudo[91390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b83726ee-11ba-423c-8be9-9273a802ade4.info Sep 06 06:34:05 devstack sudo[91390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:34:05 devstack sudo[91390]: pam_unix(sudo:session): session closed for user root Sep 06 06:34:05 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-a6debbcb-fbdc-4c42-890d-1f6faba46536 tempest-GroupSnapshotsTest-1381895959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b83726ee-11ba-423c-8be9-9273a802ade4.info" returned: 0 in 0.477s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:34:05 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-a6debbcb-fbdc-4c42-890d-1f6faba46536 tempest-GroupSnapshotsTest-1381895959 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.641s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:34:05 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-8ccb4aa0-c78f-4c06-ac8a-2a39928414f2 tempest-ServerActionsTestOtherA-968672787 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.209s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:34:05 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-8ccb4aa0-c78f-4c06-ac8a-2a39928414f2 tempest-ServerActionsTestOtherA-968672787 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:34:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1787018041',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=052783c6-7634-4422-9227-0f9e115dea08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='474e425101c84d91a4f761bb638bd56f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:34:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:34:03Z,use_quota=True,user_id='f6eb0730f9b946dd9ee3c21c75d4566e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)}" {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 06:34:05 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-8ccb4aa0-c78f-4c06-ac8a-2a39928414f2 tempest-ServerActionsTestOtherA-968672787 None] Creating volume 052783c6-7634-4422-9227-0f9e115dea08 {{(pid=87329) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 06:34:05 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-8ccb4aa0-c78f-4c06-ac8a-2a39928414f2 tempest-ServerActionsTestOtherA-968672787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:34:05 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-8ccb4aa0-c78f-4c06-ac8a-2a39928414f2 tempest-ServerActionsTestOtherA-968672787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:34:05 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-8ccb4aa0-c78f-4c06-ac8a-2a39928414f2 tempest-ServerActionsTestOtherA-968672787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:34:05 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-8ccb4aa0-c78f-4c06-ac8a-2a39928414f2 tempest-ServerActionsTestOtherA-968672787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:34:05 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-8ccb4aa0-c78f-4c06-ac8a-2a39928414f2 tempest-ServerActionsTestOtherA-968672787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:34:05 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-8ccb4aa0-c78f-4c06-ac8a-2a39928414f2 tempest-ServerActionsTestOtherA-968672787 None] Selected osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 as target Quobyte volume. {{(pid=87329) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 06:34:05 devstack cinder-volume[87329]: INFO cinder.volume.drivers.remotefs [None req-8ccb4aa0-c78f-4c06-ac8a-2a39928414f2 tempest-ServerActionsTestOtherA-968672787 None] casted to osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 Sep 06 06:34:05 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-8ccb4aa0-c78f-4c06-ac8a-2a39928414f2 tempest-ServerActionsTestOtherA-968672787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-052783c6-7634-4422-9227-0f9e115dea08 1073741824 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:34:05 devstack sudo[91403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-052783c6-7634-4422-9227-0f9e115dea08 1073741824 Sep 06 06:34:05 devstack sudo[91403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:34:05 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-a6debbcb-fbdc-4c42-890d-1f6faba46536 tempest-GroupSnapshotsTest-1381895959 None] group_snapshot 5654a126-518d-447f-9477-50ce3c87b0ac: created successfully Sep 06 06:34:06 devstack sudo[91403]: pam_unix(sudo:session): session closed for user root Sep 06 06:34:06 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-8ccb4aa0-c78f-4c06-ac8a-2a39928414f2 tempest-ServerActionsTestOtherA-968672787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-052783c6-7634-4422-9227-0f9e115dea08 1073741824" returned: 0 in 0.738s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:34:06 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-8ccb4aa0-c78f-4c06-ac8a-2a39928414f2 tempest-ServerActionsTestOtherA-968672787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-052783c6-7634-4422-9227-0f9e115dea08 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:34:06 devstack sudo[91432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-052783c6-7634-4422-9227-0f9e115dea08 Sep 06 06:34:06 devstack sudo[91432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:34:06 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-b6e45c88-5286-4501-b551-fa58c9078f0b tempest-GroupSnapshotsTest-1381895959 None] group_snapshot 5654a126-518d-447f-9477-50ce3c87b0ac: deleting Sep 06 06:34:06 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-b6e45c88-5286-4501-b551-fa58c9078f0b tempest-GroupSnapshotsTest-1381895959 None] group_snapshot 5654a126-518d-447f-9477-50ce3c87b0ac: deleting {{(pid=87329) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 06 06:34:06 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-b6e45c88-5286-4501-b551-fa58c9078f0b tempest-GroupSnapshotsTest-1381895959 None] Acquiring lock "cinder-quobyte-b83726ee-11ba-423c-8be9-9273a802ade4" by "delete_snapshot" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:34:06 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-b6e45c88-5286-4501-b551-fa58c9078f0b tempest-GroupSnapshotsTest-1381895959 None] Lock "cinder-quobyte-b83726ee-11ba-423c-8be9-9273a802ade4" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:34:06 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-b6e45c88-5286-4501-b551-fa58c9078f0b tempest-GroupSnapshotsTest-1381895959 None] Acquiring lock "cinder-quobyte-d3255d03-b6c3-48dc-bafb-4e48a88e729c" by "_delete_snapshot" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:34:06 devstack sudo[91432]: pam_unix(sudo:session): session closed for user root Sep 06 06:34:06 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-8ccb4aa0-c78f-4c06-ac8a-2a39928414f2 tempest-ServerActionsTestOtherA-968672787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-052783c6-7634-4422-9227-0f9e115dea08" returned: 0 in 0.334s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:34:06 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-8ccb4aa0-c78f-4c06-ac8a-2a39928414f2 tempest-ServerActionsTestOtherA-968672787 None] <== create_volume: return (1155ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'} {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 06:34:06 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-8ccb4aa0-c78f-4c06-ac8a-2a39928414f2 tempest-ServerActionsTestOtherA-968672787 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.165s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:34:06 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-b6e45c88-5286-4501-b551-fa58c9078f0b tempest-GroupSnapshotsTest-1381895959 None] Lock "cinder-quobyte-d3255d03-b6c3-48dc-bafb-4e48a88e729c" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:34:06 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-b6e45c88-5286-4501-b551-fa58c9078f0b tempest-GroupSnapshotsTest-1381895959 None] Deleting offline snapshot d3255d03-b6c3-48dc-bafb-4e48a88e729c of volume b83726ee-11ba-423c-8be9-9273a802ade4 {{(pid=87329) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 06 06:34:06 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-b6e45c88-5286-4501-b551-fa58c9078f0b tempest-GroupSnapshotsTest-1381895959 None] snapshot_file for this snap is: volume-b83726ee-11ba-423c-8be9-9273a802ade4.d3255d03-b6c3-48dc-bafb-4e48a88e729c {{(pid=87329) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 06 06:34:06 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-8ccb4aa0-c78f-4c06-ac8a-2a39928414f2 tempest-ServerActionsTestOtherA-968672787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4a31227-981a-43e9-8356-087f88a8bccd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-052783c6-7634-4422-9227-0f9e115dea08', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:34:06 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-8ccb4aa0-c78f-4c06-ac8a-2a39928414f2 tempest-ServerActionsTestOtherA-968672787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c67263f-7ad0-4a69-b6c7-c394e293ae98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:34:06 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[96e3aad8-6adb-4f5f-949e-b0fdbaf43326]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:34:06 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-b6e45c88-5286-4501-b551-fa58c9078f0b tempest-GroupSnapshotsTest-1381895959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b83726ee-11ba-423c-8be9-9273a802ade4.d3255d03-b6c3-48dc-bafb-4e48a88e729c {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:34:06 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-8ccb4aa0-c78f-4c06-ac8a-2a39928414f2 tempest-ServerActionsTestOtherA-968672787 None] Volume volume-052783c6-7634-4422-9227-0f9e115dea08 (052783c6-7634-4422-9227-0f9e115dea08): created successfully Sep 06 06:34:06 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-8ccb4aa0-c78f-4c06-ac8a-2a39928414f2 tempest-ServerActionsTestOtherA-968672787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c67263f-7ad0-4a69-b6c7-c394e293ae98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:34:06 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-8ccb4aa0-c78f-4c06-ac8a-2a39928414f2 tempest-ServerActionsTestOtherA-968672787 None] Flow 'volume_create_manager' (889a14e9-2600-4ce6-93a9-3ad962f9eea7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:34:06 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-8ccb4aa0-c78f-4c06-ac8a-2a39928414f2 tempest-ServerActionsTestOtherA-968672787 None] Created volume successfully. Sep 06 06:34:07 devstack sudo[91440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b83726ee-11ba-423c-8be9-9273a802ade4.d3255d03-b6c3-48dc-bafb-4e48a88e729c Sep 06 06:34:07 devstack sudo[91440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:34:07 devstack sudo[91440]: pam_unix(sudo:session): session closed for user root Sep 06 06:34:07 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-b6e45c88-5286-4501-b551-fa58c9078f0b tempest-GroupSnapshotsTest-1381895959 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b83726ee-11ba-423c-8be9-9273a802ade4.d3255d03-b6c3-48dc-bafb-4e48a88e729c" returned: 0 in 0.447s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:34:07 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-b6e45c88-5286-4501-b551-fa58c9078f0b tempest-GroupSnapshotsTest-1381895959 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b83726ee-11ba-423c-8be9-9273a802ade4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87329) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 06:34:07 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5576c5c-5d74-4ddb-9f45-4aef0f021276]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:34:07 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-b6e45c88-5286-4501-b551-fa58c9078f0b tempest-GroupSnapshotsTest-1381895959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b83726ee-11ba-423c-8be9-9273a802ade4 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:34:07 devstack sudo[91446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b83726ee-11ba-423c-8be9-9273a802ade4 Sep 06 06:34:07 devstack sudo[91446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:34:07 devstack sudo[91446]: pam_unix(sudo:session): session closed for user root Sep 06 06:34:07 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-b6e45c88-5286-4501-b551-fa58c9078f0b tempest-GroupSnapshotsTest-1381895959 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b83726ee-11ba-423c-8be9-9273a802ade4" returned: 0 in 0.465s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:34:07 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-b6e45c88-5286-4501-b551-fa58c9078f0b tempest-GroupSnapshotsTest-1381895959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b83726ee-11ba-423c-8be9-9273a802ade4.d3255d03-b6c3-48dc-bafb-4e48a88e729c {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:34:07 devstack sudo[91454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b83726ee-11ba-423c-8be9-9273a802ade4.d3255d03-b6c3-48dc-bafb-4e48a88e729c Sep 06 06:34:07 devstack sudo[91454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:34:08 devstack sudo[91454]: pam_unix(sudo:session): session closed for user root Sep 06 06:34:08 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-b6e45c88-5286-4501-b551-fa58c9078f0b tempest-GroupSnapshotsTest-1381895959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b83726ee-11ba-423c-8be9-9273a802ade4.d3255d03-b6c3-48dc-bafb-4e48a88e729c" returned: 0 in 0.535s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:34:08 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-b6e45c88-5286-4501-b551-fa58c9078f0b tempest-GroupSnapshotsTest-1381895959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b83726ee-11ba-423c-8be9-9273a802ade4.d3255d03-b6c3-48dc-bafb-4e48a88e729c {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:34:08 devstack sudo[91462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b83726ee-11ba-423c-8be9-9273a802ade4.d3255d03-b6c3-48dc-bafb-4e48a88e729c Sep 06 06:34:08 devstack sudo[91462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:34:08 devstack sudo[91462]: pam_unix(sudo:session): session closed for user root Sep 06 06:34:08 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-b6e45c88-5286-4501-b551-fa58c9078f0b tempest-GroupSnapshotsTest-1381895959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b83726ee-11ba-423c-8be9-9273a802ade4.d3255d03-b6c3-48dc-bafb-4e48a88e729c" returned: 0 in 0.444s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:34:08 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-b6e45c88-5286-4501-b551-fa58c9078f0b tempest-GroupSnapshotsTest-1381895959 None] Lock "cinder-quobyte-d3255d03-b6c3-48dc-bafb-4e48a88e729c" released by "_delete_snapshot" :: held 2.054s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:34:08 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-b6e45c88-5286-4501-b551-fa58c9078f0b tempest-GroupSnapshotsTest-1381895959 None] Lock "cinder-quobyte-b83726ee-11ba-423c-8be9-9273a802ade4" released by "delete_snapshot" :: held 2.127s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:34:09 devstack cinder-volume[87329]: WARNING cinder.quota [None req-b6e45c88-5286-4501-b551-fa58c9078f0b tempest-GroupSnapshotsTest-1381895959 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1404292696 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1404292696, it is now deprecated. Please use the default quota class for default quota. Sep 06 06:34:09 devstack cinder-volume[87329]: WARNING cinder.quota [None req-b6e45c88-5286-4501-b551-fa58c9078f0b tempest-GroupSnapshotsTest-1381895959 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1404292696 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1404292696, it is now deprecated. Please use the default quota class for default quota. Sep 06 06:34:09 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-b6e45c88-5286-4501-b551-fa58c9078f0b tempest-GroupSnapshotsTest-1381895959 None] Created reservations ['2fba1efe-57e3-4e05-b78e-10200b427c4b', '7451f75c-ae73-4980-87c2-9667fe580743', 'a8985f2d-30cd-4183-adf5-39165e3cf642', '01cd8881-c811-455b-ade8-776f0ad859d9'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:34:09 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-b6e45c88-5286-4501-b551-fa58c9078f0b tempest-GroupSnapshotsTest-1381895959 None] group_snapshot 5654a126-518d-447f-9477-50ce3c87b0ac: deleted successfully Sep 06 06:34:10 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-509acb7c-60a9-47ea-bfaf-6aa1f07f4e19 tempest-GroupSnapshotsTest-1381895959 None] Acquiring lock "cinder-quobyte-b83726ee-11ba-423c-8be9-9273a802ade4" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:34:10 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-509acb7c-60a9-47ea-bfaf-6aa1f07f4e19 tempest-GroupSnapshotsTest-1381895959 None] Lock "cinder-quobyte-b83726ee-11ba-423c-8be9-9273a802ade4" acquired by "delete_volume" :: waited 0.023s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:34:10 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[d095a5d8-b05b-4307-9940-1c6f3a0fa4d1]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:34:10 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-509acb7c-60a9-47ea-bfaf-6aa1f07f4e19 tempest-GroupSnapshotsTest-1381895959 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b83726ee-11ba-423c-8be9-9273a802ade4 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:34:11 devstack sudo[91540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b83726ee-11ba-423c-8be9-9273a802ade4 Sep 06 06:34:11 devstack sudo[91540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:34:11 devstack sudo[91540]: pam_unix(sudo:session): session closed for user root Sep 06 06:34:11 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-509acb7c-60a9-47ea-bfaf-6aa1f07f4e19 tempest-GroupSnapshotsTest-1381895959 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b83726ee-11ba-423c-8be9-9273a802ade4" returned: 0 in 0.799s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:34:11 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-509acb7c-60a9-47ea-bfaf-6aa1f07f4e19 tempest-GroupSnapshotsTest-1381895959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b83726ee-11ba-423c-8be9-9273a802ade4 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:34:11 devstack sudo[91546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b83726ee-11ba-423c-8be9-9273a802ade4 Sep 06 06:34:11 devstack sudo[91546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:34:12 devstack sudo[91546]: pam_unix(sudo:session): session closed for user root Sep 06 06:34:12 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-509acb7c-60a9-47ea-bfaf-6aa1f07f4e19 tempest-GroupSnapshotsTest-1381895959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b83726ee-11ba-423c-8be9-9273a802ade4" returned: 0 in 0.364s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:34:12 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-509acb7c-60a9-47ea-bfaf-6aa1f07f4e19 tempest-GroupSnapshotsTest-1381895959 None] Lock "cinder-quobyte-b83726ee-11ba-423c-8be9-9273a802ade4" released by "delete_volume" :: held 1.267s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:34:12 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-509acb7c-60a9-47ea-bfaf-6aa1f07f4e19 tempest-GroupSnapshotsTest-1381895959 None] Created reservations ['ebd6573c-46ba-462e-a4ce-8215d3377a11'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:34:12 devstack cinder-volume[87329]: WARNING cinder.quota [None req-509acb7c-60a9-47ea-bfaf-6aa1f07f4e19 tempest-GroupSnapshotsTest-1381895959 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1404292696 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1404292696, it is now deprecated. Please use the default quota class for default quota. Sep 06 06:34:12 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-509acb7c-60a9-47ea-bfaf-6aa1f07f4e19 tempest-GroupSnapshotsTest-1381895959 None] Created reservations ['57a07658-e405-4537-af69-096725bacd84', '68e1fd29-0289-4d4b-9827-438cbca7b925', '9b1d046a-2723-42ed-8036-4a5364639ffd', 'd9ef4fb6-2b44-4d1d-b5c1-cea1d570a490'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:34:12 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-509acb7c-60a9-47ea-bfaf-6aa1f07f4e19 tempest-GroupSnapshotsTest-1381895959 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:34:12 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-509acb7c-60a9-47ea-bfaf-6aa1f07f4e19 tempest-GroupSnapshotsTest-1381895959 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:34:12 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-509acb7c-60a9-47ea-bfaf-6aa1f07f4e19 tempest-GroupSnapshotsTest-1381895959 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:34:12 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-509acb7c-60a9-47ea-bfaf-6aa1f07f4e19 tempest-GroupSnapshotsTest-1381895959 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:34:12 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-509acb7c-60a9-47ea-bfaf-6aa1f07f4e19 tempest-GroupSnapshotsTest-1381895959 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:34:12 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-509acb7c-60a9-47ea-bfaf-6aa1f07f4e19 tempest-GroupSnapshotsTest-1381895959 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:34:12 devstack sudo[91565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:34:12 devstack sudo[91565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:34:13 devstack sudo[91565]: pam_unix(sudo:session): session closed for user root Sep 06 06:34:13 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-509acb7c-60a9-47ea-bfaf-6aa1f07f4e19 tempest-GroupSnapshotsTest-1381895959 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.385s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:34:13 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-509acb7c-60a9-47ea-bfaf-6aa1f07f4e19 tempest-GroupSnapshotsTest-1381895959 None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:34:13 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-509acb7c-60a9-47ea-bfaf-6aa1f07f4e19 tempest-GroupSnapshotsTest-1381895959 None] Delete group completed successfully. Sep 06 06:34:13 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-e39047d1-e700-4e70-a0ca-79be444c97f8 tempest-VolumesActionsTest-852331485 None] Acquiring lock "cinder-3cd2ddce-dd8e-40eb-b54e-df7057ba58f2" by "attach_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:34:13 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-e39047d1-e700-4e70-a0ca-79be444c97f8 tempest-VolumesActionsTest-852331485 None] Lock "cinder-3cd2ddce-dd8e-40eb-b54e-df7057ba58f2" acquired by "attach_volume" :: waited 0.058s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:34:13 devstack cinder-volume[87329]: DEBUG dbcounter [-] [87329] Writing DB stats cinder:SELECT=130,cinder:INSERT=37,cinder:UPDATE=139,cinder:DELETE=3 {{(pid=87329) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 06:34:13 devstack cinder-volume[87329]: INFO cinder.volume.manager [req-fe2f23e7-09e5-4126-bc58-850e3d444d33 req-8f530f65-be29-44f3-b0c9-973d038fe3c6 tempest-AttachVolumeNegativeTest-1315254098 None] Terminate volume connection completed successfully. Sep 06 06:34:13 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [req-fe2f23e7-09e5-4126-bc58-850e3d444d33 req-8f530f65-be29-44f3-b0c9-973d038fe3c6 tempest-AttachVolumeNegativeTest-1315254098 None] Deleting attachment ce713349-8acb-4c04-8a80-9e0ae07e7371. {{(pid=87329) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 06 06:34:13 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-e39047d1-e700-4e70-a0ca-79be444c97f8 tempest-VolumesActionsTest-852331485 None] Attaching volume 3cd2ddce-dd8e-40eb-b54e-df7057ba58f2 to instance c136c235-e7e2-4d44-b8a0-d7b94e31f1aa at mountpoint /dev/vdb on host None. Sep 06 06:34:13 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-e39047d1-e700-4e70-a0ca-79be444c97f8 tempest-VolumesActionsTest-852331485 None] Attach volume completed successfully. Sep 06 06:34:13 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-e39047d1-e700-4e70-a0ca-79be444c97f8 tempest-VolumesActionsTest-852331485 None] Lock "cinder-3cd2ddce-dd8e-40eb-b54e-df7057ba58f2" released by "attach_volume" :: held 0.250s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:34:13 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-2e4c53ba-6ef9-495a-a295-1970abf77553 tempest-VolumesActionsTest-852331485 None] Acquiring lock "cinder-3cd2ddce-dd8e-40eb-b54e-df7057ba58f2-detach_volume" by "detach_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:34:13 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-2e4c53ba-6ef9-495a-a295-1970abf77553 tempest-VolumesActionsTest-852331485 None] Lock "cinder-3cd2ddce-dd8e-40eb-b54e-df7057ba58f2-detach_volume" acquired by "detach_volume" :: waited 0.037s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:34:13 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-2e4c53ba-6ef9-495a-a295-1970abf77553 tempest-VolumesActionsTest-852331485 None] Detaching volume 3cd2ddce-dd8e-40eb-b54e-df7057ba58f2 from instance c136c235-e7e2-4d44-b8a0-d7b94e31f1aa. Sep 06 06:34:13 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-2e4c53ba-6ef9-495a-a295-1970abf77553 tempest-VolumesActionsTest-852331485 None] Detach volume completed successfully. Sep 06 06:34:13 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-2e4c53ba-6ef9-495a-a295-1970abf77553 tempest-VolumesActionsTest-852331485 None] Lock "cinder-3cd2ddce-dd8e-40eb-b54e-df7057ba58f2-detach_volume" released by "detach_volume" :: held 0.140s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:34:23 devstack cinder-volume[87329]: DEBUG dbcounter [-] [87329] Writing DB stats cinder:UPDATE=68,cinder:SELECT=59,cinder:INSERT=17,cinder:DELETE=1 {{(pid=87329) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 06:34:23 devstack cinder-volume[87329]: DEBUG dbcounter [-] [87329] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=87329) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 06:34:25 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-dca47fc7-000b-47d8-b76c-973e31bf5fc5 tempest-GroupsTest-1414684175 None] Group tempest-Group1-394198394: creating Sep 06 06:34:25 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-dca47fc7-000b-47d8-b76c-973e31bf5fc5 tempest-GroupsTest-1414684175 None] Group tempest-Group1-394198394: created successfully Sep 06 06:34:25 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-dca47fc7-000b-47d8-b76c-973e31bf5fc5 tempest-GroupsTest-1414684175 None] Create group completed successfully. Sep 06 06:34:27 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-bc67ec1a-9833-4f62-976c-61f65726c86a tempest-GroupsTest-1414684175 None] Group tempest-Group2-1711207800: creating Sep 06 06:34:27 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-bc67ec1a-9833-4f62-976c-61f65726c86a tempest-GroupsTest-1414684175 None] Group tempest-Group2-1711207800: created successfully Sep 06 06:34:27 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-bc67ec1a-9833-4f62-976c-61f65726c86a tempest-GroupsTest-1414684175 None] Create group completed successfully. Sep 06 06:34:30 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-80a76228-712e-4f11-9d39-34ef32c8d3e8 tempest-GroupsTest-1414684175 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87329) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 06:34:30 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-80a76228-712e-4f11-9d39-34ef32c8d3e8 tempest-GroupsTest-1414684175 None] Flow 'volume_create_manager' (04863b4c-bc9e-41bf-a928-b6fa29debdc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:34:30 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-80a76228-712e-4f11-9d39-34ef32c8d3e8 tempest-GroupsTest-1414684175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61f98b51-7f68-446f-a44c-01128b38671b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:34:30 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-80a76228-712e-4f11-9d39-34ef32c8d3e8 tempest-GroupsTest-1414684175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61f98b51-7f68-446f-a44c-01128b38671b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:34:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-868534536',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1fefd21a-45e1-401a-abad-71222b270daa,host='devstack@QuobyteHD#QuobyteHD',id=3119da17-6dce-4f68-8c81-f5193fefae3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53c9aac30d084d2283933bf9d0b3307e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:34:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:34:30Z,use_quota=True,user_id='aaa127bd30434e55a6ef1bc992fb6fe0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a0f928df-7cc3-4d9e-9695-5cfb89d5611b),volume_type_id=a0f928df-7cc3-4d9e-9695-5cfb89d5611b)' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:34:30 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-80a76228-712e-4f11-9d39-34ef32c8d3e8 tempest-GroupsTest-1414684175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27396a59-d296-4567-b368-624e905f2094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:34:30 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-80a76228-712e-4f11-9d39-34ef32c8d3e8 tempest-GroupsTest-1414684175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27396a59-d296-4567-b368-624e905f2094) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:34:30 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-80a76228-712e-4f11-9d39-34ef32c8d3e8 tempest-GroupsTest-1414684175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c09a2376-6155-47da-b4c9-f8d18a9af9c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:34:30 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-80a76228-712e-4f11-9d39-34ef32c8d3e8 tempest-GroupsTest-1414684175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c09a2376-6155-47da-b4c9-f8d18a9af9c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3119da17-6dce-4f68-8c81-f5193fefae3d', 'volume_name': 'volume-3119da17-6dce-4f68-8c81-f5193fefae3d', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:34:30 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-80a76228-712e-4f11-9d39-34ef32c8d3e8 tempest-GroupsTest-1414684175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7af049f5-fc06-49b8-a86f-aa4eee303ff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:34:30 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-80a76228-712e-4f11-9d39-34ef32c8d3e8 tempest-GroupsTest-1414684175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7af049f5-fc06-49b8-a86f-aa4eee303ff6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:34:30 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-80a76228-712e-4f11-9d39-34ef32c8d3e8 tempest-GroupsTest-1414684175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4921aa86-fcae-45bc-b188-6b66c32644f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:34:30 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-80a76228-712e-4f11-9d39-34ef32c8d3e8 tempest-GroupsTest-1414684175 None] Volume 3119da17-6dce-4f68-8c81-f5193fefae3d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3119da17-6dce-4f68-8c81-f5193fefae3d', 'volume_size': 1} Sep 06 06:34:30 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-80a76228-712e-4f11-9d39-34ef32c8d3e8 tempest-GroupsTest-1414684175 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:34:30 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-80a76228-712e-4f11-9d39-34ef32c8d3e8 tempest-GroupsTest-1414684175 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:34:30 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-80a76228-712e-4f11-9d39-34ef32c8d3e8 tempest-GroupsTest-1414684175 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=1fefd21a-45e1-401a-abad-71222b270daa,created_at=2026-09-06T04:34:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-868534536',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1fefd21a-45e1-401a-abad-71222b270daa,host='devstack@QuobyteHD#QuobyteHD',id=3119da17-6dce-4f68-8c81-f5193fefae3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53c9aac30d084d2283933bf9d0b3307e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:34:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:34:30Z,use_quota=True,user_id='aaa127bd30434e55a6ef1bc992fb6fe0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a0f928df-7cc3-4d9e-9695-5cfb89d5611b),volume_type_id=a0f928df-7cc3-4d9e-9695-5cfb89d5611b)}" {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 06:34:30 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-80a76228-712e-4f11-9d39-34ef32c8d3e8 tempest-GroupsTest-1414684175 None] Creating volume 3119da17-6dce-4f68-8c81-f5193fefae3d {{(pid=87329) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 06:34:30 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-80a76228-712e-4f11-9d39-34ef32c8d3e8 tempest-GroupsTest-1414684175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:34:30 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-80a76228-712e-4f11-9d39-34ef32c8d3e8 tempest-GroupsTest-1414684175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:34:30 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-80a76228-712e-4f11-9d39-34ef32c8d3e8 tempest-GroupsTest-1414684175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:34:30 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-80a76228-712e-4f11-9d39-34ef32c8d3e8 tempest-GroupsTest-1414684175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:34:30 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-80a76228-712e-4f11-9d39-34ef32c8d3e8 tempest-GroupsTest-1414684175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:34:30 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-80a76228-712e-4f11-9d39-34ef32c8d3e8 tempest-GroupsTest-1414684175 None] Selected osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 as target Quobyte volume. {{(pid=87329) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 06:34:30 devstack cinder-volume[87329]: INFO cinder.volume.drivers.remotefs [None req-80a76228-712e-4f11-9d39-34ef32c8d3e8 tempest-GroupsTest-1414684175 None] casted to osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 Sep 06 06:34:30 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-80a76228-712e-4f11-9d39-34ef32c8d3e8 tempest-GroupsTest-1414684175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-3119da17-6dce-4f68-8c81-f5193fefae3d 1073741824 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:34:30 devstack sudo[91798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-3119da17-6dce-4f68-8c81-f5193fefae3d 1073741824 Sep 06 06:34:30 devstack sudo[91798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:34:31 devstack sudo[91798]: pam_unix(sudo:session): session closed for user root Sep 06 06:34:31 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-80a76228-712e-4f11-9d39-34ef32c8d3e8 tempest-GroupsTest-1414684175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-3119da17-6dce-4f68-8c81-f5193fefae3d 1073741824" returned: 0 in 1.011s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:34:31 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-80a76228-712e-4f11-9d39-34ef32c8d3e8 tempest-GroupsTest-1414684175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-3119da17-6dce-4f68-8c81-f5193fefae3d {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:34:31 devstack sudo[91809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-3119da17-6dce-4f68-8c81-f5193fefae3d Sep 06 06:34:31 devstack sudo[91809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:34:32 devstack sudo[91809]: pam_unix(sudo:session): session closed for user root Sep 06 06:34:32 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-80a76228-712e-4f11-9d39-34ef32c8d3e8 tempest-GroupsTest-1414684175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-3119da17-6dce-4f68-8c81-f5193fefae3d" returned: 0 in 0.365s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:34:32 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-80a76228-712e-4f11-9d39-34ef32c8d3e8 tempest-GroupsTest-1414684175 None] <== create_volume: return (1491ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'} {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 06:34:32 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-80a76228-712e-4f11-9d39-34ef32c8d3e8 tempest-GroupsTest-1414684175 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.497s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:34:32 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-80a76228-712e-4f11-9d39-34ef32c8d3e8 tempest-GroupsTest-1414684175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4921aa86-fcae-45bc-b188-6b66c32644f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3119da17-6dce-4f68-8c81-f5193fefae3d', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:34:32 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-80a76228-712e-4f11-9d39-34ef32c8d3e8 tempest-GroupsTest-1414684175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (379e333f-b4e6-4a19-aec9-da746fbe4e9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:34:32 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-80a76228-712e-4f11-9d39-34ef32c8d3e8 tempest-GroupsTest-1414684175 None] Volume volume-3119da17-6dce-4f68-8c81-f5193fefae3d (3119da17-6dce-4f68-8c81-f5193fefae3d): created successfully Sep 06 06:34:32 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-80a76228-712e-4f11-9d39-34ef32c8d3e8 tempest-GroupsTest-1414684175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (379e333f-b4e6-4a19-aec9-da746fbe4e9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:34:32 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-80a76228-712e-4f11-9d39-34ef32c8d3e8 tempest-GroupsTest-1414684175 None] Flow 'volume_create_manager' (04863b4c-bc9e-41bf-a928-b6fa29debdc0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:34:32 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-80a76228-712e-4f11-9d39-34ef32c8d3e8 tempest-GroupsTest-1414684175 None] Created volume successfully. Sep 06 06:34:32 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-d514366a-e2de-45cc-95d8-b730f8c52b50 tempest-VolumesActionsTest-852331485 None] Acquiring lock "cinder-3cd2ddce-dd8e-40eb-b54e-df7057ba58f2" by "attach_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:34:32 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-d514366a-e2de-45cc-95d8-b730f8c52b50 tempest-VolumesActionsTest-852331485 None] Lock "cinder-3cd2ddce-dd8e-40eb-b54e-df7057ba58f2" acquired by "attach_volume" :: waited 0.032s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:34:32 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-d514366a-e2de-45cc-95d8-b730f8c52b50 tempest-VolumesActionsTest-852331485 None] Attaching volume 3cd2ddce-dd8e-40eb-b54e-df7057ba58f2 to instance 2c2d3a69-17bc-410a-a79c-43a76ed1d674 at mountpoint /dev/vdb on host None. Sep 06 06:34:32 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-d514366a-e2de-45cc-95d8-b730f8c52b50 tempest-VolumesActionsTest-852331485 None] Attach volume completed successfully. Sep 06 06:34:32 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-d514366a-e2de-45cc-95d8-b730f8c52b50 tempest-VolumesActionsTest-852331485 None] Lock "cinder-3cd2ddce-dd8e-40eb-b54e-df7057ba58f2" released by "attach_volume" :: held 0.145s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:34:33 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-bd032a1a-9ae8-4865-88da-a9219f6a1a9e tempest-VolumesActionsTest-852331485 None] Acquiring lock "cinder-3cd2ddce-dd8e-40eb-b54e-df7057ba58f2-detach_volume" by "detach_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:34:33 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-bd032a1a-9ae8-4865-88da-a9219f6a1a9e tempest-VolumesActionsTest-852331485 None] Lock "cinder-3cd2ddce-dd8e-40eb-b54e-df7057ba58f2-detach_volume" acquired by "detach_volume" :: waited 0.034s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:34:33 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-bd032a1a-9ae8-4865-88da-a9219f6a1a9e tempest-VolumesActionsTest-852331485 None] Detaching volume 3cd2ddce-dd8e-40eb-b54e-df7057ba58f2 from instance 2c2d3a69-17bc-410a-a79c-43a76ed1d674. Sep 06 06:34:33 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-bd032a1a-9ae8-4865-88da-a9219f6a1a9e tempest-VolumesActionsTest-852331485 None] Detach volume completed successfully. Sep 06 06:34:33 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-bd032a1a-9ae8-4865-88da-a9219f6a1a9e tempest-VolumesActionsTest-852331485 None] Lock "cinder-3cd2ddce-dd8e-40eb-b54e-df7057ba58f2-detach_volume" released by "detach_volume" :: held 0.144s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:34:34 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-c717dd2c-8d4a-4655-ad2a-98f056b99956 tempest-GroupsTest-1414684175 None] Acquiring lock "cinder-quobyte-3119da17-6dce-4f68-8c81-f5193fefae3d" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:34:34 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-c717dd2c-8d4a-4655-ad2a-98f056b99956 tempest-GroupsTest-1414684175 None] Lock "cinder-quobyte-3119da17-6dce-4f68-8c81-f5193fefae3d" acquired by "delete_volume" :: waited 0.031s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:34:34 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb885239-8bb0-4593-9cc9-1327e8a4f1ff]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:34:34 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-c717dd2c-8d4a-4655-ad2a-98f056b99956 tempest-GroupsTest-1414684175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-3119da17-6dce-4f68-8c81-f5193fefae3d {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:34:34 devstack sudo[91876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-3119da17-6dce-4f68-8c81-f5193fefae3d Sep 06 06:34:34 devstack sudo[91876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:34:35 devstack sudo[91876]: pam_unix(sudo:session): session closed for user root Sep 06 06:34:35 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-c717dd2c-8d4a-4655-ad2a-98f056b99956 tempest-GroupsTest-1414684175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-3119da17-6dce-4f68-8c81-f5193fefae3d" returned: 0 in 0.733s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:34:35 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-c717dd2c-8d4a-4655-ad2a-98f056b99956 tempest-GroupsTest-1414684175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-3119da17-6dce-4f68-8c81-f5193fefae3d {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:34:35 devstack sudo[91942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-3119da17-6dce-4f68-8c81-f5193fefae3d Sep 06 06:34:35 devstack sudo[91942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:34:35 devstack sudo[91942]: pam_unix(sudo:session): session closed for user root Sep 06 06:34:35 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-c717dd2c-8d4a-4655-ad2a-98f056b99956 tempest-GroupsTest-1414684175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-3119da17-6dce-4f68-8c81-f5193fefae3d" returned: 0 in 0.697s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:34:35 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-c717dd2c-8d4a-4655-ad2a-98f056b99956 tempest-GroupsTest-1414684175 None] Lock "cinder-quobyte-3119da17-6dce-4f68-8c81-f5193fefae3d" released by "delete_volume" :: held 1.513s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:34:35 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-c717dd2c-8d4a-4655-ad2a-98f056b99956 tempest-GroupsTest-1414684175 None] Created reservations ['3d33e163-a9c8-4347-b87a-a386d0fe3208'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:34:35 devstack cinder-volume[87329]: WARNING cinder.quota [None req-c717dd2c-8d4a-4655-ad2a-98f056b99956 tempest-GroupsTest-1414684175 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-2007230645 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-2007230645, it is now deprecated. Please use the default quota class for default quota. Sep 06 06:34:36 devstack cinder-volume[87329]: WARNING cinder.quota [None req-c717dd2c-8d4a-4655-ad2a-98f056b99956 tempest-GroupsTest-1414684175 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-2007230645 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-2007230645, it is now deprecated. Please use the default quota class for default quota. Sep 06 06:34:36 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-c717dd2c-8d4a-4655-ad2a-98f056b99956 tempest-GroupsTest-1414684175 None] Created reservations ['a8b2a55b-a584-4b4f-8869-90da7e2a1304', '0755e1f3-5b3b-4ffd-b122-6753d9199568', '49e3a850-585e-41c7-b1e0-5f9e7b9f7d5f', '33a8fc92-793d-44ce-b778-a1a152676532'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:34:36 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-c717dd2c-8d4a-4655-ad2a-98f056b99956 tempest-GroupsTest-1414684175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:34:36 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-c717dd2c-8d4a-4655-ad2a-98f056b99956 tempest-GroupsTest-1414684175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:34:36 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-c717dd2c-8d4a-4655-ad2a-98f056b99956 tempest-GroupsTest-1414684175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:34:36 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-c717dd2c-8d4a-4655-ad2a-98f056b99956 tempest-GroupsTest-1414684175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:34:36 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-c717dd2c-8d4a-4655-ad2a-98f056b99956 tempest-GroupsTest-1414684175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:34:36 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-c717dd2c-8d4a-4655-ad2a-98f056b99956 tempest-GroupsTest-1414684175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:34:36 devstack sudo[91969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:34:36 devstack sudo[91969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:34:36 devstack sudo[91969]: pam_unix(sudo:session): session closed for user root Sep 06 06:34:36 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-c717dd2c-8d4a-4655-ad2a-98f056b99956 tempest-GroupsTest-1414684175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.351s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:34:36 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-c717dd2c-8d4a-4655-ad2a-98f056b99956 tempest-GroupsTest-1414684175 None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:34:36 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-c717dd2c-8d4a-4655-ad2a-98f056b99956 tempest-GroupsTest-1414684175 None] Delete group completed successfully. Sep 06 06:34:37 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-a6b46878-833f-4953-9cd1-8291921de05e tempest-GroupsTest-1414684175 None] Created reservations ['f4420b85-9300-42ae-84e0-51e62be9bc59'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:34:37 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-a6b46878-833f-4953-9cd1-8291921de05e tempest-GroupsTest-1414684175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:34:37 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-a6b46878-833f-4953-9cd1-8291921de05e tempest-GroupsTest-1414684175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:34:37 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-a6b46878-833f-4953-9cd1-8291921de05e tempest-GroupsTest-1414684175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:34:37 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-a6b46878-833f-4953-9cd1-8291921de05e tempest-GroupsTest-1414684175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:34:37 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-a6b46878-833f-4953-9cd1-8291921de05e tempest-GroupsTest-1414684175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:34:37 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-a6b46878-833f-4953-9cd1-8291921de05e tempest-GroupsTest-1414684175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:34:37 devstack sudo[91972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:34:37 devstack sudo[91972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:34:37 devstack sudo[91972]: pam_unix(sudo:session): session closed for user root Sep 06 06:34:37 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-a6b46878-833f-4953-9cd1-8291921de05e tempest-GroupsTest-1414684175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.336s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:34:37 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-a6b46878-833f-4953-9cd1-8291921de05e tempest-GroupsTest-1414684175 None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:34:37 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-a6b46878-833f-4953-9cd1-8291921de05e tempest-GroupsTest-1414684175 None] Delete group completed successfully. Sep 06 06:34:39 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-0d028b64-9cb1-4cf5-8302-2a0a7ed357ee tempest-GroupsTest-1414684175 None] Group tempest-GroupsTest-Group-1651303323: creating Sep 06 06:34:39 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-777997d4-7b24-47d9-839b-462ef0f6f990 tempest-VolumesActionsTest-852331485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:34:39 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-777997d4-7b24-47d9-839b-462ef0f6f990 tempest-VolumesActionsTest-852331485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:34:39 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-0d028b64-9cb1-4cf5-8302-2a0a7ed357ee tempest-GroupsTest-1414684175 None] Group tempest-GroupsTest-Group-1651303323: created successfully Sep 06 06:34:39 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-0d028b64-9cb1-4cf5-8302-2a0a7ed357ee tempest-GroupsTest-1414684175 None] Create group completed successfully. Sep 06 06:34:39 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ca756d9-4cb4-40c3-a2e8-f98faf9b7259]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:34:39 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-777997d4-7b24-47d9-839b-462ef0f6f990 tempest-VolumesActionsTest-852331485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-3cd2ddce-dd8e-40eb-b54e-df7057ba58f2 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:34:39 devstack sudo[91980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-3cd2ddce-dd8e-40eb-b54e-df7057ba58f2 Sep 06 06:34:39 devstack sudo[91980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:34:39 devstack sudo[91980]: pam_unix(sudo:session): session closed for user root Sep 06 06:34:39 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-777997d4-7b24-47d9-839b-462ef0f6f990 tempest-VolumesActionsTest-852331485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-3cd2ddce-dd8e-40eb-b54e-df7057ba58f2" returned: 0 in 0.367s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:34:39 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[8241b998-583d-4ea6-9474-ddb72f9667b8]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:34:39 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-777997d4-7b24-47d9-839b-462ef0f6f990 tempest-VolumesActionsTest-852331485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-3cd2ddce-dd8e-40eb-b54e-df7057ba58f2 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:34:39 devstack sudo[91986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-3cd2ddce-dd8e-40eb-b54e-df7057ba58f2 Sep 06 06:34:39 devstack sudo[91986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:34:40 devstack sudo[91986]: pam_unix(sudo:session): session closed for user root Sep 06 06:34:40 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-777997d4-7b24-47d9-839b-462ef0f6f990 tempest-VolumesActionsTest-852331485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-3cd2ddce-dd8e-40eb-b54e-df7057ba58f2" returned: 0 in 0.410s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:34:40 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-777997d4-7b24-47d9-839b-462ef0f6f990 tempest-VolumesActionsTest-852331485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-3cd2ddce-dd8e-40eb-b54e-df7057ba58f2 /opt/stack/data/cinder/conversion/3cd2ddce-dd8e-40eb-b54e-df7057ba58f2.temp_image.eeb13b8e-d1e5-4c59-98ed-396e17496a4711dsr0gw.img {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:34:40 devstack sudo[91992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-3cd2ddce-dd8e-40eb-b54e-df7057ba58f2 /opt/stack/data/cinder/conversion/3cd2ddce-dd8e-40eb-b54e-df7057ba58f2.temp_image.eeb13b8e-d1e5-4c59-98ed-396e17496a4711dsr0gw.img Sep 06 06:34:40 devstack sudo[91992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:34:41 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c05498c-afc5-4211-b8bb-13f85ef6a2e8 tempest-GroupsTest-1414684175 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87329) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 06:34:41 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-0c05498c-afc5-4211-b8bb-13f85ef6a2e8 tempest-GroupsTest-1414684175 None] Flow 'volume_create_manager' (466aa101-67f6-4306-8032-d8a887a25a7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:34:41 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-0c05498c-afc5-4211-b8bb-13f85ef6a2e8 tempest-GroupsTest-1414684175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9d4b9e4-df74-4054-ab43-03fc18520a36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:34:41 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-0c05498c-afc5-4211-b8bb-13f85ef6a2e8 tempest-GroupsTest-1414684175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9d4b9e4-df74-4054-ab43-03fc18520a36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:34:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1740001115',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=315ca10a-d29b-40a5-8619-e4f320a0d964,host='devstack@QuobyteHD#QuobyteHD',id=43bef10a-3242-4b28-ac0e-9e4a311c11d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53c9aac30d084d2283933bf9d0b3307e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:34:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:34:42Z,use_quota=True,user_id='aaa127bd30434e55a6ef1bc992fb6fe0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14cac40-eb14-4dbc-87e1-2e6792167ac4),volume_type_id=b14cac40-eb14-4dbc-87e1-2e6792167ac4)' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:34:41 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-0c05498c-afc5-4211-b8bb-13f85ef6a2e8 tempest-GroupsTest-1414684175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5900155d-648b-4422-9d01-4bab35a6c993) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:34:41 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-0c05498c-afc5-4211-b8bb-13f85ef6a2e8 tempest-GroupsTest-1414684175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5900155d-648b-4422-9d01-4bab35a6c993) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:34:41 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-0c05498c-afc5-4211-b8bb-13f85ef6a2e8 tempest-GroupsTest-1414684175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0563d47f-d100-4162-a55a-c609c06b748b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:34:42 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-0c05498c-afc5-4211-b8bb-13f85ef6a2e8 tempest-GroupsTest-1414684175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0563d47f-d100-4162-a55a-c609c06b748b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43bef10a-3242-4b28-ac0e-9e4a311c11d2', 'volume_name': 'volume-43bef10a-3242-4b28-ac0e-9e4a311c11d2', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:34:42 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-0c05498c-afc5-4211-b8bb-13f85ef6a2e8 tempest-GroupsTest-1414684175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6741a0d-6b0c-4044-acd1-bdda68921ef6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:34:42 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-0c05498c-afc5-4211-b8bb-13f85ef6a2e8 tempest-GroupsTest-1414684175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6741a0d-6b0c-4044-acd1-bdda68921ef6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:34:42 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-0c05498c-afc5-4211-b8bb-13f85ef6a2e8 tempest-GroupsTest-1414684175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad65718b-9437-497e-94e2-eb5d3d5804e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:34:42 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-0c05498c-afc5-4211-b8bb-13f85ef6a2e8 tempest-GroupsTest-1414684175 None] Volume 43bef10a-3242-4b28-ac0e-9e4a311c11d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43bef10a-3242-4b28-ac0e-9e4a311c11d2', 'volume_size': 1} Sep 06 06:34:42 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-0c05498c-afc5-4211-b8bb-13f85ef6a2e8 tempest-GroupsTest-1414684175 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:34:46 devstack sudo[91992]: pam_unix(sudo:session): session closed for user root Sep 06 06:34:46 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-777997d4-7b24-47d9-839b-462ef0f6f990 tempest-VolumesActionsTest-852331485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-3cd2ddce-dd8e-40eb-b54e-df7057ba58f2 /opt/stack/data/cinder/conversion/3cd2ddce-dd8e-40eb-b54e-df7057ba58f2.temp_image.eeb13b8e-d1e5-4c59-98ed-396e17496a4711dsr0gw.img" returned: 0 in 6.327s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:34:46 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[918c5bbe-f80b-4a46-8432-71d8dcb67494]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:34:46 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-777997d4-7b24-47d9-839b-462ef0f6f990 tempest-VolumesActionsTest-852331485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-3cd2ddce-dd8e-40eb-b54e-df7057ba58f2 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:34:46 devstack sudo[92011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-3cd2ddce-dd8e-40eb-b54e-df7057ba58f2 Sep 06 06:34:46 devstack sudo[92011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:34:46 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [req-893f173a-648a-4073-88c7-4726504a4f74 req-3a931660-ffb7-40e2-a7b8-97e245d8bba5 tempest-ServerActionsTestOtherA-968672787 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:34:46 devstack sudo[92011]: pam_unix(sudo:session): session closed for user root Sep 06 06:34:46 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-777997d4-7b24-47d9-839b-462ef0f6f990 tempest-VolumesActionsTest-852331485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-3cd2ddce-dd8e-40eb-b54e-df7057ba58f2" returned: 0 in 0.615s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:34:46 devstack cinder-volume[87329]: DEBUG cinder.image.image_utils [None req-777997d4-7b24-47d9-839b-462ef0f6f990 tempest-VolumesActionsTest-852331485 None] Image conversion details: src /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-3cd2ddce-dd8e-40eb-b54e-df7057ba58f2, size 1024.00 MB, duration 6.33 sec, destination /opt/stack/data/cinder/conversion/3cd2ddce-dd8e-40eb-b54e-df7057ba58f2.temp_image.eeb13b8e-d1e5-4c59-98ed-396e17496a4711dsr0gw.img {{(pid=87329) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 06 06:34:46 devstack cinder-volume[87329]: INFO cinder.image.image_utils [None req-777997d4-7b24-47d9-839b-462ef0f6f990 tempest-VolumesActionsTest-852331485 None] Converted 1024.00 MB image at 161.78 MB/s Sep 06 06:34:46 devstack cinder-volume[87329]: DEBUG cinder.image.image_utils [None req-777997d4-7b24-47d9-839b-462ef0f6f990 tempest-VolumesActionsTest-852331485 None] eeb13b8e-d1e5-4c59-98ed-396e17496a47 was raw, no need to convert to raw {{(pid=87329) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Sep 06 06:34:48 devstack cinder-volume[87329]: DEBUG oslo_service.periodic_task [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87329) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 06 06:34:48 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:34:48 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:34:48 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:34:48 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:34:48 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:34:48 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:34:48 devstack sudo[92059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:34:48 devstack sudo[92059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:34:48 devstack sudo[92059]: pam_unix(sudo:session): session closed for user root Sep 06 06:34:48 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.301s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:34:48 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:34:48 devstack cinder-volume[87329]: DEBUG oslo_service.periodic_task [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Running periodic task VolumeManager._thread_info {{(pid=87329) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 06 06:34:48 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] thread count: 28 {{(pid=87329) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 06 06:34:48 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] thread info: [<_MainThread(MainThread, started 126855043821696)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87329) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 06 06:34:56 devstack cinder-volume[87329]: DEBUG dbcounter [-] [87329] Writing DB stats cinder:SELECT=30,cinder:UPDATE=24,cinder:INSERT=6,cinder:DELETE=1 {{(pid=87329) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 06:34:56 devstack cinder-volume[87329]: DEBUG dbcounter [-] [87329] Writing DB stats cinder:SELECT=30,cinder:UPDATE=21,cinder:INSERT=3 {{(pid=87329) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 06:35:01 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-5341f8ab-4ed6-4bc7-874d-59cf5eb74648 tempest-AttachVolumeNegativeTest-1315254098 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87329) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 06:35:01 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-5341f8ab-4ed6-4bc7-874d-59cf5eb74648 tempest-AttachVolumeNegativeTest-1315254098 None] Flow 'volume_create_manager' (e5108558-60e3-4cc9-b3a1-e4a4ba731796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:35:01 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-5341f8ab-4ed6-4bc7-874d-59cf5eb74648 tempest-AttachVolumeNegativeTest-1315254098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b04de17-1a40-4cd2-8446-2815875da5bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:35:01 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-5341f8ab-4ed6-4bc7-874d-59cf5eb74648 tempest-AttachVolumeNegativeTest-1315254098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b04de17-1a40-4cd2-8446-2815875da5bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:35:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1733737288',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ab65776-1fe0-4481-af7b-5f27787e50e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ca696acace14cfdab93b2b90cc77cee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:35:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:35:02Z,use_quota=True,user_id='3df09a7695104f7595ec6e6d40af53be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:35:01 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-5341f8ab-4ed6-4bc7-874d-59cf5eb74648 tempest-AttachVolumeNegativeTest-1315254098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5155e6d-fa99-4711-aaa6-92498f26cdcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:35:01 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-5341f8ab-4ed6-4bc7-874d-59cf5eb74648 tempest-AttachVolumeNegativeTest-1315254098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5155e6d-fa99-4711-aaa6-92498f26cdcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:35:01 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-5341f8ab-4ed6-4bc7-874d-59cf5eb74648 tempest-AttachVolumeNegativeTest-1315254098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ef683ca-9c65-45cf-a7f0-97527f53adbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:35:01 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-5341f8ab-4ed6-4bc7-874d-59cf5eb74648 tempest-AttachVolumeNegativeTest-1315254098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ef683ca-9c65-45cf-a7f0-97527f53adbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ab65776-1fe0-4481-af7b-5f27787e50e8', 'volume_name': 'volume-2ab65776-1fe0-4481-af7b-5f27787e50e8', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:35:01 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-5341f8ab-4ed6-4bc7-874d-59cf5eb74648 tempest-AttachVolumeNegativeTest-1315254098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afc91400-61f6-4377-b407-663d8230e972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:35:01 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-5341f8ab-4ed6-4bc7-874d-59cf5eb74648 tempest-AttachVolumeNegativeTest-1315254098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afc91400-61f6-4377-b407-663d8230e972) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:35:01 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-5341f8ab-4ed6-4bc7-874d-59cf5eb74648 tempest-AttachVolumeNegativeTest-1315254098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a890529-d470-4c23-a0a9-d6251e3f2caf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:35:01 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-5341f8ab-4ed6-4bc7-874d-59cf5eb74648 tempest-AttachVolumeNegativeTest-1315254098 None] Volume 2ab65776-1fe0-4481-af7b-5f27787e50e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ab65776-1fe0-4481-af7b-5f27787e50e8', 'volume_size': 1} Sep 06 06:35:01 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-5341f8ab-4ed6-4bc7-874d-59cf5eb74648 tempest-AttachVolumeNegativeTest-1315254098 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:35:05 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-777997d4-7b24-47d9-839b-462ef0f6f990 tempest-VolumesActionsTest-852331485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 26.750s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:35:05 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-777997d4-7b24-47d9-839b-462ef0f6f990 tempest-VolumesActionsTest-852331485 None] Uploaded volume to glance image-id: eeb13b8e-d1e5-4c59-98ed-396e17496a47. {{(pid=87329) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 06 06:35:05 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-0c05498c-afc5-4211-b8bb-13f85ef6a2e8 tempest-GroupsTest-1414684175 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 23.890s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:35:05 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-0c05498c-afc5-4211-b8bb-13f85ef6a2e8 tempest-GroupsTest-1414684175 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=315ca10a-d29b-40a5-8619-e4f320a0d964,created_at=2026-09-06T04:34:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1740001115',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=315ca10a-d29b-40a5-8619-e4f320a0d964,host='devstack@QuobyteHD#QuobyteHD',id=43bef10a-3242-4b28-ac0e-9e4a311c11d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53c9aac30d084d2283933bf9d0b3307e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:34:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:34:42Z,use_quota=True,user_id='aaa127bd30434e55a6ef1bc992fb6fe0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14cac40-eb14-4dbc-87e1-2e6792167ac4),volume_type_id=b14cac40-eb14-4dbc-87e1-2e6792167ac4)}" {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 06:35:05 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-0c05498c-afc5-4211-b8bb-13f85ef6a2e8 tempest-GroupsTest-1414684175 None] Creating volume 43bef10a-3242-4b28-ac0e-9e4a311c11d2 {{(pid=87329) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 06:35:05 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-0c05498c-afc5-4211-b8bb-13f85ef6a2e8 tempest-GroupsTest-1414684175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:35:05 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-0c05498c-afc5-4211-b8bb-13f85ef6a2e8 tempest-GroupsTest-1414684175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:35:05 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-0c05498c-afc5-4211-b8bb-13f85ef6a2e8 tempest-GroupsTest-1414684175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:35:05 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-0c05498c-afc5-4211-b8bb-13f85ef6a2e8 tempest-GroupsTest-1414684175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:35:05 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-0c05498c-afc5-4211-b8bb-13f85ef6a2e8 tempest-GroupsTest-1414684175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:35:05 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-0c05498c-afc5-4211-b8bb-13f85ef6a2e8 tempest-GroupsTest-1414684175 None] Selected osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 as target Quobyte volume. {{(pid=87329) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 06:35:05 devstack cinder-volume[87329]: INFO cinder.volume.drivers.remotefs [None req-0c05498c-afc5-4211-b8bb-13f85ef6a2e8 tempest-GroupsTest-1414684175 None] casted to osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 Sep 06 06:35:05 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-0c05498c-afc5-4211-b8bb-13f85ef6a2e8 tempest-GroupsTest-1414684175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-43bef10a-3242-4b28-ac0e-9e4a311c11d2 1073741824 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:35:06 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-777997d4-7b24-47d9-839b-462ef0f6f990 tempest-VolumesActionsTest-852331485 None] Copy volume to image completed successfully. Sep 06 06:35:06 devstack sudo[92112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-43bef10a-3242-4b28-ac0e-9e4a311c11d2 1073741824 Sep 06 06:35:06 devstack sudo[92112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:35:06 devstack sudo[92112]: pam_unix(sudo:session): session closed for user root Sep 06 06:35:06 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-0c05498c-afc5-4211-b8bb-13f85ef6a2e8 tempest-GroupsTest-1414684175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-43bef10a-3242-4b28-ac0e-9e4a311c11d2 1073741824" returned: 0 in 0.414s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:35:06 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-0c05498c-afc5-4211-b8bb-13f85ef6a2e8 tempest-GroupsTest-1414684175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-43bef10a-3242-4b28-ac0e-9e4a311c11d2 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:35:06 devstack sudo[92119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-43bef10a-3242-4b28-ac0e-9e4a311c11d2 Sep 06 06:35:06 devstack sudo[92119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:35:06 devstack sudo[92119]: pam_unix(sudo:session): session closed for user root Sep 06 06:35:06 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-0c05498c-afc5-4211-b8bb-13f85ef6a2e8 tempest-GroupsTest-1414684175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-43bef10a-3242-4b28-ac0e-9e4a311c11d2" returned: 0 in 0.258s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:35:06 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-0c05498c-afc5-4211-b8bb-13f85ef6a2e8 tempest-GroupsTest-1414684175 None] <== create_volume: return (724ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'} {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 06:35:06 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-0c05498c-afc5-4211-b8bb-13f85ef6a2e8 tempest-GroupsTest-1414684175 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.727s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:35:06 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [req-893f173a-648a-4073-88c7-4726504a4f74 req-3a931660-ffb7-40e2-a7b8-97e245d8bba5 tempest-ServerActionsTestOtherA-968672787 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 19.864s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:35:06 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [req-893f173a-648a-4073-88c7-4726504a4f74 req-3a931660-ffb7-40e2-a7b8-97e245d8bba5 tempest-ServerActionsTestOtherA-968672787 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:35:06 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-5341f8ab-4ed6-4bc7-874d-59cf5eb74648 tempest-AttachVolumeNegativeTest-1315254098 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.745s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:35:06 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-5341f8ab-4ed6-4bc7-874d-59cf5eb74648 tempest-AttachVolumeNegativeTest-1315254098 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:35:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1733737288',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ab65776-1fe0-4481-af7b-5f27787e50e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ca696acace14cfdab93b2b90cc77cee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:35:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:35:02Z,use_quota=True,user_id='3df09a7695104f7595ec6e6d40af53be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)}" {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 06:35:06 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-5341f8ab-4ed6-4bc7-874d-59cf5eb74648 tempest-AttachVolumeNegativeTest-1315254098 None] Creating volume 2ab65776-1fe0-4481-af7b-5f27787e50e8 {{(pid=87329) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 06:35:06 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-5341f8ab-4ed6-4bc7-874d-59cf5eb74648 tempest-AttachVolumeNegativeTest-1315254098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:35:06 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-5341f8ab-4ed6-4bc7-874d-59cf5eb74648 tempest-AttachVolumeNegativeTest-1315254098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:35:06 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-5341f8ab-4ed6-4bc7-874d-59cf5eb74648 tempest-AttachVolumeNegativeTest-1315254098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:35:06 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-5341f8ab-4ed6-4bc7-874d-59cf5eb74648 tempest-AttachVolumeNegativeTest-1315254098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:35:06 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-5341f8ab-4ed6-4bc7-874d-59cf5eb74648 tempest-AttachVolumeNegativeTest-1315254098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:35:06 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-5341f8ab-4ed6-4bc7-874d-59cf5eb74648 tempest-AttachVolumeNegativeTest-1315254098 None] Selected osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 as target Quobyte volume. {{(pid=87329) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 06:35:06 devstack cinder-volume[87329]: INFO cinder.volume.drivers.remotefs [None req-5341f8ab-4ed6-4bc7-874d-59cf5eb74648 tempest-AttachVolumeNegativeTest-1315254098 None] casted to osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 Sep 06 06:35:06 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-5341f8ab-4ed6-4bc7-874d-59cf5eb74648 tempest-AttachVolumeNegativeTest-1315254098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-2ab65776-1fe0-4481-af7b-5f27787e50e8 1073741824 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:35:06 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-0c05498c-afc5-4211-b8bb-13f85ef6a2e8 tempest-GroupsTest-1414684175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad65718b-9437-497e-94e2-eb5d3d5804e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43bef10a-3242-4b28-ac0e-9e4a311c11d2', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:35:06 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-0c05498c-afc5-4211-b8bb-13f85ef6a2e8 tempest-GroupsTest-1414684175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0a1472c-f0a7-4f10-93ca-f38a20879aa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:35:06 devstack sudo[92122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-2ab65776-1fe0-4481-af7b-5f27787e50e8 1073741824 Sep 06 06:35:06 devstack sudo[92122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:35:06 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-0c05498c-afc5-4211-b8bb-13f85ef6a2e8 tempest-GroupsTest-1414684175 None] Volume volume-43bef10a-3242-4b28-ac0e-9e4a311c11d2 (43bef10a-3242-4b28-ac0e-9e4a311c11d2): created successfully Sep 06 06:35:06 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-0c05498c-afc5-4211-b8bb-13f85ef6a2e8 tempest-GroupsTest-1414684175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0a1472c-f0a7-4f10-93ca-f38a20879aa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:35:06 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-0c05498c-afc5-4211-b8bb-13f85ef6a2e8 tempest-GroupsTest-1414684175 None] Flow 'volume_create_manager' (466aa101-67f6-4306-8032-d8a887a25a7f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:35:06 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [req-893f173a-648a-4073-88c7-4726504a4f74 req-3a931660-ffb7-40e2-a7b8-97e245d8bba5 tempest-ServerActionsTestOtherA-968672787 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6', 'name': 'volume-052783c6-7634-4422-9227-0f9e115dea08', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ffaa0c2f-b5db-4f84-83f4-642948b5fd77', 'enforce_multipath': True} {{(pid=87329) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 06 06:35:06 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-0c05498c-afc5-4211-b8bb-13f85ef6a2e8 tempest-GroupsTest-1414684175 None] Created volume successfully. Sep 06 06:35:06 devstack cinder-volume[87329]: INFO cinder.volume.manager [req-893f173a-648a-4073-88c7-4726504a4f74 req-3a931660-ffb7-40e2-a7b8-97e245d8bba5 tempest-ServerActionsTestOtherA-968672787 None] attachment_update completed successfully. Sep 06 06:35:07 devstack sudo[92122]: pam_unix(sudo:session): session closed for user root Sep 06 06:35:07 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-5341f8ab-4ed6-4bc7-874d-59cf5eb74648 tempest-AttachVolumeNegativeTest-1315254098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-2ab65776-1fe0-4481-af7b-5f27787e50e8 1073741824" returned: 0 in 0.528s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:35:07 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-5341f8ab-4ed6-4bc7-874d-59cf5eb74648 tempest-AttachVolumeNegativeTest-1315254098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-2ab65776-1fe0-4481-af7b-5f27787e50e8 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:35:07 devstack sudo[92510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-2ab65776-1fe0-4481-af7b-5f27787e50e8 Sep 06 06:35:07 devstack sudo[92510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:35:07 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-2a763558-245f-47e1-be05-663e2734adb3 tempest-VolumesActionsTest-852331485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:35:07 devstack sudo[92510]: pam_unix(sudo:session): session closed for user root Sep 06 06:35:07 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-5341f8ab-4ed6-4bc7-874d-59cf5eb74648 tempest-AttachVolumeNegativeTest-1315254098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-2ab65776-1fe0-4481-af7b-5f27787e50e8" returned: 0 in 0.307s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:35:07 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-5341f8ab-4ed6-4bc7-874d-59cf5eb74648 tempest-AttachVolumeNegativeTest-1315254098 None] <== create_volume: return (878ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'} {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 06:35:07 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-5341f8ab-4ed6-4bc7-874d-59cf5eb74648 tempest-AttachVolumeNegativeTest-1315254098 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.882s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:35:07 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-2a763558-245f-47e1-be05-663e2734adb3 tempest-VolumesActionsTest-852331485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.035s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:35:07 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-5341f8ab-4ed6-4bc7-874d-59cf5eb74648 tempest-AttachVolumeNegativeTest-1315254098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a890529-d470-4c23-a0a9-d6251e3f2caf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ab65776-1fe0-4481-af7b-5f27787e50e8', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:35:07 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-5341f8ab-4ed6-4bc7-874d-59cf5eb74648 tempest-AttachVolumeNegativeTest-1315254098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c8067c9-1f7d-46be-b770-eb9701033a70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:35:07 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[b33d2464-b807-4e42-87ca-63f423b469dd]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:35:07 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-2a763558-245f-47e1-be05-663e2734adb3 tempest-VolumesActionsTest-852331485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-3cd2ddce-dd8e-40eb-b54e-df7057ba58f2 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:35:07 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-5341f8ab-4ed6-4bc7-874d-59cf5eb74648 tempest-AttachVolumeNegativeTest-1315254098 None] Volume volume-2ab65776-1fe0-4481-af7b-5f27787e50e8 (2ab65776-1fe0-4481-af7b-5f27787e50e8): created successfully Sep 06 06:35:07 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-5341f8ab-4ed6-4bc7-874d-59cf5eb74648 tempest-AttachVolumeNegativeTest-1315254098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c8067c9-1f7d-46be-b770-eb9701033a70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:35:07 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-5341f8ab-4ed6-4bc7-874d-59cf5eb74648 tempest-AttachVolumeNegativeTest-1315254098 None] Flow 'volume_create_manager' (e5108558-60e3-4cc9-b3a1-e4a4ba731796) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:35:07 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-5341f8ab-4ed6-4bc7-874d-59cf5eb74648 tempest-AttachVolumeNegativeTest-1315254098 None] Created volume successfully. Sep 06 06:35:07 devstack sudo[92514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-3cd2ddce-dd8e-40eb-b54e-df7057ba58f2 Sep 06 06:35:07 devstack sudo[92514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:35:08 devstack sudo[92514]: pam_unix(sudo:session): session closed for user root Sep 06 06:35:08 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-2a763558-245f-47e1-be05-663e2734adb3 tempest-VolumesActionsTest-852331485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-3cd2ddce-dd8e-40eb-b54e-df7057ba58f2" returned: 0 in 0.398s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:35:08 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[21990c9c-1972-4f53-9b92-a6f76136e882]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:35:08 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-2a763558-245f-47e1-be05-663e2734adb3 tempest-VolumesActionsTest-852331485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-3cd2ddce-dd8e-40eb-b54e-df7057ba58f2 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:35:08 devstack sudo[92519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-3cd2ddce-dd8e-40eb-b54e-df7057ba58f2 Sep 06 06:35:08 devstack sudo[92519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:35:08 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb894d70-4d48-48a7-b0b0-aed827ecbc75 tempest-GroupsTest-1414684175 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87329) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 06:35:08 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-bb894d70-4d48-48a7-b0b0-aed827ecbc75 tempest-GroupsTest-1414684175 None] Flow 'volume_create_manager' (226763b8-6bab-4ba6-b69d-6657eea16228) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:35:08 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-bb894d70-4d48-48a7-b0b0-aed827ecbc75 tempest-GroupsTest-1414684175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d97c4838-f781-44ed-90e4-b8cd909e6bcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:35:08 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-bb894d70-4d48-48a7-b0b0-aed827ecbc75 tempest-GroupsTest-1414684175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d97c4838-f781-44ed-90e4-b8cd909e6bcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:35:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-418059646',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=315ca10a-d29b-40a5-8619-e4f320a0d964,host='devstack@QuobyteHD#QuobyteHD',id=d4574792-f9ab-487b-a2d9-90b6f4bc7699,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53c9aac30d084d2283933bf9d0b3307e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:35:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:35:08Z,use_quota=True,user_id='aaa127bd30434e55a6ef1bc992fb6fe0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14cac40-eb14-4dbc-87e1-2e6792167ac4),volume_type_id=b14cac40-eb14-4dbc-87e1-2e6792167ac4)' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:35:08 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-bb894d70-4d48-48a7-b0b0-aed827ecbc75 tempest-GroupsTest-1414684175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b110a85-bf08-4eba-ab3f-5499df1970d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:35:08 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-bb894d70-4d48-48a7-b0b0-aed827ecbc75 tempest-GroupsTest-1414684175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b110a85-bf08-4eba-ab3f-5499df1970d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:35:08 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-bb894d70-4d48-48a7-b0b0-aed827ecbc75 tempest-GroupsTest-1414684175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ace990e4-422c-409f-bea3-3564735288c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:35:08 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-bb894d70-4d48-48a7-b0b0-aed827ecbc75 tempest-GroupsTest-1414684175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ace990e4-422c-409f-bea3-3564735288c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4574792-f9ab-487b-a2d9-90b6f4bc7699', 'volume_name': 'volume-d4574792-f9ab-487b-a2d9-90b6f4bc7699', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:35:08 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-bb894d70-4d48-48a7-b0b0-aed827ecbc75 tempest-GroupsTest-1414684175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60bc46c9-f3f4-4091-ae05-a9000196bd7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:35:08 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-bb894d70-4d48-48a7-b0b0-aed827ecbc75 tempest-GroupsTest-1414684175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60bc46c9-f3f4-4091-ae05-a9000196bd7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:35:08 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-bb894d70-4d48-48a7-b0b0-aed827ecbc75 tempest-GroupsTest-1414684175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07a9a877-faac-4c2a-a5b8-e9e581975d52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:35:08 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-bb894d70-4d48-48a7-b0b0-aed827ecbc75 tempest-GroupsTest-1414684175 None] Volume d4574792-f9ab-487b-a2d9-90b6f4bc7699: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4574792-f9ab-487b-a2d9-90b6f4bc7699', 'volume_size': 1} Sep 06 06:35:08 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-bb894d70-4d48-48a7-b0b0-aed827ecbc75 tempest-GroupsTest-1414684175 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:35:08 devstack sudo[92519]: pam_unix(sudo:session): session closed for user root Sep 06 06:35:08 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-2a763558-245f-47e1-be05-663e2734adb3 tempest-VolumesActionsTest-852331485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-3cd2ddce-dd8e-40eb-b54e-df7057ba58f2" returned: 0 in 0.432s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:35:08 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-2a763558-245f-47e1-be05-663e2734adb3 tempest-VolumesActionsTest-852331485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-3cd2ddce-dd8e-40eb-b54e-df7057ba58f2 /opt/stack/data/cinder/conversion/3cd2ddce-dd8e-40eb-b54e-df7057ba58f2.temp_image.065bee83-ede4-44a1-b9a9-8a0326c028d1uvlqs5dw.img {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:35:08 devstack sudo[92529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-3cd2ddce-dd8e-40eb-b54e-df7057ba58f2 /opt/stack/data/cinder/conversion/3cd2ddce-dd8e-40eb-b54e-df7057ba58f2.temp_image.065bee83-ede4-44a1-b9a9-8a0326c028d1uvlqs5dw.img Sep 06 06:35:08 devstack sudo[92529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:35:08 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [req-72a7a8b9-bc64-49e4-ba50-5f6d6c94113f req-ae004567-efbe-4418-a8f7-8311cc84a7fc tempest-AttachVolumeNegativeTest-1315254098 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:35:12 devstack cinder-volume[87329]: INFO cinder.volume.manager [req-44e200c0-de9e-491a-8eef-89e5f62b185f req-24383096-ae37-4d82-bdbb-6eeefb89555d tempest-ServerActionsTestOtherA-968672787 None] Terminate volume connection completed successfully. Sep 06 06:35:12 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [req-44e200c0-de9e-491a-8eef-89e5f62b185f req-24383096-ae37-4d82-bdbb-6eeefb89555d tempest-ServerActionsTestOtherA-968672787 None] Deleting attachment ffaa0c2f-b5db-4f84-83f4-642948b5fd77. {{(pid=87329) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 06 06:35:13 devstack sudo[92529]: pam_unix(sudo:session): session closed for user root Sep 06 06:35:13 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-2a763558-245f-47e1-be05-663e2734adb3 tempest-VolumesActionsTest-852331485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-3cd2ddce-dd8e-40eb-b54e-df7057ba58f2 /opt/stack/data/cinder/conversion/3cd2ddce-dd8e-40eb-b54e-df7057ba58f2.temp_image.065bee83-ede4-44a1-b9a9-8a0326c028d1uvlqs5dw.img" returned: 0 in 4.897s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:35:13 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea108072-e3c1-400e-87d7-04f9f5f55a10]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:35:13 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-2a763558-245f-47e1-be05-663e2734adb3 tempest-VolumesActionsTest-852331485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-3cd2ddce-dd8e-40eb-b54e-df7057ba58f2 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:35:13 devstack sudo[92606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-3cd2ddce-dd8e-40eb-b54e-df7057ba58f2 Sep 06 06:35:13 devstack sudo[92606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:35:13 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [req-44e200c0-de9e-491a-8eef-89e5f62b185f req-12c0bef5-ce4e-434d-83ab-e2f0cc933d4f tempest-ServerActionsTestOtherA-968672787 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:35:14 devstack sudo[92606]: pam_unix(sudo:session): session closed for user root Sep 06 06:35:14 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-2a763558-245f-47e1-be05-663e2734adb3 tempest-VolumesActionsTest-852331485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-3cd2ddce-dd8e-40eb-b54e-df7057ba58f2" returned: 0 in 0.639s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:35:14 devstack cinder-volume[87329]: DEBUG cinder.image.image_utils [None req-2a763558-245f-47e1-be05-663e2734adb3 tempest-VolumesActionsTest-852331485 None] Image conversion details: src /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-3cd2ddce-dd8e-40eb-b54e-df7057ba58f2, size 1024.00 MB, duration 4.90 sec, destination /opt/stack/data/cinder/conversion/3cd2ddce-dd8e-40eb-b54e-df7057ba58f2.temp_image.065bee83-ede4-44a1-b9a9-8a0326c028d1uvlqs5dw.img {{(pid=87329) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 06 06:35:14 devstack cinder-volume[87329]: INFO cinder.image.image_utils [None req-2a763558-245f-47e1-be05-663e2734adb3 tempest-VolumesActionsTest-852331485 None] Converted 1024.00 MB image at 209.06 MB/s Sep 06 06:35:14 devstack cinder-volume[87329]: DEBUG cinder.image.image_utils [None req-2a763558-245f-47e1-be05-663e2734adb3 tempest-VolumesActionsTest-852331485 None] 065bee83-ede4-44a1-b9a9-8a0326c028d1 was raw, converting to qcow2 {{(pid=87329) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Sep 06 06:35:14 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[5af221cb-2378-4b29-a60c-2fe59b9818f1]: (4, 'raw') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:35:14 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-2a763558-245f-47e1-be05-663e2734adb3 tempest-VolumesActionsTest-852331485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/3cd2ddce-dd8e-40eb-b54e-df7057ba58f2.temp_image.065bee83-ede4-44a1-b9a9-8a0326c028d1uvlqs5dw.img {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:35:14 devstack sudo[92623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/3cd2ddce-dd8e-40eb-b54e-df7057ba58f2.temp_image.065bee83-ede4-44a1-b9a9-8a0326c028d1uvlqs5dw.img Sep 06 06:35:14 devstack sudo[92623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:35:14 devstack sudo[92623]: pam_unix(sudo:session): session closed for user root Sep 06 06:35:14 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-2a763558-245f-47e1-be05-663e2734adb3 tempest-VolumesActionsTest-852331485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/3cd2ddce-dd8e-40eb-b54e-df7057ba58f2.temp_image.065bee83-ede4-44a1-b9a9-8a0326c028d1uvlqs5dw.img" returned: 0 in 0.313s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:35:14 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-2a763558-245f-47e1-be05-663e2734adb3 tempest-VolumesActionsTest-852331485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/3cd2ddce-dd8e-40eb-b54e-df7057ba58f2.temp_image.065bee83-ede4-44a1-b9a9-8a0326c028d1uvlqs5dw.img {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:35:14 devstack sudo[92627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/3cd2ddce-dd8e-40eb-b54e-df7057ba58f2.temp_image.065bee83-ede4-44a1-b9a9-8a0326c028d1uvlqs5dw.img Sep 06 06:35:14 devstack sudo[92627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:35:14 devstack sudo[92627]: pam_unix(sudo:session): session closed for user root Sep 06 06:35:14 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-2a763558-245f-47e1-be05-663e2734adb3 tempest-VolumesActionsTest-852331485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/3cd2ddce-dd8e-40eb-b54e-df7057ba58f2.temp_image.065bee83-ede4-44a1-b9a9-8a0326c028d1uvlqs5dw.img" returned: 1 in 0.316s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:35:14 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-2a763558-245f-47e1-be05-663e2734adb3 tempest-VolumesActionsTest-852331485 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/3cd2ddce-dd8e-40eb-b54e-df7057ba58f2.temp_image.065bee83-ede4-44a1-b9a9-8a0326c028d1uvlqs5dw.img' failed. Not Retrying. {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 06 06:35:14 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-2a763558-245f-47e1-be05-663e2734adb3 tempest-VolumesActionsTest-852331485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/3cd2ddce-dd8e-40eb-b54e-df7057ba58f2.temp_image.065bee83-ede4-44a1-b9a9-8a0326c028d1uvlqs5dw.img /opt/stack/data/cinder/conversion/vol_upload_ezmwaonx {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:35:14 devstack sudo[92632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/3cd2ddce-dd8e-40eb-b54e-df7057ba58f2.temp_image.065bee83-ede4-44a1-b9a9-8a0326c028d1uvlqs5dw.img /opt/stack/data/cinder/conversion/vol_upload_ezmwaonx Sep 06 06:35:14 devstack sudo[92632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:35:14 devstack sudo[92632]: pam_unix(sudo:session): session closed for user root Sep 06 06:35:14 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-2a763558-245f-47e1-be05-663e2734adb3 tempest-VolumesActionsTest-852331485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/3cd2ddce-dd8e-40eb-b54e-df7057ba58f2.temp_image.065bee83-ede4-44a1-b9a9-8a0326c028d1uvlqs5dw.img /opt/stack/data/cinder/conversion/vol_upload_ezmwaonx" returned: 0 in 0.250s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:35:14 devstack cinder-volume[87329]: DEBUG cinder.image.image_utils [None req-2a763558-245f-47e1-be05-663e2734adb3 tempest-VolumesActionsTest-852331485 None] Image conversion details: src /opt/stack/data/cinder/conversion/3cd2ddce-dd8e-40eb-b54e-df7057ba58f2.temp_image.065bee83-ede4-44a1-b9a9-8a0326c028d1uvlqs5dw.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_ezmwaonx {{(pid=87329) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 06 06:35:14 devstack cinder-volume[87329]: INFO cinder.image.image_utils [None req-2a763558-245f-47e1-be05-663e2734adb3 tempest-VolumesActionsTest-852331485 None] Converted 1024.00 MB image at 1024.00 MB/s Sep 06 06:35:14 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[010fa614-cb60-4013-ad1e-9556062154dc]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:35:14 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-2a763558-245f-47e1-be05-663e2734adb3 tempest-VolumesActionsTest-852331485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_ezmwaonx {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:35:15 devstack sudo[92638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_ezmwaonx Sep 06 06:35:15 devstack sudo[92638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:35:15 devstack sudo[92638]: pam_unix(sudo:session): session closed for user root Sep 06 06:35:15 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-2a763558-245f-47e1-be05-663e2734adb3 tempest-VolumesActionsTest-852331485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_ezmwaonx" returned: 0 in 0.324s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:35:16 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-2a763558-245f-47e1-be05-663e2734adb3 tempest-VolumesActionsTest-852331485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 8.931s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:35:16 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-2a763558-245f-47e1-be05-663e2734adb3 tempest-VolumesActionsTest-852331485 None] Uploaded volume to glance image-id: 065bee83-ede4-44a1-b9a9-8a0326c028d1. {{(pid=87329) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 06 06:35:16 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-bb894d70-4d48-48a7-b0b0-aed827ecbc75 tempest-GroupsTest-1414684175 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.204s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:35:16 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-bb894d70-4d48-48a7-b0b0-aed827ecbc75 tempest-GroupsTest-1414684175 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=315ca10a-d29b-40a5-8619-e4f320a0d964,created_at=2026-09-06T04:35:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-418059646',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=315ca10a-d29b-40a5-8619-e4f320a0d964,host='devstack@QuobyteHD#QuobyteHD',id=d4574792-f9ab-487b-a2d9-90b6f4bc7699,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53c9aac30d084d2283933bf9d0b3307e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:35:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:35:08Z,use_quota=True,user_id='aaa127bd30434e55a6ef1bc992fb6fe0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b14cac40-eb14-4dbc-87e1-2e6792167ac4),volume_type_id=b14cac40-eb14-4dbc-87e1-2e6792167ac4)}" {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 06:35:16 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-bb894d70-4d48-48a7-b0b0-aed827ecbc75 tempest-GroupsTest-1414684175 None] Creating volume d4574792-f9ab-487b-a2d9-90b6f4bc7699 {{(pid=87329) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 06:35:16 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-bb894d70-4d48-48a7-b0b0-aed827ecbc75 tempest-GroupsTest-1414684175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:35:16 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-bb894d70-4d48-48a7-b0b0-aed827ecbc75 tempest-GroupsTest-1414684175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:35:16 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-bb894d70-4d48-48a7-b0b0-aed827ecbc75 tempest-GroupsTest-1414684175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:35:16 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-bb894d70-4d48-48a7-b0b0-aed827ecbc75 tempest-GroupsTest-1414684175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:35:16 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-bb894d70-4d48-48a7-b0b0-aed827ecbc75 tempest-GroupsTest-1414684175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:35:16 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-bb894d70-4d48-48a7-b0b0-aed827ecbc75 tempest-GroupsTest-1414684175 None] Selected osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 as target Quobyte volume. {{(pid=87329) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 06:35:16 devstack cinder-volume[87329]: INFO cinder.volume.drivers.remotefs [None req-bb894d70-4d48-48a7-b0b0-aed827ecbc75 tempest-GroupsTest-1414684175 None] casted to osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 Sep 06 06:35:16 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-bb894d70-4d48-48a7-b0b0-aed827ecbc75 tempest-GroupsTest-1414684175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-d4574792-f9ab-487b-a2d9-90b6f4bc7699 1073741824 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:35:16 devstack sudo[92644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-d4574792-f9ab-487b-a2d9-90b6f4bc7699 1073741824 Sep 06 06:35:16 devstack sudo[92644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:35:16 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-2a763558-245f-47e1-be05-663e2734adb3 tempest-VolumesActionsTest-852331485 None] Copy volume to image completed successfully. Sep 06 06:35:16 devstack sudo[92644]: pam_unix(sudo:session): session closed for user root Sep 06 06:35:16 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-bb894d70-4d48-48a7-b0b0-aed827ecbc75 tempest-GroupsTest-1414684175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-d4574792-f9ab-487b-a2d9-90b6f4bc7699 1073741824" returned: 0 in 0.392s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:35:16 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-bb894d70-4d48-48a7-b0b0-aed827ecbc75 tempest-GroupsTest-1414684175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-d4574792-f9ab-487b-a2d9-90b6f4bc7699 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:35:16 devstack sudo[92649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-d4574792-f9ab-487b-a2d9-90b6f4bc7699 Sep 06 06:35:16 devstack sudo[92649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:35:17 devstack sudo[92649]: pam_unix(sudo:session): session closed for user root Sep 06 06:35:17 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-bb894d70-4d48-48a7-b0b0-aed827ecbc75 tempest-GroupsTest-1414684175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-d4574792-f9ab-487b-a2d9-90b6f4bc7699" returned: 0 in 0.233s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:35:17 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-bb894d70-4d48-48a7-b0b0-aed827ecbc75 tempest-GroupsTest-1414684175 None] <== create_volume: return (662ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'} {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 06:35:17 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-bb894d70-4d48-48a7-b0b0-aed827ecbc75 tempest-GroupsTest-1414684175 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.665s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:35:17 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [req-72a7a8b9-bc64-49e4-ba50-5f6d6c94113f req-ae004567-efbe-4418-a8f7-8311cc84a7fc tempest-AttachVolumeNegativeTest-1315254098 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 8.249s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:35:17 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-bb894d70-4d48-48a7-b0b0-aed827ecbc75 tempest-GroupsTest-1414684175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07a9a877-faac-4c2a-a5b8-e9e581975d52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4574792-f9ab-487b-a2d9-90b6f4bc7699', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:35:17 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-bb894d70-4d48-48a7-b0b0-aed827ecbc75 tempest-GroupsTest-1414684175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93265ca6-05a2-4e42-a043-4b122fe36314) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:35:17 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [req-72a7a8b9-bc64-49e4-ba50-5f6d6c94113f req-ae004567-efbe-4418-a8f7-8311cc84a7fc tempest-AttachVolumeNegativeTest-1315254098 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:35:17 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [req-44e200c0-de9e-491a-8eef-89e5f62b185f req-12c0bef5-ce4e-434d-83ab-e2f0cc933d4f tempest-ServerActionsTestOtherA-968672787 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 3.342s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:35:17 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-bb894d70-4d48-48a7-b0b0-aed827ecbc75 tempest-GroupsTest-1414684175 None] Volume volume-d4574792-f9ab-487b-a2d9-90b6f4bc7699 (d4574792-f9ab-487b-a2d9-90b6f4bc7699): created successfully Sep 06 06:35:17 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-bb894d70-4d48-48a7-b0b0-aed827ecbc75 tempest-GroupsTest-1414684175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93265ca6-05a2-4e42-a043-4b122fe36314) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:35:17 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-bb894d70-4d48-48a7-b0b0-aed827ecbc75 tempest-GroupsTest-1414684175 None] Flow 'volume_create_manager' (226763b8-6bab-4ba6-b69d-6657eea16228) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:35:17 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [req-44e200c0-de9e-491a-8eef-89e5f62b185f req-12c0bef5-ce4e-434d-83ab-e2f0cc933d4f tempest-ServerActionsTestOtherA-968672787 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.028s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:35:17 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-bb894d70-4d48-48a7-b0b0-aed827ecbc75 tempest-GroupsTest-1414684175 None] Created volume successfully. Sep 06 06:35:17 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [req-72a7a8b9-bc64-49e4-ba50-5f6d6c94113f req-ae004567-efbe-4418-a8f7-8311cc84a7fc tempest-AttachVolumeNegativeTest-1315254098 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6', 'name': 'volume-2ab65776-1fe0-4481-af7b-5f27787e50e8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ec141f37-3b06-4f18-bc8f-0e13955d9487', 'enforce_multipath': True} {{(pid=87329) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 06 06:35:17 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [req-44e200c0-de9e-491a-8eef-89e5f62b185f req-12c0bef5-ce4e-434d-83ab-e2f0cc933d4f tempest-ServerActionsTestOtherA-968672787 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6', 'name': 'volume-052783c6-7634-4422-9227-0f9e115dea08', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f4269ad7-f419-4b5b-afbc-be4992020a74', 'enforce_multipath': True} {{(pid=87329) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 06 06:35:17 devstack cinder-volume[87329]: INFO cinder.volume.manager [req-72a7a8b9-bc64-49e4-ba50-5f6d6c94113f req-ae004567-efbe-4418-a8f7-8311cc84a7fc tempest-AttachVolumeNegativeTest-1315254098 None] attachment_update completed successfully. Sep 06 06:35:17 devstack cinder-volume[87329]: INFO cinder.volume.manager [req-44e200c0-de9e-491a-8eef-89e5f62b185f req-12c0bef5-ce4e-434d-83ab-e2f0cc933d4f tempest-ServerActionsTestOtherA-968672787 None] attachment_update completed successfully. Sep 06 06:35:17 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-bef9bc8d-552f-4b41-9a61-488e6f768ba0 tempest-GroupsTest-1414684175 None] Update group completed successfully. Sep 06 06:35:18 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-df2a3eb4-7516-4477-b797-acd63d4a0f8a tempest-VolumesActionsTest-852331485 None] Acquiring lock "cinder-3cd2ddce-dd8e-40eb-b54e-df7057ba58f2-delete_volume" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:35:18 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-df2a3eb4-7516-4477-b797-acd63d4a0f8a tempest-VolumesActionsTest-852331485 None] Lock "cinder-3cd2ddce-dd8e-40eb-b54e-df7057ba58f2-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:35:18 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-df2a3eb4-7516-4477-b797-acd63d4a0f8a tempest-VolumesActionsTest-852331485 None] Acquiring lock "cinder-quobyte-3cd2ddce-dd8e-40eb-b54e-df7057ba58f2" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:35:18 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-df2a3eb4-7516-4477-b797-acd63d4a0f8a tempest-VolumesActionsTest-852331485 None] Lock "cinder-quobyte-3cd2ddce-dd8e-40eb-b54e-df7057ba58f2" acquired by "delete_volume" :: waited 0.017s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:35:18 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3c0ef2f-46de-421e-81ef-6c668cb3469f]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:35:18 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-df2a3eb4-7516-4477-b797-acd63d4a0f8a tempest-VolumesActionsTest-852331485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-3cd2ddce-dd8e-40eb-b54e-df7057ba58f2 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:35:18 devstack sudo[93047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-3cd2ddce-dd8e-40eb-b54e-df7057ba58f2 Sep 06 06:35:18 devstack sudo[93047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:35:18 devstack sudo[93047]: pam_unix(sudo:session): session closed for user root Sep 06 06:35:18 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-df2a3eb4-7516-4477-b797-acd63d4a0f8a tempest-VolumesActionsTest-852331485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-3cd2ddce-dd8e-40eb-b54e-df7057ba58f2" returned: 0 in 0.538s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:35:18 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-df2a3eb4-7516-4477-b797-acd63d4a0f8a tempest-VolumesActionsTest-852331485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-3cd2ddce-dd8e-40eb-b54e-df7057ba58f2 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:35:19 devstack sudo[93072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-3cd2ddce-dd8e-40eb-b54e-df7057ba58f2 Sep 06 06:35:19 devstack sudo[93072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:35:19 devstack sudo[93072]: pam_unix(sudo:session): session closed for user root Sep 06 06:35:19 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-df2a3eb4-7516-4477-b797-acd63d4a0f8a tempest-VolumesActionsTest-852331485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-3cd2ddce-dd8e-40eb-b54e-df7057ba58f2" returned: 0 in 0.619s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:35:19 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-6a1e0c5b-3f32-48cc-abf5-38b809c95d69 tempest-GroupsTest-1414684175 None] Update group completed successfully. Sep 06 06:35:19 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-df2a3eb4-7516-4477-b797-acd63d4a0f8a tempest-VolumesActionsTest-852331485 None] Lock "cinder-quobyte-3cd2ddce-dd8e-40eb-b54e-df7057ba58f2" released by "delete_volume" :: held 1.223s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:35:19 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-df2a3eb4-7516-4477-b797-acd63d4a0f8a tempest-VolumesActionsTest-852331485 None] Created reservations ['6375327f-e8f8-4131-89ff-4e81cb4b0aed', '51688658-5526-4fe1-84b0-d419a5ac20e1', 'e79cc569-4b16-4315-8467-6616f8186218', '8c2debba-a995-4396-86b1-cd68b393f437'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:35:19 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-df2a3eb4-7516-4477-b797-acd63d4a0f8a tempest-VolumesActionsTest-852331485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:35:19 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-df2a3eb4-7516-4477-b797-acd63d4a0f8a tempest-VolumesActionsTest-852331485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:35:19 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-df2a3eb4-7516-4477-b797-acd63d4a0f8a tempest-VolumesActionsTest-852331485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:35:19 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-df2a3eb4-7516-4477-b797-acd63d4a0f8a tempest-VolumesActionsTest-852331485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:35:19 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-df2a3eb4-7516-4477-b797-acd63d4a0f8a tempest-VolumesActionsTest-852331485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:35:19 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-df2a3eb4-7516-4477-b797-acd63d4a0f8a tempest-VolumesActionsTest-852331485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:35:19 devstack sudo[93101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:35:19 devstack sudo[93101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:35:20 devstack cinder-volume[87329]: INFO cinder.volume.manager [req-8e5d728a-55a7-412c-bfc7-010741b6e784 req-d9277b78-c301-4672-a6b8-a8c9b17c75a2 tempest-AttachVolumeNegativeTest-1315254098 None] Terminate volume connection completed successfully. Sep 06 06:35:20 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [req-8e5d728a-55a7-412c-bfc7-010741b6e784 req-d9277b78-c301-4672-a6b8-a8c9b17c75a2 tempest-AttachVolumeNegativeTest-1315254098 None] Deleting attachment ec141f37-3b06-4f18-bc8f-0e13955d9487. {{(pid=87329) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 06 06:35:20 devstack sudo[93101]: pam_unix(sudo:session): session closed for user root Sep 06 06:35:20 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-df2a3eb4-7516-4477-b797-acd63d4a0f8a tempest-VolumesActionsTest-852331485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.309s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:35:20 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-df2a3eb4-7516-4477-b797-acd63d4a0f8a tempest-VolumesActionsTest-852331485 None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:35:20 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-df2a3eb4-7516-4477-b797-acd63d4a0f8a tempest-VolumesActionsTest-852331485 None] Deleted volume successfully. Sep 06 06:35:20 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-df2a3eb4-7516-4477-b797-acd63d4a0f8a tempest-VolumesActionsTest-852331485 None] Lock "cinder-3cd2ddce-dd8e-40eb-b54e-df7057ba58f2-delete_volume" released by "delete_volume" :: held 1.797s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:35:21 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-ff5672db-ec41-4fa0-bf7d-afff873113d7 tempest-GroupsTest-1414684175 None] Acquiring lock "cinder-quobyte-43bef10a-3242-4b28-ac0e-9e4a311c11d2" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:35:21 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-ff5672db-ec41-4fa0-bf7d-afff873113d7 tempest-GroupsTest-1414684175 None] Lock "cinder-quobyte-43bef10a-3242-4b28-ac0e-9e4a311c11d2" acquired by "delete_volume" :: waited 0.018s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:35:21 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[28d74710-da98-4496-97ec-9ae818c4643f]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:35:21 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-ff5672db-ec41-4fa0-bf7d-afff873113d7 tempest-GroupsTest-1414684175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-43bef10a-3242-4b28-ac0e-9e4a311c11d2 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:35:21 devstack sudo[93116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-43bef10a-3242-4b28-ac0e-9e4a311c11d2 Sep 06 06:35:21 devstack sudo[93116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:35:22 devstack sudo[93116]: pam_unix(sudo:session): session closed for user root Sep 06 06:35:22 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-ff5672db-ec41-4fa0-bf7d-afff873113d7 tempest-GroupsTest-1414684175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-43bef10a-3242-4b28-ac0e-9e4a311c11d2" returned: 0 in 0.776s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:35:22 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-ff5672db-ec41-4fa0-bf7d-afff873113d7 tempest-GroupsTest-1414684175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-43bef10a-3242-4b28-ac0e-9e4a311c11d2 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:35:22 devstack sudo[93138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-43bef10a-3242-4b28-ac0e-9e4a311c11d2 Sep 06 06:35:22 devstack sudo[93138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:35:22 devstack sudo[93138]: pam_unix(sudo:session): session closed for user root Sep 06 06:35:22 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-ff5672db-ec41-4fa0-bf7d-afff873113d7 tempest-GroupsTest-1414684175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-43bef10a-3242-4b28-ac0e-9e4a311c11d2" returned: 0 in 0.457s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:35:22 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-ff5672db-ec41-4fa0-bf7d-afff873113d7 tempest-GroupsTest-1414684175 None] Lock "cinder-quobyte-43bef10a-3242-4b28-ac0e-9e4a311c11d2" released by "delete_volume" :: held 1.323s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:35:22 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-ff5672db-ec41-4fa0-bf7d-afff873113d7 tempest-GroupsTest-1414684175 None] Acquiring lock "cinder-quobyte-d4574792-f9ab-487b-a2d9-90b6f4bc7699" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:35:22 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-ff5672db-ec41-4fa0-bf7d-afff873113d7 tempest-GroupsTest-1414684175 None] Lock "cinder-quobyte-d4574792-f9ab-487b-a2d9-90b6f4bc7699" acquired by "delete_volume" :: waited 0.021s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:35:22 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2d96996-8ba5-4108-8822-272fdf699c55]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:35:22 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-ff5672db-ec41-4fa0-bf7d-afff873113d7 tempest-GroupsTest-1414684175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-d4574792-f9ab-487b-a2d9-90b6f4bc7699 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:35:23 devstack sudo[93141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-d4574792-f9ab-487b-a2d9-90b6f4bc7699 Sep 06 06:35:23 devstack sudo[93141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:35:23 devstack sudo[93141]: pam_unix(sudo:session): session closed for user root Sep 06 06:35:23 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-ff5672db-ec41-4fa0-bf7d-afff873113d7 tempest-GroupsTest-1414684175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-d4574792-f9ab-487b-a2d9-90b6f4bc7699" returned: 0 in 0.647s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:35:23 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-ff5672db-ec41-4fa0-bf7d-afff873113d7 tempest-GroupsTest-1414684175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-d4574792-f9ab-487b-a2d9-90b6f4bc7699 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:35:23 devstack sudo[93148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-d4574792-f9ab-487b-a2d9-90b6f4bc7699 Sep 06 06:35:23 devstack sudo[93148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:35:24 devstack sudo[93148]: pam_unix(sudo:session): session closed for user root Sep 06 06:35:24 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-ff5672db-ec41-4fa0-bf7d-afff873113d7 tempest-GroupsTest-1414684175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-d4574792-f9ab-487b-a2d9-90b6f4bc7699" returned: 0 in 0.525s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:35:24 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-ff5672db-ec41-4fa0-bf7d-afff873113d7 tempest-GroupsTest-1414684175 None] Lock "cinder-quobyte-d4574792-f9ab-487b-a2d9-90b6f4bc7699" released by "delete_volume" :: held 1.251s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:35:24 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-ff5672db-ec41-4fa0-bf7d-afff873113d7 tempest-GroupsTest-1414684175 None] Created reservations ['bb98df15-ba64-4bad-8752-f2f4a54502a7'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:35:24 devstack cinder-volume[87329]: WARNING cinder.quota [None req-ff5672db-ec41-4fa0-bf7d-afff873113d7 tempest-GroupsTest-1414684175 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-2051956936 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-2051956936, it is now deprecated. Please use the default quota class for default quota. Sep 06 06:35:24 devstack cinder-volume[87329]: WARNING cinder.quota [None req-ff5672db-ec41-4fa0-bf7d-afff873113d7 tempest-GroupsTest-1414684175 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-2051956936 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-2051956936, it is now deprecated. Please use the default quota class for default quota. Sep 06 06:35:24 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-ff5672db-ec41-4fa0-bf7d-afff873113d7 tempest-GroupsTest-1414684175 None] Created reservations ['e59fe777-e35e-4a3b-b531-df184bf8c682', '9ad4dc71-2266-464a-8952-7117a82c9471', '8ac792a6-178c-4376-b4e7-1b8dd918edca', 'ea6ca7ac-eb71-4124-b14b-c934c7d7fdd7'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:35:24 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-ff5672db-ec41-4fa0-bf7d-afff873113d7 tempest-GroupsTest-1414684175 None] Created reservations ['2aebb284-3033-4c74-84a8-e4120e8efc65', '2c581fac-a598-4ac1-802f-01e20dca070e', '9ad39402-47b4-460b-bcc8-7fe14225c040', '9d121fb9-e1e9-49c7-a286-398422cba57d'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:35:24 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-ff5672db-ec41-4fa0-bf7d-afff873113d7 tempest-GroupsTest-1414684175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:35:24 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-ff5672db-ec41-4fa0-bf7d-afff873113d7 tempest-GroupsTest-1414684175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:35:24 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-ff5672db-ec41-4fa0-bf7d-afff873113d7 tempest-GroupsTest-1414684175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:35:24 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-ff5672db-ec41-4fa0-bf7d-afff873113d7 tempest-GroupsTest-1414684175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:35:24 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-ff5672db-ec41-4fa0-bf7d-afff873113d7 tempest-GroupsTest-1414684175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:35:24 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-ff5672db-ec41-4fa0-bf7d-afff873113d7 tempest-GroupsTest-1414684175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:35:24 devstack sudo[93153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:35:24 devstack sudo[93153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:35:24 devstack sudo[93153]: pam_unix(sudo:session): session closed for user root Sep 06 06:35:24 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-ff5672db-ec41-4fa0-bf7d-afff873113d7 tempest-GroupsTest-1414684175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.267s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:35:24 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-ff5672db-ec41-4fa0-bf7d-afff873113d7 tempest-GroupsTest-1414684175 None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:35:24 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-ff5672db-ec41-4fa0-bf7d-afff873113d7 tempest-GroupsTest-1414684175 None] Delete group completed successfully. Sep 06 06:35:32 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e598b07-4a03-4147-8106-188fd4145469 tempest-VolumesNegativeTest-1417748630 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87329) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 06:35:32 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-2e598b07-4a03-4147-8106-188fd4145469 tempest-VolumesNegativeTest-1417748630 None] Flow 'volume_create_manager' (a58413d2-1910-49fc-a9be-a74b9e9aa4e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:35:32 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-2e598b07-4a03-4147-8106-188fd4145469 tempest-VolumesNegativeTest-1417748630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e330de53-6023-496b-82bf-fd4452f28c0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:35:32 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-2e598b07-4a03-4147-8106-188fd4145469 tempest-VolumesNegativeTest-1417748630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e330de53-6023-496b-82bf-fd4452f28c0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:35:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1492847760',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f875b45-01c0-4226-8d15-95ee8beee44d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd2d568b7c46450ebf58bd4d1b9203ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:35:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:35:33Z,use_quota=True,user_id='e2379d3e03c34c0784ba2dac3c8a6043',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:35:32 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-2e598b07-4a03-4147-8106-188fd4145469 tempest-VolumesNegativeTest-1417748630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fdaa867-d38f-42df-8132-a7319b58e60e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:35:32 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-2e598b07-4a03-4147-8106-188fd4145469 tempest-VolumesNegativeTest-1417748630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fdaa867-d38f-42df-8132-a7319b58e60e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:35:32 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-2e598b07-4a03-4147-8106-188fd4145469 tempest-VolumesNegativeTest-1417748630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a7a662a-b249-4d67-94bf-b5f4558d6fe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:35:32 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-2e598b07-4a03-4147-8106-188fd4145469 tempest-VolumesNegativeTest-1417748630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a7a662a-b249-4d67-94bf-b5f4558d6fe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f875b45-01c0-4226-8d15-95ee8beee44d', 'volume_name': 'volume-5f875b45-01c0-4226-8d15-95ee8beee44d', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:35:32 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-2e598b07-4a03-4147-8106-188fd4145469 tempest-VolumesNegativeTest-1417748630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8265297a-ebaf-481f-8c83-faec6efeb38a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:35:32 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-2e598b07-4a03-4147-8106-188fd4145469 tempest-VolumesNegativeTest-1417748630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8265297a-ebaf-481f-8c83-faec6efeb38a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:35:32 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-2e598b07-4a03-4147-8106-188fd4145469 tempest-VolumesNegativeTest-1417748630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2556605-9596-400a-af7e-966f8bf3c232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:35:32 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-2e598b07-4a03-4147-8106-188fd4145469 tempest-VolumesNegativeTest-1417748630 None] Volume 5f875b45-01c0-4226-8d15-95ee8beee44d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f875b45-01c0-4226-8d15-95ee8beee44d', 'volume_size': 1} Sep 06 06:35:32 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-2e598b07-4a03-4147-8106-188fd4145469 tempest-VolumesNegativeTest-1417748630 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:35:32 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-2e598b07-4a03-4147-8106-188fd4145469 tempest-VolumesNegativeTest-1417748630 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:35:32 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-2e598b07-4a03-4147-8106-188fd4145469 tempest-VolumesNegativeTest-1417748630 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:35:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1492847760',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f875b45-01c0-4226-8d15-95ee8beee44d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd2d568b7c46450ebf58bd4d1b9203ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:35:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:35:33Z,use_quota=True,user_id='e2379d3e03c34c0784ba2dac3c8a6043',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)}" {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 06:35:32 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-2e598b07-4a03-4147-8106-188fd4145469 tempest-VolumesNegativeTest-1417748630 None] Creating volume 5f875b45-01c0-4226-8d15-95ee8beee44d {{(pid=87329) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 06:35:32 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-2e598b07-4a03-4147-8106-188fd4145469 tempest-VolumesNegativeTest-1417748630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:35:32 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-2e598b07-4a03-4147-8106-188fd4145469 tempest-VolumesNegativeTest-1417748630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:35:32 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-2e598b07-4a03-4147-8106-188fd4145469 tempest-VolumesNegativeTest-1417748630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:35:32 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-2e598b07-4a03-4147-8106-188fd4145469 tempest-VolumesNegativeTest-1417748630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:35:32 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-2e598b07-4a03-4147-8106-188fd4145469 tempest-VolumesNegativeTest-1417748630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.039s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:35:32 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-2e598b07-4a03-4147-8106-188fd4145469 tempest-VolumesNegativeTest-1417748630 None] Selected osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 as target Quobyte volume. {{(pid=87329) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 06:35:32 devstack cinder-volume[87329]: INFO cinder.volume.drivers.remotefs [None req-2e598b07-4a03-4147-8106-188fd4145469 tempest-VolumesNegativeTest-1417748630 None] casted to osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 Sep 06 06:35:32 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-2e598b07-4a03-4147-8106-188fd4145469 tempest-VolumesNegativeTest-1417748630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-5f875b45-01c0-4226-8d15-95ee8beee44d 1073741824 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:35:32 devstack sudo[93178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-5f875b45-01c0-4226-8d15-95ee8beee44d 1073741824 Sep 06 06:35:32 devstack sudo[93178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:35:33 devstack sudo[93178]: pam_unix(sudo:session): session closed for user root Sep 06 06:35:33 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-2e598b07-4a03-4147-8106-188fd4145469 tempest-VolumesNegativeTest-1417748630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-5f875b45-01c0-4226-8d15-95ee8beee44d 1073741824" returned: 0 in 0.679s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:35:33 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-2e598b07-4a03-4147-8106-188fd4145469 tempest-VolumesNegativeTest-1417748630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-5f875b45-01c0-4226-8d15-95ee8beee44d {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:35:33 devstack sudo[93251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-5f875b45-01c0-4226-8d15-95ee8beee44d Sep 06 06:35:33 devstack sudo[93251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:35:34 devstack sudo[93251]: pam_unix(sudo:session): session closed for user root Sep 06 06:35:34 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-2e598b07-4a03-4147-8106-188fd4145469 tempest-VolumesNegativeTest-1417748630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-5f875b45-01c0-4226-8d15-95ee8beee44d" returned: 0 in 0.504s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:35:34 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-2e598b07-4a03-4147-8106-188fd4145469 tempest-VolumesNegativeTest-1417748630 None] <== create_volume: return (1295ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'} {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 06:35:34 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-2e598b07-4a03-4147-8106-188fd4145469 tempest-VolumesNegativeTest-1417748630 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.298s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:35:34 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-2e598b07-4a03-4147-8106-188fd4145469 tempest-VolumesNegativeTest-1417748630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2556605-9596-400a-af7e-966f8bf3c232) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f875b45-01c0-4226-8d15-95ee8beee44d', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:35:34 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-2e598b07-4a03-4147-8106-188fd4145469 tempest-VolumesNegativeTest-1417748630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbfe86c1-b194-4aa2-8f36-ae5ff2abe5cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:35:34 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-2e598b07-4a03-4147-8106-188fd4145469 tempest-VolumesNegativeTest-1417748630 None] Volume volume-5f875b45-01c0-4226-8d15-95ee8beee44d (5f875b45-01c0-4226-8d15-95ee8beee44d): created successfully Sep 06 06:35:34 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-2e598b07-4a03-4147-8106-188fd4145469 tempest-VolumesNegativeTest-1417748630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbfe86c1-b194-4aa2-8f36-ae5ff2abe5cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:35:34 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-2e598b07-4a03-4147-8106-188fd4145469 tempest-VolumesNegativeTest-1417748630 None] Flow 'volume_create_manager' (a58413d2-1910-49fc-a9be-a74b9e9aa4e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:35:34 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-2e598b07-4a03-4147-8106-188fd4145469 tempest-VolumesNegativeTest-1417748630 None] Created volume successfully. Sep 06 06:35:44 devstack cinder-volume[87329]: DEBUG dbcounter [-] [87329] Writing DB stats cinder:SELECT=54,cinder:UPDATE=41,cinder:INSERT=6,cinder:DELETE=1 {{(pid=87329) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 06:35:44 devstack cinder-volume[87329]: DEBUG dbcounter [-] [87329] Writing DB stats cinder:UPDATE=50,cinder:SELECT=50,cinder:INSERT=11,cinder:DELETE=4 {{(pid=87329) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 06:35:46 devstack cinder-volume[87329]: INFO cinder.volume.manager [req-84099ccd-6a73-4c12-b92a-34199ca0b362 req-776f3448-42a1-4d7d-9a4d-9e5d7e42b71b tempest-ServerActionsTestOtherA-968672787 None] Terminate volume connection completed successfully. Sep 06 06:35:46 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [req-84099ccd-6a73-4c12-b92a-34199ca0b362 req-776f3448-42a1-4d7d-9a4d-9e5d7e42b71b tempest-ServerActionsTestOtherA-968672787 None] Deleting attachment f4269ad7-f419-4b5b-afbc-be4992020a74. {{(pid=87329) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 06 06:35:48 devstack cinder-volume[87329]: DEBUG oslo_service.periodic_task [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87329) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 06 06:35:48 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:35:48 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:35:48 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:35:48 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:35:48 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:35:48 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:35:48 devstack sudo[93479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:35:48 devstack sudo[93479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:35:49 devstack sudo[93479]: pam_unix(sudo:session): session closed for user root Sep 06 06:35:49 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.864s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:35:49 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:35:49 devstack cinder-volume[87329]: DEBUG oslo_service.periodic_task [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Running periodic task VolumeManager._thread_info {{(pid=87329) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 06 06:35:49 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] thread count: 28 {{(pid=87329) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 06 06:35:49 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] thread info: [<_MainThread(MainThread, started 126855043821696)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87329) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 06 06:35:50 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f3d8332-b674-48b3-938e-051bbf02a280 tempest-SnapshotsActionsTest-1031586015 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87329) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 06:35:50 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-2f3d8332-b674-48b3-938e-051bbf02a280 tempest-SnapshotsActionsTest-1031586015 None] Flow 'volume_create_manager' (ea812032-72e5-4064-822d-c4493fa8192a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:35:50 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-2f3d8332-b674-48b3-938e-051bbf02a280 tempest-SnapshotsActionsTest-1031586015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f95ec89b-61bd-445f-be35-6a896582ae2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:35:50 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-2f3d8332-b674-48b3-938e-051bbf02a280 tempest-SnapshotsActionsTest-1031586015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f95ec89b-61bd-445f-be35-6a896582ae2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:35:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-640326809',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=074ce519-1402-4842-9c17-e462a1f53c7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cff9d92664642b1baaa6d27c27bde95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:35:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:35:50Z,use_quota=True,user_id='cf598272d4e5455d9bc8612fecb26098',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:35:50 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-2f3d8332-b674-48b3-938e-051bbf02a280 tempest-SnapshotsActionsTest-1031586015 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec464856-f774-4115-bb80-39d0128bcb66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:35:50 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-2f3d8332-b674-48b3-938e-051bbf02a280 tempest-SnapshotsActionsTest-1031586015 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec464856-f774-4115-bb80-39d0128bcb66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:35:50 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-2f3d8332-b674-48b3-938e-051bbf02a280 tempest-SnapshotsActionsTest-1031586015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68436fd0-b398-4124-8202-7e6170ca21b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:35:50 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-2f3d8332-b674-48b3-938e-051bbf02a280 tempest-SnapshotsActionsTest-1031586015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68436fd0-b398-4124-8202-7e6170ca21b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '074ce519-1402-4842-9c17-e462a1f53c7c', 'volume_name': 'volume-074ce519-1402-4842-9c17-e462a1f53c7c', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:35:50 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-2f3d8332-b674-48b3-938e-051bbf02a280 tempest-SnapshotsActionsTest-1031586015 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9504ddc3-7d73-44f5-ae9a-d4967c47020f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:35:50 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-2f3d8332-b674-48b3-938e-051bbf02a280 tempest-SnapshotsActionsTest-1031586015 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9504ddc3-7d73-44f5-ae9a-d4967c47020f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:35:50 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-2f3d8332-b674-48b3-938e-051bbf02a280 tempest-SnapshotsActionsTest-1031586015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce33e7f5-7734-4c58-9373-2d8eb31596f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:35:50 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-2f3d8332-b674-48b3-938e-051bbf02a280 tempest-SnapshotsActionsTest-1031586015 None] Volume 074ce519-1402-4842-9c17-e462a1f53c7c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-074ce519-1402-4842-9c17-e462a1f53c7c', 'volume_size': 1} Sep 06 06:35:50 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-2f3d8332-b674-48b3-938e-051bbf02a280 tempest-SnapshotsActionsTest-1031586015 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:35:50 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-2f3d8332-b674-48b3-938e-051bbf02a280 tempest-SnapshotsActionsTest-1031586015 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:35:50 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-2f3d8332-b674-48b3-938e-051bbf02a280 tempest-SnapshotsActionsTest-1031586015 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:35:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-640326809',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=074ce519-1402-4842-9c17-e462a1f53c7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cff9d92664642b1baaa6d27c27bde95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:35:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:35:50Z,use_quota=True,user_id='cf598272d4e5455d9bc8612fecb26098',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)}" {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 06:35:50 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-2f3d8332-b674-48b3-938e-051bbf02a280 tempest-SnapshotsActionsTest-1031586015 None] Creating volume 074ce519-1402-4842-9c17-e462a1f53c7c {{(pid=87329) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 06:35:50 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-2f3d8332-b674-48b3-938e-051bbf02a280 tempest-SnapshotsActionsTest-1031586015 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:35:50 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-2f3d8332-b674-48b3-938e-051bbf02a280 tempest-SnapshotsActionsTest-1031586015 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:35:50 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-2f3d8332-b674-48b3-938e-051bbf02a280 tempest-SnapshotsActionsTest-1031586015 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:35:50 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-2f3d8332-b674-48b3-938e-051bbf02a280 tempest-SnapshotsActionsTest-1031586015 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:35:50 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-2f3d8332-b674-48b3-938e-051bbf02a280 tempest-SnapshotsActionsTest-1031586015 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:35:50 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-2f3d8332-b674-48b3-938e-051bbf02a280 tempest-SnapshotsActionsTest-1031586015 None] Selected osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 as target Quobyte volume. {{(pid=87329) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 06:35:50 devstack cinder-volume[87329]: INFO cinder.volume.drivers.remotefs [None req-2f3d8332-b674-48b3-938e-051bbf02a280 tempest-SnapshotsActionsTest-1031586015 None] casted to osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 Sep 06 06:35:50 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-2f3d8332-b674-48b3-938e-051bbf02a280 tempest-SnapshotsActionsTest-1031586015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-074ce519-1402-4842-9c17-e462a1f53c7c 1073741824 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:35:50 devstack sudo[93536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-074ce519-1402-4842-9c17-e462a1f53c7c 1073741824 Sep 06 06:35:50 devstack sudo[93536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:35:51 devstack sudo[93536]: pam_unix(sudo:session): session closed for user root Sep 06 06:35:51 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-2f3d8332-b674-48b3-938e-051bbf02a280 tempest-SnapshotsActionsTest-1031586015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-074ce519-1402-4842-9c17-e462a1f53c7c 1073741824" returned: 0 in 0.617s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:35:51 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-2f3d8332-b674-48b3-938e-051bbf02a280 tempest-SnapshotsActionsTest-1031586015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-074ce519-1402-4842-9c17-e462a1f53c7c {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:35:51 devstack sudo[93544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-074ce519-1402-4842-9c17-e462a1f53c7c Sep 06 06:35:51 devstack sudo[93544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:35:51 devstack sudo[93544]: pam_unix(sudo:session): session closed for user root Sep 06 06:35:51 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-2f3d8332-b674-48b3-938e-051bbf02a280 tempest-SnapshotsActionsTest-1031586015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-074ce519-1402-4842-9c17-e462a1f53c7c" returned: 0 in 0.272s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:35:51 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-2f3d8332-b674-48b3-938e-051bbf02a280 tempest-SnapshotsActionsTest-1031586015 None] <== create_volume: return (977ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'} {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 06:35:51 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-2f3d8332-b674-48b3-938e-051bbf02a280 tempest-SnapshotsActionsTest-1031586015 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.981s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:35:51 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-2f3d8332-b674-48b3-938e-051bbf02a280 tempest-SnapshotsActionsTest-1031586015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce33e7f5-7734-4c58-9373-2d8eb31596f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-074ce519-1402-4842-9c17-e462a1f53c7c', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:35:51 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-2f3d8332-b674-48b3-938e-051bbf02a280 tempest-SnapshotsActionsTest-1031586015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f67600f-3a92-47a0-b98f-8e687ded4b37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:35:51 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-2f3d8332-b674-48b3-938e-051bbf02a280 tempest-SnapshotsActionsTest-1031586015 None] Volume volume-074ce519-1402-4842-9c17-e462a1f53c7c (074ce519-1402-4842-9c17-e462a1f53c7c): created successfully Sep 06 06:35:51 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-2f3d8332-b674-48b3-938e-051bbf02a280 tempest-SnapshotsActionsTest-1031586015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f67600f-3a92-47a0-b98f-8e687ded4b37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:35:51 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-2f3d8332-b674-48b3-938e-051bbf02a280 tempest-SnapshotsActionsTest-1031586015 None] Flow 'volume_create_manager' (ea812032-72e5-4064-822d-c4493fa8192a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:35:51 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-2f3d8332-b674-48b3-938e-051bbf02a280 tempest-SnapshotsActionsTest-1031586015 None] Created volume successfully. Sep 06 06:35:52 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-67cd6d8c-bae2-4174-b2a1-557c0375ad22 tempest-SnapshotsActionsTest-1031586015 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:35:52 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-67cd6d8c-bae2-4174-b2a1-557c0375ad22 tempest-SnapshotsActionsTest-1031586015 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:35:52 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-67cd6d8c-bae2-4174-b2a1-557c0375ad22 tempest-SnapshotsActionsTest-1031586015 None] Creating offline snapshot 719717da-f08d-473f-9308-d29b2eb0639a of volume 074ce519-1402-4842-9c17-e462a1f53c7c {{(pid=87329) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 06 06:35:52 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d025740-6bdd-46b1-b282-0e36374f6a31]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:35:52 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-67cd6d8c-bae2-4174-b2a1-557c0375ad22 tempest-SnapshotsActionsTest-1031586015 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-074ce519-1402-4842-9c17-e462a1f53c7c {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:35:52 devstack sudo[93548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-074ce519-1402-4842-9c17-e462a1f53c7c Sep 06 06:35:52 devstack sudo[93548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:35:53 devstack sudo[93548]: pam_unix(sudo:session): session closed for user root Sep 06 06:35:53 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-67cd6d8c-bae2-4174-b2a1-557c0375ad22 tempest-SnapshotsActionsTest-1031586015 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-074ce519-1402-4842-9c17-e462a1f53c7c" returned: 0 in 0.410s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:35:53 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-67cd6d8c-bae2-4174-b2a1-557c0375ad22 tempest-SnapshotsActionsTest-1031586015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-074ce519-1402-4842-9c17-e462a1f53c7c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-074ce519-1402-4842-9c17-e462a1f53c7c.719717da-f08d-473f-9308-d29b2eb0639a 1G {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:35:53 devstack sudo[93553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-074ce519-1402-4842-9c17-e462a1f53c7c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-074ce519-1402-4842-9c17-e462a1f53c7c.719717da-f08d-473f-9308-d29b2eb0639a 1G Sep 06 06:35:53 devstack sudo[93553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:35:53 devstack sudo[93553]: pam_unix(sudo:session): session closed for user root Sep 06 06:35:53 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-67cd6d8c-bae2-4174-b2a1-557c0375ad22 tempest-SnapshotsActionsTest-1031586015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-074ce519-1402-4842-9c17-e462a1f53c7c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-074ce519-1402-4842-9c17-e462a1f53c7c.719717da-f08d-473f-9308-d29b2eb0639a 1G" returned: 0 in 0.446s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:35:53 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-67cd6d8c-bae2-4174-b2a1-557c0375ad22 tempest-SnapshotsActionsTest-1031586015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-074ce519-1402-4842-9c17-e462a1f53c7c -F qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-074ce519-1402-4842-9c17-e462a1f53c7c.719717da-f08d-473f-9308-d29b2eb0639a {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:35:53 devstack sudo[93558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-074ce519-1402-4842-9c17-e462a1f53c7c -F qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-074ce519-1402-4842-9c17-e462a1f53c7c.719717da-f08d-473f-9308-d29b2eb0639a Sep 06 06:35:53 devstack sudo[93558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:35:54 devstack sudo[93558]: pam_unix(sudo:session): session closed for user root Sep 06 06:35:54 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-67cd6d8c-bae2-4174-b2a1-557c0375ad22 tempest-SnapshotsActionsTest-1031586015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-074ce519-1402-4842-9c17-e462a1f53c7c -F qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-074ce519-1402-4842-9c17-e462a1f53c7c.719717da-f08d-473f-9308-d29b2eb0639a" returned: 0 in 0.320s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:35:54 devstack cinder-volume[87329]: WARNING cinder.volume.drivers.remotefs [None req-67cd6d8c-bae2-4174-b2a1-557c0375ad22 tempest-SnapshotsActionsTest-1031586015 None] /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-074ce519-1402-4842-9c17-e462a1f53c7c.719717da-f08d-473f-9308-d29b2eb0639a is being set with open permissions: ugo+rw Sep 06 06:35:54 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-67cd6d8c-bae2-4174-b2a1-557c0375ad22 tempest-SnapshotsActionsTest-1031586015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-074ce519-1402-4842-9c17-e462a1f53c7c.719717da-f08d-473f-9308-d29b2eb0639a {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:35:54 devstack sudo[93563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-074ce519-1402-4842-9c17-e462a1f53c7c.719717da-f08d-473f-9308-d29b2eb0639a Sep 06 06:35:54 devstack sudo[93563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:35:54 devstack sudo[93563]: pam_unix(sudo:session): session closed for user root Sep 06 06:35:54 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-67cd6d8c-bae2-4174-b2a1-557c0375ad22 tempest-SnapshotsActionsTest-1031586015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-074ce519-1402-4842-9c17-e462a1f53c7c.719717da-f08d-473f-9308-d29b2eb0639a" returned: 0 in 0.271s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:35:54 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-67cd6d8c-bae2-4174-b2a1-557c0375ad22 tempest-SnapshotsActionsTest-1031586015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-074ce519-1402-4842-9c17-e462a1f53c7c.info {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:35:54 devstack sudo[93566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-074ce519-1402-4842-9c17-e462a1f53c7c.info Sep 06 06:35:54 devstack sudo[93566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:35:54 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7f77533-d59b-467b-a56a-8335fbec8917 tempest-ServerActionsTestOtherA-968672787 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87329) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 06:35:54 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-c7f77533-d59b-467b-a56a-8335fbec8917 tempest-ServerActionsTestOtherA-968672787 None] Flow 'volume_create_manager' (3a4c5549-ab14-485b-941c-0e405af38713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:35:54 devstack sudo[93566]: pam_unix(sudo:session): session closed for user root Sep 06 06:35:54 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-c7f77533-d59b-467b-a56a-8335fbec8917 tempest-ServerActionsTestOtherA-968672787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f95420e1-32b3-4155-b607-41ec350cde0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:35:54 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-67cd6d8c-bae2-4174-b2a1-557c0375ad22 tempest-SnapshotsActionsTest-1031586015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-074ce519-1402-4842-9c17-e462a1f53c7c.info" returned: 0 in 0.287s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:35:54 devstack cinder-volume[87329]: WARNING cinder.volume.drivers.remotefs [None req-67cd6d8c-bae2-4174-b2a1-557c0375ad22 tempest-SnapshotsActionsTest-1031586015 None] /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-074ce519-1402-4842-9c17-e462a1f53c7c.info is being set with open permissions: ugo+rw Sep 06 06:35:54 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-67cd6d8c-bae2-4174-b2a1-557c0375ad22 tempest-SnapshotsActionsTest-1031586015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-074ce519-1402-4842-9c17-e462a1f53c7c.info {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:35:54 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-c7f77533-d59b-467b-a56a-8335fbec8917 tempest-ServerActionsTestOtherA-968672787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f95420e1-32b3-4155-b607-41ec350cde0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:35:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-198095546',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a774c547-4c1b-4488-a78c-6fd485434966,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='474e425101c84d91a4f761bb638bd56f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:35:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:35:55Z,use_quota=True,user_id='f6eb0730f9b946dd9ee3c21c75d4566e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:35:54 devstack sudo[93569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-074ce519-1402-4842-9c17-e462a1f53c7c.info Sep 06 06:35:54 devstack sudo[93569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:35:54 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-c7f77533-d59b-467b-a56a-8335fbec8917 tempest-ServerActionsTestOtherA-968672787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0020acad-e248-4199-96a1-5f28186aa784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:35:54 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-c7f77533-d59b-467b-a56a-8335fbec8917 tempest-ServerActionsTestOtherA-968672787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0020acad-e248-4199-96a1-5f28186aa784) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:35:54 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-c7f77533-d59b-467b-a56a-8335fbec8917 tempest-ServerActionsTestOtherA-968672787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (859b6775-7996-4046-a0c7-a6e87f56fd27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:35:54 devstack cinder-volume[87329]: DEBUG cinder.image.glance [None req-c7f77533-d59b-467b-a56a-8335fbec8917 tempest-ServerActionsTestOtherA-968672787 None] Creating Keystone auth plugin from conf {{(pid=87329) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 06 06:35:54 devstack sudo[93569]: pam_unix(sudo:session): session closed for user root Sep 06 06:35:54 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-67cd6d8c-bae2-4174-b2a1-557c0375ad22 tempest-SnapshotsActionsTest-1031586015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-074ce519-1402-4842-9c17-e462a1f53c7c.info" returned: 0 in 0.292s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:35:54 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-67cd6d8c-bae2-4174-b2a1-557c0375ad22 tempest-SnapshotsActionsTest-1031586015 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.135s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:35:54 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-c7f77533-d59b-467b-a56a-8335fbec8917 tempest-ServerActionsTestOtherA-968672787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (859b6775-7996-4046-a0c7-a6e87f56fd27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a774c547-4c1b-4488-a78c-6fd485434966', 'volume_name': 'volume-a774c547-4c1b-4488-a78c-6fd485434966', 'volume_size': 1, 'image_id': '7005ba32-ec39-44a3-88d9-ca6af0b34ea0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7005ba32-ec39-44a3-88d9-ca6af0b34ea0', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '65b0d6d605b2427d8db787d4220dbeb4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7005ba32-ec39-44a3-88d9-ca6af0b34ea0', 'created_at': datetime.datetime(2026, 9, 6, 4, 25, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 6, 4, 25, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7005ba32-ec39-44a3-88d9-ca6af0b34ea0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:35:54 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-c7f77533-d59b-467b-a56a-8335fbec8917 tempest-ServerActionsTestOtherA-968672787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b0c46c3-0e25-46f1-a29b-46b5e06e6f4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:35:54 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-c7f77533-d59b-467b-a56a-8335fbec8917 tempest-ServerActionsTestOtherA-968672787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b0c46c3-0e25-46f1-a29b-46b5e06e6f4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:35:54 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-c7f77533-d59b-467b-a56a-8335fbec8917 tempest-ServerActionsTestOtherA-968672787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1d6d57b-d21a-4928-9a4b-aaa1b864184e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:35:54 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-c7f77533-d59b-467b-a56a-8335fbec8917 tempest-ServerActionsTestOtherA-968672787 None] Volume a774c547-4c1b-4488-a78c-6fd485434966: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a774c547-4c1b-4488-a78c-6fd485434966', 'volume_size': 1, 'image_id': '7005ba32-ec39-44a3-88d9-ca6af0b34ea0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7005ba32-ec39-44a3-88d9-ca6af0b34ea0', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '65b0d6d605b2427d8db787d4220dbeb4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7005ba32-ec39-44a3-88d9-ca6af0b34ea0', 'created_at': datetime.datetime(2026, 9, 6, 4, 25, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 6, 4, 25, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7005ba32-ec39-44a3-88d9-ca6af0b34ea0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 06 06:35:54 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7f77533-d59b-467b-a56a-8335fbec8917 tempest-ServerActionsTestOtherA-968672787 None] Trying to clone a774c547-4c1b-4488-a78c-6fd485434966 from image 7005ba32-ec39-44a3-88d9-ca6af0b34ea0 at location (None, [{'url': 'file:///opt/stack/data/glance/images/7005ba32-ec39-44a3-88d9-ca6af0b34ea0', 'metadata': {}}]). {{(pid=87329) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 06 06:35:54 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-67cd6d8c-bae2-4174-b2a1-557c0375ad22 tempest-SnapshotsActionsTest-1031586015 None] Create snapshot completed successfully Sep 06 06:35:55 devstack cinder-volume[87329]: DEBUG cinder.image.image_utils [None req-c7f77533-d59b-467b-a56a-8335fbec8917 tempest-ServerActionsTestOtherA-968672787 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_7005ba32-ec39-44a3-88d9-ca6af0b34ea0_mwyivu0adevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87329) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 06 06:35:55 devstack cinder-volume[87329]: INFO cinder.image.image_utils [None req-c7f77533-d59b-467b-a56a-8335fbec8917 tempest-ServerActionsTestOtherA-968672787 None] Image download 20.69 MB at 20.69 MB/s Sep 06 06:35:55 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fedf855-f4d5-4676-a990-4b8f857da2ca]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:35:55 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-c7f77533-d59b-467b-a56a-8335fbec8917 tempest-ServerActionsTestOtherA-968672787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7005ba32-ec39-44a3-88d9-ca6af0b34ea0_mwyivu0adevstack@QuobyteHD {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:35:55 devstack sudo[93574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7005ba32-ec39-44a3-88d9-ca6af0b34ea0_mwyivu0adevstack@QuobyteHD Sep 06 06:35:55 devstack sudo[93574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:35:55 devstack sudo[93574]: pam_unix(sudo:session): session closed for user root Sep 06 06:35:55 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-c7f77533-d59b-467b-a56a-8335fbec8917 tempest-ServerActionsTestOtherA-968672787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7005ba32-ec39-44a3-88d9-ca6af0b34ea0_mwyivu0adevstack@QuobyteHD" returned: 0 in 0.340s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:35:55 devstack cinder-volume[87329]: DEBUG cinder.image.image_utils [None req-c7f77533-d59b-467b-a56a-8335fbec8917 tempest-ServerActionsTestOtherA-968672787 None] Temporary image 7005ba32-ec39-44a3-88d9-ca6af0b34ea0 is fetched for user f6eb0730f9b946dd9ee3c21c75d4566e. {{(pid=87329) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 06 06:35:55 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[0824034c-a6a9-4244-9205-817df30f11c3]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:35:55 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-c7f77533-d59b-467b-a56a-8335fbec8917 tempest-ServerActionsTestOtherA-968672787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7005ba32-ec39-44a3-88d9-ca6af0b34ea0_mwyivu0adevstack@QuobyteHD {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:35:55 devstack sudo[93580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7005ba32-ec39-44a3-88d9-ca6af0b34ea0_mwyivu0adevstack@QuobyteHD Sep 06 06:35:55 devstack sudo[93580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:35:56 devstack sudo[93580]: pam_unix(sudo:session): session closed for user root Sep 06 06:35:56 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-c7f77533-d59b-467b-a56a-8335fbec8917 tempest-ServerActionsTestOtherA-968672787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7005ba32-ec39-44a3-88d9-ca6af0b34ea0_mwyivu0adevstack@QuobyteHD" returned: 0 in 0.327s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:35:56 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-c7f77533-d59b-467b-a56a-8335fbec8917 tempest-ServerActionsTestOtherA-968672787 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:35:56 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-c7f77533-d59b-467b-a56a-8335fbec8917 tempest-ServerActionsTestOtherA-968672787 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:35:56 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-c7f77533-d59b-467b-a56a-8335fbec8917 tempest-ServerActionsTestOtherA-968672787 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:35:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-198095546',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a774c547-4c1b-4488-a78c-6fd485434966,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='474e425101c84d91a4f761bb638bd56f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:35:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:35:55Z,use_quota=True,user_id='f6eb0730f9b946dd9ee3c21c75d4566e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)}" {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 06:35:56 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-c7f77533-d59b-467b-a56a-8335fbec8917 tempest-ServerActionsTestOtherA-968672787 None] Creating volume a774c547-4c1b-4488-a78c-6fd485434966 {{(pid=87329) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 06:35:56 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-c7f77533-d59b-467b-a56a-8335fbec8917 tempest-ServerActionsTestOtherA-968672787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:35:56 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-c7f77533-d59b-467b-a56a-8335fbec8917 tempest-ServerActionsTestOtherA-968672787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:35:56 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-c7f77533-d59b-467b-a56a-8335fbec8917 tempest-ServerActionsTestOtherA-968672787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:35:56 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-c7f77533-d59b-467b-a56a-8335fbec8917 tempest-ServerActionsTestOtherA-968672787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:35:56 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-c7f77533-d59b-467b-a56a-8335fbec8917 tempest-ServerActionsTestOtherA-968672787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:35:56 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-c7f77533-d59b-467b-a56a-8335fbec8917 tempest-ServerActionsTestOtherA-968672787 None] Selected osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 as target Quobyte volume. {{(pid=87329) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 06:35:56 devstack cinder-volume[87329]: INFO cinder.volume.drivers.remotefs [None req-c7f77533-d59b-467b-a56a-8335fbec8917 tempest-ServerActionsTestOtherA-968672787 None] casted to osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 Sep 06 06:35:56 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-c7f77533-d59b-467b-a56a-8335fbec8917 tempest-ServerActionsTestOtherA-968672787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-a774c547-4c1b-4488-a78c-6fd485434966 1073741824 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:35:56 devstack sudo[93585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-a774c547-4c1b-4488-a78c-6fd485434966 1073741824 Sep 06 06:35:56 devstack sudo[93585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:35:56 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-6c176963-42e4-46df-93f8-24c8a3bfb7d1 tempest-SnapshotsActionsTest-1031586015 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:35:56 devstack sudo[93585]: pam_unix(sudo:session): session closed for user root Sep 06 06:35:56 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-c7f77533-d59b-467b-a56a-8335fbec8917 tempest-ServerActionsTestOtherA-968672787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-a774c547-4c1b-4488-a78c-6fd485434966 1073741824" returned: 0 in 0.540s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:35:56 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-c7f77533-d59b-467b-a56a-8335fbec8917 tempest-ServerActionsTestOtherA-968672787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-a774c547-4c1b-4488-a78c-6fd485434966 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:35:56 devstack sudo[93597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-a774c547-4c1b-4488-a78c-6fd485434966 Sep 06 06:35:56 devstack sudo[93597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:35:56 devstack sudo[93597]: pam_unix(sudo:session): session closed for user root Sep 06 06:35:56 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-c7f77533-d59b-467b-a56a-8335fbec8917 tempest-ServerActionsTestOtherA-968672787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-a774c547-4c1b-4488-a78c-6fd485434966" returned: 0 in 0.242s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:35:56 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-c7f77533-d59b-467b-a56a-8335fbec8917 tempest-ServerActionsTestOtherA-968672787 None] <== create_volume: return (821ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'} {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 06:35:56 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-c7f77533-d59b-467b-a56a-8335fbec8917 tempest-ServerActionsTestOtherA-968672787 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.824s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:35:56 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-6c176963-42e4-46df-93f8-24c8a3bfb7d1 tempest-SnapshotsActionsTest-1031586015 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.296s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:35:56 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-6c176963-42e4-46df-93f8-24c8a3bfb7d1 tempest-SnapshotsActionsTest-1031586015 None] Creating offline snapshot 77571ccb-7a0e-4a22-b30c-69e35ccb778e of volume 074ce519-1402-4842-9c17-e462a1f53c7c {{(pid=87329) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 06 06:35:57 devstack cinder-volume[87329]: DEBUG cinder.volume.volume_utils [None req-c7f77533-d59b-467b-a56a-8335fbec8917 tempest-ServerActionsTestOtherA-968672787 None] Attempting download of 7005ba32-ec39-44a3-88d9-ca6af0b34ea0 ((None, [{'url': 'file:///opt/stack/data/glance/images/7005ba32-ec39-44a3-88d9-ca6af0b34ea0', 'metadata': {}}])) to volume a774c547-4c1b-4488-a78c-6fd485434966. {{(pid=87329) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 06 06:35:57 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2063e49-f783-4a61-ae09-a757b7c8fdce]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:35:57 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-6c176963-42e4-46df-93f8-24c8a3bfb7d1 tempest-SnapshotsActionsTest-1031586015 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-074ce519-1402-4842-9c17-e462a1f53c7c.719717da-f08d-473f-9308-d29b2eb0639a {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:35:57 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbb6be80-2262-4eab-8e36-e11ad9d51d2a]: (4, 'raw') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:35:57 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-c7f77533-d59b-467b-a56a-8335fbec8917 tempest-ServerActionsTestOtherA-968672787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7005ba32-ec39-44a3-88d9-ca6af0b34ea0_7qtrq_jx {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:35:57 devstack sudo[93600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-074ce519-1402-4842-9c17-e462a1f53c7c.719717da-f08d-473f-9308-d29b2eb0639a Sep 06 06:35:57 devstack sudo[93600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:35:57 devstack sudo[93601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7005ba32-ec39-44a3-88d9-ca6af0b34ea0_7qtrq_jx Sep 06 06:35:57 devstack sudo[93601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:35:57 devstack sudo[93601]: pam_unix(sudo:session): session closed for user root Sep 06 06:35:57 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-c7f77533-d59b-467b-a56a-8335fbec8917 tempest-ServerActionsTestOtherA-968672787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7005ba32-ec39-44a3-88d9-ca6af0b34ea0_7qtrq_jx" returned: 0 in 0.332s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:35:57 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-c7f77533-d59b-467b-a56a-8335fbec8917 tempest-ServerActionsTestOtherA-968672787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7005ba32-ec39-44a3-88d9-ca6af0b34ea0_7qtrq_jx {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:35:57 devstack sudo[93600]: pam_unix(sudo:session): session closed for user root Sep 06 06:35:57 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-6c176963-42e4-46df-93f8-24c8a3bfb7d1 tempest-SnapshotsActionsTest-1031586015 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-074ce519-1402-4842-9c17-e462a1f53c7c.719717da-f08d-473f-9308-d29b2eb0639a" returned: 0 in 0.397s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:35:57 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-6c176963-42e4-46df-93f8-24c8a3bfb7d1 tempest-SnapshotsActionsTest-1031586015 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-074ce519-1402-4842-9c17-e462a1f53c7c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87329) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 06:35:57 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-6c176963-42e4-46df-93f8-24c8a3bfb7d1 tempest-SnapshotsActionsTest-1031586015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-074ce519-1402-4842-9c17-e462a1f53c7c.719717da-f08d-473f-9308-d29b2eb0639a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-074ce519-1402-4842-9c17-e462a1f53c7c.77571ccb-7a0e-4a22-b30c-69e35ccb778e 1G {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:35:57 devstack sudo[93610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-074ce519-1402-4842-9c17-e462a1f53c7c.719717da-f08d-473f-9308-d29b2eb0639a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-074ce519-1402-4842-9c17-e462a1f53c7c.77571ccb-7a0e-4a22-b30c-69e35ccb778e 1G Sep 06 06:35:57 devstack sudo[93610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:35:57 devstack sudo[93609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7005ba32-ec39-44a3-88d9-ca6af0b34ea0_7qtrq_jx Sep 06 06:35:57 devstack sudo[93609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:35:57 devstack sudo[93609]: pam_unix(sudo:session): session closed for user root Sep 06 06:35:57 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-c7f77533-d59b-467b-a56a-8335fbec8917 tempest-ServerActionsTestOtherA-968672787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7005ba32-ec39-44a3-88d9-ca6af0b34ea0_7qtrq_jx" returned: 1 in 0.437s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:35:57 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-c7f77533-d59b-467b-a56a-8335fbec8917 tempest-ServerActionsTestOtherA-968672787 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7005ba32-ec39-44a3-88d9-ca6af0b34ea0_7qtrq_jx' failed. Not Retrying. {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 06 06:35:57 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a127c3f-e92f-46a2-8bad-475a8deae41a]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:35:57 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-c7f77533-d59b-467b-a56a-8335fbec8917 tempest-ServerActionsTestOtherA-968672787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7005ba32-ec39-44a3-88d9-ca6af0b34ea0_mwyivu0adevstack@QuobyteHD {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:35:57 devstack sudo[93622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7005ba32-ec39-44a3-88d9-ca6af0b34ea0_mwyivu0adevstack@QuobyteHD Sep 06 06:35:57 devstack sudo[93622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:35:57 devstack sudo[93610]: pam_unix(sudo:session): session closed for user root Sep 06 06:35:57 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-6c176963-42e4-46df-93f8-24c8a3bfb7d1 tempest-SnapshotsActionsTest-1031586015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-074ce519-1402-4842-9c17-e462a1f53c7c.719717da-f08d-473f-9308-d29b2eb0639a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-074ce519-1402-4842-9c17-e462a1f53c7c.77571ccb-7a0e-4a22-b30c-69e35ccb778e 1G" returned: 0 in 0.563s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:35:57 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-6c176963-42e4-46df-93f8-24c8a3bfb7d1 tempest-SnapshotsActionsTest-1031586015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-074ce519-1402-4842-9c17-e462a1f53c7c.719717da-f08d-473f-9308-d29b2eb0639a -F qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-074ce519-1402-4842-9c17-e462a1f53c7c.77571ccb-7a0e-4a22-b30c-69e35ccb778e {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:35:58 devstack sudo[93624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-074ce519-1402-4842-9c17-e462a1f53c7c.719717da-f08d-473f-9308-d29b2eb0639a -F qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-074ce519-1402-4842-9c17-e462a1f53c7c.77571ccb-7a0e-4a22-b30c-69e35ccb778e Sep 06 06:35:58 devstack sudo[93624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:35:58 devstack sudo[93622]: pam_unix(sudo:session): session closed for user root Sep 06 06:35:58 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-c7f77533-d59b-467b-a56a-8335fbec8917 tempest-ServerActionsTestOtherA-968672787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7005ba32-ec39-44a3-88d9-ca6af0b34ea0_mwyivu0adevstack@QuobyteHD" returned: 0 in 0.375s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:35:58 devstack cinder-volume[87329]: DEBUG cinder.image.image_utils [None req-c7f77533-d59b-467b-a56a-8335fbec8917 tempest-ServerActionsTestOtherA-968672787 None] 7005ba32-ec39-44a3-88d9-ca6af0b34ea0 was qcow2, converting to qcow2 {{(pid=87329) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 06 06:35:58 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-c7f77533-d59b-467b-a56a-8335fbec8917 tempest-ServerActionsTestOtherA-968672787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7005ba32-ec39-44a3-88d9-ca6af0b34ea0_mwyivu0adevstack@QuobyteHD /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-a774c547-4c1b-4488-a78c-6fd485434966 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:35:58 devstack sudo[93630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7005ba32-ec39-44a3-88d9-ca6af0b34ea0_mwyivu0adevstack@QuobyteHD /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-a774c547-4c1b-4488-a78c-6fd485434966 Sep 06 06:35:58 devstack sudo[93630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:35:58 devstack sudo[93624]: pam_unix(sudo:session): session closed for user root Sep 06 06:35:58 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-6c176963-42e4-46df-93f8-24c8a3bfb7d1 tempest-SnapshotsActionsTest-1031586015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-074ce519-1402-4842-9c17-e462a1f53c7c.719717da-f08d-473f-9308-d29b2eb0639a -F qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-074ce519-1402-4842-9c17-e462a1f53c7c.77571ccb-7a0e-4a22-b30c-69e35ccb778e" returned: 0 in 0.464s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:35:58 devstack cinder-volume[87329]: WARNING cinder.volume.drivers.remotefs [None req-6c176963-42e4-46df-93f8-24c8a3bfb7d1 tempest-SnapshotsActionsTest-1031586015 None] /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-074ce519-1402-4842-9c17-e462a1f53c7c.77571ccb-7a0e-4a22-b30c-69e35ccb778e is being set with open permissions: ugo+rw Sep 06 06:35:58 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-6c176963-42e4-46df-93f8-24c8a3bfb7d1 tempest-SnapshotsActionsTest-1031586015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-074ce519-1402-4842-9c17-e462a1f53c7c.77571ccb-7a0e-4a22-b30c-69e35ccb778e {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:35:58 devstack sudo[93635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-074ce519-1402-4842-9c17-e462a1f53c7c.77571ccb-7a0e-4a22-b30c-69e35ccb778e Sep 06 06:35:58 devstack sudo[93635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:35:58 devstack sudo[93635]: pam_unix(sudo:session): session closed for user root Sep 06 06:35:58 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-6c176963-42e4-46df-93f8-24c8a3bfb7d1 tempest-SnapshotsActionsTest-1031586015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-074ce519-1402-4842-9c17-e462a1f53c7c.77571ccb-7a0e-4a22-b30c-69e35ccb778e" returned: 0 in 0.299s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:35:58 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-6c176963-42e4-46df-93f8-24c8a3bfb7d1 tempest-SnapshotsActionsTest-1031586015 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.853s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:35:58 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-6c176963-42e4-46df-93f8-24c8a3bfb7d1 tempest-SnapshotsActionsTest-1031586015 None] Create snapshot completed successfully Sep 06 06:35:59 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-c4a1f52d-8511-4dd0-a077-990438d5115a tempest-VolumesNegativeTest-1417748630 None] Acquiring lock "cinder-5f875b45-01c0-4226-8d15-95ee8beee44d-delete_volume" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:35:59 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-c4a1f52d-8511-4dd0-a077-990438d5115a tempest-VolumesNegativeTest-1417748630 None] Lock "cinder-5f875b45-01c0-4226-8d15-95ee8beee44d-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:35:59 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-c4a1f52d-8511-4dd0-a077-990438d5115a tempest-VolumesNegativeTest-1417748630 None] Acquiring lock "cinder-quobyte-5f875b45-01c0-4226-8d15-95ee8beee44d" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:35:59 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-c4a1f52d-8511-4dd0-a077-990438d5115a tempest-VolumesNegativeTest-1417748630 None] Lock "cinder-quobyte-5f875b45-01c0-4226-8d15-95ee8beee44d" acquired by "delete_volume" :: waited 0.017s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:35:59 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e24614f-15fc-4826-ab80-3c4396d6b387]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:35:59 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-c4a1f52d-8511-4dd0-a077-990438d5115a tempest-VolumesNegativeTest-1417748630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-5f875b45-01c0-4226-8d15-95ee8beee44d {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:35:59 devstack sudo[93645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-5f875b45-01c0-4226-8d15-95ee8beee44d Sep 06 06:35:59 devstack sudo[93645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:35:59 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-a9c19419-3414-4c22-bbca-be02aff07481 tempest-SnapshotsActionsTest-353968158 None] Acquiring lock "cinder-77571ccb-7a0e-4a22-b30c-69e35ccb778e-delete_snapshot" by "delete_snapshot" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:35:59 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-a9c19419-3414-4c22-bbca-be02aff07481 tempest-SnapshotsActionsTest-353968158 None] Lock "cinder-77571ccb-7a0e-4a22-b30c-69e35ccb778e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:35:59 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-a9c19419-3414-4c22-bbca-be02aff07481 tempest-SnapshotsActionsTest-353968158 None] Acquiring lock "cinder-quobyte-074ce519-1402-4842-9c17-e462a1f53c7c" by "delete_snapshot" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:36:00 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-a9c19419-3414-4c22-bbca-be02aff07481 tempest-SnapshotsActionsTest-353968158 None] Lock "cinder-quobyte-074ce519-1402-4842-9c17-e462a1f53c7c" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:36:00 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-a9c19419-3414-4c22-bbca-be02aff07481 tempest-SnapshotsActionsTest-353968158 None] Acquiring lock "cinder-quobyte-77571ccb-7a0e-4a22-b30c-69e35ccb778e" by "_delete_snapshot" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:36:00 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-a9c19419-3414-4c22-bbca-be02aff07481 tempest-SnapshotsActionsTest-353968158 None] Lock "cinder-quobyte-77571ccb-7a0e-4a22-b30c-69e35ccb778e" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:36:00 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-a9c19419-3414-4c22-bbca-be02aff07481 tempest-SnapshotsActionsTest-353968158 None] Deleting offline snapshot 77571ccb-7a0e-4a22-b30c-69e35ccb778e of volume 074ce519-1402-4842-9c17-e462a1f53c7c {{(pid=87329) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 06 06:36:00 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-a9c19419-3414-4c22-bbca-be02aff07481 tempest-SnapshotsActionsTest-353968158 None] snapshot_file for this snap is: volume-074ce519-1402-4842-9c17-e462a1f53c7c.77571ccb-7a0e-4a22-b30c-69e35ccb778e {{(pid=87329) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 06 06:36:00 devstack sudo[93645]: pam_unix(sudo:session): session closed for user root Sep 06 06:36:00 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-c4a1f52d-8511-4dd0-a077-990438d5115a tempest-VolumesNegativeTest-1417748630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-5f875b45-01c0-4226-8d15-95ee8beee44d" returned: 0 in 0.463s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:36:00 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-c4a1f52d-8511-4dd0-a077-990438d5115a tempest-VolumesNegativeTest-1417748630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-5f875b45-01c0-4226-8d15-95ee8beee44d {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:36:00 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae576dad-aa10-40ba-a543-4963e6cac10e]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:36:00 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-a9c19419-3414-4c22-bbca-be02aff07481 tempest-SnapshotsActionsTest-353968158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-074ce519-1402-4842-9c17-e462a1f53c7c.77571ccb-7a0e-4a22-b30c-69e35ccb778e {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:36:00 devstack sudo[93650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-5f875b45-01c0-4226-8d15-95ee8beee44d Sep 06 06:36:00 devstack sudo[93650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:36:00 devstack sudo[93651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-074ce519-1402-4842-9c17-e462a1f53c7c.77571ccb-7a0e-4a22-b30c-69e35ccb778e Sep 06 06:36:00 devstack sudo[93651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:36:00 devstack sudo[93630]: pam_unix(sudo:session): session closed for user root Sep 06 06:36:00 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-c7f77533-d59b-467b-a56a-8335fbec8917 tempest-ServerActionsTestOtherA-968672787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7005ba32-ec39-44a3-88d9-ca6af0b34ea0_mwyivu0adevstack@QuobyteHD /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-a774c547-4c1b-4488-a78c-6fd485434966" returned: 0 in 2.015s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:36:00 devstack cinder-volume[87329]: DEBUG cinder.image.image_utils [None req-c7f77533-d59b-467b-a56a-8335fbec8917 tempest-ServerActionsTestOtherA-968672787 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_7005ba32-ec39-44a3-88d9-ca6af0b34ea0_mwyivu0adevstack@QuobyteHD, size 112.00 MB, duration 2.02 sec, destination /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-a774c547-4c1b-4488-a78c-6fd485434966 {{(pid=87329) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 06 06:36:00 devstack cinder-volume[87329]: INFO cinder.image.image_utils [None req-c7f77533-d59b-467b-a56a-8335fbec8917 tempest-ServerActionsTestOtherA-968672787 None] Converted 112.00 MB image at 55.55 MB/s Sep 06 06:36:00 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-c7f77533-d59b-467b-a56a-8335fbec8917 tempest-ServerActionsTestOtherA-968672787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-a774c547-4c1b-4488-a78c-6fd485434966 1G {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:36:00 devstack sudo[93654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-a774c547-4c1b-4488-a78c-6fd485434966 1G Sep 06 06:36:00 devstack sudo[93654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:36:00 devstack sudo[93650]: pam_unix(sudo:session): session closed for user root Sep 06 06:36:00 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-c4a1f52d-8511-4dd0-a077-990438d5115a tempest-VolumesNegativeTest-1417748630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-5f875b45-01c0-4226-8d15-95ee8beee44d" returned: 0 in 0.263s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:36:00 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-c4a1f52d-8511-4dd0-a077-990438d5115a tempest-VolumesNegativeTest-1417748630 None] Lock "cinder-quobyte-5f875b45-01c0-4226-8d15-95ee8beee44d" released by "delete_volume" :: held 0.767s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:36:00 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-c4a1f52d-8511-4dd0-a077-990438d5115a tempest-VolumesNegativeTest-1417748630 None] Created reservations ['a5456ea9-2090-45c1-bd26-afa3e43a29d8', 'e7827426-881e-4607-af83-8dc4f679fe00', '502c9c1b-5350-44d6-bee6-aaff0010b60f', '853e55de-8a5a-4ee6-9da6-d3242b8ea55d'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:36:00 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-c4a1f52d-8511-4dd0-a077-990438d5115a tempest-VolumesNegativeTest-1417748630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:36:00 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-c4a1f52d-8511-4dd0-a077-990438d5115a tempest-VolumesNegativeTest-1417748630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:36:00 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-c4a1f52d-8511-4dd0-a077-990438d5115a tempest-VolumesNegativeTest-1417748630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:36:00 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-c4a1f52d-8511-4dd0-a077-990438d5115a tempest-VolumesNegativeTest-1417748630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:36:00 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-c4a1f52d-8511-4dd0-a077-990438d5115a tempest-VolumesNegativeTest-1417748630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:36:00 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-c4a1f52d-8511-4dd0-a077-990438d5115a tempest-VolumesNegativeTest-1417748630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:36:00 devstack sudo[93651]: pam_unix(sudo:session): session closed for user root Sep 06 06:36:00 devstack sudo[93662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:36:00 devstack sudo[93662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:36:00 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-a9c19419-3414-4c22-bbca-be02aff07481 tempest-SnapshotsActionsTest-353968158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-074ce519-1402-4842-9c17-e462a1f53c7c.77571ccb-7a0e-4a22-b30c-69e35ccb778e" returned: 0 in 0.415s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:36:00 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-a9c19419-3414-4c22-bbca-be02aff07481 tempest-SnapshotsActionsTest-353968158 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-074ce519-1402-4842-9c17-e462a1f53c7c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87329) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 06:36:00 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2dac7fa-c2e4-4fa0-a353-424a1dc11378]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:36:00 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-a9c19419-3414-4c22-bbca-be02aff07481 tempest-SnapshotsActionsTest-353968158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-074ce519-1402-4842-9c17-e462a1f53c7c.719717da-f08d-473f-9308-d29b2eb0639a {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:36:00 devstack sudo[93654]: pam_unix(sudo:session): session closed for user root Sep 06 06:36:00 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-c7f77533-d59b-467b-a56a-8335fbec8917 tempest-ServerActionsTestOtherA-968672787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-a774c547-4c1b-4488-a78c-6fd485434966 1G" returned: 0 in 0.334s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:36:00 devstack cinder-volume[87329]: DEBUG cinder.volume.volume_utils [None req-c7f77533-d59b-467b-a56a-8335fbec8917 tempest-ServerActionsTestOtherA-968672787 None] Downloaded image 7005ba32-ec39-44a3-88d9-ca6af0b34ea0 ((None, [{'url': 'file:///opt/stack/data/glance/images/7005ba32-ec39-44a3-88d9-ca6af0b34ea0', 'metadata': {}}])) to volume a774c547-4c1b-4488-a78c-6fd485434966 successfully. {{(pid=87329) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 06 06:36:00 devstack cinder-volume[87329]: DEBUG cinder.image.image_utils [None req-c7f77533-d59b-467b-a56a-8335fbec8917 tempest-ServerActionsTestOtherA-968672787 None] Temporary image 7005ba32-ec39-44a3-88d9-ca6af0b34ea0 for user f6eb0730f9b946dd9ee3c21c75d4566e is deleted. {{(pid=87329) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 06 06:36:00 devstack cinder-volume[87329]: DEBUG cinder.volume.volume_utils [None req-c7f77533-d59b-467b-a56a-8335fbec8917 tempest-ServerActionsTestOtherA-968672787 None] Marking volume a774c547-4c1b-4488-a78c-6fd485434966 as bootable. {{(pid=87329) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 06 06:36:00 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7f77533-d59b-467b-a56a-8335fbec8917 tempest-ServerActionsTestOtherA-968672787 None] Copying metadata from image 7005ba32-ec39-44a3-88d9-ca6af0b34ea0 to a774c547-4c1b-4488-a78c-6fd485434966. {{(pid=87329) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 06 06:36:00 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7f77533-d59b-467b-a56a-8335fbec8917 tempest-ServerActionsTestOtherA-968672787 None] Creating volume glance metadata for volume a774c547-4c1b-4488-a78c-6fd485434966 backed by image 7005ba32-ec39-44a3-88d9-ca6af0b34ea0 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '7005ba32-ec39-44a3-88d9-ca6af0b34ea0', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87329) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 06 06:36:00 devstack sudo[93666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-074ce519-1402-4842-9c17-e462a1f53c7c.719717da-f08d-473f-9308-d29b2eb0639a Sep 06 06:36:00 devstack sudo[93666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:36:00 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-c7f77533-d59b-467b-a56a-8335fbec8917 tempest-ServerActionsTestOtherA-968672787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1d6d57b-d21a-4928-9a4b-aaa1b864184e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a774c547-4c1b-4488-a78c-6fd485434966', 'volume_size': 1, 'image_id': '7005ba32-ec39-44a3-88d9-ca6af0b34ea0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7005ba32-ec39-44a3-88d9-ca6af0b34ea0', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '65b0d6d605b2427d8db787d4220dbeb4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7005ba32-ec39-44a3-88d9-ca6af0b34ea0', 'created_at': datetime.datetime(2026, 9, 6, 4, 25, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 6, 4, 25, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7005ba32-ec39-44a3-88d9-ca6af0b34ea0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:36:00 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-c7f77533-d59b-467b-a56a-8335fbec8917 tempest-ServerActionsTestOtherA-968672787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46ce93e1-506b-46fb-a1a9-a8fd6f10efaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:36:00 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-c7f77533-d59b-467b-a56a-8335fbec8917 tempest-ServerActionsTestOtherA-968672787 None] Volume volume-a774c547-4c1b-4488-a78c-6fd485434966 (a774c547-4c1b-4488-a78c-6fd485434966): created successfully Sep 06 06:36:00 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-c7f77533-d59b-467b-a56a-8335fbec8917 tempest-ServerActionsTestOtherA-968672787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46ce93e1-506b-46fb-a1a9-a8fd6f10efaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:36:00 devstack sudo[93662]: pam_unix(sudo:session): session closed for user root Sep 06 06:36:00 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-c7f77533-d59b-467b-a56a-8335fbec8917 tempest-ServerActionsTestOtherA-968672787 None] Flow 'volume_create_manager' (3a4c5549-ab14-485b-941c-0e405af38713) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:36:00 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-c4a1f52d-8511-4dd0-a077-990438d5115a tempest-VolumesNegativeTest-1417748630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.299s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:36:00 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-c4a1f52d-8511-4dd0-a077-990438d5115a tempest-VolumesNegativeTest-1417748630 None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:36:00 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-c7f77533-d59b-467b-a56a-8335fbec8917 tempest-ServerActionsTestOtherA-968672787 None] Created volume successfully. Sep 06 06:36:00 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-c4a1f52d-8511-4dd0-a077-990438d5115a tempest-VolumesNegativeTest-1417748630 None] Deleted volume successfully. Sep 06 06:36:00 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-c4a1f52d-8511-4dd0-a077-990438d5115a tempest-VolumesNegativeTest-1417748630 None] Lock "cinder-5f875b45-01c0-4226-8d15-95ee8beee44d-delete_volume" released by "delete_volume" :: held 1.301s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:36:00 devstack sudo[93666]: pam_unix(sudo:session): session closed for user root Sep 06 06:36:00 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-a9c19419-3414-4c22-bbca-be02aff07481 tempest-SnapshotsActionsTest-353968158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-074ce519-1402-4842-9c17-e462a1f53c7c.719717da-f08d-473f-9308-d29b2eb0639a" returned: 0 in 0.420s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:36:00 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-a9c19419-3414-4c22-bbca-be02aff07481 tempest-SnapshotsActionsTest-353968158 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-074ce519-1402-4842-9c17-e462a1f53c7c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87329) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 06:36:00 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-a9c19419-3414-4c22-bbca-be02aff07481 tempest-SnapshotsActionsTest-353968158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-074ce519-1402-4842-9c17-e462a1f53c7c.77571ccb-7a0e-4a22-b30c-69e35ccb778e {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:36:00 devstack sudo[93673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-074ce519-1402-4842-9c17-e462a1f53c7c.77571ccb-7a0e-4a22-b30c-69e35ccb778e Sep 06 06:36:00 devstack sudo[93673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:36:01 devstack sudo[93673]: pam_unix(sudo:session): session closed for user root Sep 06 06:36:01 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-a9c19419-3414-4c22-bbca-be02aff07481 tempest-SnapshotsActionsTest-353968158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-074ce519-1402-4842-9c17-e462a1f53c7c.77571ccb-7a0e-4a22-b30c-69e35ccb778e" returned: 0 in 0.425s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:36:01 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-a9c19419-3414-4c22-bbca-be02aff07481 tempest-SnapshotsActionsTest-353968158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-074ce519-1402-4842-9c17-e462a1f53c7c.77571ccb-7a0e-4a22-b30c-69e35ccb778e {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:36:01 devstack sudo[93679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-074ce519-1402-4842-9c17-e462a1f53c7c.77571ccb-7a0e-4a22-b30c-69e35ccb778e Sep 06 06:36:01 devstack sudo[93679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:36:01 devstack sudo[93679]: pam_unix(sudo:session): session closed for user root Sep 06 06:36:01 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-a9c19419-3414-4c22-bbca-be02aff07481 tempest-SnapshotsActionsTest-353968158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-074ce519-1402-4842-9c17-e462a1f53c7c.77571ccb-7a0e-4a22-b30c-69e35ccb778e" returned: 0 in 0.315s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:36:01 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-a9c19419-3414-4c22-bbca-be02aff07481 tempest-SnapshotsActionsTest-353968158 None] Lock "cinder-quobyte-77571ccb-7a0e-4a22-b30c-69e35ccb778e" released by "_delete_snapshot" :: held 1.718s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:36:01 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-a9c19419-3414-4c22-bbca-be02aff07481 tempest-SnapshotsActionsTest-353968158 None] Lock "cinder-quobyte-074ce519-1402-4842-9c17-e462a1f53c7c" released by "delete_snapshot" :: held 1.750s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:36:01 devstack cinder-volume[87329]: WARNING cinder.quota [None req-a9c19419-3414-4c22-bbca-be02aff07481 tempest-SnapshotsActionsTest-353968158 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 06 06:36:01 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-a9c19419-3414-4c22-bbca-be02aff07481 tempest-SnapshotsActionsTest-353968158 None] Created reservations ['38b1f06e-2189-4fb8-9346-9d27a02c1f20', '197c248b-9d6f-4fb4-84d6-ad685618efda', 'a8e713e1-fd4b-480f-b704-fe74b32290f5', '3075184c-ea3e-4539-8ff8-28e43396a4ff'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:36:01 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-a9c19419-3414-4c22-bbca-be02aff07481 tempest-SnapshotsActionsTest-353968158 None] Delete snapshot completed successfully. Sep 06 06:36:01 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-a9c19419-3414-4c22-bbca-be02aff07481 tempest-SnapshotsActionsTest-353968158 None] Lock "cinder-77571ccb-7a0e-4a22-b30c-69e35ccb778e-delete_snapshot" released by "delete_snapshot" :: held 1.942s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:36:02 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-248ce1a0-be97-4dc1-bfea-ad0c2bffc593 tempest-AttachVolumeNegativeTest-1315254098 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87329) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 06:36:02 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-248ce1a0-be97-4dc1-bfea-ad0c2bffc593 tempest-AttachVolumeNegativeTest-1315254098 None] Flow 'volume_create_manager' (d8b537b4-0917-494e-a528-e5d5c3c6c8b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:36:02 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-248ce1a0-be97-4dc1-bfea-ad0c2bffc593 tempest-AttachVolumeNegativeTest-1315254098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8822d08a-12f6-43fd-8009-b636ea5a4da7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:36:02 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-248ce1a0-be97-4dc1-bfea-ad0c2bffc593 tempest-AttachVolumeNegativeTest-1315254098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8822d08a-12f6-43fd-8009-b636ea5a4da7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:36:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-811985221',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cab89b28-c971-48a8-886b-419aeeb758ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ca696acace14cfdab93b2b90cc77cee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:36:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:36:02Z,use_quota=True,user_id='3df09a7695104f7595ec6e6d40af53be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:36:02 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-248ce1a0-be97-4dc1-bfea-ad0c2bffc593 tempest-AttachVolumeNegativeTest-1315254098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57bee19f-47fe-4a1d-bba0-a5fa18e16fa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:36:02 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-248ce1a0-be97-4dc1-bfea-ad0c2bffc593 tempest-AttachVolumeNegativeTest-1315254098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57bee19f-47fe-4a1d-bba0-a5fa18e16fa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:36:02 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-248ce1a0-be97-4dc1-bfea-ad0c2bffc593 tempest-AttachVolumeNegativeTest-1315254098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbd7a462-dd16-436d-9c2a-a553ecd87da8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:36:02 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-248ce1a0-be97-4dc1-bfea-ad0c2bffc593 tempest-AttachVolumeNegativeTest-1315254098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbd7a462-dd16-436d-9c2a-a553ecd87da8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cab89b28-c971-48a8-886b-419aeeb758ea', 'volume_name': 'volume-cab89b28-c971-48a8-886b-419aeeb758ea', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:36:02 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-248ce1a0-be97-4dc1-bfea-ad0c2bffc593 tempest-AttachVolumeNegativeTest-1315254098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38aa363c-56d1-4ae4-a3b6-59d5c159b5ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:36:02 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-248ce1a0-be97-4dc1-bfea-ad0c2bffc593 tempest-AttachVolumeNegativeTest-1315254098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38aa363c-56d1-4ae4-a3b6-59d5c159b5ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:36:02 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-248ce1a0-be97-4dc1-bfea-ad0c2bffc593 tempest-AttachVolumeNegativeTest-1315254098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d672c00d-4b51-40f2-b07b-6a4ec52b0d5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:36:02 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-248ce1a0-be97-4dc1-bfea-ad0c2bffc593 tempest-AttachVolumeNegativeTest-1315254098 None] Volume cab89b28-c971-48a8-886b-419aeeb758ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cab89b28-c971-48a8-886b-419aeeb758ea', 'volume_size': 1} Sep 06 06:36:02 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-248ce1a0-be97-4dc1-bfea-ad0c2bffc593 tempest-AttachVolumeNegativeTest-1315254098 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:36:02 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-248ce1a0-be97-4dc1-bfea-ad0c2bffc593 tempest-AttachVolumeNegativeTest-1315254098 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.008s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:36:02 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-248ce1a0-be97-4dc1-bfea-ad0c2bffc593 tempest-AttachVolumeNegativeTest-1315254098 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:36:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-811985221',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cab89b28-c971-48a8-886b-419aeeb758ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ca696acace14cfdab93b2b90cc77cee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:36:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:36:02Z,use_quota=True,user_id='3df09a7695104f7595ec6e6d40af53be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)}" {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 06:36:02 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-248ce1a0-be97-4dc1-bfea-ad0c2bffc593 tempest-AttachVolumeNegativeTest-1315254098 None] Creating volume cab89b28-c971-48a8-886b-419aeeb758ea {{(pid=87329) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 06:36:02 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-248ce1a0-be97-4dc1-bfea-ad0c2bffc593 tempest-AttachVolumeNegativeTest-1315254098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:36:02 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-248ce1a0-be97-4dc1-bfea-ad0c2bffc593 tempest-AttachVolumeNegativeTest-1315254098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:36:02 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-248ce1a0-be97-4dc1-bfea-ad0c2bffc593 tempest-AttachVolumeNegativeTest-1315254098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:36:02 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-248ce1a0-be97-4dc1-bfea-ad0c2bffc593 tempest-AttachVolumeNegativeTest-1315254098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:36:02 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-248ce1a0-be97-4dc1-bfea-ad0c2bffc593 tempest-AttachVolumeNegativeTest-1315254098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:36:02 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-248ce1a0-be97-4dc1-bfea-ad0c2bffc593 tempest-AttachVolumeNegativeTest-1315254098 None] Selected osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 as target Quobyte volume. {{(pid=87329) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 06:36:02 devstack cinder-volume[87329]: INFO cinder.volume.drivers.remotefs [None req-248ce1a0-be97-4dc1-bfea-ad0c2bffc593 tempest-AttachVolumeNegativeTest-1315254098 None] casted to osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 Sep 06 06:36:02 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-248ce1a0-be97-4dc1-bfea-ad0c2bffc593 tempest-AttachVolumeNegativeTest-1315254098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-cab89b28-c971-48a8-886b-419aeeb758ea 1073741824 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:36:02 devstack sudo[93685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-cab89b28-c971-48a8-886b-419aeeb758ea 1073741824 Sep 06 06:36:02 devstack sudo[93685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:36:02 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-f02929ba-131f-4486-953f-4316ed064d29 tempest-SnapshotsActionsTest-1031586015 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:36:03 devstack sudo[93685]: pam_unix(sudo:session): session closed for user root Sep 06 06:36:03 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-248ce1a0-be97-4dc1-bfea-ad0c2bffc593 tempest-AttachVolumeNegativeTest-1315254098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-cab89b28-c971-48a8-886b-419aeeb758ea 1073741824" returned: 0 in 0.518s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:36:03 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-248ce1a0-be97-4dc1-bfea-ad0c2bffc593 tempest-AttachVolumeNegativeTest-1315254098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-cab89b28-c971-48a8-886b-419aeeb758ea {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:36:03 devstack sudo[93694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-cab89b28-c971-48a8-886b-419aeeb758ea Sep 06 06:36:03 devstack sudo[93694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:36:03 devstack sudo[93694]: pam_unix(sudo:session): session closed for user root Sep 06 06:36:03 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-248ce1a0-be97-4dc1-bfea-ad0c2bffc593 tempest-AttachVolumeNegativeTest-1315254098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-cab89b28-c971-48a8-886b-419aeeb758ea" returned: 0 in 0.324s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:36:03 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-248ce1a0-be97-4dc1-bfea-ad0c2bffc593 tempest-AttachVolumeNegativeTest-1315254098 None] <== create_volume: return (896ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'} {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 06:36:03 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-248ce1a0-be97-4dc1-bfea-ad0c2bffc593 tempest-AttachVolumeNegativeTest-1315254098 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.900s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:36:03 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-f02929ba-131f-4486-953f-4316ed064d29 tempest-SnapshotsActionsTest-1031586015 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.815s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:36:03 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-248ce1a0-be97-4dc1-bfea-ad0c2bffc593 tempest-AttachVolumeNegativeTest-1315254098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d672c00d-4b51-40f2-b07b-6a4ec52b0d5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cab89b28-c971-48a8-886b-419aeeb758ea', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:36:03 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-248ce1a0-be97-4dc1-bfea-ad0c2bffc593 tempest-AttachVolumeNegativeTest-1315254098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8468383b-246e-4ac1-ae2e-71f8ebb9dd00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:36:03 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-f02929ba-131f-4486-953f-4316ed064d29 tempest-SnapshotsActionsTest-1031586015 None] Creating offline snapshot 6710fe17-8dcd-4a73-8233-4350ced0c953 of volume 074ce519-1402-4842-9c17-e462a1f53c7c {{(pid=87329) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 06 06:36:03 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-248ce1a0-be97-4dc1-bfea-ad0c2bffc593 tempest-AttachVolumeNegativeTest-1315254098 None] Volume volume-cab89b28-c971-48a8-886b-419aeeb758ea (cab89b28-c971-48a8-886b-419aeeb758ea): created successfully Sep 06 06:36:03 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-248ce1a0-be97-4dc1-bfea-ad0c2bffc593 tempest-AttachVolumeNegativeTest-1315254098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8468383b-246e-4ac1-ae2e-71f8ebb9dd00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:36:03 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-248ce1a0-be97-4dc1-bfea-ad0c2bffc593 tempest-AttachVolumeNegativeTest-1315254098 None] Flow 'volume_create_manager' (d8b537b4-0917-494e-a528-e5d5c3c6c8b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:36:03 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[38461228-0cb3-4df4-ba06-8ffa2b9676bd]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:36:03 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-f02929ba-131f-4486-953f-4316ed064d29 tempest-SnapshotsActionsTest-1031586015 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-074ce519-1402-4842-9c17-e462a1f53c7c.719717da-f08d-473f-9308-d29b2eb0639a {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:36:03 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-248ce1a0-be97-4dc1-bfea-ad0c2bffc593 tempest-AttachVolumeNegativeTest-1315254098 None] Created volume successfully. Sep 06 06:36:03 devstack sudo[93705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-074ce519-1402-4842-9c17-e462a1f53c7c.719717da-f08d-473f-9308-d29b2eb0639a Sep 06 06:36:03 devstack sudo[93705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:36:04 devstack sudo[93705]: pam_unix(sudo:session): session closed for user root Sep 06 06:36:04 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-f02929ba-131f-4486-953f-4316ed064d29 tempest-SnapshotsActionsTest-1031586015 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-074ce519-1402-4842-9c17-e462a1f53c7c.719717da-f08d-473f-9308-d29b2eb0639a" returned: 0 in 0.477s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:36:04 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-f02929ba-131f-4486-953f-4316ed064d29 tempest-SnapshotsActionsTest-1031586015 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-074ce519-1402-4842-9c17-e462a1f53c7c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87329) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 06:36:04 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-f02929ba-131f-4486-953f-4316ed064d29 tempest-SnapshotsActionsTest-1031586015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-074ce519-1402-4842-9c17-e462a1f53c7c.719717da-f08d-473f-9308-d29b2eb0639a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-074ce519-1402-4842-9c17-e462a1f53c7c.6710fe17-8dcd-4a73-8233-4350ced0c953 1G {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:36:04 devstack sudo[93722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-074ce519-1402-4842-9c17-e462a1f53c7c.719717da-f08d-473f-9308-d29b2eb0639a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-074ce519-1402-4842-9c17-e462a1f53c7c.6710fe17-8dcd-4a73-8233-4350ced0c953 1G Sep 06 06:36:04 devstack sudo[93722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:36:04 devstack sudo[93722]: pam_unix(sudo:session): session closed for user root Sep 06 06:36:04 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-f02929ba-131f-4486-953f-4316ed064d29 tempest-SnapshotsActionsTest-1031586015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-074ce519-1402-4842-9c17-e462a1f53c7c.719717da-f08d-473f-9308-d29b2eb0639a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-074ce519-1402-4842-9c17-e462a1f53c7c.6710fe17-8dcd-4a73-8233-4350ced0c953 1G" returned: 0 in 0.619s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:36:04 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-f02929ba-131f-4486-953f-4316ed064d29 tempest-SnapshotsActionsTest-1031586015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-074ce519-1402-4842-9c17-e462a1f53c7c.719717da-f08d-473f-9308-d29b2eb0639a -F qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-074ce519-1402-4842-9c17-e462a1f53c7c.6710fe17-8dcd-4a73-8233-4350ced0c953 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:36:04 devstack sudo[93729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-074ce519-1402-4842-9c17-e462a1f53c7c.719717da-f08d-473f-9308-d29b2eb0639a -F qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-074ce519-1402-4842-9c17-e462a1f53c7c.6710fe17-8dcd-4a73-8233-4350ced0c953 Sep 06 06:36:04 devstack sudo[93729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:36:04 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-874ef4b0-06d4-4bf9-bbbe-58b26d0937bc tempest-VolumesSnapshotListTestJSON-1542588238 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87329) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 06:36:05 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-874ef4b0-06d4-4bf9-bbbe-58b26d0937bc tempest-VolumesSnapshotListTestJSON-1542588238 None] Flow 'volume_create_manager' (adeaaa10-efdb-4b7c-baa3-10e00a0fa9b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:36:05 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-874ef4b0-06d4-4bf9-bbbe-58b26d0937bc tempest-VolumesSnapshotListTestJSON-1542588238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87a550f3-e537-480c-85ca-bcea4986349c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:36:05 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-874ef4b0-06d4-4bf9-bbbe-58b26d0937bc tempest-VolumesSnapshotListTestJSON-1542588238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87a550f3-e537-480c-85ca-bcea4986349c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:36:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-679888649',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbd7169e-4b49-4218-b985-e33207c190e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d4ca919b79547e083c752dd3ab81355',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:36:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:36:05Z,use_quota=True,user_id='7095a094ad03428fb0b508a5de6c470b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:36:05 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-874ef4b0-06d4-4bf9-bbbe-58b26d0937bc tempest-VolumesSnapshotListTestJSON-1542588238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6241174c-f529-4c22-9594-153271017bb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:36:05 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-874ef4b0-06d4-4bf9-bbbe-58b26d0937bc tempest-VolumesSnapshotListTestJSON-1542588238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6241174c-f529-4c22-9594-153271017bb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:36:05 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-874ef4b0-06d4-4bf9-bbbe-58b26d0937bc tempest-VolumesSnapshotListTestJSON-1542588238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3baa1a00-87fc-4d65-bfa5-eac40b5bea99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:36:05 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-874ef4b0-06d4-4bf9-bbbe-58b26d0937bc tempest-VolumesSnapshotListTestJSON-1542588238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3baa1a00-87fc-4d65-bfa5-eac40b5bea99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bbd7169e-4b49-4218-b985-e33207c190e1', 'volume_name': 'volume-bbd7169e-4b49-4218-b985-e33207c190e1', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:36:05 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-874ef4b0-06d4-4bf9-bbbe-58b26d0937bc tempest-VolumesSnapshotListTestJSON-1542588238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d38bfda2-3807-4c1f-a34f-2cf229a7fc6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:36:05 devstack sudo[93729]: pam_unix(sudo:session): session closed for user root Sep 06 06:36:05 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-874ef4b0-06d4-4bf9-bbbe-58b26d0937bc tempest-VolumesSnapshotListTestJSON-1542588238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d38bfda2-3807-4c1f-a34f-2cf229a7fc6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:36:05 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-874ef4b0-06d4-4bf9-bbbe-58b26d0937bc tempest-VolumesSnapshotListTestJSON-1542588238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fb5ff18-f2eb-404b-b4ab-bdc505676880) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:36:05 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-874ef4b0-06d4-4bf9-bbbe-58b26d0937bc tempest-VolumesSnapshotListTestJSON-1542588238 None] Volume bbd7169e-4b49-4218-b985-e33207c190e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bbd7169e-4b49-4218-b985-e33207c190e1', 'volume_size': 1} Sep 06 06:36:05 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-874ef4b0-06d4-4bf9-bbbe-58b26d0937bc tempest-VolumesSnapshotListTestJSON-1542588238 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:36:05 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-f02929ba-131f-4486-953f-4316ed064d29 tempest-SnapshotsActionsTest-1031586015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-074ce519-1402-4842-9c17-e462a1f53c7c.719717da-f08d-473f-9308-d29b2eb0639a -F qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-074ce519-1402-4842-9c17-e462a1f53c7c.6710fe17-8dcd-4a73-8233-4350ced0c953" returned: 0 in 0.401s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:36:05 devstack cinder-volume[87329]: WARNING cinder.volume.drivers.remotefs [None req-f02929ba-131f-4486-953f-4316ed064d29 tempest-SnapshotsActionsTest-1031586015 None] /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-074ce519-1402-4842-9c17-e462a1f53c7c.6710fe17-8dcd-4a73-8233-4350ced0c953 is being set with open permissions: ugo+rw Sep 06 06:36:05 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-f02929ba-131f-4486-953f-4316ed064d29 tempest-SnapshotsActionsTest-1031586015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-074ce519-1402-4842-9c17-e462a1f53c7c.6710fe17-8dcd-4a73-8233-4350ced0c953 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:36:05 devstack sudo[93740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-074ce519-1402-4842-9c17-e462a1f53c7c.6710fe17-8dcd-4a73-8233-4350ced0c953 Sep 06 06:36:05 devstack sudo[93740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:36:05 devstack sudo[93740]: pam_unix(sudo:session): session closed for user root Sep 06 06:36:05 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-f02929ba-131f-4486-953f-4316ed064d29 tempest-SnapshotsActionsTest-1031586015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-074ce519-1402-4842-9c17-e462a1f53c7c.6710fe17-8dcd-4a73-8233-4350ced0c953" returned: 0 in 0.308s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:36:05 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-f02929ba-131f-4486-953f-4316ed064d29 tempest-SnapshotsActionsTest-1031586015 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.015s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:36:05 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-874ef4b0-06d4-4bf9-bbbe-58b26d0937bc tempest-VolumesSnapshotListTestJSON-1542588238 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.361s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:36:05 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-874ef4b0-06d4-4bf9-bbbe-58b26d0937bc tempest-VolumesSnapshotListTestJSON-1542588238 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:36:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-679888649',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbd7169e-4b49-4218-b985-e33207c190e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d4ca919b79547e083c752dd3ab81355',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:36:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:36:05Z,use_quota=True,user_id='7095a094ad03428fb0b508a5de6c470b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)}" {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 06:36:05 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-874ef4b0-06d4-4bf9-bbbe-58b26d0937bc tempest-VolumesSnapshotListTestJSON-1542588238 None] Creating volume bbd7169e-4b49-4218-b985-e33207c190e1 {{(pid=87329) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 06:36:05 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-874ef4b0-06d4-4bf9-bbbe-58b26d0937bc tempest-VolumesSnapshotListTestJSON-1542588238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:36:05 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-874ef4b0-06d4-4bf9-bbbe-58b26d0937bc tempest-VolumesSnapshotListTestJSON-1542588238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:36:05 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-874ef4b0-06d4-4bf9-bbbe-58b26d0937bc tempest-VolumesSnapshotListTestJSON-1542588238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:36:05 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-874ef4b0-06d4-4bf9-bbbe-58b26d0937bc tempest-VolumesSnapshotListTestJSON-1542588238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:36:05 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-874ef4b0-06d4-4bf9-bbbe-58b26d0937bc tempest-VolumesSnapshotListTestJSON-1542588238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:36:05 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-874ef4b0-06d4-4bf9-bbbe-58b26d0937bc tempest-VolumesSnapshotListTestJSON-1542588238 None] Selected osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 as target Quobyte volume. {{(pid=87329) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 06:36:05 devstack cinder-volume[87329]: INFO cinder.volume.drivers.remotefs [None req-874ef4b0-06d4-4bf9-bbbe-58b26d0937bc tempest-VolumesSnapshotListTestJSON-1542588238 None] casted to osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 Sep 06 06:36:05 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-874ef4b0-06d4-4bf9-bbbe-58b26d0937bc tempest-VolumesSnapshotListTestJSON-1542588238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bbd7169e-4b49-4218-b985-e33207c190e1 1073741824 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:36:05 devstack sudo[93751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bbd7169e-4b49-4218-b985-e33207c190e1 1073741824 Sep 06 06:36:05 devstack sudo[93751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:36:05 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [req-02f50d80-097c-4933-8783-6ebfd064085a req-82b9bb47-acc6-45db-9410-b971dd24a495 tempest-ServerActionsTestOtherA-968672787 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:36:05 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-f02929ba-131f-4486-953f-4316ed064d29 tempest-SnapshotsActionsTest-1031586015 None] Create snapshot completed successfully Sep 06 06:36:05 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [req-51663b41-0b6b-4883-bf0c-ea9237a76f0b req-3bd2472b-af1d-4e23-943e-d4e4dfd1032a tempest-AttachVolumeNegativeTest-1315254098 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:36:06 devstack sudo[93751]: pam_unix(sudo:session): session closed for user root Sep 06 06:36:06 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-874ef4b0-06d4-4bf9-bbbe-58b26d0937bc tempest-VolumesSnapshotListTestJSON-1542588238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bbd7169e-4b49-4218-b985-e33207c190e1 1073741824" returned: 0 in 0.569s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:36:06 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-874ef4b0-06d4-4bf9-bbbe-58b26d0937bc tempest-VolumesSnapshotListTestJSON-1542588238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bbd7169e-4b49-4218-b985-e33207c190e1 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:36:06 devstack sudo[93766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bbd7169e-4b49-4218-b985-e33207c190e1 Sep 06 06:36:06 devstack sudo[93766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:36:06 devstack sudo[93766]: pam_unix(sudo:session): session closed for user root Sep 06 06:36:06 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-874ef4b0-06d4-4bf9-bbbe-58b26d0937bc tempest-VolumesSnapshotListTestJSON-1542588238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bbd7169e-4b49-4218-b985-e33207c190e1" returned: 0 in 0.269s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:36:06 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-874ef4b0-06d4-4bf9-bbbe-58b26d0937bc tempest-VolumesSnapshotListTestJSON-1542588238 None] <== create_volume: return (881ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'} {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 06:36:06 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-874ef4b0-06d4-4bf9-bbbe-58b26d0937bc tempest-VolumesSnapshotListTestJSON-1542588238 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.885s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:36:06 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [req-02f50d80-097c-4933-8783-6ebfd064085a req-82b9bb47-acc6-45db-9410-b971dd24a495 tempest-ServerActionsTestOtherA-968672787 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.819s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:36:06 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-874ef4b0-06d4-4bf9-bbbe-58b26d0937bc tempest-VolumesSnapshotListTestJSON-1542588238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fb5ff18-f2eb-404b-b4ab-bdc505676880) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bbd7169e-4b49-4218-b985-e33207c190e1', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:36:06 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-874ef4b0-06d4-4bf9-bbbe-58b26d0937bc tempest-VolumesSnapshotListTestJSON-1542588238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7b6db4f-4296-4e60-aa7b-bfbdc96dfd36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:36:06 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [req-02f50d80-097c-4933-8783-6ebfd064085a req-82b9bb47-acc6-45db-9410-b971dd24a495 tempest-ServerActionsTestOtherA-968672787 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.029s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:36:06 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [req-51663b41-0b6b-4883-bf0c-ea9237a76f0b req-3bd2472b-af1d-4e23-943e-d4e4dfd1032a tempest-AttachVolumeNegativeTest-1315254098 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.407s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:36:06 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-874ef4b0-06d4-4bf9-bbbe-58b26d0937bc tempest-VolumesSnapshotListTestJSON-1542588238 None] Volume volume-bbd7169e-4b49-4218-b985-e33207c190e1 (bbd7169e-4b49-4218-b985-e33207c190e1): created successfully Sep 06 06:36:06 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-874ef4b0-06d4-4bf9-bbbe-58b26d0937bc tempest-VolumesSnapshotListTestJSON-1542588238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7b6db4f-4296-4e60-aa7b-bfbdc96dfd36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:36:06 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-874ef4b0-06d4-4bf9-bbbe-58b26d0937bc tempest-VolumesSnapshotListTestJSON-1542588238 None] Flow 'volume_create_manager' (adeaaa10-efdb-4b7c-baa3-10e00a0fa9b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:36:06 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [req-51663b41-0b6b-4883-bf0c-ea9237a76f0b req-3bd2472b-af1d-4e23-943e-d4e4dfd1032a tempest-AttachVolumeNegativeTest-1315254098 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.040s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:36:06 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-874ef4b0-06d4-4bf9-bbbe-58b26d0937bc tempest-VolumesSnapshotListTestJSON-1542588238 None] Created volume successfully. Sep 06 06:36:06 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [req-02f50d80-097c-4933-8783-6ebfd064085a req-82b9bb47-acc6-45db-9410-b971dd24a495 tempest-ServerActionsTestOtherA-968672787 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6', 'name': 'volume-a774c547-4c1b-4488-a78c-6fd485434966', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5c80d499-9515-40eb-9689-06510ae453f1', 'enforce_multipath': True} {{(pid=87329) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 06 06:36:06 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [req-51663b41-0b6b-4883-bf0c-ea9237a76f0b req-3bd2472b-af1d-4e23-943e-d4e4dfd1032a tempest-AttachVolumeNegativeTest-1315254098 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6', 'name': 'volume-cab89b28-c971-48a8-886b-419aeeb758ea', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a0d5101c-10f1-492d-b904-03cea39d949d', 'enforce_multipath': True} {{(pid=87329) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 06 06:36:06 devstack cinder-volume[87329]: INFO cinder.volume.manager [req-02f50d80-097c-4933-8783-6ebfd064085a req-82b9bb47-acc6-45db-9410-b971dd24a495 tempest-ServerActionsTestOtherA-968672787 None] attachment_update completed successfully. Sep 06 06:36:06 devstack cinder-volume[87329]: INFO cinder.volume.manager [req-51663b41-0b6b-4883-bf0c-ea9237a76f0b req-3bd2472b-af1d-4e23-943e-d4e4dfd1032a tempest-AttachVolumeNegativeTest-1315254098 None] attachment_update completed successfully. Sep 06 06:36:06 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-772d196e-3699-46c5-9cdd-27cb50e3b4cc tempest-SnapshotsActionsTest-353968158 None] Acquiring lock "cinder-6710fe17-8dcd-4a73-8233-4350ced0c953-delete_snapshot" by "delete_snapshot" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:36:06 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-772d196e-3699-46c5-9cdd-27cb50e3b4cc tempest-SnapshotsActionsTest-353968158 None] Lock "cinder-6710fe17-8dcd-4a73-8233-4350ced0c953-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:36:06 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-772d196e-3699-46c5-9cdd-27cb50e3b4cc tempest-SnapshotsActionsTest-353968158 None] Acquiring lock "cinder-quobyte-074ce519-1402-4842-9c17-e462a1f53c7c" by "delete_snapshot" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:36:06 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-772d196e-3699-46c5-9cdd-27cb50e3b4cc tempest-SnapshotsActionsTest-353968158 None] Lock "cinder-quobyte-074ce519-1402-4842-9c17-e462a1f53c7c" acquired by "delete_snapshot" :: waited 0.043s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:36:06 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-772d196e-3699-46c5-9cdd-27cb50e3b4cc tempest-SnapshotsActionsTest-353968158 None] Acquiring lock "cinder-quobyte-6710fe17-8dcd-4a73-8233-4350ced0c953" by "_delete_snapshot" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:36:06 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-772d196e-3699-46c5-9cdd-27cb50e3b4cc tempest-SnapshotsActionsTest-353968158 None] Lock "cinder-quobyte-6710fe17-8dcd-4a73-8233-4350ced0c953" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:36:06 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-772d196e-3699-46c5-9cdd-27cb50e3b4cc tempest-SnapshotsActionsTest-353968158 None] Deleting offline snapshot 6710fe17-8dcd-4a73-8233-4350ced0c953 of volume 074ce519-1402-4842-9c17-e462a1f53c7c {{(pid=87329) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 06 06:36:06 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-772d196e-3699-46c5-9cdd-27cb50e3b4cc tempest-SnapshotsActionsTest-353968158 None] snapshot_file for this snap is: volume-074ce519-1402-4842-9c17-e462a1f53c7c.6710fe17-8dcd-4a73-8233-4350ced0c953 {{(pid=87329) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 06 06:36:06 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[287c057f-e9f0-4a21-b020-e86536e99c60]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:36:06 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-772d196e-3699-46c5-9cdd-27cb50e3b4cc tempest-SnapshotsActionsTest-353968158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-074ce519-1402-4842-9c17-e462a1f53c7c.6710fe17-8dcd-4a73-8233-4350ced0c953 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:36:07 devstack sudo[93837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-074ce519-1402-4842-9c17-e462a1f53c7c.6710fe17-8dcd-4a73-8233-4350ced0c953 Sep 06 06:36:07 devstack sudo[93837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:36:07 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-a0f4cde2-2d2c-4256-aaf0-1774fa2b525e tempest-VolumesSnapshotListTestJSON-1542588238 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:36:07 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-a0f4cde2-2d2c-4256-aaf0-1774fa2b525e tempest-VolumesSnapshotListTestJSON-1542588238 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:36:07 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-a0f4cde2-2d2c-4256-aaf0-1774fa2b525e tempest-VolumesSnapshotListTestJSON-1542588238 None] Creating offline snapshot 83c5d8e7-6431-48af-894b-20c1a94de7ab of volume bbd7169e-4b49-4218-b985-e33207c190e1 {{(pid=87329) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 06 06:36:07 devstack sudo[93837]: pam_unix(sudo:session): session closed for user root Sep 06 06:36:07 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-772d196e-3699-46c5-9cdd-27cb50e3b4cc tempest-SnapshotsActionsTest-353968158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-074ce519-1402-4842-9c17-e462a1f53c7c.6710fe17-8dcd-4a73-8233-4350ced0c953" returned: 0 in 0.447s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:36:07 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-772d196e-3699-46c5-9cdd-27cb50e3b4cc tempest-SnapshotsActionsTest-353968158 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-074ce519-1402-4842-9c17-e462a1f53c7c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87329) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 06:36:07 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[39ae1ec6-1111-4eeb-9d95-011a3705f840]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:36:07 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-a0f4cde2-2d2c-4256-aaf0-1774fa2b525e tempest-VolumesSnapshotListTestJSON-1542588238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bbd7169e-4b49-4218-b985-e33207c190e1 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:36:07 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aad6c2d-204b-430b-93c9-798425054c97]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:36:07 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-772d196e-3699-46c5-9cdd-27cb50e3b4cc tempest-SnapshotsActionsTest-353968158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-074ce519-1402-4842-9c17-e462a1f53c7c.719717da-f08d-473f-9308-d29b2eb0639a {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:36:07 devstack sudo[94160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bbd7169e-4b49-4218-b985-e33207c190e1 Sep 06 06:36:07 devstack sudo[94160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:36:07 devstack sudo[94161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-074ce519-1402-4842-9c17-e462a1f53c7c.719717da-f08d-473f-9308-d29b2eb0639a Sep 06 06:36:07 devstack sudo[94161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:36:07 devstack sudo[94160]: pam_unix(sudo:session): session closed for user root Sep 06 06:36:07 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-a0f4cde2-2d2c-4256-aaf0-1774fa2b525e tempest-VolumesSnapshotListTestJSON-1542588238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bbd7169e-4b49-4218-b985-e33207c190e1" returned: 0 in 0.549s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:36:07 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-a0f4cde2-2d2c-4256-aaf0-1774fa2b525e tempest-VolumesSnapshotListTestJSON-1542588238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bbd7169e-4b49-4218-b985-e33207c190e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bbd7169e-4b49-4218-b985-e33207c190e1.83c5d8e7-6431-48af-894b-20c1a94de7ab 1G {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:36:07 devstack sudo[94170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bbd7169e-4b49-4218-b985-e33207c190e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bbd7169e-4b49-4218-b985-e33207c190e1.83c5d8e7-6431-48af-894b-20c1a94de7ab 1G Sep 06 06:36:07 devstack sudo[94170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:36:08 devstack sudo[94161]: pam_unix(sudo:session): session closed for user root Sep 06 06:36:08 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-772d196e-3699-46c5-9cdd-27cb50e3b4cc tempest-SnapshotsActionsTest-353968158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-074ce519-1402-4842-9c17-e462a1f53c7c.719717da-f08d-473f-9308-d29b2eb0639a" returned: 0 in 0.626s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:36:08 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-772d196e-3699-46c5-9cdd-27cb50e3b4cc tempest-SnapshotsActionsTest-353968158 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-074ce519-1402-4842-9c17-e462a1f53c7c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87329) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 06:36:08 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-772d196e-3699-46c5-9cdd-27cb50e3b4cc tempest-SnapshotsActionsTest-353968158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-074ce519-1402-4842-9c17-e462a1f53c7c.6710fe17-8dcd-4a73-8233-4350ced0c953 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:36:08 devstack sudo[94173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-074ce519-1402-4842-9c17-e462a1f53c7c.6710fe17-8dcd-4a73-8233-4350ced0c953 Sep 06 06:36:08 devstack sudo[94173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:36:08 devstack sudo[94170]: pam_unix(sudo:session): session closed for user root Sep 06 06:36:08 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-a0f4cde2-2d2c-4256-aaf0-1774fa2b525e tempest-VolumesSnapshotListTestJSON-1542588238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bbd7169e-4b49-4218-b985-e33207c190e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bbd7169e-4b49-4218-b985-e33207c190e1.83c5d8e7-6431-48af-894b-20c1a94de7ab 1G" returned: 0 in 0.744s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:36:08 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-a0f4cde2-2d2c-4256-aaf0-1774fa2b525e tempest-VolumesSnapshotListTestJSON-1542588238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bbd7169e-4b49-4218-b985-e33207c190e1 -F qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bbd7169e-4b49-4218-b985-e33207c190e1.83c5d8e7-6431-48af-894b-20c1a94de7ab {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:36:08 devstack sudo[94173]: pam_unix(sudo:session): session closed for user root Sep 06 06:36:08 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-772d196e-3699-46c5-9cdd-27cb50e3b4cc tempest-SnapshotsActionsTest-353968158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-074ce519-1402-4842-9c17-e462a1f53c7c.6710fe17-8dcd-4a73-8233-4350ced0c953" returned: 0 in 0.693s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:36:08 devstack sudo[94195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bbd7169e-4b49-4218-b985-e33207c190e1 -F qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bbd7169e-4b49-4218-b985-e33207c190e1.83c5d8e7-6431-48af-894b-20c1a94de7ab Sep 06 06:36:08 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-772d196e-3699-46c5-9cdd-27cb50e3b4cc tempest-SnapshotsActionsTest-353968158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-074ce519-1402-4842-9c17-e462a1f53c7c.6710fe17-8dcd-4a73-8233-4350ced0c953 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:36:08 devstack sudo[94195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:36:08 devstack sudo[94201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-074ce519-1402-4842-9c17-e462a1f53c7c.6710fe17-8dcd-4a73-8233-4350ced0c953 Sep 06 06:36:08 devstack sudo[94201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:36:09 devstack sudo[94201]: pam_unix(sudo:session): session closed for user root Sep 06 06:36:09 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-772d196e-3699-46c5-9cdd-27cb50e3b4cc tempest-SnapshotsActionsTest-353968158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-074ce519-1402-4842-9c17-e462a1f53c7c.6710fe17-8dcd-4a73-8233-4350ced0c953" returned: 0 in 0.403s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:36:09 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-772d196e-3699-46c5-9cdd-27cb50e3b4cc tempest-SnapshotsActionsTest-353968158 None] Lock "cinder-quobyte-6710fe17-8dcd-4a73-8233-4350ced0c953" released by "_delete_snapshot" :: held 2.343s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:36:09 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-772d196e-3699-46c5-9cdd-27cb50e3b4cc tempest-SnapshotsActionsTest-353968158 None] Lock "cinder-quobyte-074ce519-1402-4842-9c17-e462a1f53c7c" released by "delete_snapshot" :: held 2.380s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:36:09 devstack sudo[94195]: pam_unix(sudo:session): session closed for user root Sep 06 06:36:09 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-a0f4cde2-2d2c-4256-aaf0-1774fa2b525e tempest-VolumesSnapshotListTestJSON-1542588238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bbd7169e-4b49-4218-b985-e33207c190e1 -F qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bbd7169e-4b49-4218-b985-e33207c190e1.83c5d8e7-6431-48af-894b-20c1a94de7ab" returned: 0 in 0.605s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:36:09 devstack cinder-volume[87329]: WARNING cinder.volume.drivers.remotefs [None req-a0f4cde2-2d2c-4256-aaf0-1774fa2b525e tempest-VolumesSnapshotListTestJSON-1542588238 None] /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bbd7169e-4b49-4218-b985-e33207c190e1.83c5d8e7-6431-48af-894b-20c1a94de7ab is being set with open permissions: ugo+rw Sep 06 06:36:09 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-a0f4cde2-2d2c-4256-aaf0-1774fa2b525e tempest-VolumesSnapshotListTestJSON-1542588238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bbd7169e-4b49-4218-b985-e33207c190e1.83c5d8e7-6431-48af-894b-20c1a94de7ab {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:36:09 devstack cinder-volume[87329]: INFO cinder.volume.manager [req-58217dff-6e8b-4ba0-811c-bd2192558d06 req-ee66e1d4-96cc-48d9-8297-2f4f6394eafd tempest-AttachVolumeNegativeTest-1315254098 None] Terminate volume connection completed successfully. Sep 06 06:36:09 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [req-58217dff-6e8b-4ba0-811c-bd2192558d06 req-ee66e1d4-96cc-48d9-8297-2f4f6394eafd tempest-AttachVolumeNegativeTest-1315254098 None] Deleting attachment a0d5101c-10f1-492d-b904-03cea39d949d. {{(pid=87329) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 06 06:36:09 devstack sudo[94231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bbd7169e-4b49-4218-b985-e33207c190e1.83c5d8e7-6431-48af-894b-20c1a94de7ab Sep 06 06:36:09 devstack sudo[94231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:36:09 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-772d196e-3699-46c5-9cdd-27cb50e3b4cc tempest-SnapshotsActionsTest-353968158 None] Created reservations ['bf935835-cede-4570-b783-6f5a7ed749c4', 'a4000e55-9ef9-4159-b00b-38a4aa9b4e5b', 'f143e4ca-2cda-487e-a046-09966221e4c1', 'f63a63e0-276e-406c-84ff-6f8525755312'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:36:09 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-772d196e-3699-46c5-9cdd-27cb50e3b4cc tempest-SnapshotsActionsTest-353968158 None] Delete snapshot completed successfully. Sep 06 06:36:09 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-772d196e-3699-46c5-9cdd-27cb50e3b4cc tempest-SnapshotsActionsTest-353968158 None] Lock "cinder-6710fe17-8dcd-4a73-8233-4350ced0c953-delete_snapshot" released by "delete_snapshot" :: held 2.763s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:36:09 devstack sudo[94231]: pam_unix(sudo:session): session closed for user root Sep 06 06:36:09 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-a0f4cde2-2d2c-4256-aaf0-1774fa2b525e tempest-VolumesSnapshotListTestJSON-1542588238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bbd7169e-4b49-4218-b985-e33207c190e1.83c5d8e7-6431-48af-894b-20c1a94de7ab" returned: 0 in 0.399s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:36:09 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-a0f4cde2-2d2c-4256-aaf0-1774fa2b525e tempest-VolumesSnapshotListTestJSON-1542588238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bbd7169e-4b49-4218-b985-e33207c190e1.info {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:36:09 devstack sudo[94234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bbd7169e-4b49-4218-b985-e33207c190e1.info Sep 06 06:36:09 devstack sudo[94234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:36:10 devstack sudo[94234]: pam_unix(sudo:session): session closed for user root Sep 06 06:36:10 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-a0f4cde2-2d2c-4256-aaf0-1774fa2b525e tempest-VolumesSnapshotListTestJSON-1542588238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bbd7169e-4b49-4218-b985-e33207c190e1.info" returned: 0 in 0.342s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:36:10 devstack cinder-volume[87329]: WARNING cinder.volume.drivers.remotefs [None req-a0f4cde2-2d2c-4256-aaf0-1774fa2b525e tempest-VolumesSnapshotListTestJSON-1542588238 None] /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bbd7169e-4b49-4218-b985-e33207c190e1.info is being set with open permissions: ugo+rw Sep 06 06:36:10 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-a0f4cde2-2d2c-4256-aaf0-1774fa2b525e tempest-VolumesSnapshotListTestJSON-1542588238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bbd7169e-4b49-4218-b985-e33207c190e1.info {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:36:10 devstack sudo[94239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bbd7169e-4b49-4218-b985-e33207c190e1.info Sep 06 06:36:10 devstack sudo[94239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:36:10 devstack sudo[94239]: pam_unix(sudo:session): session closed for user root Sep 06 06:36:10 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-a0f4cde2-2d2c-4256-aaf0-1774fa2b525e tempest-VolumesSnapshotListTestJSON-1542588238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bbd7169e-4b49-4218-b985-e33207c190e1.info" returned: 0 in 0.350s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:36:10 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-a0f4cde2-2d2c-4256-aaf0-1774fa2b525e tempest-VolumesSnapshotListTestJSON-1542588238 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.132s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:36:10 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-a0f4cde2-2d2c-4256-aaf0-1774fa2b525e tempest-VolumesSnapshotListTestJSON-1542588238 None] Create snapshot completed successfully Sep 06 06:36:10 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-42abfe62-d62d-4744-83c2-efdab8ca4f4d tempest-SnapshotsActionsTest-1031586015 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:36:10 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-42abfe62-d62d-4744-83c2-efdab8ca4f4d tempest-SnapshotsActionsTest-1031586015 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:36:10 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-42abfe62-d62d-4744-83c2-efdab8ca4f4d tempest-SnapshotsActionsTest-1031586015 None] Creating offline snapshot 899cea2a-e7cf-4878-8365-fa54aa4ce592 of volume 074ce519-1402-4842-9c17-e462a1f53c7c {{(pid=87329) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 06 06:36:10 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebd623c7-1021-4949-b782-e09e72396cc0]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:36:10 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-42abfe62-d62d-4744-83c2-efdab8ca4f4d tempest-SnapshotsActionsTest-1031586015 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-074ce519-1402-4842-9c17-e462a1f53c7c.719717da-f08d-473f-9308-d29b2eb0639a {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:36:10 devstack sudo[94261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-074ce519-1402-4842-9c17-e462a1f53c7c.719717da-f08d-473f-9308-d29b2eb0639a Sep 06 06:36:10 devstack sudo[94261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:36:11 devstack sudo[94261]: pam_unix(sudo:session): session closed for user root Sep 06 06:36:11 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-42abfe62-d62d-4744-83c2-efdab8ca4f4d tempest-SnapshotsActionsTest-1031586015 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-074ce519-1402-4842-9c17-e462a1f53c7c.719717da-f08d-473f-9308-d29b2eb0639a" returned: 0 in 0.517s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:36:11 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-42abfe62-d62d-4744-83c2-efdab8ca4f4d tempest-SnapshotsActionsTest-1031586015 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-074ce519-1402-4842-9c17-e462a1f53c7c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87329) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 06:36:11 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-42abfe62-d62d-4744-83c2-efdab8ca4f4d tempest-SnapshotsActionsTest-1031586015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-074ce519-1402-4842-9c17-e462a1f53c7c.719717da-f08d-473f-9308-d29b2eb0639a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-074ce519-1402-4842-9c17-e462a1f53c7c.899cea2a-e7cf-4878-8365-fa54aa4ce592 1G {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:36:11 devstack sudo[94268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-074ce519-1402-4842-9c17-e462a1f53c7c.719717da-f08d-473f-9308-d29b2eb0639a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-074ce519-1402-4842-9c17-e462a1f53c7c.899cea2a-e7cf-4878-8365-fa54aa4ce592 1G Sep 06 06:36:11 devstack sudo[94268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:36:11 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-56e8b23a-ba3a-45bc-86e8-81716b682afa tempest-VolumesSnapshotListTestJSON-1542588238 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:36:12 devstack sudo[94268]: pam_unix(sudo:session): session closed for user root Sep 06 06:36:12 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-42abfe62-d62d-4744-83c2-efdab8ca4f4d tempest-SnapshotsActionsTest-1031586015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-074ce519-1402-4842-9c17-e462a1f53c7c.719717da-f08d-473f-9308-d29b2eb0639a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-074ce519-1402-4842-9c17-e462a1f53c7c.899cea2a-e7cf-4878-8365-fa54aa4ce592 1G" returned: 0 in 0.788s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:36:12 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-42abfe62-d62d-4744-83c2-efdab8ca4f4d tempest-SnapshotsActionsTest-1031586015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-074ce519-1402-4842-9c17-e462a1f53c7c.719717da-f08d-473f-9308-d29b2eb0639a -F qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-074ce519-1402-4842-9c17-e462a1f53c7c.899cea2a-e7cf-4878-8365-fa54aa4ce592 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:36:12 devstack sudo[94275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-074ce519-1402-4842-9c17-e462a1f53c7c.719717da-f08d-473f-9308-d29b2eb0639a -F qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-074ce519-1402-4842-9c17-e462a1f53c7c.899cea2a-e7cf-4878-8365-fa54aa4ce592 Sep 06 06:36:12 devstack sudo[94275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:36:12 devstack sudo[94275]: pam_unix(sudo:session): session closed for user root Sep 06 06:36:12 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-42abfe62-d62d-4744-83c2-efdab8ca4f4d tempest-SnapshotsActionsTest-1031586015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-074ce519-1402-4842-9c17-e462a1f53c7c.719717da-f08d-473f-9308-d29b2eb0639a -F qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-074ce519-1402-4842-9c17-e462a1f53c7c.899cea2a-e7cf-4878-8365-fa54aa4ce592" returned: 0 in 0.473s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:36:12 devstack cinder-volume[87329]: WARNING cinder.volume.drivers.remotefs [None req-42abfe62-d62d-4744-83c2-efdab8ca4f4d tempest-SnapshotsActionsTest-1031586015 None] /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-074ce519-1402-4842-9c17-e462a1f53c7c.899cea2a-e7cf-4878-8365-fa54aa4ce592 is being set with open permissions: ugo+rw Sep 06 06:36:12 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-42abfe62-d62d-4744-83c2-efdab8ca4f4d tempest-SnapshotsActionsTest-1031586015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-074ce519-1402-4842-9c17-e462a1f53c7c.899cea2a-e7cf-4878-8365-fa54aa4ce592 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:36:12 devstack sudo[94282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-074ce519-1402-4842-9c17-e462a1f53c7c.899cea2a-e7cf-4878-8365-fa54aa4ce592 Sep 06 06:36:12 devstack sudo[94282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:36:13 devstack sudo[94282]: pam_unix(sudo:session): session closed for user root Sep 06 06:36:13 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-42abfe62-d62d-4744-83c2-efdab8ca4f4d tempest-SnapshotsActionsTest-1031586015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-074ce519-1402-4842-9c17-e462a1f53c7c.899cea2a-e7cf-4878-8365-fa54aa4ce592" returned: 0 in 0.506s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:36:13 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-42abfe62-d62d-4744-83c2-efdab8ca4f4d tempest-SnapshotsActionsTest-1031586015 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.547s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:36:13 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-56e8b23a-ba3a-45bc-86e8-81716b682afa tempest-VolumesSnapshotListTestJSON-1542588238 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.174s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:36:13 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-56e8b23a-ba3a-45bc-86e8-81716b682afa tempest-VolumesSnapshotListTestJSON-1542588238 None] Creating offline snapshot 302792cb-7ed5-40c2-8407-5b3c1bd84c4b of volume bbd7169e-4b49-4218-b985-e33207c190e1 {{(pid=87329) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 06 06:36:13 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[92633d22-72fb-4946-9c0c-ddec579d2329]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:36:13 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-56e8b23a-ba3a-45bc-86e8-81716b682afa tempest-VolumesSnapshotListTestJSON-1542588238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bbd7169e-4b49-4218-b985-e33207c190e1.83c5d8e7-6431-48af-894b-20c1a94de7ab {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:36:13 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-42abfe62-d62d-4744-83c2-efdab8ca4f4d tempest-SnapshotsActionsTest-1031586015 None] Create snapshot completed successfully Sep 06 06:36:13 devstack sudo[94286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bbd7169e-4b49-4218-b985-e33207c190e1.83c5d8e7-6431-48af-894b-20c1a94de7ab Sep 06 06:36:13 devstack sudo[94286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:36:13 devstack sudo[94286]: pam_unix(sudo:session): session closed for user root Sep 06 06:36:13 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-56e8b23a-ba3a-45bc-86e8-81716b682afa tempest-VolumesSnapshotListTestJSON-1542588238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bbd7169e-4b49-4218-b985-e33207c190e1.83c5d8e7-6431-48af-894b-20c1a94de7ab" returned: 0 in 0.689s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:36:13 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-56e8b23a-ba3a-45bc-86e8-81716b682afa tempest-VolumesSnapshotListTestJSON-1542588238 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bbd7169e-4b49-4218-b985-e33207c190e1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87329) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 06:36:13 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-56e8b23a-ba3a-45bc-86e8-81716b682afa tempest-VolumesSnapshotListTestJSON-1542588238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bbd7169e-4b49-4218-b985-e33207c190e1.83c5d8e7-6431-48af-894b-20c1a94de7ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bbd7169e-4b49-4218-b985-e33207c190e1.302792cb-7ed5-40c2-8407-5b3c1bd84c4b 1G {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:36:14 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-0b1eea25-13df-4c9b-8c84-7c76cf0aed95 tempest-SnapshotsActionsTest-353968158 None] Acquiring lock "cinder-899cea2a-e7cf-4878-8365-fa54aa4ce592-delete_snapshot" by "delete_snapshot" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:36:14 devstack sudo[94292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bbd7169e-4b49-4218-b985-e33207c190e1.83c5d8e7-6431-48af-894b-20c1a94de7ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bbd7169e-4b49-4218-b985-e33207c190e1.302792cb-7ed5-40c2-8407-5b3c1bd84c4b 1G Sep 06 06:36:14 devstack sudo[94292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:36:14 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-0b1eea25-13df-4c9b-8c84-7c76cf0aed95 tempest-SnapshotsActionsTest-353968158 None] Lock "cinder-899cea2a-e7cf-4878-8365-fa54aa4ce592-delete_snapshot" acquired by "delete_snapshot" :: waited 0.054s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:36:14 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-0b1eea25-13df-4c9b-8c84-7c76cf0aed95 tempest-SnapshotsActionsTest-353968158 None] Acquiring lock "cinder-quobyte-074ce519-1402-4842-9c17-e462a1f53c7c" by "delete_snapshot" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:36:14 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-0b1eea25-13df-4c9b-8c84-7c76cf0aed95 tempest-SnapshotsActionsTest-353968158 None] Lock "cinder-quobyte-074ce519-1402-4842-9c17-e462a1f53c7c" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:36:14 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-0b1eea25-13df-4c9b-8c84-7c76cf0aed95 tempest-SnapshotsActionsTest-353968158 None] Acquiring lock "cinder-quobyte-899cea2a-e7cf-4878-8365-fa54aa4ce592" by "_delete_snapshot" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:36:14 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-0b1eea25-13df-4c9b-8c84-7c76cf0aed95 tempest-SnapshotsActionsTest-353968158 None] Lock "cinder-quobyte-899cea2a-e7cf-4878-8365-fa54aa4ce592" acquired by "_delete_snapshot" :: waited 0.043s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:36:14 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-0b1eea25-13df-4c9b-8c84-7c76cf0aed95 tempest-SnapshotsActionsTest-353968158 None] Deleting offline snapshot 899cea2a-e7cf-4878-8365-fa54aa4ce592 of volume 074ce519-1402-4842-9c17-e462a1f53c7c {{(pid=87329) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 06 06:36:14 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-0b1eea25-13df-4c9b-8c84-7c76cf0aed95 tempest-SnapshotsActionsTest-353968158 None] snapshot_file for this snap is: volume-074ce519-1402-4842-9c17-e462a1f53c7c.899cea2a-e7cf-4878-8365-fa54aa4ce592 {{(pid=87329) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 06 06:36:14 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bc9613f-0e5c-4f56-b0fe-0ba47a634bf1]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:36:14 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-0b1eea25-13df-4c9b-8c84-7c76cf0aed95 tempest-SnapshotsActionsTest-353968158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-074ce519-1402-4842-9c17-e462a1f53c7c.899cea2a-e7cf-4878-8365-fa54aa4ce592 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:36:14 devstack sudo[94295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-074ce519-1402-4842-9c17-e462a1f53c7c.899cea2a-e7cf-4878-8365-fa54aa4ce592 Sep 06 06:36:14 devstack sudo[94295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:36:14 devstack sudo[94292]: pam_unix(sudo:session): session closed for user root Sep 06 06:36:14 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-56e8b23a-ba3a-45bc-86e8-81716b682afa tempest-VolumesSnapshotListTestJSON-1542588238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bbd7169e-4b49-4218-b985-e33207c190e1.83c5d8e7-6431-48af-894b-20c1a94de7ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bbd7169e-4b49-4218-b985-e33207c190e1.302792cb-7ed5-40c2-8407-5b3c1bd84c4b 1G" returned: 0 in 0.829s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:36:14 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-56e8b23a-ba3a-45bc-86e8-81716b682afa tempest-VolumesSnapshotListTestJSON-1542588238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bbd7169e-4b49-4218-b985-e33207c190e1.83c5d8e7-6431-48af-894b-20c1a94de7ab -F qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bbd7169e-4b49-4218-b985-e33207c190e1.302792cb-7ed5-40c2-8407-5b3c1bd84c4b {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:36:14 devstack sudo[94303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bbd7169e-4b49-4218-b985-e33207c190e1.83c5d8e7-6431-48af-894b-20c1a94de7ab -F qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bbd7169e-4b49-4218-b985-e33207c190e1.302792cb-7ed5-40c2-8407-5b3c1bd84c4b Sep 06 06:36:14 devstack sudo[94303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:36:15 devstack sudo[94295]: pam_unix(sudo:session): session closed for user root Sep 06 06:36:15 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-0b1eea25-13df-4c9b-8c84-7c76cf0aed95 tempest-SnapshotsActionsTest-353968158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-074ce519-1402-4842-9c17-e462a1f53c7c.899cea2a-e7cf-4878-8365-fa54aa4ce592" returned: 0 in 0.772s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:36:15 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-0b1eea25-13df-4c9b-8c84-7c76cf0aed95 tempest-SnapshotsActionsTest-353968158 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-074ce519-1402-4842-9c17-e462a1f53c7c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87329) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 06:36:15 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[b854458f-8103-4bad-9cca-010b1ede00bb]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:36:15 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-0b1eea25-13df-4c9b-8c84-7c76cf0aed95 tempest-SnapshotsActionsTest-353968158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-074ce519-1402-4842-9c17-e462a1f53c7c.719717da-f08d-473f-9308-d29b2eb0639a {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:36:15 devstack sudo[94308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-074ce519-1402-4842-9c17-e462a1f53c7c.719717da-f08d-473f-9308-d29b2eb0639a Sep 06 06:36:15 devstack sudo[94308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:36:15 devstack sudo[94303]: pam_unix(sudo:session): session closed for user root Sep 06 06:36:15 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-56e8b23a-ba3a-45bc-86e8-81716b682afa tempest-VolumesSnapshotListTestJSON-1542588238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bbd7169e-4b49-4218-b985-e33207c190e1.83c5d8e7-6431-48af-894b-20c1a94de7ab -F qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bbd7169e-4b49-4218-b985-e33207c190e1.302792cb-7ed5-40c2-8407-5b3c1bd84c4b" returned: 0 in 0.693s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:36:15 devstack cinder-volume[87329]: WARNING cinder.volume.drivers.remotefs [None req-56e8b23a-ba3a-45bc-86e8-81716b682afa tempest-VolumesSnapshotListTestJSON-1542588238 None] /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bbd7169e-4b49-4218-b985-e33207c190e1.302792cb-7ed5-40c2-8407-5b3c1bd84c4b is being set with open permissions: ugo+rw Sep 06 06:36:15 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-56e8b23a-ba3a-45bc-86e8-81716b682afa tempest-VolumesSnapshotListTestJSON-1542588238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bbd7169e-4b49-4218-b985-e33207c190e1.302792cb-7ed5-40c2-8407-5b3c1bd84c4b {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:36:15 devstack sudo[94313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bbd7169e-4b49-4218-b985-e33207c190e1.302792cb-7ed5-40c2-8407-5b3c1bd84c4b Sep 06 06:36:15 devstack sudo[94313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:36:15 devstack sudo[94308]: pam_unix(sudo:session): session closed for user root Sep 06 06:36:15 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-0b1eea25-13df-4c9b-8c84-7c76cf0aed95 tempest-SnapshotsActionsTest-353968158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-074ce519-1402-4842-9c17-e462a1f53c7c.719717da-f08d-473f-9308-d29b2eb0639a" returned: 0 in 0.737s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:36:15 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-0b1eea25-13df-4c9b-8c84-7c76cf0aed95 tempest-SnapshotsActionsTest-353968158 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-074ce519-1402-4842-9c17-e462a1f53c7c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87329) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 06:36:15 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-0b1eea25-13df-4c9b-8c84-7c76cf0aed95 tempest-SnapshotsActionsTest-353968158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-074ce519-1402-4842-9c17-e462a1f53c7c.899cea2a-e7cf-4878-8365-fa54aa4ce592 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:36:15 devstack sudo[94318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-074ce519-1402-4842-9c17-e462a1f53c7c.899cea2a-e7cf-4878-8365-fa54aa4ce592 Sep 06 06:36:15 devstack sudo[94318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:36:15 devstack sudo[94313]: pam_unix(sudo:session): session closed for user root Sep 06 06:36:15 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-56e8b23a-ba3a-45bc-86e8-81716b682afa tempest-VolumesSnapshotListTestJSON-1542588238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bbd7169e-4b49-4218-b985-e33207c190e1.302792cb-7ed5-40c2-8407-5b3c1bd84c4b" returned: 0 in 0.486s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:36:16 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-56e8b23a-ba3a-45bc-86e8-81716b682afa tempest-VolumesSnapshotListTestJSON-1542588238 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.912s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:36:16 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-b95d53ca-9dff-4676-8121-49276958f58c tempest-AttachVolumeNegativeTest-1315254098 None] Acquiring lock "cinder-cab89b28-c971-48a8-886b-419aeeb758ea-delete_volume" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:36:16 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-b95d53ca-9dff-4676-8121-49276958f58c tempest-AttachVolumeNegativeTest-1315254098 None] Lock "cinder-cab89b28-c971-48a8-886b-419aeeb758ea-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:36:16 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-56e8b23a-ba3a-45bc-86e8-81716b682afa tempest-VolumesSnapshotListTestJSON-1542588238 None] Create snapshot completed successfully Sep 06 06:36:16 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-b95d53ca-9dff-4676-8121-49276958f58c tempest-AttachVolumeNegativeTest-1315254098 None] Acquiring lock "cinder-quobyte-cab89b28-c971-48a8-886b-419aeeb758ea" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:36:16 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-b95d53ca-9dff-4676-8121-49276958f58c tempest-AttachVolumeNegativeTest-1315254098 None] Lock "cinder-quobyte-cab89b28-c971-48a8-886b-419aeeb758ea" acquired by "delete_volume" :: waited 0.034s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:36:16 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[91ffa4a2-91f5-4e06-a754-53bd2c89a64d]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:36:16 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-b95d53ca-9dff-4676-8121-49276958f58c tempest-AttachVolumeNegativeTest-1315254098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-cab89b28-c971-48a8-886b-419aeeb758ea {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:36:16 devstack sudo[94318]: pam_unix(sudo:session): session closed for user root Sep 06 06:36:16 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-0b1eea25-13df-4c9b-8c84-7c76cf0aed95 tempest-SnapshotsActionsTest-353968158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-074ce519-1402-4842-9c17-e462a1f53c7c.899cea2a-e7cf-4878-8365-fa54aa4ce592" returned: 0 in 0.717s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:36:16 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-0b1eea25-13df-4c9b-8c84-7c76cf0aed95 tempest-SnapshotsActionsTest-353968158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-074ce519-1402-4842-9c17-e462a1f53c7c.899cea2a-e7cf-4878-8365-fa54aa4ce592 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:36:16 devstack sudo[94326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-074ce519-1402-4842-9c17-e462a1f53c7c.899cea2a-e7cf-4878-8365-fa54aa4ce592 Sep 06 06:36:16 devstack sudo[94326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:36:16 devstack sudo[94325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-cab89b28-c971-48a8-886b-419aeeb758ea Sep 06 06:36:16 devstack sudo[94325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:36:16 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-5be38105-ce21-452b-be52-a221015255e7 tempest-VolumesSnapshotListTestJSON-1542588238 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:36:16 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-5be38105-ce21-452b-be52-a221015255e7 tempest-VolumesSnapshotListTestJSON-1542588238 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:36:16 devstack sudo[94325]: pam_unix(sudo:session): session closed for user root Sep 06 06:36:16 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-b95d53ca-9dff-4676-8121-49276958f58c tempest-AttachVolumeNegativeTest-1315254098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-cab89b28-c971-48a8-886b-419aeeb758ea" returned: 0 in 0.546s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:36:16 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-b95d53ca-9dff-4676-8121-49276958f58c tempest-AttachVolumeNegativeTest-1315254098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-cab89b28-c971-48a8-886b-419aeeb758ea {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:36:16 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-5be38105-ce21-452b-be52-a221015255e7 tempest-VolumesSnapshotListTestJSON-1542588238 None] Creating offline snapshot bb8fa2dc-5359-4373-ab4c-79fdd108989a of volume bbd7169e-4b49-4218-b985-e33207c190e1 {{(pid=87329) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 06 06:36:16 devstack sudo[94332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-cab89b28-c971-48a8-886b-419aeeb758ea Sep 06 06:36:16 devstack sudo[94332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:36:17 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5138713-09de-466b-abb7-8c1eedc481a7]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:36:17 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-5be38105-ce21-452b-be52-a221015255e7 tempest-VolumesSnapshotListTestJSON-1542588238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bbd7169e-4b49-4218-b985-e33207c190e1.302792cb-7ed5-40c2-8407-5b3c1bd84c4b {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:36:17 devstack sudo[94326]: pam_unix(sudo:session): session closed for user root Sep 06 06:36:17 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-0b1eea25-13df-4c9b-8c84-7c76cf0aed95 tempest-SnapshotsActionsTest-353968158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-074ce519-1402-4842-9c17-e462a1f53c7c.899cea2a-e7cf-4878-8365-fa54aa4ce592" returned: 0 in 0.588s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:36:17 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-0b1eea25-13df-4c9b-8c84-7c76cf0aed95 tempest-SnapshotsActionsTest-353968158 None] Lock "cinder-quobyte-899cea2a-e7cf-4878-8365-fa54aa4ce592" released by "_delete_snapshot" :: held 3.006s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:36:17 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-0b1eea25-13df-4c9b-8c84-7c76cf0aed95 tempest-SnapshotsActionsTest-353968158 None] Lock "cinder-quobyte-074ce519-1402-4842-9c17-e462a1f53c7c" released by "delete_snapshot" :: held 3.076s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:36:17 devstack sudo[94335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bbd7169e-4b49-4218-b985-e33207c190e1.302792cb-7ed5-40c2-8407-5b3c1bd84c4b Sep 06 06:36:17 devstack sudo[94335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:36:17 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-0b1eea25-13df-4c9b-8c84-7c76cf0aed95 tempest-SnapshotsActionsTest-353968158 None] Created reservations ['f41c3c34-8871-4db6-940a-0a616ca1a17a', '058eb0e5-c2a1-4418-a74f-1a9d984f3491', 'e373978a-6665-4ac6-af16-8006f77f9942', '6c0af471-9838-440f-aa0a-f5b9006720d4'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:36:17 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-0b1eea25-13df-4c9b-8c84-7c76cf0aed95 tempest-SnapshotsActionsTest-353968158 None] Delete snapshot completed successfully. Sep 06 06:36:17 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-0b1eea25-13df-4c9b-8c84-7c76cf0aed95 tempest-SnapshotsActionsTest-353968158 None] Lock "cinder-899cea2a-e7cf-4878-8365-fa54aa4ce592-delete_snapshot" released by "delete_snapshot" :: held 3.328s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:36:17 devstack sudo[94332]: pam_unix(sudo:session): session closed for user root Sep 06 06:36:17 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-b95d53ca-9dff-4676-8121-49276958f58c tempest-AttachVolumeNegativeTest-1315254098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-cab89b28-c971-48a8-886b-419aeeb758ea" returned: 0 in 0.524s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:36:17 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-b95d53ca-9dff-4676-8121-49276958f58c tempest-AttachVolumeNegativeTest-1315254098 None] Lock "cinder-quobyte-cab89b28-c971-48a8-886b-419aeeb758ea" released by "delete_volume" :: held 1.151s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:36:17 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-b95d53ca-9dff-4676-8121-49276958f58c tempest-AttachVolumeNegativeTest-1315254098 None] Created reservations ['e93da6a9-c6d3-47e2-a964-b6543be77cc8', 'eddc6f09-54d3-416a-b19c-f3bef7b4b9cd', '37e8f6c2-bd09-47e6-8eb6-12963b2ee763', '8303e8af-c1d9-4b59-9b0a-f8fcb70d6588'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:36:17 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-b95d53ca-9dff-4676-8121-49276958f58c tempest-AttachVolumeNegativeTest-1315254098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:36:17 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-b95d53ca-9dff-4676-8121-49276958f58c tempest-AttachVolumeNegativeTest-1315254098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:36:17 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-b95d53ca-9dff-4676-8121-49276958f58c tempest-AttachVolumeNegativeTest-1315254098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:36:17 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-b95d53ca-9dff-4676-8121-49276958f58c tempest-AttachVolumeNegativeTest-1315254098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:36:17 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-b95d53ca-9dff-4676-8121-49276958f58c tempest-AttachVolumeNegativeTest-1315254098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:36:17 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-b95d53ca-9dff-4676-8121-49276958f58c tempest-AttachVolumeNegativeTest-1315254098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:36:17 devstack sudo[94344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:36:17 devstack sudo[94344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:36:17 devstack sudo[94335]: pam_unix(sudo:session): session closed for user root Sep 06 06:36:17 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-5be38105-ce21-452b-be52-a221015255e7 tempest-VolumesSnapshotListTestJSON-1542588238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bbd7169e-4b49-4218-b985-e33207c190e1.302792cb-7ed5-40c2-8407-5b3c1bd84c4b" returned: 0 in 0.687s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:36:17 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-5be38105-ce21-452b-be52-a221015255e7 tempest-VolumesSnapshotListTestJSON-1542588238 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bbd7169e-4b49-4218-b985-e33207c190e1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87329) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 06:36:17 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-5be38105-ce21-452b-be52-a221015255e7 tempest-VolumesSnapshotListTestJSON-1542588238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bbd7169e-4b49-4218-b985-e33207c190e1.302792cb-7ed5-40c2-8407-5b3c1bd84c4b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bbd7169e-4b49-4218-b985-e33207c190e1.bb8fa2dc-5359-4373-ab4c-79fdd108989a 1G {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:36:17 devstack sudo[94346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bbd7169e-4b49-4218-b985-e33207c190e1.302792cb-7ed5-40c2-8407-5b3c1bd84c4b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bbd7169e-4b49-4218-b985-e33207c190e1.bb8fa2dc-5359-4373-ab4c-79fdd108989a 1G Sep 06 06:36:17 devstack sudo[94346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:36:18 devstack sudo[94344]: pam_unix(sudo:session): session closed for user root Sep 06 06:36:18 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-b95d53ca-9dff-4676-8121-49276958f58c tempest-AttachVolumeNegativeTest-1315254098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.370s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:36:18 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-b95d53ca-9dff-4676-8121-49276958f58c tempest-AttachVolumeNegativeTest-1315254098 None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:36:18 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-b95d53ca-9dff-4676-8121-49276958f58c tempest-AttachVolumeNegativeTest-1315254098 None] Deleted volume successfully. Sep 06 06:36:18 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-b95d53ca-9dff-4676-8121-49276958f58c tempest-AttachVolumeNegativeTest-1315254098 None] Lock "cinder-cab89b28-c971-48a8-886b-419aeeb758ea-delete_volume" released by "delete_volume" :: held 1.920s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:36:18 devstack sudo[94346]: pam_unix(sudo:session): session closed for user root Sep 06 06:36:18 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-5be38105-ce21-452b-be52-a221015255e7 tempest-VolumesSnapshotListTestJSON-1542588238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bbd7169e-4b49-4218-b985-e33207c190e1.302792cb-7ed5-40c2-8407-5b3c1bd84c4b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bbd7169e-4b49-4218-b985-e33207c190e1.bb8fa2dc-5359-4373-ab4c-79fdd108989a 1G" returned: 0 in 0.821s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:36:18 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-5be38105-ce21-452b-be52-a221015255e7 tempest-VolumesSnapshotListTestJSON-1542588238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bbd7169e-4b49-4218-b985-e33207c190e1.302792cb-7ed5-40c2-8407-5b3c1bd84c4b -F qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bbd7169e-4b49-4218-b985-e33207c190e1.bb8fa2dc-5359-4373-ab4c-79fdd108989a {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:36:18 devstack sudo[94355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bbd7169e-4b49-4218-b985-e33207c190e1.302792cb-7ed5-40c2-8407-5b3c1bd84c4b -F qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bbd7169e-4b49-4218-b985-e33207c190e1.bb8fa2dc-5359-4373-ab4c-79fdd108989a Sep 06 06:36:18 devstack sudo[94355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:36:18 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-7ae94906-a566-4540-9e94-7e3b82e89d65 tempest-AttachVolumeNegativeTest-1315254098 None] Acquiring lock "cinder-2ab65776-1fe0-4481-af7b-5f27787e50e8-delete_volume" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:36:18 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-7ae94906-a566-4540-9e94-7e3b82e89d65 tempest-AttachVolumeNegativeTest-1315254098 None] Lock "cinder-2ab65776-1fe0-4481-af7b-5f27787e50e8-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:36:18 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-7ae94906-a566-4540-9e94-7e3b82e89d65 tempest-AttachVolumeNegativeTest-1315254098 None] Acquiring lock "cinder-quobyte-2ab65776-1fe0-4481-af7b-5f27787e50e8" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:36:18 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-7ae94906-a566-4540-9e94-7e3b82e89d65 tempest-AttachVolumeNegativeTest-1315254098 None] Lock "cinder-quobyte-2ab65776-1fe0-4481-af7b-5f27787e50e8" acquired by "delete_volume" :: waited 0.064s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:36:18 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-22ea3776-0ab4-4514-9e79-3a4dc59cf5c0 tempest-SnapshotsActionsTest-1031586015 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:36:18 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[da60e745-d11d-4214-9d11-789fb22df095]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:36:18 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-7ae94906-a566-4540-9e94-7e3b82e89d65 tempest-AttachVolumeNegativeTest-1315254098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-2ab65776-1fe0-4481-af7b-5f27787e50e8 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:36:19 devstack sudo[94355]: pam_unix(sudo:session): session closed for user root Sep 06 06:36:19 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-5be38105-ce21-452b-be52-a221015255e7 tempest-VolumesSnapshotListTestJSON-1542588238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bbd7169e-4b49-4218-b985-e33207c190e1.302792cb-7ed5-40c2-8407-5b3c1bd84c4b -F qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bbd7169e-4b49-4218-b985-e33207c190e1.bb8fa2dc-5359-4373-ab4c-79fdd108989a" returned: 0 in 0.551s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:36:19 devstack cinder-volume[87329]: WARNING cinder.volume.drivers.remotefs [None req-5be38105-ce21-452b-be52-a221015255e7 tempest-VolumesSnapshotListTestJSON-1542588238 None] /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bbd7169e-4b49-4218-b985-e33207c190e1.bb8fa2dc-5359-4373-ab4c-79fdd108989a is being set with open permissions: ugo+rw Sep 06 06:36:19 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-5be38105-ce21-452b-be52-a221015255e7 tempest-VolumesSnapshotListTestJSON-1542588238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bbd7169e-4b49-4218-b985-e33207c190e1.bb8fa2dc-5359-4373-ab4c-79fdd108989a {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:36:19 devstack sudo[94358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-2ab65776-1fe0-4481-af7b-5f27787e50e8 Sep 06 06:36:19 devstack sudo[94358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:36:19 devstack sudo[94363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bbd7169e-4b49-4218-b985-e33207c190e1.bb8fa2dc-5359-4373-ab4c-79fdd108989a Sep 06 06:36:19 devstack sudo[94363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:36:19 devstack sudo[94358]: pam_unix(sudo:session): session closed for user root Sep 06 06:36:19 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-7ae94906-a566-4540-9e94-7e3b82e89d65 tempest-AttachVolumeNegativeTest-1315254098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-2ab65776-1fe0-4481-af7b-5f27787e50e8" returned: 0 in 0.461s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:36:19 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-7ae94906-a566-4540-9e94-7e3b82e89d65 tempest-AttachVolumeNegativeTest-1315254098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-2ab65776-1fe0-4481-af7b-5f27787e50e8 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:36:19 devstack sudo[94370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-2ab65776-1fe0-4481-af7b-5f27787e50e8 Sep 06 06:36:19 devstack sudo[94370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:36:19 devstack sudo[94363]: pam_unix(sudo:session): session closed for user root Sep 06 06:36:19 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-5be38105-ce21-452b-be52-a221015255e7 tempest-VolumesSnapshotListTestJSON-1542588238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bbd7169e-4b49-4218-b985-e33207c190e1.bb8fa2dc-5359-4373-ab4c-79fdd108989a" returned: 0 in 0.390s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:36:19 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-5be38105-ce21-452b-be52-a221015255e7 tempest-VolumesSnapshotListTestJSON-1542588238 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.676s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:36:19 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-22ea3776-0ab4-4514-9e79-3a4dc59cf5c0 tempest-SnapshotsActionsTest-1031586015 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.597s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:36:19 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-22ea3776-0ab4-4514-9e79-3a4dc59cf5c0 tempest-SnapshotsActionsTest-1031586015 None] Creating offline snapshot 1726566e-177d-4283-b91a-2698d545a0b0 of volume 074ce519-1402-4842-9c17-e462a1f53c7c {{(pid=87329) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 06 06:36:19 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[13b3bbe8-fdc5-4b71-a8b8-61ad15cac910]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:36:19 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-22ea3776-0ab4-4514-9e79-3a4dc59cf5c0 tempest-SnapshotsActionsTest-1031586015 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-074ce519-1402-4842-9c17-e462a1f53c7c.719717da-f08d-473f-9308-d29b2eb0639a {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:36:19 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-5be38105-ce21-452b-be52-a221015255e7 tempest-VolumesSnapshotListTestJSON-1542588238 None] Create snapshot completed successfully Sep 06 06:36:19 devstack sudo[94370]: pam_unix(sudo:session): session closed for user root Sep 06 06:36:19 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-7ae94906-a566-4540-9e94-7e3b82e89d65 tempest-AttachVolumeNegativeTest-1315254098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-2ab65776-1fe0-4481-af7b-5f27787e50e8" returned: 0 in 0.351s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:36:19 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-7ae94906-a566-4540-9e94-7e3b82e89d65 tempest-AttachVolumeNegativeTest-1315254098 None] Lock "cinder-quobyte-2ab65776-1fe0-4481-af7b-5f27787e50e8" released by "delete_volume" :: held 0.912s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:36:19 devstack sudo[94372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-074ce519-1402-4842-9c17-e462a1f53c7c.719717da-f08d-473f-9308-d29b2eb0639a Sep 06 06:36:19 devstack sudo[94372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:36:19 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-7ae94906-a566-4540-9e94-7e3b82e89d65 tempest-AttachVolumeNegativeTest-1315254098 None] Created reservations ['2753757a-9e71-4170-843f-6d6532f2a09e', '2bebf5e0-0f67-48a1-b2d6-9bbe2b7933ad', '8fb9ac14-f57f-423c-a146-ea1fff0a68be', '138b440e-118f-42d5-8292-8804c71a6c8c'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:36:20 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-7ae94906-a566-4540-9e94-7e3b82e89d65 tempest-AttachVolumeNegativeTest-1315254098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:36:20 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-7ae94906-a566-4540-9e94-7e3b82e89d65 tempest-AttachVolumeNegativeTest-1315254098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:36:20 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-7ae94906-a566-4540-9e94-7e3b82e89d65 tempest-AttachVolumeNegativeTest-1315254098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:36:20 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-7ae94906-a566-4540-9e94-7e3b82e89d65 tempest-AttachVolumeNegativeTest-1315254098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:36:20 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-7ae94906-a566-4540-9e94-7e3b82e89d65 tempest-AttachVolumeNegativeTest-1315254098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:36:20 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-7ae94906-a566-4540-9e94-7e3b82e89d65 tempest-AttachVolumeNegativeTest-1315254098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:36:20 devstack sudo[94375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:36:20 devstack sudo[94375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:36:20 devstack sudo[94372]: pam_unix(sudo:session): session closed for user root Sep 06 06:36:20 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-22ea3776-0ab4-4514-9e79-3a4dc59cf5c0 tempest-SnapshotsActionsTest-1031586015 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-074ce519-1402-4842-9c17-e462a1f53c7c.719717da-f08d-473f-9308-d29b2eb0639a" returned: 0 in 0.708s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:36:20 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-22ea3776-0ab4-4514-9e79-3a4dc59cf5c0 tempest-SnapshotsActionsTest-1031586015 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-074ce519-1402-4842-9c17-e462a1f53c7c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87329) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 06:36:20 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-22ea3776-0ab4-4514-9e79-3a4dc59cf5c0 tempest-SnapshotsActionsTest-1031586015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-074ce519-1402-4842-9c17-e462a1f53c7c.719717da-f08d-473f-9308-d29b2eb0639a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-074ce519-1402-4842-9c17-e462a1f53c7c.1726566e-177d-4283-b91a-2698d545a0b0 1G {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:36:20 devstack sudo[94381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-074ce519-1402-4842-9c17-e462a1f53c7c.719717da-f08d-473f-9308-d29b2eb0639a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-074ce519-1402-4842-9c17-e462a1f53c7c.1726566e-177d-4283-b91a-2698d545a0b0 1G Sep 06 06:36:20 devstack sudo[94381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:36:20 devstack sudo[94375]: pam_unix(sudo:session): session closed for user root Sep 06 06:36:20 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-7ae94906-a566-4540-9e94-7e3b82e89d65 tempest-AttachVolumeNegativeTest-1315254098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.437s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:36:20 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-7ae94906-a566-4540-9e94-7e3b82e89d65 tempest-AttachVolumeNegativeTest-1315254098 None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:36:20 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-7ae94906-a566-4540-9e94-7e3b82e89d65 tempest-AttachVolumeNegativeTest-1315254098 None] Deleted volume successfully. Sep 06 06:36:20 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-7ae94906-a566-4540-9e94-7e3b82e89d65 tempest-AttachVolumeNegativeTest-1315254098 None] Lock "cinder-2ab65776-1fe0-4481-af7b-5f27787e50e8-delete_volume" released by "delete_volume" :: held 1.824s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:36:21 devstack sudo[94381]: pam_unix(sudo:session): session closed for user root Sep 06 06:36:21 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-22ea3776-0ab4-4514-9e79-3a4dc59cf5c0 tempest-SnapshotsActionsTest-1031586015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-074ce519-1402-4842-9c17-e462a1f53c7c.719717da-f08d-473f-9308-d29b2eb0639a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-074ce519-1402-4842-9c17-e462a1f53c7c.1726566e-177d-4283-b91a-2698d545a0b0 1G" returned: 0 in 0.854s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:36:21 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-22ea3776-0ab4-4514-9e79-3a4dc59cf5c0 tempest-SnapshotsActionsTest-1031586015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-074ce519-1402-4842-9c17-e462a1f53c7c.719717da-f08d-473f-9308-d29b2eb0639a -F qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-074ce519-1402-4842-9c17-e462a1f53c7c.1726566e-177d-4283-b91a-2698d545a0b0 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:36:21 devstack sudo[94388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-074ce519-1402-4842-9c17-e462a1f53c7c.719717da-f08d-473f-9308-d29b2eb0639a -F qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-074ce519-1402-4842-9c17-e462a1f53c7c.1726566e-177d-4283-b91a-2698d545a0b0 Sep 06 06:36:21 devstack sudo[94388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:36:21 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-40313d7e-c40f-4cc8-87da-a51612f33f17 tempest-VolumesSnapshotListTestJSON-1542588238 None] Acquiring lock "cinder-bb8fa2dc-5359-4373-ab4c-79fdd108989a-delete_snapshot" by "delete_snapshot" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:36:21 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-40313d7e-c40f-4cc8-87da-a51612f33f17 tempest-VolumesSnapshotListTestJSON-1542588238 None] Lock "cinder-bb8fa2dc-5359-4373-ab4c-79fdd108989a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:36:21 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-40313d7e-c40f-4cc8-87da-a51612f33f17 tempest-VolumesSnapshotListTestJSON-1542588238 None] Acquiring lock "cinder-quobyte-bbd7169e-4b49-4218-b985-e33207c190e1" by "delete_snapshot" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:36:21 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-40313d7e-c40f-4cc8-87da-a51612f33f17 tempest-VolumesSnapshotListTestJSON-1542588238 None] Lock "cinder-quobyte-bbd7169e-4b49-4218-b985-e33207c190e1" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:36:21 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-40313d7e-c40f-4cc8-87da-a51612f33f17 tempest-VolumesSnapshotListTestJSON-1542588238 None] Acquiring lock "cinder-quobyte-bb8fa2dc-5359-4373-ab4c-79fdd108989a" by "_delete_snapshot" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:36:21 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-40313d7e-c40f-4cc8-87da-a51612f33f17 tempest-VolumesSnapshotListTestJSON-1542588238 None] Lock "cinder-quobyte-bb8fa2dc-5359-4373-ab4c-79fdd108989a" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:36:21 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-40313d7e-c40f-4cc8-87da-a51612f33f17 tempest-VolumesSnapshotListTestJSON-1542588238 None] Deleting offline snapshot bb8fa2dc-5359-4373-ab4c-79fdd108989a of volume bbd7169e-4b49-4218-b985-e33207c190e1 {{(pid=87329) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 06 06:36:21 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-40313d7e-c40f-4cc8-87da-a51612f33f17 tempest-VolumesSnapshotListTestJSON-1542588238 None] snapshot_file for this snap is: volume-bbd7169e-4b49-4218-b985-e33207c190e1.bb8fa2dc-5359-4373-ab4c-79fdd108989a {{(pid=87329) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 06 06:36:21 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba98703f-6a6f-4583-a078-42af7b89cb5e]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:36:21 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-40313d7e-c40f-4cc8-87da-a51612f33f17 tempest-VolumesSnapshotListTestJSON-1542588238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bbd7169e-4b49-4218-b985-e33207c190e1.bb8fa2dc-5359-4373-ab4c-79fdd108989a {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:36:21 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-b4b1e34e-1874-43c8-ade2-1f7957b4ca8a tempest-AttachVolumeNegativeTest-1315254098 None] Acquiring lock "cinder-0f5d94d9-f8f2-4389-af2d-5dc4d869a9c4-delete_volume" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:36:21 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-b4b1e34e-1874-43c8-ade2-1f7957b4ca8a tempest-AttachVolumeNegativeTest-1315254098 None] Lock "cinder-0f5d94d9-f8f2-4389-af2d-5dc4d869a9c4-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:36:21 devstack sudo[94390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bbd7169e-4b49-4218-b985-e33207c190e1.bb8fa2dc-5359-4373-ab4c-79fdd108989a Sep 06 06:36:21 devstack sudo[94390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:36:21 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-b4b1e34e-1874-43c8-ade2-1f7957b4ca8a tempest-AttachVolumeNegativeTest-1315254098 None] Acquiring lock "cinder-quobyte-0f5d94d9-f8f2-4389-af2d-5dc4d869a9c4" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:36:21 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-b4b1e34e-1874-43c8-ade2-1f7957b4ca8a tempest-AttachVolumeNegativeTest-1315254098 None] Lock "cinder-quobyte-0f5d94d9-f8f2-4389-af2d-5dc4d869a9c4" acquired by "delete_volume" :: waited 0.021s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:36:21 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[eca9cc6c-f0bd-4f53-b056-96d7e2834a30]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:36:21 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-b4b1e34e-1874-43c8-ade2-1f7957b4ca8a tempest-AttachVolumeNegativeTest-1315254098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-0f5d94d9-f8f2-4389-af2d-5dc4d869a9c4 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:36:21 devstack sudo[94388]: pam_unix(sudo:session): session closed for user root Sep 06 06:36:21 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-22ea3776-0ab4-4514-9e79-3a4dc59cf5c0 tempest-SnapshotsActionsTest-1031586015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-074ce519-1402-4842-9c17-e462a1f53c7c.719717da-f08d-473f-9308-d29b2eb0639a -F qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-074ce519-1402-4842-9c17-e462a1f53c7c.1726566e-177d-4283-b91a-2698d545a0b0" returned: 0 in 0.496s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:36:21 devstack cinder-volume[87329]: WARNING cinder.volume.drivers.remotefs [None req-22ea3776-0ab4-4514-9e79-3a4dc59cf5c0 tempest-SnapshotsActionsTest-1031586015 None] /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-074ce519-1402-4842-9c17-e462a1f53c7c.1726566e-177d-4283-b91a-2698d545a0b0 is being set with open permissions: ugo+rw Sep 06 06:36:21 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-22ea3776-0ab4-4514-9e79-3a4dc59cf5c0 tempest-SnapshotsActionsTest-1031586015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-074ce519-1402-4842-9c17-e462a1f53c7c.1726566e-177d-4283-b91a-2698d545a0b0 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:36:21 devstack sudo[94400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-074ce519-1402-4842-9c17-e462a1f53c7c.1726566e-177d-4283-b91a-2698d545a0b0 Sep 06 06:36:21 devstack sudo[94400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:36:21 devstack sudo[94397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-0f5d94d9-f8f2-4389-af2d-5dc4d869a9c4 Sep 06 06:36:21 devstack sudo[94397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:36:22 devstack sudo[94390]: pam_unix(sudo:session): session closed for user root Sep 06 06:36:22 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-40313d7e-c40f-4cc8-87da-a51612f33f17 tempest-VolumesSnapshotListTestJSON-1542588238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bbd7169e-4b49-4218-b985-e33207c190e1.bb8fa2dc-5359-4373-ab4c-79fdd108989a" returned: 0 in 0.616s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:36:22 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-40313d7e-c40f-4cc8-87da-a51612f33f17 tempest-VolumesSnapshotListTestJSON-1542588238 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bbd7169e-4b49-4218-b985-e33207c190e1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87329) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 06:36:22 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b7d305e-d3d3-443d-bd8a-df3a2cc4271d]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:36:22 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-40313d7e-c40f-4cc8-87da-a51612f33f17 tempest-VolumesSnapshotListTestJSON-1542588238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bbd7169e-4b49-4218-b985-e33207c190e1.302792cb-7ed5-40c2-8407-5b3c1bd84c4b {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:36:22 devstack sudo[94400]: pam_unix(sudo:session): session closed for user root Sep 06 06:36:22 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-22ea3776-0ab4-4514-9e79-3a4dc59cf5c0 tempest-SnapshotsActionsTest-1031586015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-074ce519-1402-4842-9c17-e462a1f53c7c.1726566e-177d-4283-b91a-2698d545a0b0" returned: 0 in 0.537s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:36:22 devstack sudo[94445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bbd7169e-4b49-4218-b985-e33207c190e1.302792cb-7ed5-40c2-8407-5b3c1bd84c4b Sep 06 06:36:22 devstack sudo[94445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:36:22 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-22ea3776-0ab4-4514-9e79-3a4dc59cf5c0 tempest-SnapshotsActionsTest-1031586015 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.764s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:36:22 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-22ea3776-0ab4-4514-9e79-3a4dc59cf5c0 tempest-SnapshotsActionsTest-1031586015 None] Create snapshot completed successfully Sep 06 06:36:22 devstack sudo[94397]: pam_unix(sudo:session): session closed for user root Sep 06 06:36:22 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-b4b1e34e-1874-43c8-ade2-1f7957b4ca8a tempest-AttachVolumeNegativeTest-1315254098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-0f5d94d9-f8f2-4389-af2d-5dc4d869a9c4" returned: 0 in 0.756s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:36:22 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-b4b1e34e-1874-43c8-ade2-1f7957b4ca8a tempest-AttachVolumeNegativeTest-1315254098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-0f5d94d9-f8f2-4389-af2d-5dc4d869a9c4 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:36:22 devstack cinder-volume[87329]: INFO cinder.volume.manager [req-b59ebf27-208b-437b-801c-dc9dcd8a0355 req-5658edda-4612-4fa2-a121-1b878ddec47d tempest-ServerActionsTestOtherA-968672787 None] Terminate volume connection completed successfully. Sep 06 06:36:22 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [req-b59ebf27-208b-437b-801c-dc9dcd8a0355 req-5658edda-4612-4fa2-a121-1b878ddec47d tempest-ServerActionsTestOtherA-968672787 None] Deleting attachment 5c80d499-9515-40eb-9689-06510ae453f1. {{(pid=87329) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 06 06:36:22 devstack sudo[94456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-0f5d94d9-f8f2-4389-af2d-5dc4d869a9c4 Sep 06 06:36:22 devstack sudo[94456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:36:22 devstack sudo[94445]: pam_unix(sudo:session): session closed for user root Sep 06 06:36:22 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-40313d7e-c40f-4cc8-87da-a51612f33f17 tempest-VolumesSnapshotListTestJSON-1542588238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bbd7169e-4b49-4218-b985-e33207c190e1.302792cb-7ed5-40c2-8407-5b3c1bd84c4b" returned: 0 in 0.502s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:36:22 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-40313d7e-c40f-4cc8-87da-a51612f33f17 tempest-VolumesSnapshotListTestJSON-1542588238 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bbd7169e-4b49-4218-b985-e33207c190e1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87329) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 06:36:22 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-40313d7e-c40f-4cc8-87da-a51612f33f17 tempest-VolumesSnapshotListTestJSON-1542588238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bbd7169e-4b49-4218-b985-e33207c190e1.bb8fa2dc-5359-4373-ab4c-79fdd108989a {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:36:22 devstack sudo[94461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bbd7169e-4b49-4218-b985-e33207c190e1.bb8fa2dc-5359-4373-ab4c-79fdd108989a Sep 06 06:36:22 devstack sudo[94461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:36:22 devstack sudo[94456]: pam_unix(sudo:session): session closed for user root Sep 06 06:36:22 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-b4b1e34e-1874-43c8-ade2-1f7957b4ca8a tempest-AttachVolumeNegativeTest-1315254098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-0f5d94d9-f8f2-4389-af2d-5dc4d869a9c4" returned: 0 in 0.367s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:36:22 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-b4b1e34e-1874-43c8-ade2-1f7957b4ca8a tempest-AttachVolumeNegativeTest-1315254098 None] Lock "cinder-quobyte-0f5d94d9-f8f2-4389-af2d-5dc4d869a9c4" released by "delete_volume" :: held 1.166s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:36:22 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-b4b1e34e-1874-43c8-ade2-1f7957b4ca8a tempest-AttachVolumeNegativeTest-1315254098 None] Created reservations ['dbf785f8-23ee-4818-a902-aa52ce8546be', '5db97321-0ca4-4426-9c5d-cbf92733ba17', '5ff3e531-e74b-4321-9649-8e85c7eded65', 'f2f1d1db-e2f2-42d7-a161-1ec16800d6a1'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:36:22 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-b4b1e34e-1874-43c8-ade2-1f7957b4ca8a tempest-AttachVolumeNegativeTest-1315254098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:36:22 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-b4b1e34e-1874-43c8-ade2-1f7957b4ca8a tempest-AttachVolumeNegativeTest-1315254098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:36:22 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-b4b1e34e-1874-43c8-ade2-1f7957b4ca8a tempest-AttachVolumeNegativeTest-1315254098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:36:22 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-b4b1e34e-1874-43c8-ade2-1f7957b4ca8a tempest-AttachVolumeNegativeTest-1315254098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:36:22 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-b4b1e34e-1874-43c8-ade2-1f7957b4ca8a tempest-AttachVolumeNegativeTest-1315254098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:36:22 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-b4b1e34e-1874-43c8-ade2-1f7957b4ca8a tempest-AttachVolumeNegativeTest-1315254098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:36:23 devstack sudo[94469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:36:23 devstack sudo[94469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:36:23 devstack sudo[94461]: pam_unix(sudo:session): session closed for user root Sep 06 06:36:23 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-40313d7e-c40f-4cc8-87da-a51612f33f17 tempest-VolumesSnapshotListTestJSON-1542588238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bbd7169e-4b49-4218-b985-e33207c190e1.bb8fa2dc-5359-4373-ab4c-79fdd108989a" returned: 0 in 0.552s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:36:23 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-40313d7e-c40f-4cc8-87da-a51612f33f17 tempest-VolumesSnapshotListTestJSON-1542588238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bbd7169e-4b49-4218-b985-e33207c190e1.bb8fa2dc-5359-4373-ab4c-79fdd108989a {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:36:23 devstack sudo[94472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bbd7169e-4b49-4218-b985-e33207c190e1.bb8fa2dc-5359-4373-ab4c-79fdd108989a Sep 06 06:36:23 devstack sudo[94472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:36:23 devstack sudo[94469]: pam_unix(sudo:session): session closed for user root Sep 06 06:36:23 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-b4b1e34e-1874-43c8-ade2-1f7957b4ca8a tempest-AttachVolumeNegativeTest-1315254098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.285s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:36:23 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-b4b1e34e-1874-43c8-ade2-1f7957b4ca8a tempest-AttachVolumeNegativeTest-1315254098 None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:36:23 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-b4b1e34e-1874-43c8-ade2-1f7957b4ca8a tempest-AttachVolumeNegativeTest-1315254098 None] Deleted volume successfully. Sep 06 06:36:23 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-b4b1e34e-1874-43c8-ade2-1f7957b4ca8a tempest-AttachVolumeNegativeTest-1315254098 None] Lock "cinder-0f5d94d9-f8f2-4389-af2d-5dc4d869a9c4-delete_volume" released by "delete_volume" :: held 1.732s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:36:23 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-c52fd686-dffa-4d1d-afc7-7cd0f5537fab tempest-SnapshotsActionsTest-353968158 None] Acquiring lock "cinder-1726566e-177d-4283-b91a-2698d545a0b0-delete_snapshot" by "delete_snapshot" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:36:23 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-c52fd686-dffa-4d1d-afc7-7cd0f5537fab tempest-SnapshotsActionsTest-353968158 None] Lock "cinder-1726566e-177d-4283-b91a-2698d545a0b0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:36:23 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-c52fd686-dffa-4d1d-afc7-7cd0f5537fab tempest-SnapshotsActionsTest-353968158 None] Acquiring lock "cinder-quobyte-074ce519-1402-4842-9c17-e462a1f53c7c" by "delete_snapshot" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:36:23 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-c52fd686-dffa-4d1d-afc7-7cd0f5537fab tempest-SnapshotsActionsTest-353968158 None] Lock "cinder-quobyte-074ce519-1402-4842-9c17-e462a1f53c7c" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:36:23 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-c52fd686-dffa-4d1d-afc7-7cd0f5537fab tempest-SnapshotsActionsTest-353968158 None] Acquiring lock "cinder-quobyte-1726566e-177d-4283-b91a-2698d545a0b0" by "_delete_snapshot" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:36:23 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-c52fd686-dffa-4d1d-afc7-7cd0f5537fab tempest-SnapshotsActionsTest-353968158 None] Lock "cinder-quobyte-1726566e-177d-4283-b91a-2698d545a0b0" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:36:23 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-c52fd686-dffa-4d1d-afc7-7cd0f5537fab tempest-SnapshotsActionsTest-353968158 None] Deleting offline snapshot 1726566e-177d-4283-b91a-2698d545a0b0 of volume 074ce519-1402-4842-9c17-e462a1f53c7c {{(pid=87329) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 06 06:36:23 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-c52fd686-dffa-4d1d-afc7-7cd0f5537fab tempest-SnapshotsActionsTest-353968158 None] snapshot_file for this snap is: volume-074ce519-1402-4842-9c17-e462a1f53c7c.1726566e-177d-4283-b91a-2698d545a0b0 {{(pid=87329) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 06 06:36:23 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3809289-f49b-47ce-8658-36625d5e04ca]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:36:23 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-c52fd686-dffa-4d1d-afc7-7cd0f5537fab tempest-SnapshotsActionsTest-353968158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-074ce519-1402-4842-9c17-e462a1f53c7c.1726566e-177d-4283-b91a-2698d545a0b0 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:36:23 devstack sudo[94472]: pam_unix(sudo:session): session closed for user root Sep 06 06:36:23 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-40313d7e-c40f-4cc8-87da-a51612f33f17 tempest-VolumesSnapshotListTestJSON-1542588238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bbd7169e-4b49-4218-b985-e33207c190e1.bb8fa2dc-5359-4373-ab4c-79fdd108989a" returned: 0 in 0.300s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:36:23 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-40313d7e-c40f-4cc8-87da-a51612f33f17 tempest-VolumesSnapshotListTestJSON-1542588238 None] Lock "cinder-quobyte-bb8fa2dc-5359-4373-ab4c-79fdd108989a" released by "_delete_snapshot" :: held 2.129s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:36:23 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-40313d7e-c40f-4cc8-87da-a51612f33f17 tempest-VolumesSnapshotListTestJSON-1542588238 None] Lock "cinder-quobyte-bbd7169e-4b49-4218-b985-e33207c190e1" released by "delete_snapshot" :: held 2.169s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:36:23 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-40313d7e-c40f-4cc8-87da-a51612f33f17 tempest-VolumesSnapshotListTestJSON-1542588238 None] Created reservations ['363c6ade-bb7c-4f81-9a36-93b46043abc0', 'dfe5f620-40a6-4dc4-8154-423380a7cc9a', '10e7d5ab-6dd4-4628-b155-bfb535b9d133', 'a097672d-976c-45be-bf6d-b3c3a6e66761'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:36:23 devstack sudo[94476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-074ce519-1402-4842-9c17-e462a1f53c7c.1726566e-177d-4283-b91a-2698d545a0b0 Sep 06 06:36:23 devstack sudo[94476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:36:23 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-40313d7e-c40f-4cc8-87da-a51612f33f17 tempest-VolumesSnapshotListTestJSON-1542588238 None] Delete snapshot completed successfully. Sep 06 06:36:23 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-40313d7e-c40f-4cc8-87da-a51612f33f17 tempest-VolumesSnapshotListTestJSON-1542588238 None] Lock "cinder-bb8fa2dc-5359-4373-ab4c-79fdd108989a-delete_snapshot" released by "delete_snapshot" :: held 2.328s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:36:23 devstack sudo[94476]: pam_unix(sudo:session): session closed for user root Sep 06 06:36:23 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-c52fd686-dffa-4d1d-afc7-7cd0f5537fab tempest-SnapshotsActionsTest-353968158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-074ce519-1402-4842-9c17-e462a1f53c7c.1726566e-177d-4283-b91a-2698d545a0b0" returned: 0 in 0.412s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:36:23 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-c52fd686-dffa-4d1d-afc7-7cd0f5537fab tempest-SnapshotsActionsTest-353968158 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-074ce519-1402-4842-9c17-e462a1f53c7c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87329) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 06:36:23 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[06e55855-5ed4-443b-8a7f-49ec2c3ce7fe]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:36:23 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-c52fd686-dffa-4d1d-afc7-7cd0f5537fab tempest-SnapshotsActionsTest-353968158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-074ce519-1402-4842-9c17-e462a1f53c7c.719717da-f08d-473f-9308-d29b2eb0639a {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:36:24 devstack sudo[94482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-074ce519-1402-4842-9c17-e462a1f53c7c.719717da-f08d-473f-9308-d29b2eb0639a Sep 06 06:36:24 devstack sudo[94482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:36:24 devstack sudo[94482]: pam_unix(sudo:session): session closed for user root Sep 06 06:36:24 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-c52fd686-dffa-4d1d-afc7-7cd0f5537fab tempest-SnapshotsActionsTest-353968158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-074ce519-1402-4842-9c17-e462a1f53c7c.719717da-f08d-473f-9308-d29b2eb0639a" returned: 0 in 0.426s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:36:24 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-c52fd686-dffa-4d1d-afc7-7cd0f5537fab tempest-SnapshotsActionsTest-353968158 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-074ce519-1402-4842-9c17-e462a1f53c7c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87329) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 06:36:24 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-c52fd686-dffa-4d1d-afc7-7cd0f5537fab tempest-SnapshotsActionsTest-353968158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-074ce519-1402-4842-9c17-e462a1f53c7c.1726566e-177d-4283-b91a-2698d545a0b0 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:36:24 devstack sudo[94496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-074ce519-1402-4842-9c17-e462a1f53c7c.1726566e-177d-4283-b91a-2698d545a0b0 Sep 06 06:36:24 devstack sudo[94496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:36:24 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [req-b59ebf27-208b-437b-801c-dc9dcd8a0355 req-3f472b3e-c054-4ecc-97af-9631aa7d2739 tempest-ServerActionsTestOtherA-968672787 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:36:24 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [req-b59ebf27-208b-437b-801c-dc9dcd8a0355 req-3f472b3e-c054-4ecc-97af-9631aa7d2739 tempest-ServerActionsTestOtherA-968672787 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:36:24 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [req-b59ebf27-208b-437b-801c-dc9dcd8a0355 req-3f472b3e-c054-4ecc-97af-9631aa7d2739 tempest-ServerActionsTestOtherA-968672787 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.027s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:36:24 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [req-b59ebf27-208b-437b-801c-dc9dcd8a0355 req-3f472b3e-c054-4ecc-97af-9631aa7d2739 tempest-ServerActionsTestOtherA-968672787 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6', 'name': 'volume-a774c547-4c1b-4488-a78c-6fd485434966', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'eaf5b25e-ac23-4a9f-9c7e-b1f678c025a0', 'enforce_multipath': True} {{(pid=87329) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 06 06:36:24 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-f8978b57-e60b-476a-8879-9cd17d2bdff9 tempest-VolumesSnapshotListTestJSON-1542588238 None] Acquiring lock "cinder-302792cb-7ed5-40c2-8407-5b3c1bd84c4b-delete_snapshot" by "delete_snapshot" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:36:24 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-f8978b57-e60b-476a-8879-9cd17d2bdff9 tempest-VolumesSnapshotListTestJSON-1542588238 None] Lock "cinder-302792cb-7ed5-40c2-8407-5b3c1bd84c4b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:36:24 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-f8978b57-e60b-476a-8879-9cd17d2bdff9 tempest-VolumesSnapshotListTestJSON-1542588238 None] Acquiring lock "cinder-quobyte-bbd7169e-4b49-4218-b985-e33207c190e1" by "delete_snapshot" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:36:24 devstack cinder-volume[87329]: INFO cinder.volume.manager [req-b59ebf27-208b-437b-801c-dc9dcd8a0355 req-3f472b3e-c054-4ecc-97af-9631aa7d2739 tempest-ServerActionsTestOtherA-968672787 None] attachment_update completed successfully. Sep 06 06:36:24 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-f8978b57-e60b-476a-8879-9cd17d2bdff9 tempest-VolumesSnapshotListTestJSON-1542588238 None] Lock "cinder-quobyte-bbd7169e-4b49-4218-b985-e33207c190e1" acquired by "delete_snapshot" :: waited 0.045s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:36:24 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-f8978b57-e60b-476a-8879-9cd17d2bdff9 tempest-VolumesSnapshotListTestJSON-1542588238 None] Acquiring lock "cinder-quobyte-302792cb-7ed5-40c2-8407-5b3c1bd84c4b" by "_delete_snapshot" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:36:24 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-f8978b57-e60b-476a-8879-9cd17d2bdff9 tempest-VolumesSnapshotListTestJSON-1542588238 None] Lock "cinder-quobyte-302792cb-7ed5-40c2-8407-5b3c1bd84c4b" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:36:24 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-f8978b57-e60b-476a-8879-9cd17d2bdff9 tempest-VolumesSnapshotListTestJSON-1542588238 None] Deleting offline snapshot 302792cb-7ed5-40c2-8407-5b3c1bd84c4b of volume bbd7169e-4b49-4218-b985-e33207c190e1 {{(pid=87329) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 06 06:36:24 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-f8978b57-e60b-476a-8879-9cd17d2bdff9 tempest-VolumesSnapshotListTestJSON-1542588238 None] snapshot_file for this snap is: volume-bbd7169e-4b49-4218-b985-e33207c190e1.302792cb-7ed5-40c2-8407-5b3c1bd84c4b {{(pid=87329) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 06 06:36:24 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab296c63-b41f-4320-a47f-2a722b8ab1fa]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:36:24 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-f8978b57-e60b-476a-8879-9cd17d2bdff9 tempest-VolumesSnapshotListTestJSON-1542588238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bbd7169e-4b49-4218-b985-e33207c190e1.302792cb-7ed5-40c2-8407-5b3c1bd84c4b {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:36:24 devstack sudo[94504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bbd7169e-4b49-4218-b985-e33207c190e1.302792cb-7ed5-40c2-8407-5b3c1bd84c4b Sep 06 06:36:24 devstack sudo[94504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:36:24 devstack sudo[94496]: pam_unix(sudo:session): session closed for user root Sep 06 06:36:24 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-c52fd686-dffa-4d1d-afc7-7cd0f5537fab tempest-SnapshotsActionsTest-353968158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-074ce519-1402-4842-9c17-e462a1f53c7c.1726566e-177d-4283-b91a-2698d545a0b0" returned: 0 in 0.600s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:36:24 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-c52fd686-dffa-4d1d-afc7-7cd0f5537fab tempest-SnapshotsActionsTest-353968158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-074ce519-1402-4842-9c17-e462a1f53c7c.1726566e-177d-4283-b91a-2698d545a0b0 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:36:24 devstack sudo[94507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-074ce519-1402-4842-9c17-e462a1f53c7c.1726566e-177d-4283-b91a-2698d545a0b0 Sep 06 06:36:24 devstack sudo[94507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:36:25 devstack sudo[94504]: pam_unix(sudo:session): session closed for user root Sep 06 06:36:25 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-f8978b57-e60b-476a-8879-9cd17d2bdff9 tempest-VolumesSnapshotListTestJSON-1542588238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bbd7169e-4b49-4218-b985-e33207c190e1.302792cb-7ed5-40c2-8407-5b3c1bd84c4b" returned: 0 in 0.484s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:36:25 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-f8978b57-e60b-476a-8879-9cd17d2bdff9 tempest-VolumesSnapshotListTestJSON-1542588238 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bbd7169e-4b49-4218-b985-e33207c190e1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87329) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 06:36:25 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-c52fd686-dffa-4d1d-afc7-7cd0f5537fab tempest-SnapshotsActionsTest-353968158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-074ce519-1402-4842-9c17-e462a1f53c7c.1726566e-177d-4283-b91a-2698d545a0b0" returned: 0 in 0.354s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:36:25 devstack sudo[94507]: pam_unix(sudo:session): session closed for user root Sep 06 06:36:25 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5f3dd6b-0a8b-4c6d-8ee4-fd3f9c9592bd]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:36:25 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-f8978b57-e60b-476a-8879-9cd17d2bdff9 tempest-VolumesSnapshotListTestJSON-1542588238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bbd7169e-4b49-4218-b985-e33207c190e1.83c5d8e7-6431-48af-894b-20c1a94de7ab {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:36:25 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-c52fd686-dffa-4d1d-afc7-7cd0f5537fab tempest-SnapshotsActionsTest-353968158 None] Lock "cinder-quobyte-1726566e-177d-4283-b91a-2698d545a0b0" released by "_delete_snapshot" :: held 1.989s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:36:25 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-c52fd686-dffa-4d1d-afc7-7cd0f5537fab tempest-SnapshotsActionsTest-353968158 None] Lock "cinder-quobyte-074ce519-1402-4842-9c17-e462a1f53c7c" released by "delete_snapshot" :: held 2.037s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:36:25 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-c52fd686-dffa-4d1d-afc7-7cd0f5537fab tempest-SnapshotsActionsTest-353968158 None] Created reservations ['9ace370e-aac0-4b03-8dd8-21486408e202', '99f17e2f-b6cf-43c6-8cf1-d9749b857452', '1ffcf399-a15c-40fb-bf94-8ae0c5fda4e6', '8abc7975-b433-405d-b402-45866f50609e'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:36:25 devstack sudo[94588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bbd7169e-4b49-4218-b985-e33207c190e1.83c5d8e7-6431-48af-894b-20c1a94de7ab Sep 06 06:36:25 devstack sudo[94588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:36:25 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-c52fd686-dffa-4d1d-afc7-7cd0f5537fab tempest-SnapshotsActionsTest-353968158 None] Delete snapshot completed successfully. Sep 06 06:36:25 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-c52fd686-dffa-4d1d-afc7-7cd0f5537fab tempest-SnapshotsActionsTest-353968158 None] Lock "cinder-1726566e-177d-4283-b91a-2698d545a0b0-delete_snapshot" released by "delete_snapshot" :: held 2.300s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:36:25 devstack sudo[94588]: pam_unix(sudo:session): session closed for user root Sep 06 06:36:25 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-f8978b57-e60b-476a-8879-9cd17d2bdff9 tempest-VolumesSnapshotListTestJSON-1542588238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bbd7169e-4b49-4218-b985-e33207c190e1.83c5d8e7-6431-48af-894b-20c1a94de7ab" returned: 0 in 0.609s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:36:25 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-f8978b57-e60b-476a-8879-9cd17d2bdff9 tempest-VolumesSnapshotListTestJSON-1542588238 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bbd7169e-4b49-4218-b985-e33207c190e1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87329) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 06:36:25 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-f8978b57-e60b-476a-8879-9cd17d2bdff9 tempest-VolumesSnapshotListTestJSON-1542588238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bbd7169e-4b49-4218-b985-e33207c190e1.302792cb-7ed5-40c2-8407-5b3c1bd84c4b {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:36:26 devstack sudo[94930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bbd7169e-4b49-4218-b985-e33207c190e1.302792cb-7ed5-40c2-8407-5b3c1bd84c4b Sep 06 06:36:26 devstack sudo[94930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:36:26 devstack sudo[94930]: pam_unix(sudo:session): session closed for user root Sep 06 06:36:26 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-f8978b57-e60b-476a-8879-9cd17d2bdff9 tempest-VolumesSnapshotListTestJSON-1542588238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bbd7169e-4b49-4218-b985-e33207c190e1.302792cb-7ed5-40c2-8407-5b3c1bd84c4b" returned: 0 in 0.448s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:36:26 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-f8978b57-e60b-476a-8879-9cd17d2bdff9 tempest-VolumesSnapshotListTestJSON-1542588238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bbd7169e-4b49-4218-b985-e33207c190e1.302792cb-7ed5-40c2-8407-5b3c1bd84c4b {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:36:26 devstack sudo[94943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bbd7169e-4b49-4218-b985-e33207c190e1.302792cb-7ed5-40c2-8407-5b3c1bd84c4b Sep 06 06:36:26 devstack sudo[94943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:36:26 devstack sudo[94943]: pam_unix(sudo:session): session closed for user root Sep 06 06:36:26 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-f8978b57-e60b-476a-8879-9cd17d2bdff9 tempest-VolumesSnapshotListTestJSON-1542588238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bbd7169e-4b49-4218-b985-e33207c190e1.302792cb-7ed5-40c2-8407-5b3c1bd84c4b" returned: 0 in 0.427s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:36:26 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-f8978b57-e60b-476a-8879-9cd17d2bdff9 tempest-VolumesSnapshotListTestJSON-1542588238 None] Lock "cinder-quobyte-302792cb-7ed5-40c2-8407-5b3c1bd84c4b" released by "_delete_snapshot" :: held 2.144s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:36:26 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-f8978b57-e60b-476a-8879-9cd17d2bdff9 tempest-VolumesSnapshotListTestJSON-1542588238 None] Lock "cinder-quobyte-bbd7169e-4b49-4218-b985-e33207c190e1" released by "delete_snapshot" :: held 2.188s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:36:26 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-f8978b57-e60b-476a-8879-9cd17d2bdff9 tempest-VolumesSnapshotListTestJSON-1542588238 None] Created reservations ['0e4f5ed4-8529-42e7-8568-f06619d4a067', '8716f3c3-c5da-48d2-9e8d-503b6966baa4', '8fdb22ea-ec96-4b62-9987-e0133feb54b5', '02227b71-7eda-463b-88f9-cf519594ad87'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:36:27 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-f8978b57-e60b-476a-8879-9cd17d2bdff9 tempest-VolumesSnapshotListTestJSON-1542588238 None] Delete snapshot completed successfully. Sep 06 06:36:27 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-f8978b57-e60b-476a-8879-9cd17d2bdff9 tempest-VolumesSnapshotListTestJSON-1542588238 None] Lock "cinder-302792cb-7ed5-40c2-8407-5b3c1bd84c4b-delete_snapshot" released by "delete_snapshot" :: held 2.398s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:36:27 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-9f904d7c-02d7-4c8e-b54e-a8c7a27d306f tempest-SnapshotsActionsTest-1031586015 None] Acquiring lock "cinder-719717da-f08d-473f-9308-d29b2eb0639a-delete_snapshot" by "delete_snapshot" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:36:27 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-9f904d7c-02d7-4c8e-b54e-a8c7a27d306f tempest-SnapshotsActionsTest-1031586015 None] Lock "cinder-719717da-f08d-473f-9308-d29b2eb0639a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.080s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:36:27 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-9f904d7c-02d7-4c8e-b54e-a8c7a27d306f tempest-SnapshotsActionsTest-1031586015 None] Acquiring lock "cinder-quobyte-074ce519-1402-4842-9c17-e462a1f53c7c" by "delete_snapshot" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:36:27 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-9f904d7c-02d7-4c8e-b54e-a8c7a27d306f tempest-SnapshotsActionsTest-1031586015 None] Lock "cinder-quobyte-074ce519-1402-4842-9c17-e462a1f53c7c" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:36:27 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-9f904d7c-02d7-4c8e-b54e-a8c7a27d306f tempest-SnapshotsActionsTest-1031586015 None] Acquiring lock "cinder-quobyte-719717da-f08d-473f-9308-d29b2eb0639a" by "_delete_snapshot" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:36:27 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-9f904d7c-02d7-4c8e-b54e-a8c7a27d306f tempest-SnapshotsActionsTest-1031586015 None] Lock "cinder-quobyte-719717da-f08d-473f-9308-d29b2eb0639a" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:36:27 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-9f904d7c-02d7-4c8e-b54e-a8c7a27d306f tempest-SnapshotsActionsTest-1031586015 None] Deleting offline snapshot 719717da-f08d-473f-9308-d29b2eb0639a of volume 074ce519-1402-4842-9c17-e462a1f53c7c {{(pid=87329) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 06 06:36:27 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-9f904d7c-02d7-4c8e-b54e-a8c7a27d306f tempest-SnapshotsActionsTest-1031586015 None] snapshot_file for this snap is: volume-074ce519-1402-4842-9c17-e462a1f53c7c.719717da-f08d-473f-9308-d29b2eb0639a {{(pid=87329) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 06 06:36:27 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a911af1-b7f7-4a8e-95ae-3f93e7e663a6]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:36:27 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-9f904d7c-02d7-4c8e-b54e-a8c7a27d306f tempest-SnapshotsActionsTest-1031586015 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-074ce519-1402-4842-9c17-e462a1f53c7c.719717da-f08d-473f-9308-d29b2eb0639a {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:36:27 devstack sudo[94949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-074ce519-1402-4842-9c17-e462a1f53c7c.719717da-f08d-473f-9308-d29b2eb0639a Sep 06 06:36:27 devstack sudo[94949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:36:27 devstack sudo[94949]: pam_unix(sudo:session): session closed for user root Sep 06 06:36:27 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-9f904d7c-02d7-4c8e-b54e-a8c7a27d306f tempest-SnapshotsActionsTest-1031586015 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-074ce519-1402-4842-9c17-e462a1f53c7c.719717da-f08d-473f-9308-d29b2eb0639a" returned: 0 in 0.448s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:36:27 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-9f904d7c-02d7-4c8e-b54e-a8c7a27d306f tempest-SnapshotsActionsTest-1031586015 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-074ce519-1402-4842-9c17-e462a1f53c7c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87329) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 06:36:27 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[942a6a1c-c3ab-48f7-ac0f-4e8c7a884ead]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:36:27 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-9f904d7c-02d7-4c8e-b54e-a8c7a27d306f tempest-SnapshotsActionsTest-1031586015 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-074ce519-1402-4842-9c17-e462a1f53c7c {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:36:27 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-14106e59-86fe-4410-bbd2-1a9ee63f0ec7 tempest-VolumesSnapshotListTestJSON-1542588238 None] Acquiring lock "cinder-83c5d8e7-6431-48af-894b-20c1a94de7ab-delete_snapshot" by "delete_snapshot" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:36:27 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-14106e59-86fe-4410-bbd2-1a9ee63f0ec7 tempest-VolumesSnapshotListTestJSON-1542588238 None] Lock "cinder-83c5d8e7-6431-48af-894b-20c1a94de7ab-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:36:27 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-14106e59-86fe-4410-bbd2-1a9ee63f0ec7 tempest-VolumesSnapshotListTestJSON-1542588238 None] Acquiring lock "cinder-quobyte-bbd7169e-4b49-4218-b985-e33207c190e1" by "delete_snapshot" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:36:27 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-14106e59-86fe-4410-bbd2-1a9ee63f0ec7 tempest-VolumesSnapshotListTestJSON-1542588238 None] Lock "cinder-quobyte-bbd7169e-4b49-4218-b985-e33207c190e1" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:36:27 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-14106e59-86fe-4410-bbd2-1a9ee63f0ec7 tempest-VolumesSnapshotListTestJSON-1542588238 None] Acquiring lock "cinder-quobyte-83c5d8e7-6431-48af-894b-20c1a94de7ab" by "_delete_snapshot" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:36:27 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-14106e59-86fe-4410-bbd2-1a9ee63f0ec7 tempest-VolumesSnapshotListTestJSON-1542588238 None] Lock "cinder-quobyte-83c5d8e7-6431-48af-894b-20c1a94de7ab" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:36:27 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-14106e59-86fe-4410-bbd2-1a9ee63f0ec7 tempest-VolumesSnapshotListTestJSON-1542588238 None] Deleting offline snapshot 83c5d8e7-6431-48af-894b-20c1a94de7ab of volume bbd7169e-4b49-4218-b985-e33207c190e1 {{(pid=87329) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 06 06:36:28 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-14106e59-86fe-4410-bbd2-1a9ee63f0ec7 tempest-VolumesSnapshotListTestJSON-1542588238 None] snapshot_file for this snap is: volume-bbd7169e-4b49-4218-b985-e33207c190e1.83c5d8e7-6431-48af-894b-20c1a94de7ab {{(pid=87329) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 06 06:36:28 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f8a72b4-742c-4249-8a91-d59517f199f2]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:36:28 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-14106e59-86fe-4410-bbd2-1a9ee63f0ec7 tempest-VolumesSnapshotListTestJSON-1542588238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bbd7169e-4b49-4218-b985-e33207c190e1.83c5d8e7-6431-48af-894b-20c1a94de7ab {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:36:28 devstack sudo[94955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-074ce519-1402-4842-9c17-e462a1f53c7c Sep 06 06:36:28 devstack sudo[94955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:36:28 devstack sudo[94956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bbd7169e-4b49-4218-b985-e33207c190e1.83c5d8e7-6431-48af-894b-20c1a94de7ab Sep 06 06:36:28 devstack sudo[94956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:36:28 devstack sudo[94955]: pam_unix(sudo:session): session closed for user root Sep 06 06:36:28 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-9f904d7c-02d7-4c8e-b54e-a8c7a27d306f tempest-SnapshotsActionsTest-1031586015 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-074ce519-1402-4842-9c17-e462a1f53c7c" returned: 0 in 0.600s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:36:28 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-9f904d7c-02d7-4c8e-b54e-a8c7a27d306f tempest-SnapshotsActionsTest-1031586015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-074ce519-1402-4842-9c17-e462a1f53c7c.719717da-f08d-473f-9308-d29b2eb0639a {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:36:28 devstack sudo[94963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-074ce519-1402-4842-9c17-e462a1f53c7c.719717da-f08d-473f-9308-d29b2eb0639a Sep 06 06:36:28 devstack sudo[94963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:36:28 devstack sudo[94956]: pam_unix(sudo:session): session closed for user root Sep 06 06:36:28 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-14106e59-86fe-4410-bbd2-1a9ee63f0ec7 tempest-VolumesSnapshotListTestJSON-1542588238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bbd7169e-4b49-4218-b985-e33207c190e1.83c5d8e7-6431-48af-894b-20c1a94de7ab" returned: 0 in 0.715s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:36:28 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-14106e59-86fe-4410-bbd2-1a9ee63f0ec7 tempest-VolumesSnapshotListTestJSON-1542588238 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bbd7169e-4b49-4218-b985-e33207c190e1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87329) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 06:36:28 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1a3ef5a-9d53-4ed6-8720-2c7328379492]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:36:28 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-14106e59-86fe-4410-bbd2-1a9ee63f0ec7 tempest-VolumesSnapshotListTestJSON-1542588238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bbd7169e-4b49-4218-b985-e33207c190e1 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:36:29 devstack sudo[94968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bbd7169e-4b49-4218-b985-e33207c190e1 Sep 06 06:36:29 devstack sudo[94968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:36:29 devstack sudo[94963]: pam_unix(sudo:session): session closed for user root Sep 06 06:36:29 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-9f904d7c-02d7-4c8e-b54e-a8c7a27d306f tempest-SnapshotsActionsTest-1031586015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-074ce519-1402-4842-9c17-e462a1f53c7c.719717da-f08d-473f-9308-d29b2eb0639a" returned: 0 in 0.945s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:36:29 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-9f904d7c-02d7-4c8e-b54e-a8c7a27d306f tempest-SnapshotsActionsTest-1031586015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-074ce519-1402-4842-9c17-e462a1f53c7c.719717da-f08d-473f-9308-d29b2eb0639a {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:36:29 devstack sudo[94968]: pam_unix(sudo:session): session closed for user root Sep 06 06:36:29 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-14106e59-86fe-4410-bbd2-1a9ee63f0ec7 tempest-VolumesSnapshotListTestJSON-1542588238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bbd7169e-4b49-4218-b985-e33207c190e1" returned: 0 in 0.642s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:36:29 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-14106e59-86fe-4410-bbd2-1a9ee63f0ec7 tempest-VolumesSnapshotListTestJSON-1542588238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bbd7169e-4b49-4218-b985-e33207c190e1.83c5d8e7-6431-48af-894b-20c1a94de7ab {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:36:29 devstack sudo[94978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-074ce519-1402-4842-9c17-e462a1f53c7c.719717da-f08d-473f-9308-d29b2eb0639a Sep 06 06:36:29 devstack sudo[94978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:36:29 devstack sudo[94980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bbd7169e-4b49-4218-b985-e33207c190e1.83c5d8e7-6431-48af-894b-20c1a94de7ab Sep 06 06:36:29 devstack sudo[94980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:36:29 devstack sudo[94978]: pam_unix(sudo:session): session closed for user root Sep 06 06:36:29 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-9f904d7c-02d7-4c8e-b54e-a8c7a27d306f tempest-SnapshotsActionsTest-1031586015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-074ce519-1402-4842-9c17-e462a1f53c7c.719717da-f08d-473f-9308-d29b2eb0639a" returned: 0 in 0.361s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:36:29 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-9f904d7c-02d7-4c8e-b54e-a8c7a27d306f tempest-SnapshotsActionsTest-1031586015 None] Lock "cinder-quobyte-719717da-f08d-473f-9308-d29b2eb0639a" released by "_delete_snapshot" :: held 2.564s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:36:29 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-9f904d7c-02d7-4c8e-b54e-a8c7a27d306f tempest-SnapshotsActionsTest-1031586015 None] Lock "cinder-quobyte-074ce519-1402-4842-9c17-e462a1f53c7c" released by "delete_snapshot" :: held 2.619s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:36:30 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-9f904d7c-02d7-4c8e-b54e-a8c7a27d306f tempest-SnapshotsActionsTest-1031586015 None] Created reservations ['1d8b78a4-aa53-4f64-af77-2b7b341b1b0d', 'e4c27787-653f-4041-9370-4c927b84d64c', '3bea0d1d-e157-4a81-8f45-c8331d7a9897', '1c976e6f-ad8e-46ad-8352-6bdb144b06d8'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:36:30 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-9f904d7c-02d7-4c8e-b54e-a8c7a27d306f tempest-SnapshotsActionsTest-1031586015 None] Delete snapshot completed successfully. Sep 06 06:36:30 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-9f904d7c-02d7-4c8e-b54e-a8c7a27d306f tempest-SnapshotsActionsTest-1031586015 None] Lock "cinder-719717da-f08d-473f-9308-d29b2eb0639a-delete_snapshot" released by "delete_snapshot" :: held 3.012s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:36:30 devstack sudo[94980]: pam_unix(sudo:session): session closed for user root Sep 06 06:36:30 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-14106e59-86fe-4410-bbd2-1a9ee63f0ec7 tempest-VolumesSnapshotListTestJSON-1542588238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bbd7169e-4b49-4218-b985-e33207c190e1.83c5d8e7-6431-48af-894b-20c1a94de7ab" returned: 0 in 0.812s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:36:30 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-14106e59-86fe-4410-bbd2-1a9ee63f0ec7 tempest-VolumesSnapshotListTestJSON-1542588238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bbd7169e-4b49-4218-b985-e33207c190e1.83c5d8e7-6431-48af-894b-20c1a94de7ab {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:36:30 devstack sudo[94986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bbd7169e-4b49-4218-b985-e33207c190e1.83c5d8e7-6431-48af-894b-20c1a94de7ab Sep 06 06:36:30 devstack sudo[94986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:36:30 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-832ab95b-b617-418c-9376-226a37eb6dfc tempest-SnapshotsActionsTest-1031586015 None] Acquiring lock "cinder-074ce519-1402-4842-9c17-e462a1f53c7c-delete_volume" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:36:30 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-832ab95b-b617-418c-9376-226a37eb6dfc tempest-SnapshotsActionsTest-1031586015 None] Lock "cinder-074ce519-1402-4842-9c17-e462a1f53c7c-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:36:30 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-832ab95b-b617-418c-9376-226a37eb6dfc tempest-SnapshotsActionsTest-1031586015 None] Acquiring lock "cinder-quobyte-074ce519-1402-4842-9c17-e462a1f53c7c" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:36:30 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-832ab95b-b617-418c-9376-226a37eb6dfc tempest-SnapshotsActionsTest-1031586015 None] Lock "cinder-quobyte-074ce519-1402-4842-9c17-e462a1f53c7c" acquired by "delete_volume" :: waited 0.030s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:36:30 devstack sudo[94986]: pam_unix(sudo:session): session closed for user root Sep 06 06:36:31 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-14106e59-86fe-4410-bbd2-1a9ee63f0ec7 tempest-VolumesSnapshotListTestJSON-1542588238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bbd7169e-4b49-4218-b985-e33207c190e1.83c5d8e7-6431-48af-894b-20c1a94de7ab" returned: 0 in 0.741s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:36:31 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[928a1353-bb5d-4943-a23d-4940b9f67fe9]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:36:31 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-832ab95b-b617-418c-9376-226a37eb6dfc tempest-SnapshotsActionsTest-1031586015 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-074ce519-1402-4842-9c17-e462a1f53c7c {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:36:31 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-14106e59-86fe-4410-bbd2-1a9ee63f0ec7 tempest-VolumesSnapshotListTestJSON-1542588238 None] Lock "cinder-quobyte-83c5d8e7-6431-48af-894b-20c1a94de7ab" released by "_delete_snapshot" :: held 3.160s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:36:31 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-14106e59-86fe-4410-bbd2-1a9ee63f0ec7 tempest-VolumesSnapshotListTestJSON-1542588238 None] Lock "cinder-quobyte-bbd7169e-4b49-4218-b985-e33207c190e1" released by "delete_snapshot" :: held 3.197s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:36:31 devstack sudo[94990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-074ce519-1402-4842-9c17-e462a1f53c7c Sep 06 06:36:31 devstack sudo[94990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:36:31 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-14106e59-86fe-4410-bbd2-1a9ee63f0ec7 tempest-VolumesSnapshotListTestJSON-1542588238 None] Created reservations ['4e74e1c4-bf91-4bde-a453-4de133f5a392', '1df61f00-1219-47d7-aa02-eb31c3a66baf', '6cfbf556-be17-4df5-86c5-61ec9e8a0d67', '07591708-a7fc-4d34-a4b1-44bb9de69ccd'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:36:31 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-14106e59-86fe-4410-bbd2-1a9ee63f0ec7 tempest-VolumesSnapshotListTestJSON-1542588238 None] Delete snapshot completed successfully. Sep 06 06:36:31 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-14106e59-86fe-4410-bbd2-1a9ee63f0ec7 tempest-VolumesSnapshotListTestJSON-1542588238 None] Lock "cinder-83c5d8e7-6431-48af-894b-20c1a94de7ab-delete_snapshot" released by "delete_snapshot" :: held 3.546s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:36:31 devstack sudo[94990]: pam_unix(sudo:session): session closed for user root Sep 06 06:36:31 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-832ab95b-b617-418c-9376-226a37eb6dfc tempest-SnapshotsActionsTest-1031586015 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-074ce519-1402-4842-9c17-e462a1f53c7c" returned: 0 in 0.529s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:36:31 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-832ab95b-b617-418c-9376-226a37eb6dfc tempest-SnapshotsActionsTest-1031586015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-074ce519-1402-4842-9c17-e462a1f53c7c {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:36:31 devstack sudo[94995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-074ce519-1402-4842-9c17-e462a1f53c7c Sep 06 06:36:31 devstack sudo[94995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:36:31 devstack sudo[94995]: pam_unix(sudo:session): session closed for user root Sep 06 06:36:31 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-832ab95b-b617-418c-9376-226a37eb6dfc tempest-SnapshotsActionsTest-1031586015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-074ce519-1402-4842-9c17-e462a1f53c7c" returned: 0 in 0.265s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:36:31 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-832ab95b-b617-418c-9376-226a37eb6dfc tempest-SnapshotsActionsTest-1031586015 None] Lock "cinder-quobyte-074ce519-1402-4842-9c17-e462a1f53c7c" released by "delete_volume" :: held 0.911s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:36:31 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-832ab95b-b617-418c-9376-226a37eb6dfc tempest-SnapshotsActionsTest-1031586015 None] Created reservations ['6ab26dd1-9ba8-40f4-aa04-f8f8a0760307', '95633cbd-b5c4-4056-a185-05a1e1197ed9', 'c2a103a3-29c7-440e-a8df-3517341bccdc', 'd47de19a-e3d4-4c0c-b3f9-4b375d922858'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:36:32 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-832ab95b-b617-418c-9376-226a37eb6dfc tempest-SnapshotsActionsTest-1031586015 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:36:32 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-832ab95b-b617-418c-9376-226a37eb6dfc tempest-SnapshotsActionsTest-1031586015 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:36:32 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-832ab95b-b617-418c-9376-226a37eb6dfc tempest-SnapshotsActionsTest-1031586015 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:36:32 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-832ab95b-b617-418c-9376-226a37eb6dfc tempest-SnapshotsActionsTest-1031586015 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:36:32 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-832ab95b-b617-418c-9376-226a37eb6dfc tempest-SnapshotsActionsTest-1031586015 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:36:32 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-832ab95b-b617-418c-9376-226a37eb6dfc tempest-SnapshotsActionsTest-1031586015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:36:32 devstack sudo[94998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:36:32 devstack sudo[94998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:36:32 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-592d2463-3983-4e0d-9a14-0d0f8eb6bcdb tempest-VolumesSnapshotListTestJSON-1542588238 None] Acquiring lock "cinder-bbd7169e-4b49-4218-b985-e33207c190e1-delete_volume" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:36:32 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-592d2463-3983-4e0d-9a14-0d0f8eb6bcdb tempest-VolumesSnapshotListTestJSON-1542588238 None] Lock "cinder-bbd7169e-4b49-4218-b985-e33207c190e1-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:36:32 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-592d2463-3983-4e0d-9a14-0d0f8eb6bcdb tempest-VolumesSnapshotListTestJSON-1542588238 None] Acquiring lock "cinder-quobyte-bbd7169e-4b49-4218-b985-e33207c190e1" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:36:32 devstack sudo[94998]: pam_unix(sudo:session): session closed for user root Sep 06 06:36:32 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-832ab95b-b617-418c-9376-226a37eb6dfc tempest-SnapshotsActionsTest-1031586015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.661s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:36:32 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-832ab95b-b617-418c-9376-226a37eb6dfc tempest-SnapshotsActionsTest-1031586015 None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:36:32 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-832ab95b-b617-418c-9376-226a37eb6dfc tempest-SnapshotsActionsTest-1031586015 None] Deleted volume successfully. Sep 06 06:36:32 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-592d2463-3983-4e0d-9a14-0d0f8eb6bcdb tempest-VolumesSnapshotListTestJSON-1542588238 None] Lock "cinder-quobyte-bbd7169e-4b49-4218-b985-e33207c190e1" acquired by "delete_volume" :: waited 0.063s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:36:32 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[839d72ca-bb92-4bc7-83de-5ceaebea057f]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:36:32 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-592d2463-3983-4e0d-9a14-0d0f8eb6bcdb tempest-VolumesSnapshotListTestJSON-1542588238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bbd7169e-4b49-4218-b985-e33207c190e1 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:36:32 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-832ab95b-b617-418c-9376-226a37eb6dfc tempest-SnapshotsActionsTest-1031586015 None] Lock "cinder-074ce519-1402-4842-9c17-e462a1f53c7c-delete_volume" released by "delete_volume" :: held 2.068s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:36:33 devstack sudo[95003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bbd7169e-4b49-4218-b985-e33207c190e1 Sep 06 06:36:33 devstack sudo[95003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:36:33 devstack sudo[95003]: pam_unix(sudo:session): session closed for user root Sep 06 06:36:33 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-592d2463-3983-4e0d-9a14-0d0f8eb6bcdb tempest-VolumesSnapshotListTestJSON-1542588238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bbd7169e-4b49-4218-b985-e33207c190e1" returned: 0 in 0.582s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:36:33 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-592d2463-3983-4e0d-9a14-0d0f8eb6bcdb tempest-VolumesSnapshotListTestJSON-1542588238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bbd7169e-4b49-4218-b985-e33207c190e1 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:36:33 devstack sudo[95008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bbd7169e-4b49-4218-b985-e33207c190e1 Sep 06 06:36:33 devstack sudo[95008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:36:33 devstack sudo[95008]: pam_unix(sudo:session): session closed for user root Sep 06 06:36:33 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-592d2463-3983-4e0d-9a14-0d0f8eb6bcdb tempest-VolumesSnapshotListTestJSON-1542588238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bbd7169e-4b49-4218-b985-e33207c190e1" returned: 0 in 0.371s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:36:33 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-592d2463-3983-4e0d-9a14-0d0f8eb6bcdb tempest-VolumesSnapshotListTestJSON-1542588238 None] Lock "cinder-quobyte-bbd7169e-4b49-4218-b985-e33207c190e1" released by "delete_volume" :: held 1.080s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:36:33 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-592d2463-3983-4e0d-9a14-0d0f8eb6bcdb tempest-VolumesSnapshotListTestJSON-1542588238 None] Created reservations ['8f36b1d0-6b7b-4e7f-bf6f-00658c4e7fb6', '5ac41d84-7b58-44c7-96a0-4b8933104bef', 'c3309d2a-afd1-4b82-a88b-e84682614c69', 'fd4f4b24-4f12-45ce-a357-118700670fe2'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:36:34 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-592d2463-3983-4e0d-9a14-0d0f8eb6bcdb tempest-VolumesSnapshotListTestJSON-1542588238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:36:34 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-592d2463-3983-4e0d-9a14-0d0f8eb6bcdb tempest-VolumesSnapshotListTestJSON-1542588238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:36:34 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-592d2463-3983-4e0d-9a14-0d0f8eb6bcdb tempest-VolumesSnapshotListTestJSON-1542588238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:36:34 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-592d2463-3983-4e0d-9a14-0d0f8eb6bcdb tempest-VolumesSnapshotListTestJSON-1542588238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:36:34 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-592d2463-3983-4e0d-9a14-0d0f8eb6bcdb tempest-VolumesSnapshotListTestJSON-1542588238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:36:34 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-592d2463-3983-4e0d-9a14-0d0f8eb6bcdb tempest-VolumesSnapshotListTestJSON-1542588238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:36:34 devstack sudo[95011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:36:34 devstack sudo[95011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:36:34 devstack sudo[95011]: pam_unix(sudo:session): session closed for user root Sep 06 06:36:34 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-592d2463-3983-4e0d-9a14-0d0f8eb6bcdb tempest-VolumesSnapshotListTestJSON-1542588238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.498s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:36:34 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-592d2463-3983-4e0d-9a14-0d0f8eb6bcdb tempest-VolumesSnapshotListTestJSON-1542588238 None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:36:34 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-592d2463-3983-4e0d-9a14-0d0f8eb6bcdb tempest-VolumesSnapshotListTestJSON-1542588238 None] Deleted volume successfully. Sep 06 06:36:34 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-592d2463-3983-4e0d-9a14-0d0f8eb6bcdb tempest-VolumesSnapshotListTestJSON-1542588238 None] Lock "cinder-bbd7169e-4b49-4218-b985-e33207c190e1-delete_volume" released by "delete_volume" :: held 2.023s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:36:44 devstack cinder-volume[87329]: DEBUG dbcounter [-] [87329] Writing DB stats cinder:SELECT=135,cinder:UPDATE=112,cinder:INSERT=41,cinder:DELETE=8 {{(pid=87329) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 06:36:44 devstack cinder-volume[87329]: DEBUG dbcounter [-] [87329] Writing DB stats cinder:SELECT=122,cinder:UPDATE=127,cinder:INSERT=34,cinder:DELETE=10 {{(pid=87329) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 06:36:48 devstack cinder-volume[87329]: DEBUG oslo_service.periodic_task [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87329) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 06 06:36:48 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:36:48 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:36:48 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:36:48 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:36:48 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:36:48 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:36:48 devstack sudo[95085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:36:48 devstack sudo[95085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:36:48 devstack sudo[95085]: pam_unix(sudo:session): session closed for user root Sep 06 06:36:48 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.374s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:36:48 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:36:48 devstack cinder-volume[87329]: DEBUG oslo_service.periodic_task [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Running periodic task VolumeManager._thread_info {{(pid=87329) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 06 06:36:48 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] thread count: 28 {{(pid=87329) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 06 06:36:48 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] thread info: [<_MainThread(MainThread, started 126855043821696)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87329) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 06 06:36:49 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-f492c063-1f5f-4eec-8507-2c20c0cb6adb tempest-VolumesServicesTestJSON-1468857707 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87329) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 06:36:49 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-f492c063-1f5f-4eec-8507-2c20c0cb6adb tempest-VolumesServicesTestJSON-1468857707 None] Flow 'volume_create_manager' (72a1dcf1-e5d8-45e0-b15e-6556333cd2c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:36:49 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-f492c063-1f5f-4eec-8507-2c20c0cb6adb tempest-VolumesServicesTestJSON-1468857707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c35122ab-ca03-444d-b198-c0fba60058b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:36:49 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-f492c063-1f5f-4eec-8507-2c20c0cb6adb tempest-VolumesServicesTestJSON-1468857707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c35122ab-ca03-444d-b198-c0fba60058b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:36:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-584565506',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cecadad0-449c-4ba1-806f-f0f577bf8120,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69a581f2d77d48f7ae0785355e00a5b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:36:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:36:50Z,use_quota=True,user_id='35eaa4c1416444c881d62e07cbebda75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:36:49 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-f492c063-1f5f-4eec-8507-2c20c0cb6adb tempest-VolumesServicesTestJSON-1468857707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (850ab416-468e-4ca3-af1f-0d84221d0fcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:36:49 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-f492c063-1f5f-4eec-8507-2c20c0cb6adb tempest-VolumesServicesTestJSON-1468857707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (850ab416-468e-4ca3-af1f-0d84221d0fcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:36:49 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-f492c063-1f5f-4eec-8507-2c20c0cb6adb tempest-VolumesServicesTestJSON-1468857707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (004cf8db-291c-4f86-bb93-dba08551e718) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:36:49 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-f492c063-1f5f-4eec-8507-2c20c0cb6adb tempest-VolumesServicesTestJSON-1468857707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (004cf8db-291c-4f86-bb93-dba08551e718) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cecadad0-449c-4ba1-806f-f0f577bf8120', 'volume_name': 'volume-cecadad0-449c-4ba1-806f-f0f577bf8120', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:36:49 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-f492c063-1f5f-4eec-8507-2c20c0cb6adb tempest-VolumesServicesTestJSON-1468857707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9a0554f-a797-4107-8bb6-71bcdacd5dd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:36:49 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-f492c063-1f5f-4eec-8507-2c20c0cb6adb tempest-VolumesServicesTestJSON-1468857707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9a0554f-a797-4107-8bb6-71bcdacd5dd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:36:49 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-f492c063-1f5f-4eec-8507-2c20c0cb6adb tempest-VolumesServicesTestJSON-1468857707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b059f63-6a15-4901-ad44-7163455842fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:36:49 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-f492c063-1f5f-4eec-8507-2c20c0cb6adb tempest-VolumesServicesTestJSON-1468857707 None] Volume cecadad0-449c-4ba1-806f-f0f577bf8120: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cecadad0-449c-4ba1-806f-f0f577bf8120', 'volume_size': 1} Sep 06 06:36:49 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-f492c063-1f5f-4eec-8507-2c20c0cb6adb tempest-VolumesServicesTestJSON-1468857707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:36:49 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-f492c063-1f5f-4eec-8507-2c20c0cb6adb tempest-VolumesServicesTestJSON-1468857707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:36:49 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-f492c063-1f5f-4eec-8507-2c20c0cb6adb tempest-VolumesServicesTestJSON-1468857707 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:36:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-584565506',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cecadad0-449c-4ba1-806f-f0f577bf8120,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69a581f2d77d48f7ae0785355e00a5b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:36:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:36:50Z,use_quota=True,user_id='35eaa4c1416444c881d62e07cbebda75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)}" {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 06:36:49 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-f492c063-1f5f-4eec-8507-2c20c0cb6adb tempest-VolumesServicesTestJSON-1468857707 None] Creating volume cecadad0-449c-4ba1-806f-f0f577bf8120 {{(pid=87329) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 06:36:49 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-f492c063-1f5f-4eec-8507-2c20c0cb6adb tempest-VolumesServicesTestJSON-1468857707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:36:49 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-f492c063-1f5f-4eec-8507-2c20c0cb6adb tempest-VolumesServicesTestJSON-1468857707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:36:49 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-f492c063-1f5f-4eec-8507-2c20c0cb6adb tempest-VolumesServicesTestJSON-1468857707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:36:50 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-f492c063-1f5f-4eec-8507-2c20c0cb6adb tempest-VolumesServicesTestJSON-1468857707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:36:50 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-f492c063-1f5f-4eec-8507-2c20c0cb6adb tempest-VolumesServicesTestJSON-1468857707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:36:50 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-f492c063-1f5f-4eec-8507-2c20c0cb6adb tempest-VolumesServicesTestJSON-1468857707 None] Selected osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 as target Quobyte volume. {{(pid=87329) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 06:36:50 devstack cinder-volume[87329]: INFO cinder.volume.drivers.remotefs [None req-f492c063-1f5f-4eec-8507-2c20c0cb6adb tempest-VolumesServicesTestJSON-1468857707 None] casted to osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 Sep 06 06:36:50 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-f492c063-1f5f-4eec-8507-2c20c0cb6adb tempest-VolumesServicesTestJSON-1468857707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-cecadad0-449c-4ba1-806f-f0f577bf8120 1073741824 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:36:50 devstack sudo[95089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-cecadad0-449c-4ba1-806f-f0f577bf8120 1073741824 Sep 06 06:36:50 devstack sudo[95089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:36:50 devstack sudo[95089]: pam_unix(sudo:session): session closed for user root Sep 06 06:36:50 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-f492c063-1f5f-4eec-8507-2c20c0cb6adb tempest-VolumesServicesTestJSON-1468857707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-cecadad0-449c-4ba1-806f-f0f577bf8120 1073741824" returned: 0 in 0.596s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:36:50 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-f492c063-1f5f-4eec-8507-2c20c0cb6adb tempest-VolumesServicesTestJSON-1468857707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-cecadad0-449c-4ba1-806f-f0f577bf8120 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:36:50 devstack sudo[95095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-cecadad0-449c-4ba1-806f-f0f577bf8120 Sep 06 06:36:50 devstack sudo[95095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:36:50 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-0be7e5d8-8baf-4e82-84db-6b2d710e1832 tempest-GroupsV314Test-1495585002 None] Group tempest-GroupsV314Test-Group-2005321580: creating Sep 06 06:36:50 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-0be7e5d8-8baf-4e82-84db-6b2d710e1832 tempest-GroupsV314Test-1495585002 None] Group tempest-GroupsV314Test-Group-2005321580: created successfully Sep 06 06:36:50 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-0be7e5d8-8baf-4e82-84db-6b2d710e1832 tempest-GroupsV314Test-1495585002 None] Create group completed successfully. Sep 06 06:36:51 devstack sudo[95095]: pam_unix(sudo:session): session closed for user root Sep 06 06:36:51 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-f492c063-1f5f-4eec-8507-2c20c0cb6adb tempest-VolumesServicesTestJSON-1468857707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-cecadad0-449c-4ba1-806f-f0f577bf8120" returned: 0 in 0.368s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:36:51 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-f492c063-1f5f-4eec-8507-2c20c0cb6adb tempest-VolumesServicesTestJSON-1468857707 None] <== create_volume: return (1033ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'} {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 06:36:51 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-f492c063-1f5f-4eec-8507-2c20c0cb6adb tempest-VolumesServicesTestJSON-1468857707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.036s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:36:51 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-f492c063-1f5f-4eec-8507-2c20c0cb6adb tempest-VolumesServicesTestJSON-1468857707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b059f63-6a15-4901-ad44-7163455842fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cecadad0-449c-4ba1-806f-f0f577bf8120', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:36:51 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-f492c063-1f5f-4eec-8507-2c20c0cb6adb tempest-VolumesServicesTestJSON-1468857707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d51f070-10c3-4758-a57c-b6f82110931a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:36:51 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-f492c063-1f5f-4eec-8507-2c20c0cb6adb tempest-VolumesServicesTestJSON-1468857707 None] Volume volume-cecadad0-449c-4ba1-806f-f0f577bf8120 (cecadad0-449c-4ba1-806f-f0f577bf8120): created successfully Sep 06 06:36:51 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-f492c063-1f5f-4eec-8507-2c20c0cb6adb tempest-VolumesServicesTestJSON-1468857707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d51f070-10c3-4758-a57c-b6f82110931a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:36:51 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-f492c063-1f5f-4eec-8507-2c20c0cb6adb tempest-VolumesServicesTestJSON-1468857707 None] Flow 'volume_create_manager' (72a1dcf1-e5d8-45e0-b15e-6556333cd2c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:36:51 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-f492c063-1f5f-4eec-8507-2c20c0cb6adb tempest-VolumesServicesTestJSON-1468857707 None] Created volume successfully. Sep 06 06:36:52 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-059c8182-4164-444a-b9f6-f21b10a34d45 tempest-VolumesServicesTestJSON-1468857707 None] Acquiring lock "cinder-cecadad0-449c-4ba1-806f-f0f577bf8120-delete_volume" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:36:52 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-059c8182-4164-444a-b9f6-f21b10a34d45 tempest-VolumesServicesTestJSON-1468857707 None] Lock "cinder-cecadad0-449c-4ba1-806f-f0f577bf8120-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:36:52 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-059c8182-4164-444a-b9f6-f21b10a34d45 tempest-VolumesServicesTestJSON-1468857707 None] Acquiring lock "cinder-quobyte-cecadad0-449c-4ba1-806f-f0f577bf8120" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:36:52 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-059c8182-4164-444a-b9f6-f21b10a34d45 tempest-VolumesServicesTestJSON-1468857707 None] Lock "cinder-quobyte-cecadad0-449c-4ba1-806f-f0f577bf8120" acquired by "delete_volume" :: waited 0.023s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:36:52 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[d45421f1-fe77-4441-9ddf-e2c20e314155]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:36:52 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-059c8182-4164-444a-b9f6-f21b10a34d45 tempest-VolumesServicesTestJSON-1468857707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-cecadad0-449c-4ba1-806f-f0f577bf8120 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:36:52 devstack sudo[95098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-cecadad0-449c-4ba1-806f-f0f577bf8120 Sep 06 06:36:52 devstack sudo[95098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:36:52 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-9eac28a1-4cf9-4a88-8210-be5b5bb29fc6 tempest-GroupsV314Test-1495585002 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87329) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 06:36:52 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-9eac28a1-4cf9-4a88-8210-be5b5bb29fc6 tempest-GroupsV314Test-1495585002 None] Flow 'volume_create_manager' (39352f74-8b92-455f-a498-3c51fd2f0127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:36:52 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-9eac28a1-4cf9-4a88-8210-be5b5bb29fc6 tempest-GroupsV314Test-1495585002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccc6c180-4560-411a-bcca-116427a4a51c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:36:52 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-9eac28a1-4cf9-4a88-8210-be5b5bb29fc6 tempest-GroupsV314Test-1495585002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccc6c180-4560-411a-bcca-116427a4a51c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:36:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1039355374',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=78b6bf47-a00f-4913-8e90-e0bcbec472f2,host='devstack@QuobyteHD#QuobyteHD',id=6abeb7ab-d3a6-48d9-9a25-0e4c13e06cdd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='322dd19993484a62b5be0e58158f78ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:36:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:36:53Z,use_quota=True,user_id='8cc4f77cf85043e8b1309d0daafa7d55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca4c4a28-2f0c-4186-8ea8-4688a71767ad),volume_type_id=ca4c4a28-2f0c-4186-8ea8-4688a71767ad)' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:36:52 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-9eac28a1-4cf9-4a88-8210-be5b5bb29fc6 tempest-GroupsV314Test-1495585002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (771c8428-c532-4934-887d-9a3afcead2a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:36:52 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-9eac28a1-4cf9-4a88-8210-be5b5bb29fc6 tempest-GroupsV314Test-1495585002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (771c8428-c532-4934-887d-9a3afcead2a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:36:52 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-9eac28a1-4cf9-4a88-8210-be5b5bb29fc6 tempest-GroupsV314Test-1495585002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02a47d4f-d228-42b5-b012-05de9043b5e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:36:52 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-9eac28a1-4cf9-4a88-8210-be5b5bb29fc6 tempest-GroupsV314Test-1495585002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02a47d4f-d228-42b5-b012-05de9043b5e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6abeb7ab-d3a6-48d9-9a25-0e4c13e06cdd', 'volume_name': 'volume-6abeb7ab-d3a6-48d9-9a25-0e4c13e06cdd', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:36:52 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-9eac28a1-4cf9-4a88-8210-be5b5bb29fc6 tempest-GroupsV314Test-1495585002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f30b5f12-48ed-4938-8d16-2157b9ea06a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:36:52 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-9eac28a1-4cf9-4a88-8210-be5b5bb29fc6 tempest-GroupsV314Test-1495585002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f30b5f12-48ed-4938-8d16-2157b9ea06a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:36:52 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-9eac28a1-4cf9-4a88-8210-be5b5bb29fc6 tempest-GroupsV314Test-1495585002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3312cb06-b2b8-4cc3-b233-1354cef4b500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:36:52 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-9eac28a1-4cf9-4a88-8210-be5b5bb29fc6 tempest-GroupsV314Test-1495585002 None] Volume 6abeb7ab-d3a6-48d9-9a25-0e4c13e06cdd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6abeb7ab-d3a6-48d9-9a25-0e4c13e06cdd', 'volume_size': 1} Sep 06 06:36:52 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-9eac28a1-4cf9-4a88-8210-be5b5bb29fc6 tempest-GroupsV314Test-1495585002 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:36:52 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-9eac28a1-4cf9-4a88-8210-be5b5bb29fc6 tempest-GroupsV314Test-1495585002 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:36:52 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-9eac28a1-4cf9-4a88-8210-be5b5bb29fc6 tempest-GroupsV314Test-1495585002 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=78b6bf47-a00f-4913-8e90-e0bcbec472f2,created_at=2026-09-06T04:36:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1039355374',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=78b6bf47-a00f-4913-8e90-e0bcbec472f2,host='devstack@QuobyteHD#QuobyteHD',id=6abeb7ab-d3a6-48d9-9a25-0e4c13e06cdd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='322dd19993484a62b5be0e58158f78ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:36:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:36:53Z,use_quota=True,user_id='8cc4f77cf85043e8b1309d0daafa7d55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca4c4a28-2f0c-4186-8ea8-4688a71767ad),volume_type_id=ca4c4a28-2f0c-4186-8ea8-4688a71767ad)}" {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 06:36:52 devstack sudo[95098]: pam_unix(sudo:session): session closed for user root Sep 06 06:36:52 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-9eac28a1-4cf9-4a88-8210-be5b5bb29fc6 tempest-GroupsV314Test-1495585002 None] Creating volume 6abeb7ab-d3a6-48d9-9a25-0e4c13e06cdd {{(pid=87329) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 06:36:52 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-9eac28a1-4cf9-4a88-8210-be5b5bb29fc6 tempest-GroupsV314Test-1495585002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:36:52 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-9eac28a1-4cf9-4a88-8210-be5b5bb29fc6 tempest-GroupsV314Test-1495585002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:36:52 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-9eac28a1-4cf9-4a88-8210-be5b5bb29fc6 tempest-GroupsV314Test-1495585002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:36:52 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-9eac28a1-4cf9-4a88-8210-be5b5bb29fc6 tempest-GroupsV314Test-1495585002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:36:52 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-9eac28a1-4cf9-4a88-8210-be5b5bb29fc6 tempest-GroupsV314Test-1495585002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:36:52 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-9eac28a1-4cf9-4a88-8210-be5b5bb29fc6 tempest-GroupsV314Test-1495585002 None] Selected osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 as target Quobyte volume. {{(pid=87329) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 06:36:52 devstack cinder-volume[87329]: INFO cinder.volume.drivers.remotefs [None req-9eac28a1-4cf9-4a88-8210-be5b5bb29fc6 tempest-GroupsV314Test-1495585002 None] casted to osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 Sep 06 06:36:52 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-9eac28a1-4cf9-4a88-8210-be5b5bb29fc6 tempest-GroupsV314Test-1495585002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6abeb7ab-d3a6-48d9-9a25-0e4c13e06cdd 1073741824 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:36:52 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-059c8182-4164-444a-b9f6-f21b10a34d45 tempest-VolumesServicesTestJSON-1468857707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-cecadad0-449c-4ba1-806f-f0f577bf8120" returned: 0 in 0.532s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:36:52 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-059c8182-4164-444a-b9f6-f21b10a34d45 tempest-VolumesServicesTestJSON-1468857707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-cecadad0-449c-4ba1-806f-f0f577bf8120 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:36:52 devstack sudo[95103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6abeb7ab-d3a6-48d9-9a25-0e4c13e06cdd 1073741824 Sep 06 06:36:52 devstack sudo[95103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:36:52 devstack sudo[95104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-cecadad0-449c-4ba1-806f-f0f577bf8120 Sep 06 06:36:52 devstack sudo[95104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:36:53 devstack sudo[95104]: pam_unix(sudo:session): session closed for user root Sep 06 06:36:53 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-059c8182-4164-444a-b9f6-f21b10a34d45 tempest-VolumesServicesTestJSON-1468857707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-cecadad0-449c-4ba1-806f-f0f577bf8120" returned: 0 in 0.316s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:36:53 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-059c8182-4164-444a-b9f6-f21b10a34d45 tempest-VolumesServicesTestJSON-1468857707 None] Lock "cinder-quobyte-cecadad0-449c-4ba1-806f-f0f577bf8120" released by "delete_volume" :: held 0.918s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:36:53 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-059c8182-4164-444a-b9f6-f21b10a34d45 tempest-VolumesServicesTestJSON-1468857707 None] Created reservations ['be6dce5c-8569-4783-8cd2-fbb374fac4b9', '56f776fe-20cc-4d88-b79c-a8567523a8e1', '8ce528d1-b0e2-4bb5-926d-0a78702f52ed', 'bab5675c-a024-455d-b145-4376cf113f37'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:36:53 devstack sudo[95103]: pam_unix(sudo:session): session closed for user root Sep 06 06:36:53 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-9eac28a1-4cf9-4a88-8210-be5b5bb29fc6 tempest-GroupsV314Test-1495585002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6abeb7ab-d3a6-48d9-9a25-0e4c13e06cdd 1073741824" returned: 0 in 0.536s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:36:53 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-9eac28a1-4cf9-4a88-8210-be5b5bb29fc6 tempest-GroupsV314Test-1495585002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6abeb7ab-d3a6-48d9-9a25-0e4c13e06cdd {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:36:53 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-059c8182-4164-444a-b9f6-f21b10a34d45 tempest-VolumesServicesTestJSON-1468857707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:36:53 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-059c8182-4164-444a-b9f6-f21b10a34d45 tempest-VolumesServicesTestJSON-1468857707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:36:53 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-059c8182-4164-444a-b9f6-f21b10a34d45 tempest-VolumesServicesTestJSON-1468857707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:36:53 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-059c8182-4164-444a-b9f6-f21b10a34d45 tempest-VolumesServicesTestJSON-1468857707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:36:53 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-059c8182-4164-444a-b9f6-f21b10a34d45 tempest-VolumesServicesTestJSON-1468857707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:36:53 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-059c8182-4164-444a-b9f6-f21b10a34d45 tempest-VolumesServicesTestJSON-1468857707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:36:53 devstack sudo[95112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6abeb7ab-d3a6-48d9-9a25-0e4c13e06cdd Sep 06 06:36:53 devstack sudo[95112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:36:53 devstack sudo[95113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:36:53 devstack sudo[95113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:36:53 devstack sudo[95112]: pam_unix(sudo:session): session closed for user root Sep 06 06:36:53 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-9eac28a1-4cf9-4a88-8210-be5b5bb29fc6 tempest-GroupsV314Test-1495585002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6abeb7ab-d3a6-48d9-9a25-0e4c13e06cdd" returned: 0 in 0.378s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:36:53 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-9eac28a1-4cf9-4a88-8210-be5b5bb29fc6 tempest-GroupsV314Test-1495585002 None] <== create_volume: return (981ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'} {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 06:36:53 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-9eac28a1-4cf9-4a88-8210-be5b5bb29fc6 tempest-GroupsV314Test-1495585002 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.985s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:36:53 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-9eac28a1-4cf9-4a88-8210-be5b5bb29fc6 tempest-GroupsV314Test-1495585002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3312cb06-b2b8-4cc3-b233-1354cef4b500) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6abeb7ab-d3a6-48d9-9a25-0e4c13e06cdd', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:36:53 devstack sudo[95113]: pam_unix(sudo:session): session closed for user root Sep 06 06:36:53 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-9eac28a1-4cf9-4a88-8210-be5b5bb29fc6 tempest-GroupsV314Test-1495585002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf021fdf-d129-4a9e-a983-942a5e609570) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:36:53 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-059c8182-4164-444a-b9f6-f21b10a34d45 tempest-VolumesServicesTestJSON-1468857707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.406s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:36:53 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-059c8182-4164-444a-b9f6-f21b10a34d45 tempest-VolumesServicesTestJSON-1468857707 None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:36:53 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-059c8182-4164-444a-b9f6-f21b10a34d45 tempest-VolumesServicesTestJSON-1468857707 None] Deleted volume successfully. Sep 06 06:36:53 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-9eac28a1-4cf9-4a88-8210-be5b5bb29fc6 tempest-GroupsV314Test-1495585002 None] Volume volume-6abeb7ab-d3a6-48d9-9a25-0e4c13e06cdd (6abeb7ab-d3a6-48d9-9a25-0e4c13e06cdd): created successfully Sep 06 06:36:53 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-9eac28a1-4cf9-4a88-8210-be5b5bb29fc6 tempest-GroupsV314Test-1495585002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf021fdf-d129-4a9e-a983-942a5e609570) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:36:53 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-9eac28a1-4cf9-4a88-8210-be5b5bb29fc6 tempest-GroupsV314Test-1495585002 None] Flow 'volume_create_manager' (39352f74-8b92-455f-a498-3c51fd2f0127) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:36:53 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-059c8182-4164-444a-b9f6-f21b10a34d45 tempest-VolumesServicesTestJSON-1468857707 None] Lock "cinder-cecadad0-449c-4ba1-806f-f0f577bf8120-delete_volume" released by "delete_volume" :: held 1.736s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:36:53 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-9eac28a1-4cf9-4a88-8210-be5b5bb29fc6 tempest-GroupsV314Test-1495585002 None] Created volume successfully. Sep 06 06:36:56 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-8d76b9a3-bb60-4481-8d90-96189cfc23b6 tempest-GroupsV314Test-1495585002 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:36:56 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-8d76b9a3-bb60-4481-8d90-96189cfc23b6 tempest-GroupsV314Test-1495585002 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:36:56 devstack cinder-volume[87329]: INFO cinder.volume.drivers.remotefs [None req-8d76b9a3-bb60-4481-8d90-96189cfc23b6 tempest-GroupsV314Test-1495585002 None] Cloning volume 6abeb7ab-d3a6-48d9-9a25-0e4c13e06cdd to volume b5123030-8d11-43e0-b2eb-86d160a73a6d Sep 06 06:36:56 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-8d76b9a3-bb60-4481-8d90-96189cfc23b6 tempest-GroupsV314Test-1495585002 None] Creating offline snapshot d5f754fb-fdf4-48b1-a524-d8c62e5fc358 of volume 6abeb7ab-d3a6-48d9-9a25-0e4c13e06cdd {{(pid=87329) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 06 06:36:56 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ee5200a-6f55-4a26-ac98-49f8772f5c93]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:36:56 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-8d76b9a3-bb60-4481-8d90-96189cfc23b6 tempest-GroupsV314Test-1495585002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6abeb7ab-d3a6-48d9-9a25-0e4c13e06cdd {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:36:56 devstack sudo[95146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6abeb7ab-d3a6-48d9-9a25-0e4c13e06cdd Sep 06 06:36:56 devstack sudo[95146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:36:56 devstack sudo[95146]: pam_unix(sudo:session): session closed for user root Sep 06 06:36:56 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-8d76b9a3-bb60-4481-8d90-96189cfc23b6 tempest-GroupsV314Test-1495585002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6abeb7ab-d3a6-48d9-9a25-0e4c13e06cdd" returned: 0 in 0.554s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:36:56 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-8d76b9a3-bb60-4481-8d90-96189cfc23b6 tempest-GroupsV314Test-1495585002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6abeb7ab-d3a6-48d9-9a25-0e4c13e06cdd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6abeb7ab-d3a6-48d9-9a25-0e4c13e06cdd.d5f754fb-fdf4-48b1-a524-d8c62e5fc358 1G {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:36:56 devstack sudo[95166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6abeb7ab-d3a6-48d9-9a25-0e4c13e06cdd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6abeb7ab-d3a6-48d9-9a25-0e4c13e06cdd.d5f754fb-fdf4-48b1-a524-d8c62e5fc358 1G Sep 06 06:36:56 devstack sudo[95166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:36:57 devstack sudo[95166]: pam_unix(sudo:session): session closed for user root Sep 06 06:36:57 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-8d76b9a3-bb60-4481-8d90-96189cfc23b6 tempest-GroupsV314Test-1495585002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6abeb7ab-d3a6-48d9-9a25-0e4c13e06cdd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6abeb7ab-d3a6-48d9-9a25-0e4c13e06cdd.d5f754fb-fdf4-48b1-a524-d8c62e5fc358 1G" returned: 0 in 0.524s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:36:57 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-8d76b9a3-bb60-4481-8d90-96189cfc23b6 tempest-GroupsV314Test-1495585002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6abeb7ab-d3a6-48d9-9a25-0e4c13e06cdd -F qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6abeb7ab-d3a6-48d9-9a25-0e4c13e06cdd.d5f754fb-fdf4-48b1-a524-d8c62e5fc358 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:36:57 devstack sudo[95172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6abeb7ab-d3a6-48d9-9a25-0e4c13e06cdd -F qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6abeb7ab-d3a6-48d9-9a25-0e4c13e06cdd.d5f754fb-fdf4-48b1-a524-d8c62e5fc358 Sep 06 06:36:57 devstack sudo[95172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:36:57 devstack sudo[95172]: pam_unix(sudo:session): session closed for user root Sep 06 06:36:57 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-8d76b9a3-bb60-4481-8d90-96189cfc23b6 tempest-GroupsV314Test-1495585002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6abeb7ab-d3a6-48d9-9a25-0e4c13e06cdd -F qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6abeb7ab-d3a6-48d9-9a25-0e4c13e06cdd.d5f754fb-fdf4-48b1-a524-d8c62e5fc358" returned: 0 in 0.396s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:36:57 devstack cinder-volume[87329]: WARNING cinder.volume.drivers.remotefs [None req-8d76b9a3-bb60-4481-8d90-96189cfc23b6 tempest-GroupsV314Test-1495585002 None] /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6abeb7ab-d3a6-48d9-9a25-0e4c13e06cdd.d5f754fb-fdf4-48b1-a524-d8c62e5fc358 is being set with open permissions: ugo+rw: NotImplementedError Sep 06 06:36:57 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-8d76b9a3-bb60-4481-8d90-96189cfc23b6 tempest-GroupsV314Test-1495585002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6abeb7ab-d3a6-48d9-9a25-0e4c13e06cdd.d5f754fb-fdf4-48b1-a524-d8c62e5fc358 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:36:57 devstack sudo[95179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6abeb7ab-d3a6-48d9-9a25-0e4c13e06cdd.d5f754fb-fdf4-48b1-a524-d8c62e5fc358 Sep 06 06:36:57 devstack sudo[95179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:36:57 devstack sudo[95179]: pam_unix(sudo:session): session closed for user root Sep 06 06:36:57 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-8d76b9a3-bb60-4481-8d90-96189cfc23b6 tempest-GroupsV314Test-1495585002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6abeb7ab-d3a6-48d9-9a25-0e4c13e06cdd.d5f754fb-fdf4-48b1-a524-d8c62e5fc358" returned: 0 in 0.339s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:36:58 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-8d76b9a3-bb60-4481-8d90-96189cfc23b6 tempest-GroupsV314Test-1495585002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6abeb7ab-d3a6-48d9-9a25-0e4c13e06cdd.info {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:36:58 devstack sudo[95183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6abeb7ab-d3a6-48d9-9a25-0e4c13e06cdd.info Sep 06 06:36:58 devstack sudo[95183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:36:58 devstack sudo[95183]: pam_unix(sudo:session): session closed for user root Sep 06 06:36:58 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-8d76b9a3-bb60-4481-8d90-96189cfc23b6 tempest-GroupsV314Test-1495585002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6abeb7ab-d3a6-48d9-9a25-0e4c13e06cdd.info" returned: 0 in 0.300s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:36:58 devstack cinder-volume[87329]: WARNING cinder.volume.drivers.remotefs [None req-8d76b9a3-bb60-4481-8d90-96189cfc23b6 tempest-GroupsV314Test-1495585002 None] /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6abeb7ab-d3a6-48d9-9a25-0e4c13e06cdd.info is being set with open permissions: ugo+rw: NotImplementedError Sep 06 06:36:58 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-8d76b9a3-bb60-4481-8d90-96189cfc23b6 tempest-GroupsV314Test-1495585002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6abeb7ab-d3a6-48d9-9a25-0e4c13e06cdd.info {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:36:58 devstack sudo[95186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6abeb7ab-d3a6-48d9-9a25-0e4c13e06cdd.info Sep 06 06:36:58 devstack sudo[95186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:36:58 devstack cinder-volume[87329]: INFO cinder.volume.manager [req-19213052-0e6f-4da9-afdf-5ff1964f474d req-e0bbe262-2c7a-40dc-875d-b43c170ba0e6 tempest-ServerActionsTestOtherA-968672787 None] Terminate volume connection completed successfully. Sep 06 06:36:58 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [req-19213052-0e6f-4da9-afdf-5ff1964f474d req-e0bbe262-2c7a-40dc-875d-b43c170ba0e6 tempest-ServerActionsTestOtherA-968672787 None] Deleting attachment eaf5b25e-ac23-4a9f-9c7e-b1f678c025a0. {{(pid=87329) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 06 06:36:58 devstack sudo[95186]: pam_unix(sudo:session): session closed for user root Sep 06 06:36:58 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-8d76b9a3-bb60-4481-8d90-96189cfc23b6 tempest-GroupsV314Test-1495585002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6abeb7ab-d3a6-48d9-9a25-0e4c13e06cdd.info" returned: 0 in 0.312s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:36:58 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-8d76b9a3-bb60-4481-8d90-96189cfc23b6 tempest-GroupsV314Test-1495585002 None] Acquiring lock "cinder-quobyte-b5123030-8d11-43e0-b2eb-86d160a73a6d" by "_copy_volume_from_snapshot" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:36:58 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-8d76b9a3-bb60-4481-8d90-96189cfc23b6 tempest-GroupsV314Test-1495585002 None] Lock "cinder-quobyte-b5123030-8d11-43e0-b2eb-86d160a73a6d" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:36:58 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-8d76b9a3-bb60-4481-8d90-96189cfc23b6 tempest-GroupsV314Test-1495585002 None] snapshot: d5f754fb-fdf4-48b1-a524-d8c62e5fc358, volume: b5123030-8d11-43e0-b2eb-86d160a73a6d, {{(pid=87329) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 06 06:36:58 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-8d76b9a3-bb60-4481-8d90-96189cfc23b6 tempest-GroupsV314Test-1495585002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:36:58 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-8d76b9a3-bb60-4481-8d90-96189cfc23b6 tempest-GroupsV314Test-1495585002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:36:58 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-8d76b9a3-bb60-4481-8d90-96189cfc23b6 tempest-GroupsV314Test-1495585002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:36:58 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-8d76b9a3-bb60-4481-8d90-96189cfc23b6 tempest-GroupsV314Test-1495585002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:36:58 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-8d76b9a3-bb60-4481-8d90-96189cfc23b6 tempest-GroupsV314Test-1495585002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:36:58 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[97b44dbb-af66-4156-bf54-860ce3d87981]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:36:58 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-8d76b9a3-bb60-4481-8d90-96189cfc23b6 tempest-GroupsV314Test-1495585002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6abeb7ab-d3a6-48d9-9a25-0e4c13e06cdd.d5f754fb-fdf4-48b1-a524-d8c62e5fc358 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:36:58 devstack cinder-volume[87329]: DEBUG cinder.coordination [req-19213052-0e6f-4da9-afdf-5ff1964f474d req-c251d125-d12e-4f28-a701-b92d96d5e015 tempest-ServerActionsTestOtherA-968672787 None] Acquiring lock "cinder-a774c547-4c1b-4488-a78c-6fd485434966-delete_volume" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:36:58 devstack cinder-volume[87329]: DEBUG cinder.coordination [req-19213052-0e6f-4da9-afdf-5ff1964f474d req-c251d125-d12e-4f28-a701-b92d96d5e015 tempest-ServerActionsTestOtherA-968672787 None] Lock "cinder-a774c547-4c1b-4488-a78c-6fd485434966-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:36:58 devstack sudo[95190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6abeb7ab-d3a6-48d9-9a25-0e4c13e06cdd.d5f754fb-fdf4-48b1-a524-d8c62e5fc358 Sep 06 06:36:58 devstack sudo[95190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:36:59 devstack cinder-volume[87329]: DEBUG cinder.coordination [req-19213052-0e6f-4da9-afdf-5ff1964f474d req-c251d125-d12e-4f28-a701-b92d96d5e015 tempest-ServerActionsTestOtherA-968672787 None] Acquiring lock "cinder-quobyte-a774c547-4c1b-4488-a78c-6fd485434966" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:36:59 devstack cinder-volume[87329]: DEBUG cinder.coordination [req-19213052-0e6f-4da9-afdf-5ff1964f474d req-c251d125-d12e-4f28-a701-b92d96d5e015 tempest-ServerActionsTestOtherA-968672787 None] Lock "cinder-quobyte-a774c547-4c1b-4488-a78c-6fd485434966" acquired by "delete_volume" :: waited 0.039s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:36:59 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[05e88821-ed3a-46c8-9c16-41c4ecc78811]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:36:59 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [req-19213052-0e6f-4da9-afdf-5ff1964f474d req-c251d125-d12e-4f28-a701-b92d96d5e015 tempest-ServerActionsTestOtherA-968672787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-a774c547-4c1b-4488-a78c-6fd485434966 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:36:59 devstack sudo[95192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-a774c547-4c1b-4488-a78c-6fd485434966 Sep 06 06:36:59 devstack sudo[95192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:36:59 devstack sudo[95190]: pam_unix(sudo:session): session closed for user root Sep 06 06:36:59 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-8d76b9a3-bb60-4481-8d90-96189cfc23b6 tempest-GroupsV314Test-1495585002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6abeb7ab-d3a6-48d9-9a25-0e4c13e06cdd.d5f754fb-fdf4-48b1-a524-d8c62e5fc358" returned: 0 in 0.776s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:36:59 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-8d76b9a3-bb60-4481-8d90-96189cfc23b6 tempest-GroupsV314Test-1495585002 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6abeb7ab-d3a6-48d9-9a25-0e4c13e06cdd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87329) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 06:36:59 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae651724-9c55-46d8-a168-ff76f8b842d6]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:36:59 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-8d76b9a3-bb60-4481-8d90-96189cfc23b6 tempest-GroupsV314Test-1495585002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6abeb7ab-d3a6-48d9-9a25-0e4c13e06cdd {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:36:59 devstack sudo[95198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6abeb7ab-d3a6-48d9-9a25-0e4c13e06cdd Sep 06 06:36:59 devstack sudo[95198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:36:59 devstack sudo[95192]: pam_unix(sudo:session): session closed for user root Sep 06 06:36:59 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [req-19213052-0e6f-4da9-afdf-5ff1964f474d req-c251d125-d12e-4f28-a701-b92d96d5e015 tempest-ServerActionsTestOtherA-968672787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-a774c547-4c1b-4488-a78c-6fd485434966" returned: 0 in 0.572s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:36:59 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [req-19213052-0e6f-4da9-afdf-5ff1964f474d req-c251d125-d12e-4f28-a701-b92d96d5e015 tempest-ServerActionsTestOtherA-968672787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-a774c547-4c1b-4488-a78c-6fd485434966 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:36:59 devstack sudo[95203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-a774c547-4c1b-4488-a78c-6fd485434966 Sep 06 06:36:59 devstack sudo[95203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:37:00 devstack sudo[95203]: pam_unix(sudo:session): session closed for user root Sep 06 06:37:00 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [req-19213052-0e6f-4da9-afdf-5ff1964f474d req-c251d125-d12e-4f28-a701-b92d96d5e015 tempest-ServerActionsTestOtherA-968672787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-a774c547-4c1b-4488-a78c-6fd485434966" returned: 0 in 0.314s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:37:00 devstack cinder-volume[87329]: DEBUG cinder.coordination [req-19213052-0e6f-4da9-afdf-5ff1964f474d req-c251d125-d12e-4f28-a701-b92d96d5e015 tempest-ServerActionsTestOtherA-968672787 None] Lock "cinder-quobyte-a774c547-4c1b-4488-a78c-6fd485434966" released by "delete_volume" :: held 0.973s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:37:00 devstack sudo[95198]: pam_unix(sudo:session): session closed for user root Sep 06 06:37:00 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-8d76b9a3-bb60-4481-8d90-96189cfc23b6 tempest-GroupsV314Test-1495585002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6abeb7ab-d3a6-48d9-9a25-0e4c13e06cdd" returned: 0 in 0.516s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:37:00 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-8d76b9a3-bb60-4481-8d90-96189cfc23b6 tempest-GroupsV314Test-1495585002 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6abeb7ab-d3a6-48d9-9a25-0e4c13e06cdd {{(pid=87329) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 06 06:37:00 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-8d76b9a3-bb60-4481-8d90-96189cfc23b6 tempest-GroupsV314Test-1495585002 None] Creating direct copy from snapshot {{(pid=87329) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 06 06:37:00 devstack cinder-volume[87329]: DEBUG cinder.utils [None req-8d76b9a3-bb60-4481-8d90-96189cfc23b6 tempest-GroupsV314Test-1495585002 None] Path /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b5123030-8d11-43e0-b2eb-86d160a73a6d not found in is_blk_device check {{(pid=87329) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 06 06:37:00 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-8d76b9a3-bb60-4481-8d90-96189cfc23b6 tempest-GroupsV314Test-1495585002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6abeb7ab-d3a6-48d9-9a25-0e4c13e06cdd /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b5123030-8d11-43e0-b2eb-86d160a73a6d {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:37:00 devstack sudo[95210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6abeb7ab-d3a6-48d9-9a25-0e4c13e06cdd /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b5123030-8d11-43e0-b2eb-86d160a73a6d Sep 06 06:37:00 devstack sudo[95210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:37:00 devstack cinder-volume[87329]: DEBUG cinder.quota [req-19213052-0e6f-4da9-afdf-5ff1964f474d req-c251d125-d12e-4f28-a701-b92d96d5e015 tempest-ServerActionsTestOtherA-968672787 None] Created reservations ['dbf3befd-5572-4825-b820-cfc37d14e98a', 'dc3f68d7-d567-47b3-91e0-3b2b3f0bd39c', '4e303365-eba5-4297-9e1a-85d6b08cf4a0', 'f822649f-fdbc-41ff-8de5-c6ebea81ce85'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:37:00 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [req-19213052-0e6f-4da9-afdf-5ff1964f474d req-c251d125-d12e-4f28-a701-b92d96d5e015 tempest-ServerActionsTestOtherA-968672787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:37:00 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [req-19213052-0e6f-4da9-afdf-5ff1964f474d req-c251d125-d12e-4f28-a701-b92d96d5e015 tempest-ServerActionsTestOtherA-968672787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:37:00 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [req-19213052-0e6f-4da9-afdf-5ff1964f474d req-c251d125-d12e-4f28-a701-b92d96d5e015 tempest-ServerActionsTestOtherA-968672787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:37:00 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [req-19213052-0e6f-4da9-afdf-5ff1964f474d req-c251d125-d12e-4f28-a701-b92d96d5e015 tempest-ServerActionsTestOtherA-968672787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:37:00 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [req-19213052-0e6f-4da9-afdf-5ff1964f474d req-c251d125-d12e-4f28-a701-b92d96d5e015 tempest-ServerActionsTestOtherA-968672787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:37:00 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [req-19213052-0e6f-4da9-afdf-5ff1964f474d req-c251d125-d12e-4f28-a701-b92d96d5e015 tempest-ServerActionsTestOtherA-968672787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:37:00 devstack sudo[95212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:37:00 devstack sudo[95212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:37:00 devstack sudo[95212]: pam_unix(sudo:session): session closed for user root Sep 06 06:37:00 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [req-19213052-0e6f-4da9-afdf-5ff1964f474d req-c251d125-d12e-4f28-a701-b92d96d5e015 tempest-ServerActionsTestOtherA-968672787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.427s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:37:00 devstack cinder-volume[87329]: DEBUG cinder.manager [req-19213052-0e6f-4da9-afdf-5ff1964f474d req-c251d125-d12e-4f28-a701-b92d96d5e015 tempest-ServerActionsTestOtherA-968672787 None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:37:00 devstack cinder-volume[87329]: INFO cinder.volume.manager [req-19213052-0e6f-4da9-afdf-5ff1964f474d req-c251d125-d12e-4f28-a701-b92d96d5e015 tempest-ServerActionsTestOtherA-968672787 None] Deleted volume successfully. Sep 06 06:37:00 devstack cinder-volume[87329]: DEBUG cinder.coordination [req-19213052-0e6f-4da9-afdf-5ff1964f474d req-c251d125-d12e-4f28-a701-b92d96d5e015 tempest-ServerActionsTestOtherA-968672787 None] Lock "cinder-a774c547-4c1b-4488-a78c-6fd485434966-delete_volume" released by "delete_volume" :: held 1.821s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:37:01 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-f65808db-7f4e-48d6-8752-23ffec7f0a19 tempest-ServerActionsTestOtherA-968672787 None] Acquiring lock "cinder-052783c6-7634-4422-9227-0f9e115dea08-delete_volume" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:37:01 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-f65808db-7f4e-48d6-8752-23ffec7f0a19 tempest-ServerActionsTestOtherA-968672787 None] Lock "cinder-052783c6-7634-4422-9227-0f9e115dea08-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:37:01 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-f65808db-7f4e-48d6-8752-23ffec7f0a19 tempest-ServerActionsTestOtherA-968672787 None] Acquiring lock "cinder-quobyte-052783c6-7634-4422-9227-0f9e115dea08" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:37:01 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-f65808db-7f4e-48d6-8752-23ffec7f0a19 tempest-ServerActionsTestOtherA-968672787 None] Lock "cinder-quobyte-052783c6-7634-4422-9227-0f9e115dea08" acquired by "delete_volume" :: waited 0.022s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:37:01 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cc33329-2e32-40b7-8454-afadcb309f57]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:37:01 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-f65808db-7f4e-48d6-8752-23ffec7f0a19 tempest-ServerActionsTestOtherA-968672787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-052783c6-7634-4422-9227-0f9e115dea08 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:37:01 devstack sudo[95225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-052783c6-7634-4422-9227-0f9e115dea08 Sep 06 06:37:01 devstack sudo[95225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:37:02 devstack sudo[95225]: pam_unix(sudo:session): session closed for user root Sep 06 06:37:02 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-f65808db-7f4e-48d6-8752-23ffec7f0a19 tempest-ServerActionsTestOtherA-968672787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-052783c6-7634-4422-9227-0f9e115dea08" returned: 0 in 0.985s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:37:02 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-f65808db-7f4e-48d6-8752-23ffec7f0a19 tempest-ServerActionsTestOtherA-968672787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-052783c6-7634-4422-9227-0f9e115dea08 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:37:02 devstack sudo[95231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-052783c6-7634-4422-9227-0f9e115dea08 Sep 06 06:37:02 devstack sudo[95231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:37:03 devstack sudo[95231]: pam_unix(sudo:session): session closed for user root Sep 06 06:37:03 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-f65808db-7f4e-48d6-8752-23ffec7f0a19 tempest-ServerActionsTestOtherA-968672787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-052783c6-7634-4422-9227-0f9e115dea08" returned: 0 in 0.835s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:37:03 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-f65808db-7f4e-48d6-8752-23ffec7f0a19 tempest-ServerActionsTestOtherA-968672787 None] Lock "cinder-quobyte-052783c6-7634-4422-9227-0f9e115dea08" released by "delete_volume" :: held 1.944s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:37:03 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-f65808db-7f4e-48d6-8752-23ffec7f0a19 tempest-ServerActionsTestOtherA-968672787 None] Created reservations ['998b4d47-5309-4d07-b6b3-d5a459d1065f', '7b6fb023-3526-4300-a005-6bd49b3feacc', '0e0b7dec-552b-43cc-b6ab-c07dea90f049', 'e30befb6-45b5-4160-8b49-45f365c8d544'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:37:03 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-f65808db-7f4e-48d6-8752-23ffec7f0a19 tempest-ServerActionsTestOtherA-968672787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:37:03 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-f65808db-7f4e-48d6-8752-23ffec7f0a19 tempest-ServerActionsTestOtherA-968672787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:37:03 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-f65808db-7f4e-48d6-8752-23ffec7f0a19 tempest-ServerActionsTestOtherA-968672787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:37:03 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-f65808db-7f4e-48d6-8752-23ffec7f0a19 tempest-ServerActionsTestOtherA-968672787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:37:03 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-f65808db-7f4e-48d6-8752-23ffec7f0a19 tempest-ServerActionsTestOtherA-968672787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:37:03 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-f65808db-7f4e-48d6-8752-23ffec7f0a19 tempest-ServerActionsTestOtherA-968672787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:37:03 devstack sudo[95235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:37:03 devstack sudo[95235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:37:04 devstack sudo[95235]: pam_unix(sudo:session): session closed for user root Sep 06 06:37:04 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-f65808db-7f4e-48d6-8752-23ffec7f0a19 tempest-ServerActionsTestOtherA-968672787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.680s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:37:04 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-f65808db-7f4e-48d6-8752-23ffec7f0a19 tempest-ServerActionsTestOtherA-968672787 None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:37:04 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-f65808db-7f4e-48d6-8752-23ffec7f0a19 tempest-ServerActionsTestOtherA-968672787 None] Deleted volume successfully. Sep 06 06:37:04 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-f65808db-7f4e-48d6-8752-23ffec7f0a19 tempest-ServerActionsTestOtherA-968672787 None] Lock "cinder-052783c6-7634-4422-9227-0f9e115dea08-delete_volume" released by "delete_volume" :: held 3.381s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:37:06 devstack sudo[95210]: pam_unix(sudo:session): session closed for user root Sep 06 06:37:06 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-8d76b9a3-bb60-4481-8d90-96189cfc23b6 tempest-GroupsV314Test-1495585002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6abeb7ab-d3a6-48d9-9a25-0e4c13e06cdd /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b5123030-8d11-43e0-b2eb-86d160a73a6d" returned: 0 in 6.916s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:37:06 devstack cinder-volume[87329]: DEBUG cinder.image.image_utils [None req-8d76b9a3-bb60-4481-8d90-96189cfc23b6 tempest-GroupsV314Test-1495585002 None] Image conversion details: src /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6abeb7ab-d3a6-48d9-9a25-0e4c13e06cdd, size 1024.00 MB, duration 6.92 sec, destination /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b5123030-8d11-43e0-b2eb-86d160a73a6d {{(pid=87329) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 06 06:37:07 devstack cinder-volume[87329]: INFO cinder.image.image_utils [None req-8d76b9a3-bb60-4481-8d90-96189cfc23b6 tempest-GroupsV314Test-1495585002 None] Converted 1024.00 MB image at 148.04 MB/s Sep 06 06:37:07 devstack cinder-volume[87329]: WARNING cinder.volume.drivers.remotefs [None req-8d76b9a3-bb60-4481-8d90-96189cfc23b6 tempest-GroupsV314Test-1495585002 None] /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b5123030-8d11-43e0-b2eb-86d160a73a6d is being set with open permissions: ugo+rw: NotImplementedError Sep 06 06:37:07 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-8d76b9a3-bb60-4481-8d90-96189cfc23b6 tempest-GroupsV314Test-1495585002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b5123030-8d11-43e0-b2eb-86d160a73a6d {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:37:07 devstack sudo[95268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b5123030-8d11-43e0-b2eb-86d160a73a6d Sep 06 06:37:07 devstack sudo[95268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:37:07 devstack sudo[95268]: pam_unix(sudo:session): session closed for user root Sep 06 06:37:07 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-8d76b9a3-bb60-4481-8d90-96189cfc23b6 tempest-GroupsV314Test-1495585002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b5123030-8d11-43e0-b2eb-86d160a73a6d" returned: 0 in 0.283s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:37:07 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-8d76b9a3-bb60-4481-8d90-96189cfc23b6 tempest-GroupsV314Test-1495585002 None] Lock "cinder-quobyte-b5123030-8d11-43e0-b2eb-86d160a73a6d" released by "_copy_volume_from_snapshot" :: held 8.609s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:37:07 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-8d76b9a3-bb60-4481-8d90-96189cfc23b6 tempest-GroupsV314Test-1495585002 None] Acquiring lock "cinder-quobyte-d5f754fb-fdf4-48b1-a524-d8c62e5fc358" by "_delete_snapshot" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:37:07 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-8d76b9a3-bb60-4481-8d90-96189cfc23b6 tempest-GroupsV314Test-1495585002 None] Lock "cinder-quobyte-d5f754fb-fdf4-48b1-a524-d8c62e5fc358" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:37:07 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-8d76b9a3-bb60-4481-8d90-96189cfc23b6 tempest-GroupsV314Test-1495585002 None] Deleting offline snapshot d5f754fb-fdf4-48b1-a524-d8c62e5fc358 of volume 6abeb7ab-d3a6-48d9-9a25-0e4c13e06cdd {{(pid=87329) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 06 06:37:07 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-8d76b9a3-bb60-4481-8d90-96189cfc23b6 tempest-GroupsV314Test-1495585002 None] snapshot_file for this snap is: volume-6abeb7ab-d3a6-48d9-9a25-0e4c13e06cdd.d5f754fb-fdf4-48b1-a524-d8c62e5fc358 {{(pid=87329) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 06 06:37:07 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[41d1b311-c9b6-4835-a262-9a3fdd22b225]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:37:07 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-8d76b9a3-bb60-4481-8d90-96189cfc23b6 tempest-GroupsV314Test-1495585002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6abeb7ab-d3a6-48d9-9a25-0e4c13e06cdd.d5f754fb-fdf4-48b1-a524-d8c62e5fc358 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:37:07 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a7a8ff1-990b-41f3-95e7-7f3c4e08f677 tempest-VolumesImageMetadata-1229675148 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87329) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 06:37:07 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-6a7a8ff1-990b-41f3-95e7-7f3c4e08f677 tempest-VolumesImageMetadata-1229675148 None] Flow 'volume_create_manager' (c792dfbf-ace4-42a7-ac6b-cf977d6883a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:37:07 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-6a7a8ff1-990b-41f3-95e7-7f3c4e08f677 tempest-VolumesImageMetadata-1229675148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (baabcbc2-fc34-4eaf-8850-f1d2c14573a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:37:07 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-6a7a8ff1-990b-41f3-95e7-7f3c4e08f677 tempest-VolumesImageMetadata-1229675148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (baabcbc2-fc34-4eaf-8850-f1d2c14573a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:37:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1059090276',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab3a0fbb-4a74-40e6-9e41-da641ca994c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7e4431aac19407489a4d42dd0cb3127',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:37:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:37:07Z,use_quota=True,user_id='fc7e53b20672412ba84db31c04dd7d00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:37:07 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-6a7a8ff1-990b-41f3-95e7-7f3c4e08f677 tempest-VolumesImageMetadata-1229675148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17e519ff-d6e4-4529-a667-a1fc5957f8e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:37:07 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-6a7a8ff1-990b-41f3-95e7-7f3c4e08f677 tempest-VolumesImageMetadata-1229675148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17e519ff-d6e4-4529-a667-a1fc5957f8e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:37:07 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-6a7a8ff1-990b-41f3-95e7-7f3c4e08f677 tempest-VolumesImageMetadata-1229675148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bbe0471-42ea-43fb-b85b-3b4556603698) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:37:07 devstack cinder-volume[87329]: DEBUG cinder.image.glance [None req-6a7a8ff1-990b-41f3-95e7-7f3c4e08f677 tempest-VolumesImageMetadata-1229675148 None] Creating Keystone auth plugin from conf {{(pid=87329) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 06 06:37:07 devstack sudo[95271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6abeb7ab-d3a6-48d9-9a25-0e4c13e06cdd.d5f754fb-fdf4-48b1-a524-d8c62e5fc358 Sep 06 06:37:07 devstack sudo[95271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:37:07 devstack sudo[95271]: pam_unix(sudo:session): session closed for user root Sep 06 06:37:07 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-8d76b9a3-bb60-4481-8d90-96189cfc23b6 tempest-GroupsV314Test-1495585002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6abeb7ab-d3a6-48d9-9a25-0e4c13e06cdd.d5f754fb-fdf4-48b1-a524-d8c62e5fc358" returned: 0 in 0.559s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:37:07 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-8d76b9a3-bb60-4481-8d90-96189cfc23b6 tempest-GroupsV314Test-1495585002 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6abeb7ab-d3a6-48d9-9a25-0e4c13e06cdd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87329) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 06:37:08 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-6a7a8ff1-990b-41f3-95e7-7f3c4e08f677 tempest-VolumesImageMetadata-1229675148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bbe0471-42ea-43fb-b85b-3b4556603698) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ab3a0fbb-4a74-40e6-9e41-da641ca994c5', 'volume_name': 'volume-ab3a0fbb-4a74-40e6-9e41-da641ca994c5', 'volume_size': 1, 'image_id': '7005ba32-ec39-44a3-88d9-ca6af0b34ea0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7005ba32-ec39-44a3-88d9-ca6af0b34ea0', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '65b0d6d605b2427d8db787d4220dbeb4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7005ba32-ec39-44a3-88d9-ca6af0b34ea0', 'created_at': datetime.datetime(2026, 9, 6, 4, 25, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 6, 4, 25, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7005ba32-ec39-44a3-88d9-ca6af0b34ea0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:37:08 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-6a7a8ff1-990b-41f3-95e7-7f3c4e08f677 tempest-VolumesImageMetadata-1229675148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f2fb3b9-d628-4c30-b1f9-0b17c64a984f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:37:08 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-6a7a8ff1-990b-41f3-95e7-7f3c4e08f677 tempest-VolumesImageMetadata-1229675148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f2fb3b9-d628-4c30-b1f9-0b17c64a984f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:37:08 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-6a7a8ff1-990b-41f3-95e7-7f3c4e08f677 tempest-VolumesImageMetadata-1229675148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2582a3d-5be8-49ee-a5d7-062ca0d06149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:37:08 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-6a7a8ff1-990b-41f3-95e7-7f3c4e08f677 tempest-VolumesImageMetadata-1229675148 None] Volume ab3a0fbb-4a74-40e6-9e41-da641ca994c5: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ab3a0fbb-4a74-40e6-9e41-da641ca994c5', 'volume_size': 1, 'image_id': '7005ba32-ec39-44a3-88d9-ca6af0b34ea0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7005ba32-ec39-44a3-88d9-ca6af0b34ea0', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '65b0d6d605b2427d8db787d4220dbeb4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7005ba32-ec39-44a3-88d9-ca6af0b34ea0', 'created_at': datetime.datetime(2026, 9, 6, 4, 25, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 6, 4, 25, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7005ba32-ec39-44a3-88d9-ca6af0b34ea0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 06 06:37:08 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a7a8ff1-990b-41f3-95e7-7f3c4e08f677 tempest-VolumesImageMetadata-1229675148 None] Trying to clone ab3a0fbb-4a74-40e6-9e41-da641ca994c5 from image 7005ba32-ec39-44a3-88d9-ca6af0b34ea0 at location (None, [{'url': 'file:///opt/stack/data/glance/images/7005ba32-ec39-44a3-88d9-ca6af0b34ea0', 'metadata': {}}]). {{(pid=87329) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 06 06:37:08 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[924088bf-8947-40f5-bc5e-42b1ef8db33a]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:37:08 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-8d76b9a3-bb60-4481-8d90-96189cfc23b6 tempest-GroupsV314Test-1495585002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6abeb7ab-d3a6-48d9-9a25-0e4c13e06cdd {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:37:08 devstack sudo[95279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6abeb7ab-d3a6-48d9-9a25-0e4c13e06cdd Sep 06 06:37:08 devstack sudo[95279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:37:08 devstack cinder-volume[87329]: DEBUG cinder.image.image_utils [None req-6a7a8ff1-990b-41f3-95e7-7f3c4e08f677 tempest-VolumesImageMetadata-1229675148 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_7005ba32-ec39-44a3-88d9-ca6af0b34ea0_01ur104ydevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87329) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 06 06:37:08 devstack cinder-volume[87329]: INFO cinder.image.image_utils [None req-6a7a8ff1-990b-41f3-95e7-7f3c4e08f677 tempest-VolumesImageMetadata-1229675148 None] Image download 20.69 MB at 20.69 MB/s Sep 06 06:37:08 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[58cfc52f-13fb-4ca9-8549-141a48871d99]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:37:08 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-6a7a8ff1-990b-41f3-95e7-7f3c4e08f677 tempest-VolumesImageMetadata-1229675148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7005ba32-ec39-44a3-88d9-ca6af0b34ea0_01ur104ydevstack@QuobyteHD {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:37:08 devstack sudo[95285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7005ba32-ec39-44a3-88d9-ca6af0b34ea0_01ur104ydevstack@QuobyteHD Sep 06 06:37:08 devstack sudo[95285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:37:08 devstack sudo[95279]: pam_unix(sudo:session): session closed for user root Sep 06 06:37:08 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-8d76b9a3-bb60-4481-8d90-96189cfc23b6 tempest-GroupsV314Test-1495585002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6abeb7ab-d3a6-48d9-9a25-0e4c13e06cdd" returned: 0 in 0.804s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:37:08 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-8d76b9a3-bb60-4481-8d90-96189cfc23b6 tempest-GroupsV314Test-1495585002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6abeb7ab-d3a6-48d9-9a25-0e4c13e06cdd.d5f754fb-fdf4-48b1-a524-d8c62e5fc358 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:37:08 devstack sudo[95288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6abeb7ab-d3a6-48d9-9a25-0e4c13e06cdd.d5f754fb-fdf4-48b1-a524-d8c62e5fc358 Sep 06 06:37:08 devstack sudo[95288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:37:08 devstack sudo[95285]: pam_unix(sudo:session): session closed for user root Sep 06 06:37:08 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-6a7a8ff1-990b-41f3-95e7-7f3c4e08f677 tempest-VolumesImageMetadata-1229675148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7005ba32-ec39-44a3-88d9-ca6af0b34ea0_01ur104ydevstack@QuobyteHD" returned: 0 in 0.408s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:37:09 devstack cinder-volume[87329]: DEBUG cinder.image.image_utils [None req-6a7a8ff1-990b-41f3-95e7-7f3c4e08f677 tempest-VolumesImageMetadata-1229675148 None] Temporary image 7005ba32-ec39-44a3-88d9-ca6af0b34ea0 is fetched for user fc7e53b20672412ba84db31c04dd7d00. {{(pid=87329) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 06 06:37:09 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c2f0be0-6b0e-4fa1-bd03-87aaf6029167]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:37:09 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-6a7a8ff1-990b-41f3-95e7-7f3c4e08f677 tempest-VolumesImageMetadata-1229675148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7005ba32-ec39-44a3-88d9-ca6af0b34ea0_01ur104ydevstack@QuobyteHD {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:37:09 devstack sudo[95294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7005ba32-ec39-44a3-88d9-ca6af0b34ea0_01ur104ydevstack@QuobyteHD Sep 06 06:37:09 devstack sudo[95294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:37:09 devstack sudo[95288]: pam_unix(sudo:session): session closed for user root Sep 06 06:37:09 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-8d76b9a3-bb60-4481-8d90-96189cfc23b6 tempest-GroupsV314Test-1495585002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6abeb7ab-d3a6-48d9-9a25-0e4c13e06cdd.d5f754fb-fdf4-48b1-a524-d8c62e5fc358" returned: 0 in 0.452s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:37:09 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-8d76b9a3-bb60-4481-8d90-96189cfc23b6 tempest-GroupsV314Test-1495585002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6abeb7ab-d3a6-48d9-9a25-0e4c13e06cdd.d5f754fb-fdf4-48b1-a524-d8c62e5fc358 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:37:09 devstack sudo[95300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6abeb7ab-d3a6-48d9-9a25-0e4c13e06cdd.d5f754fb-fdf4-48b1-a524-d8c62e5fc358 Sep 06 06:37:09 devstack sudo[95300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:37:09 devstack sudo[95294]: pam_unix(sudo:session): session closed for user root Sep 06 06:37:09 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-6a7a8ff1-990b-41f3-95e7-7f3c4e08f677 tempest-VolumesImageMetadata-1229675148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7005ba32-ec39-44a3-88d9-ca6af0b34ea0_01ur104ydevstack@QuobyteHD" returned: 0 in 0.468s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:37:09 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-6a7a8ff1-990b-41f3-95e7-7f3c4e08f677 tempest-VolumesImageMetadata-1229675148 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:37:09 devstack sudo[95300]: pam_unix(sudo:session): session closed for user root Sep 06 06:37:09 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-8d76b9a3-bb60-4481-8d90-96189cfc23b6 tempest-GroupsV314Test-1495585002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6abeb7ab-d3a6-48d9-9a25-0e4c13e06cdd.d5f754fb-fdf4-48b1-a524-d8c62e5fc358" returned: 0 in 0.305s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:37:09 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-8d76b9a3-bb60-4481-8d90-96189cfc23b6 tempest-GroupsV314Test-1495585002 None] Lock "cinder-quobyte-d5f754fb-fdf4-48b1-a524-d8c62e5fc358" released by "_delete_snapshot" :: held 2.306s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:37:09 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-8d76b9a3-bb60-4481-8d90-96189cfc23b6 tempest-GroupsV314Test-1495585002 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.642s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:37:09 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-6a7a8ff1-990b-41f3-95e7-7f3c4e08f677 tempest-VolumesImageMetadata-1229675148 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.119s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:37:09 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-6a7a8ff1-990b-41f3-95e7-7f3c4e08f677 tempest-VolumesImageMetadata-1229675148 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:37:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1059090276',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab3a0fbb-4a74-40e6-9e41-da641ca994c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7e4431aac19407489a4d42dd0cb3127',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:37:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:37:07Z,use_quota=True,user_id='fc7e53b20672412ba84db31c04dd7d00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)}" {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 06:37:09 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-6a7a8ff1-990b-41f3-95e7-7f3c4e08f677 tempest-VolumesImageMetadata-1229675148 None] Creating volume ab3a0fbb-4a74-40e6-9e41-da641ca994c5 {{(pid=87329) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 06:37:09 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-6a7a8ff1-990b-41f3-95e7-7f3c4e08f677 tempest-VolumesImageMetadata-1229675148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:37:09 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-6a7a8ff1-990b-41f3-95e7-7f3c4e08f677 tempest-VolumesImageMetadata-1229675148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:37:09 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-6a7a8ff1-990b-41f3-95e7-7f3c4e08f677 tempest-VolumesImageMetadata-1229675148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:37:09 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-6a7a8ff1-990b-41f3-95e7-7f3c4e08f677 tempest-VolumesImageMetadata-1229675148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:37:09 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-6a7a8ff1-990b-41f3-95e7-7f3c4e08f677 tempest-VolumesImageMetadata-1229675148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:37:09 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-6a7a8ff1-990b-41f3-95e7-7f3c4e08f677 tempest-VolumesImageMetadata-1229675148 None] Selected osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 as target Quobyte volume. {{(pid=87329) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 06:37:09 devstack cinder-volume[87329]: INFO cinder.volume.drivers.remotefs [None req-6a7a8ff1-990b-41f3-95e7-7f3c4e08f677 tempest-VolumesImageMetadata-1229675148 None] casted to osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 Sep 06 06:37:09 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-6a7a8ff1-990b-41f3-95e7-7f3c4e08f677 tempest-VolumesImageMetadata-1229675148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-ab3a0fbb-4a74-40e6-9e41-da641ca994c5 1073741824 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:37:09 devstack sudo[95307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-ab3a0fbb-4a74-40e6-9e41-da641ca994c5 1073741824 Sep 06 06:37:09 devstack sudo[95307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:37:09 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-8d76b9a3-bb60-4481-8d90-96189cfc23b6 tempest-GroupsV314Test-1495585002 None] Create group from source-group-78b6bf47-a00f-4913-8e90-e0bcbec472f2 completed successfully. Sep 06 06:37:10 devstack sudo[95307]: pam_unix(sudo:session): session closed for user root Sep 06 06:37:10 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-6a7a8ff1-990b-41f3-95e7-7f3c4e08f677 tempest-VolumesImageMetadata-1229675148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-ab3a0fbb-4a74-40e6-9e41-da641ca994c5 1073741824" returned: 0 in 0.498s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:37:10 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-6a7a8ff1-990b-41f3-95e7-7f3c4e08f677 tempest-VolumesImageMetadata-1229675148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-ab3a0fbb-4a74-40e6-9e41-da641ca994c5 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:37:10 devstack sudo[95313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-ab3a0fbb-4a74-40e6-9e41-da641ca994c5 Sep 06 06:37:10 devstack sudo[95313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:37:10 devstack sudo[95313]: pam_unix(sudo:session): session closed for user root Sep 06 06:37:10 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-6a7a8ff1-990b-41f3-95e7-7f3c4e08f677 tempest-VolumesImageMetadata-1229675148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-ab3a0fbb-4a74-40e6-9e41-da641ca994c5" returned: 0 in 0.299s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:37:10 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-6a7a8ff1-990b-41f3-95e7-7f3c4e08f677 tempest-VolumesImageMetadata-1229675148 None] <== create_volume: return (844ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'} {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 06:37:10 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-6a7a8ff1-990b-41f3-95e7-7f3c4e08f677 tempest-VolumesImageMetadata-1229675148 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.848s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:37:10 devstack cinder-volume[87329]: DEBUG cinder.volume.volume_utils [None req-6a7a8ff1-990b-41f3-95e7-7f3c4e08f677 tempest-VolumesImageMetadata-1229675148 None] Attempting download of 7005ba32-ec39-44a3-88d9-ca6af0b34ea0 ((None, [{'url': 'file:///opt/stack/data/glance/images/7005ba32-ec39-44a3-88d9-ca6af0b34ea0', 'metadata': {}}])) to volume ab3a0fbb-4a74-40e6-9e41-da641ca994c5. {{(pid=87329) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 06 06:37:10 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[bde45c11-8896-4a5a-be75-e38dc6e22ca1]: (4, 'raw') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:37:10 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-6a7a8ff1-990b-41f3-95e7-7f3c4e08f677 tempest-VolumesImageMetadata-1229675148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7005ba32-ec39-44a3-88d9-ca6af0b34ea0_zhjxaavi {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:37:10 devstack sudo[95316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7005ba32-ec39-44a3-88d9-ca6af0b34ea0_zhjxaavi Sep 06 06:37:10 devstack sudo[95316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:37:11 devstack sudo[95316]: pam_unix(sudo:session): session closed for user root Sep 06 06:37:11 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-6a7a8ff1-990b-41f3-95e7-7f3c4e08f677 tempest-VolumesImageMetadata-1229675148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7005ba32-ec39-44a3-88d9-ca6af0b34ea0_zhjxaavi" returned: 0 in 0.455s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:37:11 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-6a7a8ff1-990b-41f3-95e7-7f3c4e08f677 tempest-VolumesImageMetadata-1229675148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7005ba32-ec39-44a3-88d9-ca6af0b34ea0_zhjxaavi {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:37:11 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-6284ed25-3a5a-4b2d-a1b4-4054618ebec3 tempest-GroupsV314Test-1495585002 None] Acquiring lock "cinder-quobyte-b5123030-8d11-43e0-b2eb-86d160a73a6d" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:37:11 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-6284ed25-3a5a-4b2d-a1b4-4054618ebec3 tempest-GroupsV314Test-1495585002 None] Lock "cinder-quobyte-b5123030-8d11-43e0-b2eb-86d160a73a6d" acquired by "delete_volume" :: waited 0.017s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:37:11 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c356816-d317-4b99-8e23-79eb75f63fdd]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:37:11 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-6284ed25-3a5a-4b2d-a1b4-4054618ebec3 tempest-GroupsV314Test-1495585002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b5123030-8d11-43e0-b2eb-86d160a73a6d {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:37:11 devstack sudo[95320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7005ba32-ec39-44a3-88d9-ca6af0b34ea0_zhjxaavi Sep 06 06:37:11 devstack sudo[95320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:37:11 devstack sudo[95321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b5123030-8d11-43e0-b2eb-86d160a73a6d Sep 06 06:37:11 devstack sudo[95321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:37:11 devstack sudo[95320]: pam_unix(sudo:session): session closed for user root Sep 06 06:37:11 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-6a7a8ff1-990b-41f3-95e7-7f3c4e08f677 tempest-VolumesImageMetadata-1229675148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7005ba32-ec39-44a3-88d9-ca6af0b34ea0_zhjxaavi" returned: 1 in 0.511s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:37:11 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-6a7a8ff1-990b-41f3-95e7-7f3c4e08f677 tempest-VolumesImageMetadata-1229675148 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7005ba32-ec39-44a3-88d9-ca6af0b34ea0_zhjxaavi' failed. Not Retrying. {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 06 06:37:11 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[765c106f-9793-40d7-ac74-2b706bc9784e]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:37:11 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-6a7a8ff1-990b-41f3-95e7-7f3c4e08f677 tempest-VolumesImageMetadata-1229675148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7005ba32-ec39-44a3-88d9-ca6af0b34ea0_01ur104ydevstack@QuobyteHD {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:37:11 devstack sudo[95321]: pam_unix(sudo:session): session closed for user root Sep 06 06:37:11 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-6284ed25-3a5a-4b2d-a1b4-4054618ebec3 tempest-GroupsV314Test-1495585002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b5123030-8d11-43e0-b2eb-86d160a73a6d" returned: 0 in 0.544s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:37:11 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-6284ed25-3a5a-4b2d-a1b4-4054618ebec3 tempest-GroupsV314Test-1495585002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b5123030-8d11-43e0-b2eb-86d160a73a6d {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:37:11 devstack sudo[95330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b5123030-8d11-43e0-b2eb-86d160a73a6d Sep 06 06:37:11 devstack sudo[95330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:37:11 devstack sudo[95328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7005ba32-ec39-44a3-88d9-ca6af0b34ea0_01ur104ydevstack@QuobyteHD Sep 06 06:37:11 devstack sudo[95328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:37:12 devstack sudo[95328]: pam_unix(sudo:session): session closed for user root Sep 06 06:37:12 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-6a7a8ff1-990b-41f3-95e7-7f3c4e08f677 tempest-VolumesImageMetadata-1229675148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7005ba32-ec39-44a3-88d9-ca6af0b34ea0_01ur104ydevstack@QuobyteHD" returned: 0 in 0.390s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:37:12 devstack cinder-volume[87329]: DEBUG cinder.image.image_utils [None req-6a7a8ff1-990b-41f3-95e7-7f3c4e08f677 tempest-VolumesImageMetadata-1229675148 None] 7005ba32-ec39-44a3-88d9-ca6af0b34ea0 was qcow2, converting to qcow2 {{(pid=87329) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 06 06:37:12 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-6a7a8ff1-990b-41f3-95e7-7f3c4e08f677 tempest-VolumesImageMetadata-1229675148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7005ba32-ec39-44a3-88d9-ca6af0b34ea0_01ur104ydevstack@QuobyteHD /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-ab3a0fbb-4a74-40e6-9e41-da641ca994c5 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:37:12 devstack sudo[95330]: pam_unix(sudo:session): session closed for user root Sep 06 06:37:12 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-6284ed25-3a5a-4b2d-a1b4-4054618ebec3 tempest-GroupsV314Test-1495585002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b5123030-8d11-43e0-b2eb-86d160a73a6d" returned: 0 in 0.308s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:37:12 devstack sudo[95337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7005ba32-ec39-44a3-88d9-ca6af0b34ea0_01ur104ydevstack@QuobyteHD /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-ab3a0fbb-4a74-40e6-9e41-da641ca994c5 Sep 06 06:37:12 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-6284ed25-3a5a-4b2d-a1b4-4054618ebec3 tempest-GroupsV314Test-1495585002 None] Lock "cinder-quobyte-b5123030-8d11-43e0-b2eb-86d160a73a6d" released by "delete_volume" :: held 0.908s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:37:12 devstack sudo[95337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:37:12 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-6284ed25-3a5a-4b2d-a1b4-4054618ebec3 tempest-GroupsV314Test-1495585002 None] Created reservations ['037e95cd-a8e0-4b95-97dd-74473912ebaf'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:37:12 devstack cinder-volume[87329]: WARNING cinder.quota [None req-6284ed25-3a5a-4b2d-a1b4-4054618ebec3 tempest-GroupsV314Test-1495585002 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-254054923 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-254054923, it is now deprecated. Please use the default quota class for default quota. Sep 06 06:37:12 devstack cinder-volume[87329]: WARNING cinder.quota [None req-6284ed25-3a5a-4b2d-a1b4-4054618ebec3 tempest-GroupsV314Test-1495585002 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-254054923 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-254054923, it is now deprecated. Please use the default quota class for default quota. Sep 06 06:37:12 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-6284ed25-3a5a-4b2d-a1b4-4054618ebec3 tempest-GroupsV314Test-1495585002 None] Created reservations ['973a315d-37f8-4f7d-88a0-6240904a1eeb', '89789a45-665d-49bf-834f-1524988ceaea', '6c8ae21a-78b0-4149-a945-58871d71cec1', 'a7a51fe3-7346-441d-80a3-1a1462921401'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:37:12 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-6284ed25-3a5a-4b2d-a1b4-4054618ebec3 tempest-GroupsV314Test-1495585002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:37:12 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-6284ed25-3a5a-4b2d-a1b4-4054618ebec3 tempest-GroupsV314Test-1495585002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:37:12 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-6284ed25-3a5a-4b2d-a1b4-4054618ebec3 tempest-GroupsV314Test-1495585002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:37:12 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-6284ed25-3a5a-4b2d-a1b4-4054618ebec3 tempest-GroupsV314Test-1495585002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:37:12 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-6284ed25-3a5a-4b2d-a1b4-4054618ebec3 tempest-GroupsV314Test-1495585002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:37:12 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-6284ed25-3a5a-4b2d-a1b4-4054618ebec3 tempest-GroupsV314Test-1495585002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:37:12 devstack sudo[95343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:37:12 devstack sudo[95343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:37:12 devstack sudo[95343]: pam_unix(sudo:session): session closed for user root Sep 06 06:37:12 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-6284ed25-3a5a-4b2d-a1b4-4054618ebec3 tempest-GroupsV314Test-1495585002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.341s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:37:12 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-6284ed25-3a5a-4b2d-a1b4-4054618ebec3 tempest-GroupsV314Test-1495585002 None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:37:12 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-6284ed25-3a5a-4b2d-a1b4-4054618ebec3 tempest-GroupsV314Test-1495585002 None] Delete group completed successfully. Sep 06 06:37:13 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-934a8cf0-d7c4-4178-b59c-da8c1453bf59 tempest-GroupsV314Test-1495585002 None] Acquiring lock "cinder-quobyte-6abeb7ab-d3a6-48d9-9a25-0e4c13e06cdd" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:37:13 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-934a8cf0-d7c4-4178-b59c-da8c1453bf59 tempest-GroupsV314Test-1495585002 None] Lock "cinder-quobyte-6abeb7ab-d3a6-48d9-9a25-0e4c13e06cdd" acquired by "delete_volume" :: waited 0.024s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:37:13 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[c92020e6-7496-4aae-b510-17b7667a2ad5]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:37:13 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-934a8cf0-d7c4-4178-b59c-da8c1453bf59 tempest-GroupsV314Test-1495585002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6abeb7ab-d3a6-48d9-9a25-0e4c13e06cdd {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:37:14 devstack sudo[95349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6abeb7ab-d3a6-48d9-9a25-0e4c13e06cdd Sep 06 06:37:14 devstack sudo[95349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:37:14 devstack sudo[95337]: pam_unix(sudo:session): session closed for user root Sep 06 06:37:14 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-6a7a8ff1-990b-41f3-95e7-7f3c4e08f677 tempest-VolumesImageMetadata-1229675148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7005ba32-ec39-44a3-88d9-ca6af0b34ea0_01ur104ydevstack@QuobyteHD /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-ab3a0fbb-4a74-40e6-9e41-da641ca994c5" returned: 0 in 2.074s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:37:14 devstack cinder-volume[87329]: DEBUG cinder.image.image_utils [None req-6a7a8ff1-990b-41f3-95e7-7f3c4e08f677 tempest-VolumesImageMetadata-1229675148 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_7005ba32-ec39-44a3-88d9-ca6af0b34ea0_01ur104ydevstack@QuobyteHD, size 112.00 MB, duration 2.08 sec, destination /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-ab3a0fbb-4a74-40e6-9e41-da641ca994c5 {{(pid=87329) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 06 06:37:14 devstack cinder-volume[87329]: INFO cinder.image.image_utils [None req-6a7a8ff1-990b-41f3-95e7-7f3c4e08f677 tempest-VolumesImageMetadata-1229675148 None] Converted 112.00 MB image at 53.96 MB/s Sep 06 06:37:14 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-6a7a8ff1-990b-41f3-95e7-7f3c4e08f677 tempest-VolumesImageMetadata-1229675148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-ab3a0fbb-4a74-40e6-9e41-da641ca994c5 1G {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:37:14 devstack sudo[95351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-ab3a0fbb-4a74-40e6-9e41-da641ca994c5 1G Sep 06 06:37:14 devstack sudo[95351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:37:14 devstack sudo[95349]: pam_unix(sudo:session): session closed for user root Sep 06 06:37:14 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-934a8cf0-d7c4-4178-b59c-da8c1453bf59 tempest-GroupsV314Test-1495585002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6abeb7ab-d3a6-48d9-9a25-0e4c13e06cdd" returned: 0 in 0.417s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:37:14 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-934a8cf0-d7c4-4178-b59c-da8c1453bf59 tempest-GroupsV314Test-1495585002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6abeb7ab-d3a6-48d9-9a25-0e4c13e06cdd {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:37:14 devstack sudo[95357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6abeb7ab-d3a6-48d9-9a25-0e4c13e06cdd Sep 06 06:37:14 devstack sudo[95357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:37:14 devstack sudo[95357]: pam_unix(sudo:session): session closed for user root Sep 06 06:37:14 devstack sudo[95351]: pam_unix(sudo:session): session closed for user root Sep 06 06:37:14 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-934a8cf0-d7c4-4178-b59c-da8c1453bf59 tempest-GroupsV314Test-1495585002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6abeb7ab-d3a6-48d9-9a25-0e4c13e06cdd" returned: 0 in 0.322s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:37:14 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-6a7a8ff1-990b-41f3-95e7-7f3c4e08f677 tempest-VolumesImageMetadata-1229675148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-ab3a0fbb-4a74-40e6-9e41-da641ca994c5 1G" returned: 0 in 0.505s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:37:14 devstack cinder-volume[87329]: DEBUG cinder.volume.volume_utils [None req-6a7a8ff1-990b-41f3-95e7-7f3c4e08f677 tempest-VolumesImageMetadata-1229675148 None] Downloaded image 7005ba32-ec39-44a3-88d9-ca6af0b34ea0 ((None, [{'url': 'file:///opt/stack/data/glance/images/7005ba32-ec39-44a3-88d9-ca6af0b34ea0', 'metadata': {}}])) to volume ab3a0fbb-4a74-40e6-9e41-da641ca994c5 successfully. {{(pid=87329) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 06 06:37:14 devstack cinder-volume[87329]: DEBUG cinder.image.image_utils [None req-6a7a8ff1-990b-41f3-95e7-7f3c4e08f677 tempest-VolumesImageMetadata-1229675148 None] Temporary image 7005ba32-ec39-44a3-88d9-ca6af0b34ea0 for user fc7e53b20672412ba84db31c04dd7d00 is deleted. {{(pid=87329) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 06 06:37:14 devstack cinder-volume[87329]: DEBUG cinder.volume.volume_utils [None req-6a7a8ff1-990b-41f3-95e7-7f3c4e08f677 tempest-VolumesImageMetadata-1229675148 None] Marking volume ab3a0fbb-4a74-40e6-9e41-da641ca994c5 as bootable. {{(pid=87329) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 06 06:37:14 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-934a8cf0-d7c4-4178-b59c-da8c1453bf59 tempest-GroupsV314Test-1495585002 None] Lock "cinder-quobyte-6abeb7ab-d3a6-48d9-9a25-0e4c13e06cdd" released by "delete_volume" :: held 0.831s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:37:14 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a7a8ff1-990b-41f3-95e7-7f3c4e08f677 tempest-VolumesImageMetadata-1229675148 None] Copying metadata from image 7005ba32-ec39-44a3-88d9-ca6af0b34ea0 to ab3a0fbb-4a74-40e6-9e41-da641ca994c5. {{(pid=87329) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 06 06:37:14 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a7a8ff1-990b-41f3-95e7-7f3c4e08f677 tempest-VolumesImageMetadata-1229675148 None] Creating volume glance metadata for volume ab3a0fbb-4a74-40e6-9e41-da641ca994c5 backed by image 7005ba32-ec39-44a3-88d9-ca6af0b34ea0 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '7005ba32-ec39-44a3-88d9-ca6af0b34ea0', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87329) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 06 06:37:14 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-934a8cf0-d7c4-4178-b59c-da8c1453bf59 tempest-GroupsV314Test-1495585002 None] Created reservations ['11476e80-199a-4548-8bdc-4a2ef77bc0fc'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:37:14 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-6a7a8ff1-990b-41f3-95e7-7f3c4e08f677 tempest-VolumesImageMetadata-1229675148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2582a3d-5be8-49ee-a5d7-062ca0d06149) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab3a0fbb-4a74-40e6-9e41-da641ca994c5', 'volume_size': 1, 'image_id': '7005ba32-ec39-44a3-88d9-ca6af0b34ea0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7005ba32-ec39-44a3-88d9-ca6af0b34ea0', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '65b0d6d605b2427d8db787d4220dbeb4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7005ba32-ec39-44a3-88d9-ca6af0b34ea0', 'created_at': datetime.datetime(2026, 9, 6, 4, 25, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 6, 4, 25, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7005ba32-ec39-44a3-88d9-ca6af0b34ea0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:37:14 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-6a7a8ff1-990b-41f3-95e7-7f3c4e08f677 tempest-VolumesImageMetadata-1229675148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e69bf29-8956-48b9-a2e7-ca96059d09b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:37:14 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-6a7a8ff1-990b-41f3-95e7-7f3c4e08f677 tempest-VolumesImageMetadata-1229675148 None] Volume volume-ab3a0fbb-4a74-40e6-9e41-da641ca994c5 (ab3a0fbb-4a74-40e6-9e41-da641ca994c5): created successfully Sep 06 06:37:14 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-6a7a8ff1-990b-41f3-95e7-7f3c4e08f677 tempest-VolumesImageMetadata-1229675148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e69bf29-8956-48b9-a2e7-ca96059d09b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:37:14 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-6a7a8ff1-990b-41f3-95e7-7f3c4e08f677 tempest-VolumesImageMetadata-1229675148 None] Flow 'volume_create_manager' (c792dfbf-ace4-42a7-ac6b-cf977d6883a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:37:14 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-934a8cf0-d7c4-4178-b59c-da8c1453bf59 tempest-GroupsV314Test-1495585002 None] Created reservations ['951dc603-e94b-4009-8c8b-6d1e726bb767', 'f82ca6dc-dc2e-486b-9141-4f021231a3dc', '93c02db3-94e8-406c-9a1f-c5f311c09086', '3902b606-1785-4aa1-85f3-0efb79f775aa'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:37:14 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-6a7a8ff1-990b-41f3-95e7-7f3c4e08f677 tempest-VolumesImageMetadata-1229675148 None] Created volume successfully. Sep 06 06:37:15 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-934a8cf0-d7c4-4178-b59c-da8c1453bf59 tempest-GroupsV314Test-1495585002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:37:15 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-934a8cf0-d7c4-4178-b59c-da8c1453bf59 tempest-GroupsV314Test-1495585002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:37:15 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-934a8cf0-d7c4-4178-b59c-da8c1453bf59 tempest-GroupsV314Test-1495585002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:37:15 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-934a8cf0-d7c4-4178-b59c-da8c1453bf59 tempest-GroupsV314Test-1495585002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:37:15 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-934a8cf0-d7c4-4178-b59c-da8c1453bf59 tempest-GroupsV314Test-1495585002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:37:15 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-934a8cf0-d7c4-4178-b59c-da8c1453bf59 tempest-GroupsV314Test-1495585002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:37:15 devstack sudo[95364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:37:15 devstack sudo[95364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:37:15 devstack sudo[95364]: pam_unix(sudo:session): session closed for user root Sep 06 06:37:15 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-934a8cf0-d7c4-4178-b59c-da8c1453bf59 tempest-GroupsV314Test-1495585002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.313s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:37:15 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-934a8cf0-d7c4-4178-b59c-da8c1453bf59 tempest-GroupsV314Test-1495585002 None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:37:15 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-934a8cf0-d7c4-4178-b59c-da8c1453bf59 tempest-GroupsV314Test-1495585002 None] Delete group completed successfully. Sep 06 06:37:15 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-df48c2bc-6160-4627-b202-be8561270c88 tempest-VolumesImageMetadata-1229675148 None] Acquiring lock "cinder-ab3a0fbb-4a74-40e6-9e41-da641ca994c5-delete_volume" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:37:15 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-df48c2bc-6160-4627-b202-be8561270c88 tempest-VolumesImageMetadata-1229675148 None] Lock "cinder-ab3a0fbb-4a74-40e6-9e41-da641ca994c5-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:37:15 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-df48c2bc-6160-4627-b202-be8561270c88 tempest-VolumesImageMetadata-1229675148 None] Acquiring lock "cinder-quobyte-ab3a0fbb-4a74-40e6-9e41-da641ca994c5" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:37:15 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-df48c2bc-6160-4627-b202-be8561270c88 tempest-VolumesImageMetadata-1229675148 None] Lock "cinder-quobyte-ab3a0fbb-4a74-40e6-9e41-da641ca994c5" acquired by "delete_volume" :: waited 0.028s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:37:15 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a704595-2c90-4b6b-9324-520743d260f8]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:37:15 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-df48c2bc-6160-4627-b202-be8561270c88 tempest-VolumesImageMetadata-1229675148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-ab3a0fbb-4a74-40e6-9e41-da641ca994c5 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:37:16 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-98510796-e550-426a-94d2-5036fe207454 tempest-TestInstancesWithCinderVolumes-102430806 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87329) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 06:37:16 devstack sudo[95368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-ab3a0fbb-4a74-40e6-9e41-da641ca994c5 Sep 06 06:37:16 devstack sudo[95368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:37:16 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-98510796-e550-426a-94d2-5036fe207454 tempest-TestInstancesWithCinderVolumes-102430806 None] Flow 'volume_create_manager' (fef4a475-7095-4239-a28c-062d1edee3af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:37:16 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-98510796-e550-426a-94d2-5036fe207454 tempest-TestInstancesWithCinderVolumes-102430806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4e34dd6-7dc9-4255-b95f-9742b359db78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:37:16 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-98510796-e550-426a-94d2-5036fe207454 tempest-TestInstancesWithCinderVolumes-102430806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4e34dd6-7dc9-4255-b95f-9742b359db78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:37:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-934605920',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3880ea2c-60dc-4cb0-9186-8c98cad13ab1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f9bf25272e444f395b1908b706aa147',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:37:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:37:16Z,use_quota=True,user_id='23104bb67481471dba2e921be5fa49c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(171ff8d2-415e-4f0f-91f9-ef05de0492ee),volume_type_id=171ff8d2-415e-4f0f-91f9-ef05de0492ee)' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:37:16 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-98510796-e550-426a-94d2-5036fe207454 tempest-TestInstancesWithCinderVolumes-102430806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3003b18-cbfa-4ac0-9641-b83b4c0dca24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:37:16 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-98510796-e550-426a-94d2-5036fe207454 tempest-TestInstancesWithCinderVolumes-102430806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3003b18-cbfa-4ac0-9641-b83b4c0dca24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:37:16 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-98510796-e550-426a-94d2-5036fe207454 tempest-TestInstancesWithCinderVolumes-102430806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c9040c1-b56c-4af7-874b-13d6bd104214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:37:16 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-98510796-e550-426a-94d2-5036fe207454 tempest-TestInstancesWithCinderVolumes-102430806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c9040c1-b56c-4af7-874b-13d6bd104214) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3880ea2c-60dc-4cb0-9186-8c98cad13ab1', 'volume_name': 'volume-3880ea2c-60dc-4cb0-9186-8c98cad13ab1', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:37:16 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-98510796-e550-426a-94d2-5036fe207454 tempest-TestInstancesWithCinderVolumes-102430806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a9efb82-30d4-4f40-89bb-1eeaf26e6302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:37:16 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-98510796-e550-426a-94d2-5036fe207454 tempest-TestInstancesWithCinderVolumes-102430806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a9efb82-30d4-4f40-89bb-1eeaf26e6302) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:37:16 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-98510796-e550-426a-94d2-5036fe207454 tempest-TestInstancesWithCinderVolumes-102430806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed22913f-57b6-4ee3-829f-fd6bcc435363) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:37:16 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-98510796-e550-426a-94d2-5036fe207454 tempest-TestInstancesWithCinderVolumes-102430806 None] Volume 3880ea2c-60dc-4cb0-9186-8c98cad13ab1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3880ea2c-60dc-4cb0-9186-8c98cad13ab1', 'volume_size': 1} Sep 06 06:37:16 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-98510796-e550-426a-94d2-5036fe207454 tempest-TestInstancesWithCinderVolumes-102430806 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:37:16 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-98510796-e550-426a-94d2-5036fe207454 tempest-TestInstancesWithCinderVolumes-102430806 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:37:16 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-98510796-e550-426a-94d2-5036fe207454 tempest-TestInstancesWithCinderVolumes-102430806 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:37:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-934605920',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3880ea2c-60dc-4cb0-9186-8c98cad13ab1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f9bf25272e444f395b1908b706aa147',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:37:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:37:16Z,use_quota=True,user_id='23104bb67481471dba2e921be5fa49c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(171ff8d2-415e-4f0f-91f9-ef05de0492ee),volume_type_id=171ff8d2-415e-4f0f-91f9-ef05de0492ee)}" {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 06:37:16 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-98510796-e550-426a-94d2-5036fe207454 tempest-TestInstancesWithCinderVolumes-102430806 None] Creating volume 3880ea2c-60dc-4cb0-9186-8c98cad13ab1 {{(pid=87329) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 06:37:16 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-98510796-e550-426a-94d2-5036fe207454 tempest-TestInstancesWithCinderVolumes-102430806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:37:16 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-98510796-e550-426a-94d2-5036fe207454 tempest-TestInstancesWithCinderVolumes-102430806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:37:16 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-98510796-e550-426a-94d2-5036fe207454 tempest-TestInstancesWithCinderVolumes-102430806 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:37:16 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-98510796-e550-426a-94d2-5036fe207454 tempest-TestInstancesWithCinderVolumes-102430806 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:37:16 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-98510796-e550-426a-94d2-5036fe207454 tempest-TestInstancesWithCinderVolumes-102430806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:37:16 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-98510796-e550-426a-94d2-5036fe207454 tempest-TestInstancesWithCinderVolumes-102430806 None] Selected osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 as target Quobyte volume. {{(pid=87329) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 06:37:16 devstack cinder-volume[87329]: INFO cinder.volume.drivers.remotefs [None req-98510796-e550-426a-94d2-5036fe207454 tempest-TestInstancesWithCinderVolumes-102430806 None] casted to osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 Sep 06 06:37:16 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-98510796-e550-426a-94d2-5036fe207454 tempest-TestInstancesWithCinderVolumes-102430806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-3880ea2c-60dc-4cb0-9186-8c98cad13ab1 1073741824 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:37:16 devstack sudo[95370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-3880ea2c-60dc-4cb0-9186-8c98cad13ab1 1073741824 Sep 06 06:37:16 devstack sudo[95370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:37:16 devstack sudo[95368]: pam_unix(sudo:session): session closed for user root Sep 06 06:37:16 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-df48c2bc-6160-4627-b202-be8561270c88 tempest-VolumesImageMetadata-1229675148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-ab3a0fbb-4a74-40e6-9e41-da641ca994c5" returned: 0 in 0.609s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:37:16 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-df48c2bc-6160-4627-b202-be8561270c88 tempest-VolumesImageMetadata-1229675148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-ab3a0fbb-4a74-40e6-9e41-da641ca994c5 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:37:16 devstack sudo[95375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-ab3a0fbb-4a74-40e6-9e41-da641ca994c5 Sep 06 06:37:16 devstack sudo[95375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:37:16 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe237094-ffc1-445e-a00b-0a0aef90b54c tempest-TestInstancesWithCinderVolumes-102430806 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87329) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 06:37:16 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-fe237094-ffc1-445e-a00b-0a0aef90b54c tempest-TestInstancesWithCinderVolumes-102430806 None] Flow 'volume_create_manager' (64501733-0dc7-42fd-ba92-ca1191304df0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:37:16 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-fe237094-ffc1-445e-a00b-0a0aef90b54c tempest-TestInstancesWithCinderVolumes-102430806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51ac27f9-7b14-4506-9be5-e77097bc5f2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:37:16 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-fe237094-ffc1-445e-a00b-0a0aef90b54c tempest-TestInstancesWithCinderVolumes-102430806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51ac27f9-7b14-4506-9be5-e77097bc5f2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:37:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2142220719',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1efe1c77-2770-4e7d-8293-625d554592a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f9bf25272e444f395b1908b706aa147',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:37:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:37:17Z,use_quota=True,user_id='23104bb67481471dba2e921be5fa49c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da70b0af-8129-4335-9a80-12f3e88cea6b),volume_type_id=da70b0af-8129-4335-9a80-12f3e88cea6b)' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:37:16 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-fe237094-ffc1-445e-a00b-0a0aef90b54c tempest-TestInstancesWithCinderVolumes-102430806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c3aca73-9132-48c5-90da-4aec556b07a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:37:16 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-fe237094-ffc1-445e-a00b-0a0aef90b54c tempest-TestInstancesWithCinderVolumes-102430806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c3aca73-9132-48c5-90da-4aec556b07a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:37:16 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-fe237094-ffc1-445e-a00b-0a0aef90b54c tempest-TestInstancesWithCinderVolumes-102430806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37fdbd91-7c85-4169-9196-cedf74844329) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:37:16 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-fe237094-ffc1-445e-a00b-0a0aef90b54c tempest-TestInstancesWithCinderVolumes-102430806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37fdbd91-7c85-4169-9196-cedf74844329) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1efe1c77-2770-4e7d-8293-625d554592a8', 'volume_name': 'volume-1efe1c77-2770-4e7d-8293-625d554592a8', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:37:16 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-fe237094-ffc1-445e-a00b-0a0aef90b54c tempest-TestInstancesWithCinderVolumes-102430806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e8b85b5-171a-4ad8-9d4b-4c2fc26f2542) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:37:16 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-fe237094-ffc1-445e-a00b-0a0aef90b54c tempest-TestInstancesWithCinderVolumes-102430806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e8b85b5-171a-4ad8-9d4b-4c2fc26f2542) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:37:16 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-fe237094-ffc1-445e-a00b-0a0aef90b54c tempest-TestInstancesWithCinderVolumes-102430806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de75d6e4-f87c-484b-a071-88e444a54eab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:37:16 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-fe237094-ffc1-445e-a00b-0a0aef90b54c tempest-TestInstancesWithCinderVolumes-102430806 None] Volume 1efe1c77-2770-4e7d-8293-625d554592a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1efe1c77-2770-4e7d-8293-625d554592a8', 'volume_size': 1} Sep 06 06:37:16 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-fe237094-ffc1-445e-a00b-0a0aef90b54c tempest-TestInstancesWithCinderVolumes-102430806 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:37:16 devstack sudo[95375]: pam_unix(sudo:session): session closed for user root Sep 06 06:37:16 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-df48c2bc-6160-4627-b202-be8561270c88 tempest-VolumesImageMetadata-1229675148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-ab3a0fbb-4a74-40e6-9e41-da641ca994c5" returned: 0 in 0.402s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:37:17 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-df48c2bc-6160-4627-b202-be8561270c88 tempest-VolumesImageMetadata-1229675148 None] Lock "cinder-quobyte-ab3a0fbb-4a74-40e6-9e41-da641ca994c5" released by "delete_volume" :: held 1.083s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:37:17 devstack sudo[95370]: pam_unix(sudo:session): session closed for user root Sep 06 06:37:17 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-df48c2bc-6160-4627-b202-be8561270c88 tempest-VolumesImageMetadata-1229675148 None] Created reservations ['8c1634fa-a668-4241-b601-774f036f1d64', 'cf57942b-6f99-44c4-a2e8-6def49a3ed58', 'b0bc9cab-e01f-42df-a677-a23372523318', '177dde66-81a0-4b2d-8248-8eabafdfa715'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:37:17 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-98510796-e550-426a-94d2-5036fe207454 tempest-TestInstancesWithCinderVolumes-102430806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-3880ea2c-60dc-4cb0-9186-8c98cad13ab1 1073741824" returned: 0 in 0.801s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:37:17 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-98510796-e550-426a-94d2-5036fe207454 tempest-TestInstancesWithCinderVolumes-102430806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-3880ea2c-60dc-4cb0-9186-8c98cad13ab1 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:37:17 devstack sudo[95382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-3880ea2c-60dc-4cb0-9186-8c98cad13ab1 Sep 06 06:37:17 devstack sudo[95382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:37:17 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-df48c2bc-6160-4627-b202-be8561270c88 tempest-VolumesImageMetadata-1229675148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:37:17 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-df48c2bc-6160-4627-b202-be8561270c88 tempest-VolumesImageMetadata-1229675148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:37:17 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-df48c2bc-6160-4627-b202-be8561270c88 tempest-VolumesImageMetadata-1229675148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:37:17 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-df48c2bc-6160-4627-b202-be8561270c88 tempest-VolumesImageMetadata-1229675148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:37:17 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-df48c2bc-6160-4627-b202-be8561270c88 tempest-VolumesImageMetadata-1229675148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:37:17 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-df48c2bc-6160-4627-b202-be8561270c88 tempest-VolumesImageMetadata-1229675148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:37:17 devstack sudo[95384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:37:17 devstack sudo[95384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:37:17 devstack sudo[95384]: pam_unix(sudo:session): session closed for user root Sep 06 06:37:17 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-df48c2bc-6160-4627-b202-be8561270c88 tempest-VolumesImageMetadata-1229675148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.331s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:37:17 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-df48c2bc-6160-4627-b202-be8561270c88 tempest-VolumesImageMetadata-1229675148 None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:37:17 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-df48c2bc-6160-4627-b202-be8561270c88 tempest-VolumesImageMetadata-1229675148 None] Deleted volume successfully. Sep 06 06:37:17 devstack sudo[95382]: pam_unix(sudo:session): session closed for user root Sep 06 06:37:17 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-df48c2bc-6160-4627-b202-be8561270c88 tempest-VolumesImageMetadata-1229675148 None] Lock "cinder-ab3a0fbb-4a74-40e6-9e41-da641ca994c5-delete_volume" released by "delete_volume" :: held 1.820s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:37:17 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-98510796-e550-426a-94d2-5036fe207454 tempest-TestInstancesWithCinderVolumes-102430806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-3880ea2c-60dc-4cb0-9186-8c98cad13ab1" returned: 0 in 0.497s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:37:17 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-98510796-e550-426a-94d2-5036fe207454 tempest-TestInstancesWithCinderVolumes-102430806 None] <== create_volume: return (1382ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'} {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 06:37:17 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-98510796-e550-426a-94d2-5036fe207454 tempest-TestInstancesWithCinderVolumes-102430806 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.384s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:37:17 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-fe237094-ffc1-445e-a00b-0a0aef90b54c tempest-TestInstancesWithCinderVolumes-102430806 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.781s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:37:17 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-fe237094-ffc1-445e-a00b-0a0aef90b54c tempest-TestInstancesWithCinderVolumes-102430806 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:37:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2142220719',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1efe1c77-2770-4e7d-8293-625d554592a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f9bf25272e444f395b1908b706aa147',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:37:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:37:17Z,use_quota=True,user_id='23104bb67481471dba2e921be5fa49c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(da70b0af-8129-4335-9a80-12f3e88cea6b),volume_type_id=da70b0af-8129-4335-9a80-12f3e88cea6b)}" {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 06:37:17 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-fe237094-ffc1-445e-a00b-0a0aef90b54c tempest-TestInstancesWithCinderVolumes-102430806 None] Creating volume 1efe1c77-2770-4e7d-8293-625d554592a8 {{(pid=87329) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 06:37:17 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-fe237094-ffc1-445e-a00b-0a0aef90b54c tempest-TestInstancesWithCinderVolumes-102430806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:37:17 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-fe237094-ffc1-445e-a00b-0a0aef90b54c tempest-TestInstancesWithCinderVolumes-102430806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:37:17 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-fe237094-ffc1-445e-a00b-0a0aef90b54c tempest-TestInstancesWithCinderVolumes-102430806 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:37:17 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-fe237094-ffc1-445e-a00b-0a0aef90b54c tempest-TestInstancesWithCinderVolumes-102430806 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:37:17 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-fe237094-ffc1-445e-a00b-0a0aef90b54c tempest-TestInstancesWithCinderVolumes-102430806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:37:17 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-fe237094-ffc1-445e-a00b-0a0aef90b54c tempest-TestInstancesWithCinderVolumes-102430806 None] Selected osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 as target Quobyte volume. {{(pid=87329) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 06:37:17 devstack cinder-volume[87329]: INFO cinder.volume.drivers.remotefs [None req-fe237094-ffc1-445e-a00b-0a0aef90b54c tempest-TestInstancesWithCinderVolumes-102430806 None] casted to osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 Sep 06 06:37:17 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-fe237094-ffc1-445e-a00b-0a0aef90b54c tempest-TestInstancesWithCinderVolumes-102430806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-1efe1c77-2770-4e7d-8293-625d554592a8 1073741824 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:37:17 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-98510796-e550-426a-94d2-5036fe207454 tempest-TestInstancesWithCinderVolumes-102430806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed22913f-57b6-4ee3-829f-fd6bcc435363) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3880ea2c-60dc-4cb0-9186-8c98cad13ab1', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:37:17 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-98510796-e550-426a-94d2-5036fe207454 tempest-TestInstancesWithCinderVolumes-102430806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (baf1444d-9214-4e93-a1fc-ecbdabac8191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:37:17 devstack sudo[95388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-1efe1c77-2770-4e7d-8293-625d554592a8 1073741824 Sep 06 06:37:17 devstack sudo[95388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:37:17 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-98510796-e550-426a-94d2-5036fe207454 tempest-TestInstancesWithCinderVolumes-102430806 None] Volume volume-3880ea2c-60dc-4cb0-9186-8c98cad13ab1 (3880ea2c-60dc-4cb0-9186-8c98cad13ab1): created successfully Sep 06 06:37:17 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-98510796-e550-426a-94d2-5036fe207454 tempest-TestInstancesWithCinderVolumes-102430806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (baf1444d-9214-4e93-a1fc-ecbdabac8191) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:37:17 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-98510796-e550-426a-94d2-5036fe207454 tempest-TestInstancesWithCinderVolumes-102430806 None] Flow 'volume_create_manager' (fef4a475-7095-4239-a28c-062d1edee3af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:37:17 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-52392a4f-9ffe-4be0-80f8-468703a6ef4a tempest-TestInstancesWithCinderVolumes-102430806 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87329) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 06:37:17 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-52392a4f-9ffe-4be0-80f8-468703a6ef4a tempest-TestInstancesWithCinderVolumes-102430806 None] Flow 'volume_create_manager' (ab7206fe-4c48-4226-8934-b285d7fd6794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:37:17 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-52392a4f-9ffe-4be0-80f8-468703a6ef4a tempest-TestInstancesWithCinderVolumes-102430806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14c211c9-b750-4ce9-b62c-9d69ee42edd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:37:17 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-98510796-e550-426a-94d2-5036fe207454 tempest-TestInstancesWithCinderVolumes-102430806 None] Created volume successfully. Sep 06 06:37:17 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-52392a4f-9ffe-4be0-80f8-468703a6ef4a tempest-TestInstancesWithCinderVolumes-102430806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14c211c9-b750-4ce9-b62c-9d69ee42edd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:37:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2118698074',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f9b73f7-6ebd-4f23-abb5-eeda5ff71799,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f9bf25272e444f395b1908b706aa147',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:37:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:37:18Z,use_quota=True,user_id='23104bb67481471dba2e921be5fa49c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(900ceb63-dd1e-4fa9-88f9-a4018732e1f3),volume_type_id=900ceb63-dd1e-4fa9-88f9-a4018732e1f3)' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:37:17 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-52392a4f-9ffe-4be0-80f8-468703a6ef4a tempest-TestInstancesWithCinderVolumes-102430806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13c3a847-0af6-407f-918b-28c679e9e418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:37:17 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-52392a4f-9ffe-4be0-80f8-468703a6ef4a tempest-TestInstancesWithCinderVolumes-102430806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13c3a847-0af6-407f-918b-28c679e9e418) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:37:17 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-52392a4f-9ffe-4be0-80f8-468703a6ef4a tempest-TestInstancesWithCinderVolumes-102430806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed487642-99ac-4b1b-9ccb-34890f21196d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:37:17 devstack cinder-volume[87329]: DEBUG cinder.image.glance [None req-52392a4f-9ffe-4be0-80f8-468703a6ef4a tempest-TestInstancesWithCinderVolumes-102430806 None] Creating Keystone auth plugin from conf {{(pid=87329) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 06 06:37:18 devstack sudo[95388]: pam_unix(sudo:session): session closed for user root Sep 06 06:37:18 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-52392a4f-9ffe-4be0-80f8-468703a6ef4a tempest-TestInstancesWithCinderVolumes-102430806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed487642-99ac-4b1b-9ccb-34890f21196d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3f9b73f7-6ebd-4f23-abb5-eeda5ff71799', 'volume_name': 'volume-3f9b73f7-6ebd-4f23-abb5-eeda5ff71799', 'volume_size': 1, 'image_id': '5522887d-d303-4a6b-bc6b-da9996987e87', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5522887d-d303-4a6b-bc6b-da9996987e87', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1971389473', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3f9bf25272e444f395b1908b706aa147', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5522887d-d303-4a6b-bc6b-da9996987e87', 'created_at': datetime.datetime(2026, 9, 6, 4, 37, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 6, 4, 37, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5522887d-d303-4a6b-bc6b-da9996987e87/file', 'properties': {}}, 'image_service': }' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:37:18 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-52392a4f-9ffe-4be0-80f8-468703a6ef4a tempest-TestInstancesWithCinderVolumes-102430806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (784fee98-a0a4-4c5c-891a-446f13dc2ad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:37:18 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-52392a4f-9ffe-4be0-80f8-468703a6ef4a tempest-TestInstancesWithCinderVolumes-102430806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (784fee98-a0a4-4c5c-891a-446f13dc2ad8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:37:18 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-52392a4f-9ffe-4be0-80f8-468703a6ef4a tempest-TestInstancesWithCinderVolumes-102430806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9be9767-d502-49f2-b62f-74e2d8027861) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:37:18 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-52392a4f-9ffe-4be0-80f8-468703a6ef4a tempest-TestInstancesWithCinderVolumes-102430806 None] Volume 3f9b73f7-6ebd-4f23-abb5-eeda5ff71799: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3f9b73f7-6ebd-4f23-abb5-eeda5ff71799', 'volume_size': 1, 'image_id': '5522887d-d303-4a6b-bc6b-da9996987e87', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5522887d-d303-4a6b-bc6b-da9996987e87', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1971389473', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3f9bf25272e444f395b1908b706aa147', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5522887d-d303-4a6b-bc6b-da9996987e87', 'created_at': datetime.datetime(2026, 9, 6, 4, 37, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 6, 4, 37, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5522887d-d303-4a6b-bc6b-da9996987e87/file', 'properties': {}}, 'image_service': } Sep 06 06:37:18 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-52392a4f-9ffe-4be0-80f8-468703a6ef4a tempest-TestInstancesWithCinderVolumes-102430806 None] Trying to clone 3f9b73f7-6ebd-4f23-abb5-eeda5ff71799 from image 5522887d-d303-4a6b-bc6b-da9996987e87 at location (None, [{'url': 'file:///opt/stack/data/glance/images/5522887d-d303-4a6b-bc6b-da9996987e87', 'metadata': {}}]). {{(pid=87329) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 06 06:37:18 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-fe237094-ffc1-445e-a00b-0a0aef90b54c tempest-TestInstancesWithCinderVolumes-102430806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-1efe1c77-2770-4e7d-8293-625d554592a8 1073741824" returned: 0 in 0.731s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:37:18 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-fe237094-ffc1-445e-a00b-0a0aef90b54c tempest-TestInstancesWithCinderVolumes-102430806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-1efe1c77-2770-4e7d-8293-625d554592a8 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:37:18 devstack sudo[95394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-1efe1c77-2770-4e7d-8293-625d554592a8 Sep 06 06:37:18 devstack sudo[95394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:37:18 devstack sudo[95394]: pam_unix(sudo:session): session closed for user root Sep 06 06:37:18 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-fe237094-ffc1-445e-a00b-0a0aef90b54c tempest-TestInstancesWithCinderVolumes-102430806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-1efe1c77-2770-4e7d-8293-625d554592a8" returned: 0 in 0.362s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:37:18 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-fe237094-ffc1-445e-a00b-0a0aef90b54c tempest-TestInstancesWithCinderVolumes-102430806 None] <== create_volume: return (1183ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'} {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 06:37:18 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-fe237094-ffc1-445e-a00b-0a0aef90b54c tempest-TestInstancesWithCinderVolumes-102430806 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.186s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:37:18 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-fe237094-ffc1-445e-a00b-0a0aef90b54c tempest-TestInstancesWithCinderVolumes-102430806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de75d6e4-f87c-484b-a071-88e444a54eab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1efe1c77-2770-4e7d-8293-625d554592a8', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:37:18 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-fe237094-ffc1-445e-a00b-0a0aef90b54c tempest-TestInstancesWithCinderVolumes-102430806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d58178c-2f1a-4308-a96c-60ad46ad3d92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:37:18 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-fe237094-ffc1-445e-a00b-0a0aef90b54c tempest-TestInstancesWithCinderVolumes-102430806 None] Volume volume-1efe1c77-2770-4e7d-8293-625d554592a8 (1efe1c77-2770-4e7d-8293-625d554592a8): created successfully Sep 06 06:37:18 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-fe237094-ffc1-445e-a00b-0a0aef90b54c tempest-TestInstancesWithCinderVolumes-102430806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d58178c-2f1a-4308-a96c-60ad46ad3d92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:37:18 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-fe237094-ffc1-445e-a00b-0a0aef90b54c tempest-TestInstancesWithCinderVolumes-102430806 None] Flow 'volume_create_manager' (64501733-0dc7-42fd-ba92-ca1191304df0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:37:18 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-fe237094-ffc1-445e-a00b-0a0aef90b54c tempest-TestInstancesWithCinderVolumes-102430806 None] Created volume successfully. Sep 06 06:37:22 devstack cinder-volume[87329]: DEBUG cinder.image.image_utils [None req-52392a4f-9ffe-4be0-80f8-468703a6ef4a tempest-TestInstancesWithCinderVolumes-102430806 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_5522887d-d303-4a6b-bc6b-da9996987e87__xvs65jxdevstack@QuobyteHD, size 20.69 MB, duration 4.49 sec {{(pid=87329) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 06 06:37:22 devstack cinder-volume[87329]: INFO cinder.image.image_utils [None req-52392a4f-9ffe-4be0-80f8-468703a6ef4a tempest-TestInstancesWithCinderVolumes-102430806 None] Image download 20.69 MB at 4.60 MB/s Sep 06 06:37:22 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[8805a437-3550-4901-95e0-d098f5bf74ad]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:37:22 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-52392a4f-9ffe-4be0-80f8-468703a6ef4a tempest-TestInstancesWithCinderVolumes-102430806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5522887d-d303-4a6b-bc6b-da9996987e87__xvs65jxdevstack@QuobyteHD {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:37:23 devstack sudo[95399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5522887d-d303-4a6b-bc6b-da9996987e87__xvs65jxdevstack@QuobyteHD Sep 06 06:37:23 devstack sudo[95399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:37:23 devstack sudo[95399]: pam_unix(sudo:session): session closed for user root Sep 06 06:37:23 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-52392a4f-9ffe-4be0-80f8-468703a6ef4a tempest-TestInstancesWithCinderVolumes-102430806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5522887d-d303-4a6b-bc6b-da9996987e87__xvs65jxdevstack@QuobyteHD" returned: 0 in 0.396s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:37:23 devstack cinder-volume[87329]: DEBUG cinder.image.image_utils [None req-52392a4f-9ffe-4be0-80f8-468703a6ef4a tempest-TestInstancesWithCinderVolumes-102430806 None] Temporary image 5522887d-d303-4a6b-bc6b-da9996987e87 is fetched for user 23104bb67481471dba2e921be5fa49c8. {{(pid=87329) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 06 06:37:23 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[5458ddec-1cb2-4fb5-9d2c-8af1ea4d7e8c]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:37:23 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-52392a4f-9ffe-4be0-80f8-468703a6ef4a tempest-TestInstancesWithCinderVolumes-102430806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5522887d-d303-4a6b-bc6b-da9996987e87__xvs65jxdevstack@QuobyteHD {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:37:23 devstack sudo[95405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5522887d-d303-4a6b-bc6b-da9996987e87__xvs65jxdevstack@QuobyteHD Sep 06 06:37:23 devstack sudo[95405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:37:23 devstack sudo[95405]: pam_unix(sudo:session): session closed for user root Sep 06 06:37:23 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-52392a4f-9ffe-4be0-80f8-468703a6ef4a tempest-TestInstancesWithCinderVolumes-102430806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5522887d-d303-4a6b-bc6b-da9996987e87__xvs65jxdevstack@QuobyteHD" returned: 0 in 0.413s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:37:23 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-52392a4f-9ffe-4be0-80f8-468703a6ef4a tempest-TestInstancesWithCinderVolumes-102430806 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:37:23 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-52392a4f-9ffe-4be0-80f8-468703a6ef4a tempest-TestInstancesWithCinderVolumes-102430806 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:37:23 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-52392a4f-9ffe-4be0-80f8-468703a6ef4a tempest-TestInstancesWithCinderVolumes-102430806 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:37:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2118698074',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f9b73f7-6ebd-4f23-abb5-eeda5ff71799,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f9bf25272e444f395b1908b706aa147',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:37:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:37:18Z,use_quota=True,user_id='23104bb67481471dba2e921be5fa49c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(900ceb63-dd1e-4fa9-88f9-a4018732e1f3),volume_type_id=900ceb63-dd1e-4fa9-88f9-a4018732e1f3)}" {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 06:37:23 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-52392a4f-9ffe-4be0-80f8-468703a6ef4a tempest-TestInstancesWithCinderVolumes-102430806 None] Creating volume 3f9b73f7-6ebd-4f23-abb5-eeda5ff71799 {{(pid=87329) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 06:37:23 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-52392a4f-9ffe-4be0-80f8-468703a6ef4a tempest-TestInstancesWithCinderVolumes-102430806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:37:23 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-52392a4f-9ffe-4be0-80f8-468703a6ef4a tempest-TestInstancesWithCinderVolumes-102430806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:37:23 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-52392a4f-9ffe-4be0-80f8-468703a6ef4a tempest-TestInstancesWithCinderVolumes-102430806 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:37:23 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-52392a4f-9ffe-4be0-80f8-468703a6ef4a tempest-TestInstancesWithCinderVolumes-102430806 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:37:23 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-52392a4f-9ffe-4be0-80f8-468703a6ef4a tempest-TestInstancesWithCinderVolumes-102430806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:37:23 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-52392a4f-9ffe-4be0-80f8-468703a6ef4a tempest-TestInstancesWithCinderVolumes-102430806 None] Selected osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 as target Quobyte volume. {{(pid=87329) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 06:37:23 devstack cinder-volume[87329]: INFO cinder.volume.drivers.remotefs [None req-52392a4f-9ffe-4be0-80f8-468703a6ef4a tempest-TestInstancesWithCinderVolumes-102430806 None] casted to osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 Sep 06 06:37:23 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-52392a4f-9ffe-4be0-80f8-468703a6ef4a tempest-TestInstancesWithCinderVolumes-102430806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-3f9b73f7-6ebd-4f23-abb5-eeda5ff71799 1073741824 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:37:23 devstack sudo[95410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-3f9b73f7-6ebd-4f23-abb5-eeda5ff71799 1073741824 Sep 06 06:37:23 devstack sudo[95410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:37:24 devstack sudo[95410]: pam_unix(sudo:session): session closed for user root Sep 06 06:37:24 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-52392a4f-9ffe-4be0-80f8-468703a6ef4a tempest-TestInstancesWithCinderVolumes-102430806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-3f9b73f7-6ebd-4f23-abb5-eeda5ff71799 1073741824" returned: 0 in 0.512s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:37:24 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-52392a4f-9ffe-4be0-80f8-468703a6ef4a tempest-TestInstancesWithCinderVolumes-102430806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-3f9b73f7-6ebd-4f23-abb5-eeda5ff71799 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:37:24 devstack sudo[95416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-3f9b73f7-6ebd-4f23-abb5-eeda5ff71799 Sep 06 06:37:24 devstack sudo[95416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:37:24 devstack sudo[95416]: pam_unix(sudo:session): session closed for user root Sep 06 06:37:24 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-52392a4f-9ffe-4be0-80f8-468703a6ef4a tempest-TestInstancesWithCinderVolumes-102430806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-3f9b73f7-6ebd-4f23-abb5-eeda5ff71799" returned: 0 in 0.333s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:37:24 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-52392a4f-9ffe-4be0-80f8-468703a6ef4a tempest-TestInstancesWithCinderVolumes-102430806 None] <== create_volume: return (901ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'} {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 06:37:24 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-52392a4f-9ffe-4be0-80f8-468703a6ef4a tempest-TestInstancesWithCinderVolumes-102430806 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.906s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:37:24 devstack cinder-volume[87329]: DEBUG cinder.volume.volume_utils [None req-52392a4f-9ffe-4be0-80f8-468703a6ef4a tempest-TestInstancesWithCinderVolumes-102430806 None] Attempting download of 5522887d-d303-4a6b-bc6b-da9996987e87 ((None, [{'url': 'file:///opt/stack/data/glance/images/5522887d-d303-4a6b-bc6b-da9996987e87', 'metadata': {}}])) to volume 3f9b73f7-6ebd-4f23-abb5-eeda5ff71799. {{(pid=87329) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 06 06:37:24 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-d45d6e1e-460e-4c38-8bdf-a4545e952fa4 tempest-AbsoluteLimitsTests-783578615 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87329) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 06:37:24 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-d45d6e1e-460e-4c38-8bdf-a4545e952fa4 tempest-AbsoluteLimitsTests-783578615 None] Flow 'volume_create_manager' (c32d8379-1688-4feb-b7f7-1ac437a1d6ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:37:24 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-d45d6e1e-460e-4c38-8bdf-a4545e952fa4 tempest-AbsoluteLimitsTests-783578615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e78a8db6-a1de-4a65-8636-9bcb80ac9cc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:37:24 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[93747566-be7c-4283-852e-dcccfc8b2c48]: (4, 'raw') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:37:24 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-52392a4f-9ffe-4be0-80f8-468703a6ef4a tempest-TestInstancesWithCinderVolumes-102430806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5522887d-d303-4a6b-bc6b-da9996987e87_gfszqjuj {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:37:25 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-d45d6e1e-460e-4c38-8bdf-a4545e952fa4 tempest-AbsoluteLimitsTests-783578615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e78a8db6-a1de-4a65-8636-9bcb80ac9cc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:37:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1506778460',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=463af6c8-0c81-4ae9-a4af-b8a6d81d51f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eef467a6683041cc860987a356051b98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:37:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:37:25Z,use_quota=True,user_id='e5f31707d02e4f6180377c5f5c352f43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:37:25 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-d45d6e1e-460e-4c38-8bdf-a4545e952fa4 tempest-AbsoluteLimitsTests-783578615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f9685e4-da1f-4ab2-a5ce-d40eb5bbc70d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:37:25 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-d45d6e1e-460e-4c38-8bdf-a4545e952fa4 tempest-AbsoluteLimitsTests-783578615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f9685e4-da1f-4ab2-a5ce-d40eb5bbc70d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:37:25 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-d45d6e1e-460e-4c38-8bdf-a4545e952fa4 tempest-AbsoluteLimitsTests-783578615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17afda34-f847-40d8-9c51-cde49035ec44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:37:25 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-d45d6e1e-460e-4c38-8bdf-a4545e952fa4 tempest-AbsoluteLimitsTests-783578615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17afda34-f847-40d8-9c51-cde49035ec44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '463af6c8-0c81-4ae9-a4af-b8a6d81d51f0', 'volume_name': 'volume-463af6c8-0c81-4ae9-a4af-b8a6d81d51f0', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:37:25 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-d45d6e1e-460e-4c38-8bdf-a4545e952fa4 tempest-AbsoluteLimitsTests-783578615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91ff0446-14b0-452f-b61d-dac798292102) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:37:25 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-d45d6e1e-460e-4c38-8bdf-a4545e952fa4 tempest-AbsoluteLimitsTests-783578615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91ff0446-14b0-452f-b61d-dac798292102) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:37:25 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-d45d6e1e-460e-4c38-8bdf-a4545e952fa4 tempest-AbsoluteLimitsTests-783578615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33838abf-91d3-45e7-ba08-1bacefdec776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:37:25 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-d45d6e1e-460e-4c38-8bdf-a4545e952fa4 tempest-AbsoluteLimitsTests-783578615 None] Volume 463af6c8-0c81-4ae9-a4af-b8a6d81d51f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-463af6c8-0c81-4ae9-a4af-b8a6d81d51f0', 'volume_size': 1} Sep 06 06:37:25 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-d45d6e1e-460e-4c38-8bdf-a4545e952fa4 tempest-AbsoluteLimitsTests-783578615 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:37:25 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-d45d6e1e-460e-4c38-8bdf-a4545e952fa4 tempest-AbsoluteLimitsTests-783578615 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:37:25 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-d45d6e1e-460e-4c38-8bdf-a4545e952fa4 tempest-AbsoluteLimitsTests-783578615 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:37:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1506778460',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=463af6c8-0c81-4ae9-a4af-b8a6d81d51f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eef467a6683041cc860987a356051b98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:37:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:37:25Z,use_quota=True,user_id='e5f31707d02e4f6180377c5f5c352f43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)}" {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 06:37:25 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-d45d6e1e-460e-4c38-8bdf-a4545e952fa4 tempest-AbsoluteLimitsTests-783578615 None] Creating volume 463af6c8-0c81-4ae9-a4af-b8a6d81d51f0 {{(pid=87329) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 06:37:25 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-d45d6e1e-460e-4c38-8bdf-a4545e952fa4 tempest-AbsoluteLimitsTests-783578615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:37:25 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-d45d6e1e-460e-4c38-8bdf-a4545e952fa4 tempest-AbsoluteLimitsTests-783578615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:37:25 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-d45d6e1e-460e-4c38-8bdf-a4545e952fa4 tempest-AbsoluteLimitsTests-783578615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:37:25 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-d45d6e1e-460e-4c38-8bdf-a4545e952fa4 tempest-AbsoluteLimitsTests-783578615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:37:25 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-d45d6e1e-460e-4c38-8bdf-a4545e952fa4 tempest-AbsoluteLimitsTests-783578615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:37:25 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-d45d6e1e-460e-4c38-8bdf-a4545e952fa4 tempest-AbsoluteLimitsTests-783578615 None] Selected osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 as target Quobyte volume. {{(pid=87329) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 06:37:25 devstack cinder-volume[87329]: INFO cinder.volume.drivers.remotefs [None req-d45d6e1e-460e-4c38-8bdf-a4545e952fa4 tempest-AbsoluteLimitsTests-783578615 None] casted to osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 Sep 06 06:37:25 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-d45d6e1e-460e-4c38-8bdf-a4545e952fa4 tempest-AbsoluteLimitsTests-783578615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-463af6c8-0c81-4ae9-a4af-b8a6d81d51f0 1073741824 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:37:25 devstack sudo[95419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5522887d-d303-4a6b-bc6b-da9996987e87_gfszqjuj Sep 06 06:37:25 devstack sudo[95419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:37:25 devstack sudo[95420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-463af6c8-0c81-4ae9-a4af-b8a6d81d51f0 1073741824 Sep 06 06:37:25 devstack sudo[95420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:37:25 devstack sudo[95419]: pam_unix(sudo:session): session closed for user root Sep 06 06:37:25 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-52392a4f-9ffe-4be0-80f8-468703a6ef4a tempest-TestInstancesWithCinderVolumes-102430806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5522887d-d303-4a6b-bc6b-da9996987e87_gfszqjuj" returned: 0 in 0.370s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:37:25 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-52392a4f-9ffe-4be0-80f8-468703a6ef4a tempest-TestInstancesWithCinderVolumes-102430806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5522887d-d303-4a6b-bc6b-da9996987e87_gfszqjuj {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:37:25 devstack sudo[95425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5522887d-d303-4a6b-bc6b-da9996987e87_gfszqjuj Sep 06 06:37:25 devstack sudo[95425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:37:25 devstack sudo[95420]: pam_unix(sudo:session): session closed for user root Sep 06 06:37:25 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-d45d6e1e-460e-4c38-8bdf-a4545e952fa4 tempest-AbsoluteLimitsTests-783578615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-463af6c8-0c81-4ae9-a4af-b8a6d81d51f0 1073741824" returned: 0 in 0.606s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:37:25 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-d45d6e1e-460e-4c38-8bdf-a4545e952fa4 tempest-AbsoluteLimitsTests-783578615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-463af6c8-0c81-4ae9-a4af-b8a6d81d51f0 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:37:25 devstack sudo[95425]: pam_unix(sudo:session): session closed for user root Sep 06 06:37:25 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-52392a4f-9ffe-4be0-80f8-468703a6ef4a tempest-TestInstancesWithCinderVolumes-102430806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5522887d-d303-4a6b-bc6b-da9996987e87_gfszqjuj" returned: 1 in 0.396s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:37:25 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-52392a4f-9ffe-4be0-80f8-468703a6ef4a tempest-TestInstancesWithCinderVolumes-102430806 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5522887d-d303-4a6b-bc6b-da9996987e87_gfszqjuj' failed. Not Retrying. {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 06 06:37:25 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b76c6a5-2739-47e1-90b7-20133d57986f]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:37:25 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-52392a4f-9ffe-4be0-80f8-468703a6ef4a tempest-TestInstancesWithCinderVolumes-102430806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5522887d-d303-4a6b-bc6b-da9996987e87__xvs65jxdevstack@QuobyteHD {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:37:25 devstack sudo[95433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-463af6c8-0c81-4ae9-a4af-b8a6d81d51f0 Sep 06 06:37:25 devstack sudo[95433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:37:25 devstack sudo[95434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5522887d-d303-4a6b-bc6b-da9996987e87__xvs65jxdevstack@QuobyteHD Sep 06 06:37:25 devstack sudo[95434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:37:26 devstack sudo[95433]: pam_unix(sudo:session): session closed for user root Sep 06 06:37:26 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-d45d6e1e-460e-4c38-8bdf-a4545e952fa4 tempest-AbsoluteLimitsTests-783578615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-463af6c8-0c81-4ae9-a4af-b8a6d81d51f0" returned: 0 in 0.341s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:37:26 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-d45d6e1e-460e-4c38-8bdf-a4545e952fa4 tempest-AbsoluteLimitsTests-783578615 None] <== create_volume: return (1008ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'} {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 06:37:26 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-d45d6e1e-460e-4c38-8bdf-a4545e952fa4 tempest-AbsoluteLimitsTests-783578615 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.011s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:37:26 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-d45d6e1e-460e-4c38-8bdf-a4545e952fa4 tempest-AbsoluteLimitsTests-783578615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33838abf-91d3-45e7-ba08-1bacefdec776) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-463af6c8-0c81-4ae9-a4af-b8a6d81d51f0', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:37:26 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-d45d6e1e-460e-4c38-8bdf-a4545e952fa4 tempest-AbsoluteLimitsTests-783578615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4397c59a-56b8-4953-8cd9-b4ceeecbe86f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:37:26 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-d45d6e1e-460e-4c38-8bdf-a4545e952fa4 tempest-AbsoluteLimitsTests-783578615 None] Volume volume-463af6c8-0c81-4ae9-a4af-b8a6d81d51f0 (463af6c8-0c81-4ae9-a4af-b8a6d81d51f0): created successfully Sep 06 06:37:26 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-d45d6e1e-460e-4c38-8bdf-a4545e952fa4 tempest-AbsoluteLimitsTests-783578615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4397c59a-56b8-4953-8cd9-b4ceeecbe86f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:37:26 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-d45d6e1e-460e-4c38-8bdf-a4545e952fa4 tempest-AbsoluteLimitsTests-783578615 None] Flow 'volume_create_manager' (c32d8379-1688-4feb-b7f7-1ac437a1d6ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:37:26 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-d45d6e1e-460e-4c38-8bdf-a4545e952fa4 tempest-AbsoluteLimitsTests-783578615 None] Created volume successfully. Sep 06 06:37:26 devstack sudo[95434]: pam_unix(sudo:session): session closed for user root Sep 06 06:37:26 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-52392a4f-9ffe-4be0-80f8-468703a6ef4a tempest-TestInstancesWithCinderVolumes-102430806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5522887d-d303-4a6b-bc6b-da9996987e87__xvs65jxdevstack@QuobyteHD" returned: 0 in 0.483s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:37:26 devstack cinder-volume[87329]: DEBUG cinder.image.image_utils [None req-52392a4f-9ffe-4be0-80f8-468703a6ef4a tempest-TestInstancesWithCinderVolumes-102430806 None] 5522887d-d303-4a6b-bc6b-da9996987e87 was qcow2, converting to qcow2 {{(pid=87329) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 06 06:37:26 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-52392a4f-9ffe-4be0-80f8-468703a6ef4a tempest-TestInstancesWithCinderVolumes-102430806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5522887d-d303-4a6b-bc6b-da9996987e87__xvs65jxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-3f9b73f7-6ebd-4f23-abb5-eeda5ff71799 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:37:26 devstack sudo[95441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5522887d-d303-4a6b-bc6b-da9996987e87__xvs65jxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-3f9b73f7-6ebd-4f23-abb5-eeda5ff71799 Sep 06 06:37:26 devstack sudo[95441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:37:27 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-c2b0bf9c-e153-4457-a2d6-edb94cb2bae0 tempest-AbsoluteLimitsTests-783578615 None] Acquiring lock "cinder-463af6c8-0c81-4ae9-a4af-b8a6d81d51f0-delete_volume" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:37:27 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-c2b0bf9c-e153-4457-a2d6-edb94cb2bae0 tempest-AbsoluteLimitsTests-783578615 None] Lock "cinder-463af6c8-0c81-4ae9-a4af-b8a6d81d51f0-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:37:27 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-c2b0bf9c-e153-4457-a2d6-edb94cb2bae0 tempest-AbsoluteLimitsTests-783578615 None] Acquiring lock "cinder-quobyte-463af6c8-0c81-4ae9-a4af-b8a6d81d51f0" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:37:27 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-c2b0bf9c-e153-4457-a2d6-edb94cb2bae0 tempest-AbsoluteLimitsTests-783578615 None] Lock "cinder-quobyte-463af6c8-0c81-4ae9-a4af-b8a6d81d51f0" acquired by "delete_volume" :: waited 0.019s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:37:27 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[969c2f7a-5924-4685-8b7c-22a0f0a29c17]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:37:27 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-c2b0bf9c-e153-4457-a2d6-edb94cb2bae0 tempest-AbsoluteLimitsTests-783578615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-463af6c8-0c81-4ae9-a4af-b8a6d81d51f0 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:37:27 devstack sudo[95453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-463af6c8-0c81-4ae9-a4af-b8a6d81d51f0 Sep 06 06:37:27 devstack sudo[95453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:37:28 devstack sudo[95453]: pam_unix(sudo:session): session closed for user root Sep 06 06:37:28 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-c2b0bf9c-e153-4457-a2d6-edb94cb2bae0 tempest-AbsoluteLimitsTests-783578615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-463af6c8-0c81-4ae9-a4af-b8a6d81d51f0" returned: 0 in 0.610s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:37:28 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-c2b0bf9c-e153-4457-a2d6-edb94cb2bae0 tempest-AbsoluteLimitsTests-783578615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-463af6c8-0c81-4ae9-a4af-b8a6d81d51f0 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:37:28 devstack sudo[95459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-463af6c8-0c81-4ae9-a4af-b8a6d81d51f0 Sep 06 06:37:28 devstack sudo[95459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:37:28 devstack sudo[95459]: pam_unix(sudo:session): session closed for user root Sep 06 06:37:28 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-c2b0bf9c-e153-4457-a2d6-edb94cb2bae0 tempest-AbsoluteLimitsTests-783578615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-463af6c8-0c81-4ae9-a4af-b8a6d81d51f0" returned: 0 in 0.470s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:37:28 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-c2b0bf9c-e153-4457-a2d6-edb94cb2bae0 tempest-AbsoluteLimitsTests-783578615 None] Lock "cinder-quobyte-463af6c8-0c81-4ae9-a4af-b8a6d81d51f0" released by "delete_volume" :: held 1.153s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:37:28 devstack sudo[95441]: pam_unix(sudo:session): session closed for user root Sep 06 06:37:28 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-52392a4f-9ffe-4be0-80f8-468703a6ef4a tempest-TestInstancesWithCinderVolumes-102430806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5522887d-d303-4a6b-bc6b-da9996987e87__xvs65jxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-3f9b73f7-6ebd-4f23-abb5-eeda5ff71799" returned: 0 in 2.329s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:37:28 devstack cinder-volume[87329]: DEBUG cinder.image.image_utils [None req-52392a4f-9ffe-4be0-80f8-468703a6ef4a tempest-TestInstancesWithCinderVolumes-102430806 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_5522887d-d303-4a6b-bc6b-da9996987e87__xvs65jxdevstack@QuobyteHD, size 112.00 MB, duration 2.33 sec, destination /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-3f9b73f7-6ebd-4f23-abb5-eeda5ff71799 {{(pid=87329) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 06 06:37:28 devstack cinder-volume[87329]: INFO cinder.image.image_utils [None req-52392a4f-9ffe-4be0-80f8-468703a6ef4a tempest-TestInstancesWithCinderVolumes-102430806 None] Converted 112.00 MB image at 48.04 MB/s Sep 06 06:37:28 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-52392a4f-9ffe-4be0-80f8-468703a6ef4a tempest-TestInstancesWithCinderVolumes-102430806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-3f9b73f7-6ebd-4f23-abb5-eeda5ff71799 1G {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:37:28 devstack sudo[95462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-3f9b73f7-6ebd-4f23-abb5-eeda5ff71799 1G Sep 06 06:37:28 devstack sudo[95462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:37:28 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-c2b0bf9c-e153-4457-a2d6-edb94cb2bae0 tempest-AbsoluteLimitsTests-783578615 None] Created reservations ['62612a7d-195a-42e7-8d95-d4c68b5a0092', '12440dc9-975b-47e2-9544-59d8222bad94', 'cb82601c-a92a-44c6-8648-42fd2531a52e', '48621074-59f4-4a40-b619-61851710bdf3'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:37:28 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-c2b0bf9c-e153-4457-a2d6-edb94cb2bae0 tempest-AbsoluteLimitsTests-783578615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:37:28 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-c2b0bf9c-e153-4457-a2d6-edb94cb2bae0 tempest-AbsoluteLimitsTests-783578615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:37:28 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-c2b0bf9c-e153-4457-a2d6-edb94cb2bae0 tempest-AbsoluteLimitsTests-783578615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:37:28 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-c2b0bf9c-e153-4457-a2d6-edb94cb2bae0 tempest-AbsoluteLimitsTests-783578615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:37:28 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-c2b0bf9c-e153-4457-a2d6-edb94cb2bae0 tempest-AbsoluteLimitsTests-783578615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:37:28 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-c2b0bf9c-e153-4457-a2d6-edb94cb2bae0 tempest-AbsoluteLimitsTests-783578615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:37:28 devstack sudo[95464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:37:28 devstack sudo[95464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:37:29 devstack sudo[95462]: pam_unix(sudo:session): session closed for user root Sep 06 06:37:29 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-52392a4f-9ffe-4be0-80f8-468703a6ef4a tempest-TestInstancesWithCinderVolumes-102430806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-3f9b73f7-6ebd-4f23-abb5-eeda5ff71799 1G" returned: 0 in 0.567s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:37:29 devstack cinder-volume[87329]: DEBUG cinder.volume.volume_utils [None req-52392a4f-9ffe-4be0-80f8-468703a6ef4a tempest-TestInstancesWithCinderVolumes-102430806 None] Downloaded image 5522887d-d303-4a6b-bc6b-da9996987e87 ((None, [{'url': 'file:///opt/stack/data/glance/images/5522887d-d303-4a6b-bc6b-da9996987e87', 'metadata': {}}])) to volume 3f9b73f7-6ebd-4f23-abb5-eeda5ff71799 successfully. {{(pid=87329) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 06 06:37:29 devstack cinder-volume[87329]: DEBUG cinder.image.image_utils [None req-52392a4f-9ffe-4be0-80f8-468703a6ef4a tempest-TestInstancesWithCinderVolumes-102430806 None] Temporary image 5522887d-d303-4a6b-bc6b-da9996987e87 for user 23104bb67481471dba2e921be5fa49c8 is deleted. {{(pid=87329) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 06 06:37:29 devstack cinder-volume[87329]: DEBUG cinder.volume.volume_utils [None req-52392a4f-9ffe-4be0-80f8-468703a6ef4a tempest-TestInstancesWithCinderVolumes-102430806 None] Marking volume 3f9b73f7-6ebd-4f23-abb5-eeda5ff71799 as bootable. {{(pid=87329) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 06 06:37:29 devstack sudo[95464]: pam_unix(sudo:session): session closed for user root Sep 06 06:37:29 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-52392a4f-9ffe-4be0-80f8-468703a6ef4a tempest-TestInstancesWithCinderVolumes-102430806 None] Copying metadata from image 5522887d-d303-4a6b-bc6b-da9996987e87 to 3f9b73f7-6ebd-4f23-abb5-eeda5ff71799. {{(pid=87329) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 06 06:37:29 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-52392a4f-9ffe-4be0-80f8-468703a6ef4a tempest-TestInstancesWithCinderVolumes-102430806 None] Creating volume glance metadata for volume 3f9b73f7-6ebd-4f23-abb5-eeda5ff71799 backed by image 5522887d-d303-4a6b-bc6b-da9996987e87 with: {'image_id': '5522887d-d303-4a6b-bc6b-da9996987e87', 'image_name': 'tempest-scenario-img--1971389473', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87329) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 06 06:37:29 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-c2b0bf9c-e153-4457-a2d6-edb94cb2bae0 tempest-AbsoluteLimitsTests-783578615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.471s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:37:29 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-c2b0bf9c-e153-4457-a2d6-edb94cb2bae0 tempest-AbsoluteLimitsTests-783578615 None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:37:29 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-c2b0bf9c-e153-4457-a2d6-edb94cb2bae0 tempest-AbsoluteLimitsTests-783578615 None] Deleted volume successfully. Sep 06 06:37:29 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-c2b0bf9c-e153-4457-a2d6-edb94cb2bae0 tempest-AbsoluteLimitsTests-783578615 None] Lock "cinder-463af6c8-0c81-4ae9-a4af-b8a6d81d51f0-delete_volume" released by "delete_volume" :: held 1.938s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:37:29 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-52392a4f-9ffe-4be0-80f8-468703a6ef4a tempest-TestInstancesWithCinderVolumes-102430806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9be9767-d502-49f2-b62f-74e2d8027861) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f9b73f7-6ebd-4f23-abb5-eeda5ff71799', 'volume_size': 1, 'image_id': '5522887d-d303-4a6b-bc6b-da9996987e87', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5522887d-d303-4a6b-bc6b-da9996987e87', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1971389473', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3f9bf25272e444f395b1908b706aa147', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5522887d-d303-4a6b-bc6b-da9996987e87', 'created_at': datetime.datetime(2026, 9, 6, 4, 37, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 6, 4, 37, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5522887d-d303-4a6b-bc6b-da9996987e87/file', 'properties': {}}, 'image_service': }' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:37:29 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-52392a4f-9ffe-4be0-80f8-468703a6ef4a tempest-TestInstancesWithCinderVolumes-102430806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ae22c06-6f65-46b6-8ddd-06302ef108b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:37:29 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-52392a4f-9ffe-4be0-80f8-468703a6ef4a tempest-TestInstancesWithCinderVolumes-102430806 None] Volume volume-3f9b73f7-6ebd-4f23-abb5-eeda5ff71799 (3f9b73f7-6ebd-4f23-abb5-eeda5ff71799): created successfully Sep 06 06:37:29 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-52392a4f-9ffe-4be0-80f8-468703a6ef4a tempest-TestInstancesWithCinderVolumes-102430806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ae22c06-6f65-46b6-8ddd-06302ef108b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:37:29 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-52392a4f-9ffe-4be0-80f8-468703a6ef4a tempest-TestInstancesWithCinderVolumes-102430806 None] Flow 'volume_create_manager' (ab7206fe-4c48-4226-8934-b285d7fd6794) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:37:29 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-52392a4f-9ffe-4be0-80f8-468703a6ef4a tempest-TestInstancesWithCinderVolumes-102430806 None] Created volume successfully. Sep 06 06:37:35 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [req-2c0e2a54-be5f-4b2e-be55-0dc184f467b9 req-3bef2579-2d03-423a-adea-d64a321fde4e tempest-TestInstancesWithCinderVolumes-102430806 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:37:35 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [req-2c0e2a54-be5f-4b2e-be55-0dc184f467b9 req-3bef2579-2d03-423a-adea-d64a321fde4e tempest-TestInstancesWithCinderVolumes-102430806 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:37:35 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [req-2c0e2a54-be5f-4b2e-be55-0dc184f467b9 req-3bef2579-2d03-423a-adea-d64a321fde4e tempest-TestInstancesWithCinderVolumes-102430806 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.024s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:37:35 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [req-2c0e2a54-be5f-4b2e-be55-0dc184f467b9 req-3bef2579-2d03-423a-adea-d64a321fde4e tempest-TestInstancesWithCinderVolumes-102430806 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6', 'name': 'volume-3f9b73f7-6ebd-4f23-abb5-eeda5ff71799', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '834d5e61-130b-4ed1-98d1-3519ba00c9bc', 'enforce_multipath': True} {{(pid=87329) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 06 06:37:35 devstack cinder-volume[87329]: INFO cinder.volume.manager [req-2c0e2a54-be5f-4b2e-be55-0dc184f467b9 req-3bef2579-2d03-423a-adea-d64a321fde4e tempest-TestInstancesWithCinderVolumes-102430806 None] attachment_update completed successfully. Sep 06 06:37:39 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-d710052c-5acb-4b07-b96e-51ea566dc823 tempest-VolumesTransfersV357Test-550362040 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87329) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 06:37:39 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-d710052c-5acb-4b07-b96e-51ea566dc823 tempest-VolumesTransfersV357Test-550362040 None] Flow 'volume_create_manager' (f5db73ba-5636-4fa0-b450-45907a0e6169) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:37:39 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-d710052c-5acb-4b07-b96e-51ea566dc823 tempest-VolumesTransfersV357Test-550362040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (532973be-e64b-47cc-b795-17e2795a32f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:37:39 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-d710052c-5acb-4b07-b96e-51ea566dc823 tempest-VolumesTransfersV357Test-550362040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (532973be-e64b-47cc-b795-17e2795a32f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:37:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-2083413588',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5566af65-b894-4b47-9bf2-8bfab79da5b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7783fd40ebc45039771c0a9495ec8c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:37:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:37:40Z,use_quota=True,user_id='f6770371d3244c13b4a695dcac15499b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:37:40 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-d710052c-5acb-4b07-b96e-51ea566dc823 tempest-VolumesTransfersV357Test-550362040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4801571-2469-4157-b4f8-e8e3af0ffa7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:37:40 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-d710052c-5acb-4b07-b96e-51ea566dc823 tempest-VolumesTransfersV357Test-550362040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4801571-2469-4157-b4f8-e8e3af0ffa7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:37:40 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-d710052c-5acb-4b07-b96e-51ea566dc823 tempest-VolumesTransfersV357Test-550362040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f716f03c-4956-4572-8efa-d29b33ec8341) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:37:40 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-d710052c-5acb-4b07-b96e-51ea566dc823 tempest-VolumesTransfersV357Test-550362040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f716f03c-4956-4572-8efa-d29b33ec8341) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5566af65-b894-4b47-9bf2-8bfab79da5b7', 'volume_name': 'volume-5566af65-b894-4b47-9bf2-8bfab79da5b7', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:37:40 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-d710052c-5acb-4b07-b96e-51ea566dc823 tempest-VolumesTransfersV357Test-550362040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (156a7742-7b02-48e4-beec-f2e26f82b446) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:37:40 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-d710052c-5acb-4b07-b96e-51ea566dc823 tempest-VolumesTransfersV357Test-550362040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (156a7742-7b02-48e4-beec-f2e26f82b446) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:37:40 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-d710052c-5acb-4b07-b96e-51ea566dc823 tempest-VolumesTransfersV357Test-550362040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02903358-fe2d-4f1c-8c6c-3d8c0a0c9bf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:37:40 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-d710052c-5acb-4b07-b96e-51ea566dc823 tempest-VolumesTransfersV357Test-550362040 None] Volume 5566af65-b894-4b47-9bf2-8bfab79da5b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5566af65-b894-4b47-9bf2-8bfab79da5b7', 'volume_size': 1} Sep 06 06:37:40 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-d710052c-5acb-4b07-b96e-51ea566dc823 tempest-VolumesTransfersV357Test-550362040 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:37:40 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-d710052c-5acb-4b07-b96e-51ea566dc823 tempest-VolumesTransfersV357Test-550362040 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:37:40 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-d710052c-5acb-4b07-b96e-51ea566dc823 tempest-VolumesTransfersV357Test-550362040 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:37:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-2083413588',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5566af65-b894-4b47-9bf2-8bfab79da5b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7783fd40ebc45039771c0a9495ec8c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:37:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:37:40Z,use_quota=True,user_id='f6770371d3244c13b4a695dcac15499b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)}" {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 06:37:40 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-d710052c-5acb-4b07-b96e-51ea566dc823 tempest-VolumesTransfersV357Test-550362040 None] Creating volume 5566af65-b894-4b47-9bf2-8bfab79da5b7 {{(pid=87329) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 06:37:40 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-d710052c-5acb-4b07-b96e-51ea566dc823 tempest-VolumesTransfersV357Test-550362040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:37:40 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-d710052c-5acb-4b07-b96e-51ea566dc823 tempest-VolumesTransfersV357Test-550362040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:37:40 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-d710052c-5acb-4b07-b96e-51ea566dc823 tempest-VolumesTransfersV357Test-550362040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:37:40 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-d710052c-5acb-4b07-b96e-51ea566dc823 tempest-VolumesTransfersV357Test-550362040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:37:40 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-d710052c-5acb-4b07-b96e-51ea566dc823 tempest-VolumesTransfersV357Test-550362040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:37:40 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-d710052c-5acb-4b07-b96e-51ea566dc823 tempest-VolumesTransfersV357Test-550362040 None] Selected osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 as target Quobyte volume. {{(pid=87329) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 06:37:40 devstack cinder-volume[87329]: INFO cinder.volume.drivers.remotefs [None req-d710052c-5acb-4b07-b96e-51ea566dc823 tempest-VolumesTransfersV357Test-550362040 None] casted to osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 Sep 06 06:37:40 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-d710052c-5acb-4b07-b96e-51ea566dc823 tempest-VolumesTransfersV357Test-550362040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-5566af65-b894-4b47-9bf2-8bfab79da5b7 1073741824 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:37:40 devstack sudo[95913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-5566af65-b894-4b47-9bf2-8bfab79da5b7 1073741824 Sep 06 06:37:40 devstack sudo[95913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:37:41 devstack sudo[95913]: pam_unix(sudo:session): session closed for user root Sep 06 06:37:41 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-d710052c-5acb-4b07-b96e-51ea566dc823 tempest-VolumesTransfersV357Test-550362040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-5566af65-b894-4b47-9bf2-8bfab79da5b7 1073741824" returned: 0 in 1.087s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:37:41 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-d710052c-5acb-4b07-b96e-51ea566dc823 tempest-VolumesTransfersV357Test-550362040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-5566af65-b894-4b47-9bf2-8bfab79da5b7 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:37:41 devstack sudo[96028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-5566af65-b894-4b47-9bf2-8bfab79da5b7 Sep 06 06:37:41 devstack sudo[96028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:37:41 devstack sudo[96028]: pam_unix(sudo:session): session closed for user root Sep 06 06:37:41 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-d710052c-5acb-4b07-b96e-51ea566dc823 tempest-VolumesTransfersV357Test-550362040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-5566af65-b894-4b47-9bf2-8bfab79da5b7" returned: 0 in 0.547s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:37:41 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-d710052c-5acb-4b07-b96e-51ea566dc823 tempest-VolumesTransfersV357Test-550362040 None] <== create_volume: return (1750ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'} {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 06:37:41 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-d710052c-5acb-4b07-b96e-51ea566dc823 tempest-VolumesTransfersV357Test-550362040 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.754s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:37:41 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-d710052c-5acb-4b07-b96e-51ea566dc823 tempest-VolumesTransfersV357Test-550362040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02903358-fe2d-4f1c-8c6c-3d8c0a0c9bf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5566af65-b894-4b47-9bf2-8bfab79da5b7', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:37:41 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-d710052c-5acb-4b07-b96e-51ea566dc823 tempest-VolumesTransfersV357Test-550362040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f5f7b19-cf00-4ac6-afb0-f146a9ace2f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:37:41 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-d710052c-5acb-4b07-b96e-51ea566dc823 tempest-VolumesTransfersV357Test-550362040 None] Volume volume-5566af65-b894-4b47-9bf2-8bfab79da5b7 (5566af65-b894-4b47-9bf2-8bfab79da5b7): created successfully Sep 06 06:37:41 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-d710052c-5acb-4b07-b96e-51ea566dc823 tempest-VolumesTransfersV357Test-550362040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f5f7b19-cf00-4ac6-afb0-f146a9ace2f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:37:42 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-d710052c-5acb-4b07-b96e-51ea566dc823 tempest-VolumesTransfersV357Test-550362040 None] Flow 'volume_create_manager' (f5db73ba-5636-4fa0-b450-45907a0e6169) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:37:42 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-d710052c-5acb-4b07-b96e-51ea566dc823 tempest-VolumesTransfersV357Test-550362040 None] Created volume successfully. Sep 06 06:37:45 devstack cinder-volume[87329]: DEBUG dbcounter [-] [87329] Writing DB stats cinder:SELECT=94,cinder:UPDATE=93,cinder:INSERT=37,cinder:DELETE=4 {{(pid=87329) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 06:37:45 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-dfb1556d-ba2f-4915-90f1-cdc334eebc3b tempest-VolumesTransfersV357Test-195411771 None] Transfer volume completed successfully. Sep 06 06:37:47 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-c2b2802c-2ac3-4559-96ce-9d7fc2c691f6 tempest-VolumesTransfersV357Test-1556646511 None] Acquiring lock "cinder-5566af65-b894-4b47-9bf2-8bfab79da5b7-delete_volume" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:37:47 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-c2b2802c-2ac3-4559-96ce-9d7fc2c691f6 tempest-VolumesTransfersV357Test-1556646511 None] Lock "cinder-5566af65-b894-4b47-9bf2-8bfab79da5b7-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:37:47 devstack cinder-volume[87329]: DEBUG dbcounter [-] [87329] Writing DB stats cinder:UPDATE=96,cinder:SELECT=81,cinder:INSERT=25,cinder:DELETE=9 {{(pid=87329) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 06:37:47 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-c2b2802c-2ac3-4559-96ce-9d7fc2c691f6 tempest-VolumesTransfersV357Test-1556646511 None] Acquiring lock "cinder-quobyte-5566af65-b894-4b47-9bf2-8bfab79da5b7" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:37:47 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-c2b2802c-2ac3-4559-96ce-9d7fc2c691f6 tempest-VolumesTransfersV357Test-1556646511 None] Lock "cinder-quobyte-5566af65-b894-4b47-9bf2-8bfab79da5b7" acquired by "delete_volume" :: waited 0.022s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:37:47 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffcc9deb-5994-4f02-98f0-3fa5ff2a0854]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:37:47 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-c2b2802c-2ac3-4559-96ce-9d7fc2c691f6 tempest-VolumesTransfersV357Test-1556646511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-5566af65-b894-4b47-9bf2-8bfab79da5b7 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:37:47 devstack sudo[96069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-5566af65-b894-4b47-9bf2-8bfab79da5b7 Sep 06 06:37:47 devstack sudo[96069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:37:48 devstack sudo[96069]: pam_unix(sudo:session): session closed for user root Sep 06 06:37:48 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-c2b2802c-2ac3-4559-96ce-9d7fc2c691f6 tempest-VolumesTransfersV357Test-1556646511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-5566af65-b894-4b47-9bf2-8bfab79da5b7" returned: 0 in 0.905s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:37:48 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-c2b2802c-2ac3-4559-96ce-9d7fc2c691f6 tempest-VolumesTransfersV357Test-1556646511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-5566af65-b894-4b47-9bf2-8bfab79da5b7 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:37:48 devstack cinder-volume[87329]: DEBUG oslo_service.periodic_task [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87329) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 06 06:37:48 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:37:48 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:37:48 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:37:48 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:37:48 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:37:48 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:37:48 devstack sudo[96074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-5566af65-b894-4b47-9bf2-8bfab79da5b7 Sep 06 06:37:48 devstack sudo[96074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:37:48 devstack sudo[96075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:37:48 devstack sudo[96075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:37:49 devstack sudo[96074]: pam_unix(sudo:session): session closed for user root Sep 06 06:37:49 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-c2b2802c-2ac3-4559-96ce-9d7fc2c691f6 tempest-VolumesTransfersV357Test-1556646511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-5566af65-b894-4b47-9bf2-8bfab79da5b7" returned: 0 in 0.652s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:37:49 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-c2b2802c-2ac3-4559-96ce-9d7fc2c691f6 tempest-VolumesTransfersV357Test-1556646511 None] Lock "cinder-quobyte-5566af65-b894-4b47-9bf2-8bfab79da5b7" released by "delete_volume" :: held 1.705s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:37:49 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-c2b2802c-2ac3-4559-96ce-9d7fc2c691f6 tempest-VolumesTransfersV357Test-1556646511 None] Created reservations ['88f13a11-23c6-4615-93b6-14b600ab68b1', '51aefce9-bddf-47fc-898d-fe0e2fc01960', '021265fe-3bd6-48d3-ba60-c3c1fca1853d', 'b89f5eb1-a330-4660-aa4e-e0968510002f'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:37:49 devstack sudo[96075]: pam_unix(sudo:session): session closed for user root Sep 06 06:37:49 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.982s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:37:49 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:37:49 devstack cinder-volume[87329]: DEBUG oslo_service.periodic_task [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Running periodic task VolumeManager._thread_info {{(pid=87329) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 06 06:37:49 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] thread count: 28 {{(pid=87329) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 06 06:37:49 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] thread info: [<_MainThread(MainThread, started 126855043821696)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87329) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 06 06:37:49 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-c2b2802c-2ac3-4559-96ce-9d7fc2c691f6 tempest-VolumesTransfersV357Test-1556646511 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:37:49 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-c2b2802c-2ac3-4559-96ce-9d7fc2c691f6 tempest-VolumesTransfersV357Test-1556646511 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:37:49 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-c2b2802c-2ac3-4559-96ce-9d7fc2c691f6 tempest-VolumesTransfersV357Test-1556646511 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:37:49 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-c2b2802c-2ac3-4559-96ce-9d7fc2c691f6 tempest-VolumesTransfersV357Test-1556646511 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:37:49 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-c2b2802c-2ac3-4559-96ce-9d7fc2c691f6 tempest-VolumesTransfersV357Test-1556646511 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:37:49 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-c2b2802c-2ac3-4559-96ce-9d7fc2c691f6 tempest-VolumesTransfersV357Test-1556646511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:37:49 devstack sudo[96081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:37:49 devstack sudo[96081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:37:50 devstack sudo[96081]: pam_unix(sudo:session): session closed for user root Sep 06 06:37:50 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-c2b2802c-2ac3-4559-96ce-9d7fc2c691f6 tempest-VolumesTransfersV357Test-1556646511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.998s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:37:50 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-c2b2802c-2ac3-4559-96ce-9d7fc2c691f6 tempest-VolumesTransfersV357Test-1556646511 None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:37:50 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-c2b2802c-2ac3-4559-96ce-9d7fc2c691f6 tempest-VolumesTransfersV357Test-1556646511 None] Deleted volume successfully. Sep 06 06:37:50 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-c2b2802c-2ac3-4559-96ce-9d7fc2c691f6 tempest-VolumesTransfersV357Test-1556646511 None] Lock "cinder-5566af65-b894-4b47-9bf2-8bfab79da5b7-delete_volume" released by "delete_volume" :: held 3.586s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:37:51 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-a024df84-d0dc-4a45-9d2d-ee4355fbbbc0 tempest-VolumesTransfersV357Test-550362040 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87329) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 06:37:51 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-a024df84-d0dc-4a45-9d2d-ee4355fbbbc0 tempest-VolumesTransfersV357Test-550362040 None] Flow 'volume_create_manager' (9be36869-ff38-4562-8b53-1bd2545402b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:37:51 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-a024df84-d0dc-4a45-9d2d-ee4355fbbbc0 tempest-VolumesTransfersV357Test-550362040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6065241-29be-4adb-891e-d00d3325eaf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:37:51 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-a024df84-d0dc-4a45-9d2d-ee4355fbbbc0 tempest-VolumesTransfersV357Test-550362040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6065241-29be-4adb-891e-d00d3325eaf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:37:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-216923076',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f224ab36-d66e-4621-a52c-da1aaa6b181f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7783fd40ebc45039771c0a9495ec8c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:37:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:37:52Z,use_quota=True,user_id='f6770371d3244c13b4a695dcac15499b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:37:51 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-a024df84-d0dc-4a45-9d2d-ee4355fbbbc0 tempest-VolumesTransfersV357Test-550362040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b118d525-ca28-4ff0-8403-e6b4b57c43c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:37:51 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-a024df84-d0dc-4a45-9d2d-ee4355fbbbc0 tempest-VolumesTransfersV357Test-550362040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b118d525-ca28-4ff0-8403-e6b4b57c43c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:37:51 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-a024df84-d0dc-4a45-9d2d-ee4355fbbbc0 tempest-VolumesTransfersV357Test-550362040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45d486f2-5144-451a-8a18-01f8760f15c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:37:51 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-a024df84-d0dc-4a45-9d2d-ee4355fbbbc0 tempest-VolumesTransfersV357Test-550362040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45d486f2-5144-451a-8a18-01f8760f15c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f224ab36-d66e-4621-a52c-da1aaa6b181f', 'volume_name': 'volume-f224ab36-d66e-4621-a52c-da1aaa6b181f', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:37:51 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-a024df84-d0dc-4a45-9d2d-ee4355fbbbc0 tempest-VolumesTransfersV357Test-550362040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b460cb5f-3b89-44b8-a761-6003af41ed60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:37:51 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-a024df84-d0dc-4a45-9d2d-ee4355fbbbc0 tempest-VolumesTransfersV357Test-550362040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b460cb5f-3b89-44b8-a761-6003af41ed60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:37:51 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-a024df84-d0dc-4a45-9d2d-ee4355fbbbc0 tempest-VolumesTransfersV357Test-550362040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9af08ab-c54f-4435-9ec5-6f93ec144ec7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:37:51 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-a024df84-d0dc-4a45-9d2d-ee4355fbbbc0 tempest-VolumesTransfersV357Test-550362040 None] Volume f224ab36-d66e-4621-a52c-da1aaa6b181f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f224ab36-d66e-4621-a52c-da1aaa6b181f', 'volume_size': 1} Sep 06 06:37:51 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-a024df84-d0dc-4a45-9d2d-ee4355fbbbc0 tempest-VolumesTransfersV357Test-550362040 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:37:51 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-a024df84-d0dc-4a45-9d2d-ee4355fbbbc0 tempest-VolumesTransfersV357Test-550362040 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:37:51 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-a024df84-d0dc-4a45-9d2d-ee4355fbbbc0 tempest-VolumesTransfersV357Test-550362040 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:37:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-216923076',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f224ab36-d66e-4621-a52c-da1aaa6b181f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7783fd40ebc45039771c0a9495ec8c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:37:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:37:52Z,use_quota=True,user_id='f6770371d3244c13b4a695dcac15499b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)}" {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 06:37:51 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-a024df84-d0dc-4a45-9d2d-ee4355fbbbc0 tempest-VolumesTransfersV357Test-550362040 None] Creating volume f224ab36-d66e-4621-a52c-da1aaa6b181f {{(pid=87329) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 06:37:51 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-a024df84-d0dc-4a45-9d2d-ee4355fbbbc0 tempest-VolumesTransfersV357Test-550362040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:37:51 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-a024df84-d0dc-4a45-9d2d-ee4355fbbbc0 tempest-VolumesTransfersV357Test-550362040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:37:51 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-a024df84-d0dc-4a45-9d2d-ee4355fbbbc0 tempest-VolumesTransfersV357Test-550362040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:37:51 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-a024df84-d0dc-4a45-9d2d-ee4355fbbbc0 tempest-VolumesTransfersV357Test-550362040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:37:51 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-a024df84-d0dc-4a45-9d2d-ee4355fbbbc0 tempest-VolumesTransfersV357Test-550362040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:37:51 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-a024df84-d0dc-4a45-9d2d-ee4355fbbbc0 tempest-VolumesTransfersV357Test-550362040 None] Selected osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 as target Quobyte volume. {{(pid=87329) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 06:37:51 devstack cinder-volume[87329]: INFO cinder.volume.drivers.remotefs [None req-a024df84-d0dc-4a45-9d2d-ee4355fbbbc0 tempest-VolumesTransfersV357Test-550362040 None] casted to osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 Sep 06 06:37:51 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-a024df84-d0dc-4a45-9d2d-ee4355fbbbc0 tempest-VolumesTransfersV357Test-550362040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-f224ab36-d66e-4621-a52c-da1aaa6b181f 1073741824 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:37:51 devstack sudo[96102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-f224ab36-d66e-4621-a52c-da1aaa6b181f 1073741824 Sep 06 06:37:51 devstack sudo[96102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:37:52 devstack sudo[96102]: pam_unix(sudo:session): session closed for user root Sep 06 06:37:52 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-a024df84-d0dc-4a45-9d2d-ee4355fbbbc0 tempest-VolumesTransfersV357Test-550362040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-f224ab36-d66e-4621-a52c-da1aaa6b181f 1073741824" returned: 0 in 1.018s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:37:52 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-a024df84-d0dc-4a45-9d2d-ee4355fbbbc0 tempest-VolumesTransfersV357Test-550362040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-f224ab36-d66e-4621-a52c-da1aaa6b181f {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:37:52 devstack sudo[96108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-f224ab36-d66e-4621-a52c-da1aaa6b181f Sep 06 06:37:52 devstack sudo[96108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:37:53 devstack sudo[96108]: pam_unix(sudo:session): session closed for user root Sep 06 06:37:53 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-a024df84-d0dc-4a45-9d2d-ee4355fbbbc0 tempest-VolumesTransfersV357Test-550362040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-f224ab36-d66e-4621-a52c-da1aaa6b181f" returned: 0 in 0.825s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:37:53 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-a024df84-d0dc-4a45-9d2d-ee4355fbbbc0 tempest-VolumesTransfersV357Test-550362040 None] <== create_volume: return (1947ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'} {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 06:37:53 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-a024df84-d0dc-4a45-9d2d-ee4355fbbbc0 tempest-VolumesTransfersV357Test-550362040 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.953s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:37:53 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-a024df84-d0dc-4a45-9d2d-ee4355fbbbc0 tempest-VolumesTransfersV357Test-550362040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9af08ab-c54f-4435-9ec5-6f93ec144ec7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f224ab36-d66e-4621-a52c-da1aaa6b181f', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:37:53 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-a024df84-d0dc-4a45-9d2d-ee4355fbbbc0 tempest-VolumesTransfersV357Test-550362040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2fddc12-18a4-492c-8587-279238a87292) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:37:53 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-a024df84-d0dc-4a45-9d2d-ee4355fbbbc0 tempest-VolumesTransfersV357Test-550362040 None] Volume volume-f224ab36-d66e-4621-a52c-da1aaa6b181f (f224ab36-d66e-4621-a52c-da1aaa6b181f): created successfully Sep 06 06:37:53 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-a024df84-d0dc-4a45-9d2d-ee4355fbbbc0 tempest-VolumesTransfersV357Test-550362040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2fddc12-18a4-492c-8587-279238a87292) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:37:53 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-a024df84-d0dc-4a45-9d2d-ee4355fbbbc0 tempest-VolumesTransfersV357Test-550362040 None] Flow 'volume_create_manager' (9be36869-ff38-4562-8b53-1bd2545402b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:37:53 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-a024df84-d0dc-4a45-9d2d-ee4355fbbbc0 tempest-VolumesTransfersV357Test-550362040 None] Created volume successfully. Sep 06 06:37:55 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-3d7b4c52-a199-484a-996a-63e02b1a0f2d tempest-VolumesTransfersV357Test-1556646511 None] Acquiring lock "cinder-f224ab36-d66e-4621-a52c-da1aaa6b181f-delete_volume" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:37:55 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-3d7b4c52-a199-484a-996a-63e02b1a0f2d tempest-VolumesTransfersV357Test-1556646511 None] Lock "cinder-f224ab36-d66e-4621-a52c-da1aaa6b181f-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:37:55 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-3d7b4c52-a199-484a-996a-63e02b1a0f2d tempest-VolumesTransfersV357Test-1556646511 None] Acquiring lock "cinder-quobyte-f224ab36-d66e-4621-a52c-da1aaa6b181f" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:37:55 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-3d7b4c52-a199-484a-996a-63e02b1a0f2d tempest-VolumesTransfersV357Test-1556646511 None] Lock "cinder-quobyte-f224ab36-d66e-4621-a52c-da1aaa6b181f" acquired by "delete_volume" :: waited 0.042s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:37:55 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5584e84-c0df-41dd-9cd6-09933d5b07ea]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:37:55 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-3d7b4c52-a199-484a-996a-63e02b1a0f2d tempest-VolumesTransfersV357Test-1556646511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-f224ab36-d66e-4621-a52c-da1aaa6b181f {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:37:56 devstack sudo[96112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-f224ab36-d66e-4621-a52c-da1aaa6b181f Sep 06 06:37:56 devstack sudo[96112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:37:56 devstack sudo[96112]: pam_unix(sudo:session): session closed for user root Sep 06 06:37:56 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-3d7b4c52-a199-484a-996a-63e02b1a0f2d tempest-VolumesTransfersV357Test-1556646511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-f224ab36-d66e-4621-a52c-da1aaa6b181f" returned: 0 in 0.780s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:37:56 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-3d7b4c52-a199-484a-996a-63e02b1a0f2d tempest-VolumesTransfersV357Test-1556646511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-f224ab36-d66e-4621-a52c-da1aaa6b181f {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:37:56 devstack sudo[96117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-f224ab36-d66e-4621-a52c-da1aaa6b181f Sep 06 06:37:56 devstack sudo[96117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:37:57 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-91f6aca3-1924-454d-a2f7-94f31711281c tempest-VolumeQuotasNegativeTestJSON-1121050141 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87329) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 06:37:57 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-91f6aca3-1924-454d-a2f7-94f31711281c tempest-VolumeQuotasNegativeTestJSON-1121050141 None] Flow 'volume_create_manager' (985f3764-99e2-4d29-a471-6a2d15db27a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:37:57 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-91f6aca3-1924-454d-a2f7-94f31711281c tempest-VolumeQuotasNegativeTestJSON-1121050141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe385dda-d888-4cee-867d-a06ef6625182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:37:57 devstack sudo[96117]: pam_unix(sudo:session): session closed for user root Sep 06 06:37:57 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-3d7b4c52-a199-484a-996a-63e02b1a0f2d tempest-VolumesTransfersV357Test-1556646511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-f224ab36-d66e-4621-a52c-da1aaa6b181f" returned: 0 in 1.068s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:37:57 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-91f6aca3-1924-454d-a2f7-94f31711281c tempest-VolumeQuotasNegativeTestJSON-1121050141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe385dda-d888-4cee-867d-a06ef6625182) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:37:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1669029514',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=831e35ef-4b06-4f8a-9cf6-2f16de724c92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='292df9bda7df46c08fb73b6a114bf93e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:37:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:37:57Z,use_quota=True,user_id='d5d0eca7900e45b58e0a85c2773d40f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:37:57 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-91f6aca3-1924-454d-a2f7-94f31711281c tempest-VolumeQuotasNegativeTestJSON-1121050141 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a63dc8ed-b48c-45ca-8b61-741304e81bc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:37:57 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-91f6aca3-1924-454d-a2f7-94f31711281c tempest-VolumeQuotasNegativeTestJSON-1121050141 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a63dc8ed-b48c-45ca-8b61-741304e81bc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:37:57 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-91f6aca3-1924-454d-a2f7-94f31711281c tempest-VolumeQuotasNegativeTestJSON-1121050141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d90405bf-b8b1-4862-8a7b-33ec71ab6290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:37:57 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-91f6aca3-1924-454d-a2f7-94f31711281c tempest-VolumeQuotasNegativeTestJSON-1121050141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d90405bf-b8b1-4862-8a7b-33ec71ab6290) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '831e35ef-4b06-4f8a-9cf6-2f16de724c92', 'volume_name': 'volume-831e35ef-4b06-4f8a-9cf6-2f16de724c92', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:37:57 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-91f6aca3-1924-454d-a2f7-94f31711281c tempest-VolumeQuotasNegativeTestJSON-1121050141 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2f5adc0-e7f4-46bf-a09a-0adcb46548b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:37:57 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-91f6aca3-1924-454d-a2f7-94f31711281c tempest-VolumeQuotasNegativeTestJSON-1121050141 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2f5adc0-e7f4-46bf-a09a-0adcb46548b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:37:57 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-91f6aca3-1924-454d-a2f7-94f31711281c tempest-VolumeQuotasNegativeTestJSON-1121050141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a7822ef-4963-4c62-bc6b-e5f0326ba595) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:37:57 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-91f6aca3-1924-454d-a2f7-94f31711281c tempest-VolumeQuotasNegativeTestJSON-1121050141 None] Volume 831e35ef-4b06-4f8a-9cf6-2f16de724c92: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-831e35ef-4b06-4f8a-9cf6-2f16de724c92', 'volume_size': 1} Sep 06 06:37:57 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-91f6aca3-1924-454d-a2f7-94f31711281c tempest-VolumeQuotasNegativeTestJSON-1121050141 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:37:57 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-91f6aca3-1924-454d-a2f7-94f31711281c tempest-VolumeQuotasNegativeTestJSON-1121050141 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:37:57 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-91f6aca3-1924-454d-a2f7-94f31711281c tempest-VolumeQuotasNegativeTestJSON-1121050141 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:37:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1669029514',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=831e35ef-4b06-4f8a-9cf6-2f16de724c92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='292df9bda7df46c08fb73b6a114bf93e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:37:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:37:57Z,use_quota=True,user_id='d5d0eca7900e45b58e0a85c2773d40f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)}" {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 06:37:57 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-91f6aca3-1924-454d-a2f7-94f31711281c tempest-VolumeQuotasNegativeTestJSON-1121050141 None] Creating volume 831e35ef-4b06-4f8a-9cf6-2f16de724c92 {{(pid=87329) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 06:37:57 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-91f6aca3-1924-454d-a2f7-94f31711281c tempest-VolumeQuotasNegativeTestJSON-1121050141 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:37:57 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-91f6aca3-1924-454d-a2f7-94f31711281c tempest-VolumeQuotasNegativeTestJSON-1121050141 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:37:57 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-91f6aca3-1924-454d-a2f7-94f31711281c tempest-VolumeQuotasNegativeTestJSON-1121050141 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:37:57 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-91f6aca3-1924-454d-a2f7-94f31711281c tempest-VolumeQuotasNegativeTestJSON-1121050141 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:37:57 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-91f6aca3-1924-454d-a2f7-94f31711281c tempest-VolumeQuotasNegativeTestJSON-1121050141 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:37:57 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-91f6aca3-1924-454d-a2f7-94f31711281c tempest-VolumeQuotasNegativeTestJSON-1121050141 None] Selected osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 as target Quobyte volume. {{(pid=87329) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 06:37:57 devstack cinder-volume[87329]: INFO cinder.volume.drivers.remotefs [None req-91f6aca3-1924-454d-a2f7-94f31711281c tempest-VolumeQuotasNegativeTestJSON-1121050141 None] casted to osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 Sep 06 06:37:57 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-91f6aca3-1924-454d-a2f7-94f31711281c tempest-VolumeQuotasNegativeTestJSON-1121050141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-831e35ef-4b06-4f8a-9cf6-2f16de724c92 1073741824 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:37:58 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-3d7b4c52-a199-484a-996a-63e02b1a0f2d tempest-VolumesTransfersV357Test-1556646511 None] Lock "cinder-quobyte-f224ab36-d66e-4621-a52c-da1aaa6b181f" released by "delete_volume" :: held 2.317s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:37:58 devstack sudo[96178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-831e35ef-4b06-4f8a-9cf6-2f16de724c92 1073741824 Sep 06 06:37:58 devstack sudo[96178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:37:58 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-3d7b4c52-a199-484a-996a-63e02b1a0f2d tempest-VolumesTransfersV357Test-1556646511 None] Created reservations ['184d8d51-98a6-4fc6-8c3f-db61f8edd5cb', '3376d256-c246-42a5-aadc-71c640cf39eb', 'dc07d91d-53e0-4743-8877-29bdfa6151ce', '0f1a4aeb-b1a1-442c-b32a-29372148c606'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:37:58 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-3d7b4c52-a199-484a-996a-63e02b1a0f2d tempest-VolumesTransfersV357Test-1556646511 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:37:58 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-3d7b4c52-a199-484a-996a-63e02b1a0f2d tempest-VolumesTransfersV357Test-1556646511 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:37:58 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-3d7b4c52-a199-484a-996a-63e02b1a0f2d tempest-VolumesTransfersV357Test-1556646511 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:37:58 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-3d7b4c52-a199-484a-996a-63e02b1a0f2d tempest-VolumesTransfersV357Test-1556646511 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:37:58 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-3d7b4c52-a199-484a-996a-63e02b1a0f2d tempest-VolumesTransfersV357Test-1556646511 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:37:58 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-3d7b4c52-a199-484a-996a-63e02b1a0f2d tempest-VolumesTransfersV357Test-1556646511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:37:58 devstack sudo[96189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:37:58 devstack sudo[96189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:37:59 devstack sudo[96189]: pam_unix(sudo:session): session closed for user root Sep 06 06:37:59 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-3d7b4c52-a199-484a-996a-63e02b1a0f2d tempest-VolumesTransfersV357Test-1556646511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.510s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:37:59 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-3d7b4c52-a199-484a-996a-63e02b1a0f2d tempest-VolumesTransfersV357Test-1556646511 None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:37:59 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-3d7b4c52-a199-484a-996a-63e02b1a0f2d tempest-VolumesTransfersV357Test-1556646511 None] Deleted volume successfully. Sep 06 06:37:59 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-3d7b4c52-a199-484a-996a-63e02b1a0f2d tempest-VolumesTransfersV357Test-1556646511 None] Lock "cinder-f224ab36-d66e-4621-a52c-da1aaa6b181f-delete_volume" released by "delete_volume" :: held 3.424s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:37:59 devstack sudo[96178]: pam_unix(sudo:session): session closed for user root Sep 06 06:37:59 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-91f6aca3-1924-454d-a2f7-94f31711281c tempest-VolumeQuotasNegativeTestJSON-1121050141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-831e35ef-4b06-4f8a-9cf6-2f16de724c92 1073741824" returned: 0 in 1.211s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:37:59 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-91f6aca3-1924-454d-a2f7-94f31711281c tempest-VolumeQuotasNegativeTestJSON-1121050141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-831e35ef-4b06-4f8a-9cf6-2f16de724c92 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:37:59 devstack sudo[96221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-831e35ef-4b06-4f8a-9cf6-2f16de724c92 Sep 06 06:37:59 devstack sudo[96221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:37:59 devstack sudo[96221]: pam_unix(sudo:session): session closed for user root Sep 06 06:37:59 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-91f6aca3-1924-454d-a2f7-94f31711281c tempest-VolumeQuotasNegativeTestJSON-1121050141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-831e35ef-4b06-4f8a-9cf6-2f16de724c92" returned: 0 in 0.542s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:37:59 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-91f6aca3-1924-454d-a2f7-94f31711281c tempest-VolumeQuotasNegativeTestJSON-1121050141 None] <== create_volume: return (1859ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'} {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 06:37:59 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-91f6aca3-1924-454d-a2f7-94f31711281c tempest-VolumeQuotasNegativeTestJSON-1121050141 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.870s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:37:59 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-91f6aca3-1924-454d-a2f7-94f31711281c tempest-VolumeQuotasNegativeTestJSON-1121050141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a7822ef-4963-4c62-bc6b-e5f0326ba595) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-831e35ef-4b06-4f8a-9cf6-2f16de724c92', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:37:59 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-91f6aca3-1924-454d-a2f7-94f31711281c tempest-VolumeQuotasNegativeTestJSON-1121050141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a8e8479-d5e5-4b0f-9250-eaf499fcfc57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:37:59 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-91f6aca3-1924-454d-a2f7-94f31711281c tempest-VolumeQuotasNegativeTestJSON-1121050141 None] Volume volume-831e35ef-4b06-4f8a-9cf6-2f16de724c92 (831e35ef-4b06-4f8a-9cf6-2f16de724c92): created successfully Sep 06 06:37:59 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-91f6aca3-1924-454d-a2f7-94f31711281c tempest-VolumeQuotasNegativeTestJSON-1121050141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a8e8479-d5e5-4b0f-9250-eaf499fcfc57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:37:59 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-91f6aca3-1924-454d-a2f7-94f31711281c tempest-VolumeQuotasNegativeTestJSON-1121050141 None] Flow 'volume_create_manager' (985f3764-99e2-4d29-a471-6a2d15db27a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:37:59 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-91f6aca3-1924-454d-a2f7-94f31711281c tempest-VolumeQuotasNegativeTestJSON-1121050141 None] Created volume successfully. Sep 06 06:38:02 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-2239df3d-28b7-48d3-82df-ede136448731 tempest-VolumeQuotasNegativeTestJSON-1121050141 None] Acquiring lock "cinder-831e35ef-4b06-4f8a-9cf6-2f16de724c92-delete_volume" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:38:02 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-2239df3d-28b7-48d3-82df-ede136448731 tempest-VolumeQuotasNegativeTestJSON-1121050141 None] Lock "cinder-831e35ef-4b06-4f8a-9cf6-2f16de724c92-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:38:02 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-2239df3d-28b7-48d3-82df-ede136448731 tempest-VolumeQuotasNegativeTestJSON-1121050141 None] Acquiring lock "cinder-quobyte-831e35ef-4b06-4f8a-9cf6-2f16de724c92" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:38:02 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-2239df3d-28b7-48d3-82df-ede136448731 tempest-VolumeQuotasNegativeTestJSON-1121050141 None] Lock "cinder-quobyte-831e35ef-4b06-4f8a-9cf6-2f16de724c92" acquired by "delete_volume" :: waited 0.025s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:38:02 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7c97082-307d-4e9f-98f4-436cd31a34ba]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:38:02 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-2239df3d-28b7-48d3-82df-ede136448731 tempest-VolumeQuotasNegativeTestJSON-1121050141 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-831e35ef-4b06-4f8a-9cf6-2f16de724c92 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:38:03 devstack sudo[96247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-831e35ef-4b06-4f8a-9cf6-2f16de724c92 Sep 06 06:38:03 devstack sudo[96247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:38:03 devstack sudo[96247]: pam_unix(sudo:session): session closed for user root Sep 06 06:38:03 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-2239df3d-28b7-48d3-82df-ede136448731 tempest-VolumeQuotasNegativeTestJSON-1121050141 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-831e35ef-4b06-4f8a-9cf6-2f16de724c92" returned: 0 in 0.638s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:38:03 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-2239df3d-28b7-48d3-82df-ede136448731 tempest-VolumeQuotasNegativeTestJSON-1121050141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-831e35ef-4b06-4f8a-9cf6-2f16de724c92 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:38:03 devstack sudo[96265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-831e35ef-4b06-4f8a-9cf6-2f16de724c92 Sep 06 06:38:03 devstack sudo[96265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:38:03 devstack sudo[96265]: pam_unix(sudo:session): session closed for user root Sep 06 06:38:04 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-2239df3d-28b7-48d3-82df-ede136448731 tempest-VolumeQuotasNegativeTestJSON-1121050141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-831e35ef-4b06-4f8a-9cf6-2f16de724c92" returned: 0 in 0.388s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:38:04 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-2239df3d-28b7-48d3-82df-ede136448731 tempest-VolumeQuotasNegativeTestJSON-1121050141 None] Lock "cinder-quobyte-831e35ef-4b06-4f8a-9cf6-2f16de724c92" released by "delete_volume" :: held 1.105s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:38:04 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-2239df3d-28b7-48d3-82df-ede136448731 tempest-VolumeQuotasNegativeTestJSON-1121050141 None] Created reservations ['2dfa38cf-0388-46dc-a2eb-40ad8822bb1a', 'b56bf7d7-3367-4964-a66b-c968e2485af2', '79533212-04be-4da1-93a5-d83509fc9e9f', 'c33a5306-3fcf-44e6-8bed-cd58943c8b43'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:38:04 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-2239df3d-28b7-48d3-82df-ede136448731 tempest-VolumeQuotasNegativeTestJSON-1121050141 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:38:04 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-2239df3d-28b7-48d3-82df-ede136448731 tempest-VolumeQuotasNegativeTestJSON-1121050141 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:38:04 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-2239df3d-28b7-48d3-82df-ede136448731 tempest-VolumeQuotasNegativeTestJSON-1121050141 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:38:04 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-2239df3d-28b7-48d3-82df-ede136448731 tempest-VolumeQuotasNegativeTestJSON-1121050141 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:38:04 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-2239df3d-28b7-48d3-82df-ede136448731 tempest-VolumeQuotasNegativeTestJSON-1121050141 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:38:04 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-2239df3d-28b7-48d3-82df-ede136448731 tempest-VolumeQuotasNegativeTestJSON-1121050141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:38:04 devstack sudo[96271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:38:04 devstack sudo[96271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:38:04 devstack sudo[96271]: pam_unix(sudo:session): session closed for user root Sep 06 06:38:04 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-2239df3d-28b7-48d3-82df-ede136448731 tempest-VolumeQuotasNegativeTestJSON-1121050141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.453s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:38:04 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-2239df3d-28b7-48d3-82df-ede136448731 tempest-VolumeQuotasNegativeTestJSON-1121050141 None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:38:04 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-2239df3d-28b7-48d3-82df-ede136448731 tempest-VolumeQuotasNegativeTestJSON-1121050141 None] Deleted volume successfully. Sep 06 06:38:04 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-2239df3d-28b7-48d3-82df-ede136448731 tempest-VolumeQuotasNegativeTestJSON-1121050141 None] Lock "cinder-831e35ef-4b06-4f8a-9cf6-2f16de724c92-delete_volume" released by "delete_volume" :: held 2.016s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:38:06 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-04eea749-79de-4a2a-ab28-cdc9839b139a tempest-ServersNegativeTestJSON-819510877 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87329) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 06:38:06 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-04eea749-79de-4a2a-ab28-cdc9839b139a tempest-ServersNegativeTestJSON-819510877 None] Flow 'volume_create_manager' (28710108-457e-48b2-a485-689c8a8ebafc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:38:06 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-04eea749-79de-4a2a-ab28-cdc9839b139a tempest-ServersNegativeTestJSON-819510877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f051075b-6631-43f5-8f0c-1838bb3bc183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:38:06 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-04eea749-79de-4a2a-ab28-cdc9839b139a tempest-ServersNegativeTestJSON-819510877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f051075b-6631-43f5-8f0c-1838bb3bc183) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:38:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-550982198',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2bf113d-2332-41eb-9dc1-edfb656e9a48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9ed83742e8342aab51a11663ebf1b00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:38:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:38:06Z,use_quota=True,user_id='6701e3a5b6644dda93eea54deb135777',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:38:06 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-04eea749-79de-4a2a-ab28-cdc9839b139a tempest-ServersNegativeTestJSON-819510877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (459ec130-f665-4cb4-a03e-9d194e124dfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:38:06 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-04eea749-79de-4a2a-ab28-cdc9839b139a tempest-ServersNegativeTestJSON-819510877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (459ec130-f665-4cb4-a03e-9d194e124dfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:38:06 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-04eea749-79de-4a2a-ab28-cdc9839b139a tempest-ServersNegativeTestJSON-819510877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (895e1ca8-b402-4ef4-b368-7dfd7cbac3fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:38:06 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-04eea749-79de-4a2a-ab28-cdc9839b139a tempest-ServersNegativeTestJSON-819510877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (895e1ca8-b402-4ef4-b368-7dfd7cbac3fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c2bf113d-2332-41eb-9dc1-edfb656e9a48', 'volume_name': 'volume-c2bf113d-2332-41eb-9dc1-edfb656e9a48', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:38:06 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-04eea749-79de-4a2a-ab28-cdc9839b139a tempest-ServersNegativeTestJSON-819510877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ceb55b4-185e-4d51-aaa0-902a9d5be6ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:38:06 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-04eea749-79de-4a2a-ab28-cdc9839b139a tempest-ServersNegativeTestJSON-819510877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ceb55b4-185e-4d51-aaa0-902a9d5be6ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:38:06 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-04eea749-79de-4a2a-ab28-cdc9839b139a tempest-ServersNegativeTestJSON-819510877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4fcd460-0f8b-48ef-8ff6-aa1a60b8b7d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:38:06 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-04eea749-79de-4a2a-ab28-cdc9839b139a tempest-ServersNegativeTestJSON-819510877 None] Volume c2bf113d-2332-41eb-9dc1-edfb656e9a48: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c2bf113d-2332-41eb-9dc1-edfb656e9a48', 'volume_size': 1} Sep 06 06:38:06 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-04eea749-79de-4a2a-ab28-cdc9839b139a tempest-ServersNegativeTestJSON-819510877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:38:06 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-04eea749-79de-4a2a-ab28-cdc9839b139a tempest-ServersNegativeTestJSON-819510877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:38:06 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-04eea749-79de-4a2a-ab28-cdc9839b139a tempest-ServersNegativeTestJSON-819510877 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:38:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-550982198',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2bf113d-2332-41eb-9dc1-edfb656e9a48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9ed83742e8342aab51a11663ebf1b00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:38:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:38:06Z,use_quota=True,user_id='6701e3a5b6644dda93eea54deb135777',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)}" {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 06:38:06 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-04eea749-79de-4a2a-ab28-cdc9839b139a tempest-ServersNegativeTestJSON-819510877 None] Creating volume c2bf113d-2332-41eb-9dc1-edfb656e9a48 {{(pid=87329) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 06:38:06 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-04eea749-79de-4a2a-ab28-cdc9839b139a tempest-ServersNegativeTestJSON-819510877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:38:06 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-04eea749-79de-4a2a-ab28-cdc9839b139a tempest-ServersNegativeTestJSON-819510877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:38:06 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-04eea749-79de-4a2a-ab28-cdc9839b139a tempest-ServersNegativeTestJSON-819510877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:38:06 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-04eea749-79de-4a2a-ab28-cdc9839b139a tempest-ServersNegativeTestJSON-819510877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:38:06 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-04eea749-79de-4a2a-ab28-cdc9839b139a tempest-ServersNegativeTestJSON-819510877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:38:06 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-04eea749-79de-4a2a-ab28-cdc9839b139a tempest-ServersNegativeTestJSON-819510877 None] Selected osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 as target Quobyte volume. {{(pid=87329) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 06:38:06 devstack cinder-volume[87329]: INFO cinder.volume.drivers.remotefs [None req-04eea749-79de-4a2a-ab28-cdc9839b139a tempest-ServersNegativeTestJSON-819510877 None] casted to osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 Sep 06 06:38:06 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-04eea749-79de-4a2a-ab28-cdc9839b139a tempest-ServersNegativeTestJSON-819510877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-c2bf113d-2332-41eb-9dc1-edfb656e9a48 1073741824 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:38:06 devstack sudo[96291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-c2bf113d-2332-41eb-9dc1-edfb656e9a48 1073741824 Sep 06 06:38:06 devstack sudo[96291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:38:07 devstack sudo[96291]: pam_unix(sudo:session): session closed for user root Sep 06 06:38:07 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-04eea749-79de-4a2a-ab28-cdc9839b139a tempest-ServersNegativeTestJSON-819510877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-c2bf113d-2332-41eb-9dc1-edfb656e9a48 1073741824" returned: 0 in 0.608s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:38:07 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-04eea749-79de-4a2a-ab28-cdc9839b139a tempest-ServersNegativeTestJSON-819510877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-c2bf113d-2332-41eb-9dc1-edfb656e9a48 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:38:07 devstack sudo[96297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-c2bf113d-2332-41eb-9dc1-edfb656e9a48 Sep 06 06:38:07 devstack sudo[96297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:38:07 devstack sudo[96297]: pam_unix(sudo:session): session closed for user root Sep 06 06:38:07 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-04eea749-79de-4a2a-ab28-cdc9839b139a tempest-ServersNegativeTestJSON-819510877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-c2bf113d-2332-41eb-9dc1-edfb656e9a48" returned: 0 in 0.334s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:38:07 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-04eea749-79de-4a2a-ab28-cdc9839b139a tempest-ServersNegativeTestJSON-819510877 None] <== create_volume: return (1007ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'} {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 06:38:07 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-04eea749-79de-4a2a-ab28-cdc9839b139a tempest-ServersNegativeTestJSON-819510877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.010s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:38:07 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-04eea749-79de-4a2a-ab28-cdc9839b139a tempest-ServersNegativeTestJSON-819510877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4fcd460-0f8b-48ef-8ff6-aa1a60b8b7d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2bf113d-2332-41eb-9dc1-edfb656e9a48', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:38:07 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-04eea749-79de-4a2a-ab28-cdc9839b139a tempest-ServersNegativeTestJSON-819510877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26cae0d0-9662-4de5-b1b2-6f8705897869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:38:07 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-04eea749-79de-4a2a-ab28-cdc9839b139a tempest-ServersNegativeTestJSON-819510877 None] Volume volume-c2bf113d-2332-41eb-9dc1-edfb656e9a48 (c2bf113d-2332-41eb-9dc1-edfb656e9a48): created successfully Sep 06 06:38:07 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-04eea749-79de-4a2a-ab28-cdc9839b139a tempest-ServersNegativeTestJSON-819510877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26cae0d0-9662-4de5-b1b2-6f8705897869) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:38:07 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-04eea749-79de-4a2a-ab28-cdc9839b139a tempest-ServersNegativeTestJSON-819510877 None] Flow 'volume_create_manager' (28710108-457e-48b2-a485-689c8a8ebafc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:38:07 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-04eea749-79de-4a2a-ab28-cdc9839b139a tempest-ServersNegativeTestJSON-819510877 None] Created volume successfully. Sep 06 06:38:10 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-49fd47d7-6bc2-4137-96b3-58c696d9c8cf tempest-ServersNegativeTestJSON-819510877 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87329) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 06:38:10 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-49fd47d7-6bc2-4137-96b3-58c696d9c8cf tempest-ServersNegativeTestJSON-819510877 None] Flow 'volume_create_manager' (c23f2f71-8b3c-4a9e-a4aa-4086eeff1cf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:38:10 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-49fd47d7-6bc2-4137-96b3-58c696d9c8cf tempest-ServersNegativeTestJSON-819510877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3130453d-1885-4578-81f0-8364c4d67a8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:38:10 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-49fd47d7-6bc2-4137-96b3-58c696d9c8cf tempest-ServersNegativeTestJSON-819510877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3130453d-1885-4578-81f0-8364c4d67a8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:38:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-878377901',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27234d6f-c693-4a4d-955e-472b41961383,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9ed83742e8342aab51a11663ebf1b00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:38:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:38:10Z,use_quota=True,user_id='6701e3a5b6644dda93eea54deb135777',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:38:10 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-49fd47d7-6bc2-4137-96b3-58c696d9c8cf tempest-ServersNegativeTestJSON-819510877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14a03965-987e-4db8-aee3-d476d89dd695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:38:10 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-49fd47d7-6bc2-4137-96b3-58c696d9c8cf tempest-ServersNegativeTestJSON-819510877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14a03965-987e-4db8-aee3-d476d89dd695) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:38:10 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-49fd47d7-6bc2-4137-96b3-58c696d9c8cf tempest-ServersNegativeTestJSON-819510877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (772ca834-6846-465d-ac65-72d1b72f479c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:38:10 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-49fd47d7-6bc2-4137-96b3-58c696d9c8cf tempest-ServersNegativeTestJSON-819510877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (772ca834-6846-465d-ac65-72d1b72f479c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '27234d6f-c693-4a4d-955e-472b41961383', 'volume_name': 'volume-27234d6f-c693-4a4d-955e-472b41961383', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:38:10 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-49fd47d7-6bc2-4137-96b3-58c696d9c8cf tempest-ServersNegativeTestJSON-819510877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01ee66a3-f6d2-4041-a9fc-c3d65022381d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:38:10 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-49fd47d7-6bc2-4137-96b3-58c696d9c8cf tempest-ServersNegativeTestJSON-819510877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01ee66a3-f6d2-4041-a9fc-c3d65022381d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:38:10 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-49fd47d7-6bc2-4137-96b3-58c696d9c8cf tempest-ServersNegativeTestJSON-819510877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e53adb2a-6a45-4d48-9f6a-ff8bc0f65bc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:38:10 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-49fd47d7-6bc2-4137-96b3-58c696d9c8cf tempest-ServersNegativeTestJSON-819510877 None] Volume 27234d6f-c693-4a4d-955e-472b41961383: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-27234d6f-c693-4a4d-955e-472b41961383', 'volume_size': 1} Sep 06 06:38:10 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-49fd47d7-6bc2-4137-96b3-58c696d9c8cf tempest-ServersNegativeTestJSON-819510877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:38:10 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-49fd47d7-6bc2-4137-96b3-58c696d9c8cf tempest-ServersNegativeTestJSON-819510877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:38:10 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-49fd47d7-6bc2-4137-96b3-58c696d9c8cf tempest-ServersNegativeTestJSON-819510877 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:38:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-878377901',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27234d6f-c693-4a4d-955e-472b41961383,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9ed83742e8342aab51a11663ebf1b00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:38:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:38:10Z,use_quota=True,user_id='6701e3a5b6644dda93eea54deb135777',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)}" {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 06:38:10 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-49fd47d7-6bc2-4137-96b3-58c696d9c8cf tempest-ServersNegativeTestJSON-819510877 None] Creating volume 27234d6f-c693-4a4d-955e-472b41961383 {{(pid=87329) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 06:38:10 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-49fd47d7-6bc2-4137-96b3-58c696d9c8cf tempest-ServersNegativeTestJSON-819510877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:38:10 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-49fd47d7-6bc2-4137-96b3-58c696d9c8cf tempest-ServersNegativeTestJSON-819510877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:38:10 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-49fd47d7-6bc2-4137-96b3-58c696d9c8cf tempest-ServersNegativeTestJSON-819510877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:38:10 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-49fd47d7-6bc2-4137-96b3-58c696d9c8cf tempest-ServersNegativeTestJSON-819510877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:38:10 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-49fd47d7-6bc2-4137-96b3-58c696d9c8cf tempest-ServersNegativeTestJSON-819510877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:38:10 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-49fd47d7-6bc2-4137-96b3-58c696d9c8cf tempest-ServersNegativeTestJSON-819510877 None] Selected osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 as target Quobyte volume. {{(pid=87329) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 06:38:10 devstack cinder-volume[87329]: INFO cinder.volume.drivers.remotefs [None req-49fd47d7-6bc2-4137-96b3-58c696d9c8cf tempest-ServersNegativeTestJSON-819510877 None] casted to osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 Sep 06 06:38:10 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-49fd47d7-6bc2-4137-96b3-58c696d9c8cf tempest-ServersNegativeTestJSON-819510877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-27234d6f-c693-4a4d-955e-472b41961383 1073741824 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:38:10 devstack sudo[96302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-27234d6f-c693-4a4d-955e-472b41961383 1073741824 Sep 06 06:38:10 devstack sudo[96302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:38:10 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-985a5442-6d71-407e-8801-15e5bf1b9d86 tempest-VolumesCloneNegativeTest-1325760059 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87329) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 06:38:10 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-985a5442-6d71-407e-8801-15e5bf1b9d86 tempest-VolumesCloneNegativeTest-1325760059 None] Flow 'volume_create_manager' (5de78ed3-68b1-4ec2-a73e-3c57cb757870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:38:10 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-985a5442-6d71-407e-8801-15e5bf1b9d86 tempest-VolumesCloneNegativeTest-1325760059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cf46049-d9be-444a-bc59-583ff482e859) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:38:10 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-985a5442-6d71-407e-8801-15e5bf1b9d86 tempest-VolumesCloneNegativeTest-1325760059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cf46049-d9be-444a-bc59-583ff482e859) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:38:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-242829430',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d48b9360-8b74-421f-9e66-7cb20c66b419,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7932c90df2e64a9c81b374a05235cdfb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:38:10Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:38:10Z,use_quota=True,user_id='c9e6a4c30b974ac093cc11cbaa36f679',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:38:10 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-985a5442-6d71-407e-8801-15e5bf1b9d86 tempest-VolumesCloneNegativeTest-1325760059 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a67905d5-4d8c-4279-9961-c3f55433d6c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:38:10 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-985a5442-6d71-407e-8801-15e5bf1b9d86 tempest-VolumesCloneNegativeTest-1325760059 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a67905d5-4d8c-4279-9961-c3f55433d6c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:38:10 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-985a5442-6d71-407e-8801-15e5bf1b9d86 tempest-VolumesCloneNegativeTest-1325760059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc08a890-001e-4c16-9940-a93942aea597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:38:10 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-985a5442-6d71-407e-8801-15e5bf1b9d86 tempest-VolumesCloneNegativeTest-1325760059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc08a890-001e-4c16-9940-a93942aea597) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd48b9360-8b74-421f-9e66-7cb20c66b419', 'volume_name': 'volume-d48b9360-8b74-421f-9e66-7cb20c66b419', 'volume_size': 2}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:38:10 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-985a5442-6d71-407e-8801-15e5bf1b9d86 tempest-VolumesCloneNegativeTest-1325760059 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5069a42c-3f55-4204-954e-09fdbfce770d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:38:10 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-985a5442-6d71-407e-8801-15e5bf1b9d86 tempest-VolumesCloneNegativeTest-1325760059 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5069a42c-3f55-4204-954e-09fdbfce770d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:38:10 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-985a5442-6d71-407e-8801-15e5bf1b9d86 tempest-VolumesCloneNegativeTest-1325760059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b15dd5f8-4407-4d4c-b325-4384f0b41cb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:38:10 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-985a5442-6d71-407e-8801-15e5bf1b9d86 tempest-VolumesCloneNegativeTest-1325760059 None] Volume d48b9360-8b74-421f-9e66-7cb20c66b419: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d48b9360-8b74-421f-9e66-7cb20c66b419', 'volume_size': 2} Sep 06 06:38:10 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-985a5442-6d71-407e-8801-15e5bf1b9d86 tempest-VolumesCloneNegativeTest-1325760059 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:38:10 devstack sudo[96302]: pam_unix(sudo:session): session closed for user root Sep 06 06:38:10 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-49fd47d7-6bc2-4137-96b3-58c696d9c8cf tempest-ServersNegativeTestJSON-819510877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-27234d6f-c693-4a4d-955e-472b41961383 1073741824" returned: 0 in 0.514s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:38:10 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-49fd47d7-6bc2-4137-96b3-58c696d9c8cf tempest-ServersNegativeTestJSON-819510877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-27234d6f-c693-4a4d-955e-472b41961383 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:38:10 devstack sudo[96307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-27234d6f-c693-4a4d-955e-472b41961383 Sep 06 06:38:10 devstack sudo[96307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:38:11 devstack sudo[96307]: pam_unix(sudo:session): session closed for user root Sep 06 06:38:11 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-49fd47d7-6bc2-4137-96b3-58c696d9c8cf tempest-ServersNegativeTestJSON-819510877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-27234d6f-c693-4a4d-955e-472b41961383" returned: 0 in 0.259s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:38:11 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-49fd47d7-6bc2-4137-96b3-58c696d9c8cf tempest-ServersNegativeTestJSON-819510877 None] <== create_volume: return (816ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'} {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 06:38:11 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-49fd47d7-6bc2-4137-96b3-58c696d9c8cf tempest-ServersNegativeTestJSON-819510877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.819s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:38:11 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-985a5442-6d71-407e-8801-15e5bf1b9d86 tempest-VolumesCloneNegativeTest-1325760059 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.680s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:38:11 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-985a5442-6d71-407e-8801-15e5bf1b9d86 tempest-VolumesCloneNegativeTest-1325760059 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:38:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-242829430',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d48b9360-8b74-421f-9e66-7cb20c66b419,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7932c90df2e64a9c81b374a05235cdfb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:38:10Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:38:10Z,use_quota=True,user_id='c9e6a4c30b974ac093cc11cbaa36f679',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)}" {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 06:38:11 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-985a5442-6d71-407e-8801-15e5bf1b9d86 tempest-VolumesCloneNegativeTest-1325760059 None] Creating volume d48b9360-8b74-421f-9e66-7cb20c66b419 {{(pid=87329) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 06:38:11 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-985a5442-6d71-407e-8801-15e5bf1b9d86 tempest-VolumesCloneNegativeTest-1325760059 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:38:11 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-985a5442-6d71-407e-8801-15e5bf1b9d86 tempest-VolumesCloneNegativeTest-1325760059 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:38:11 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-985a5442-6d71-407e-8801-15e5bf1b9d86 tempest-VolumesCloneNegativeTest-1325760059 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:38:11 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-985a5442-6d71-407e-8801-15e5bf1b9d86 tempest-VolumesCloneNegativeTest-1325760059 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:38:11 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-985a5442-6d71-407e-8801-15e5bf1b9d86 tempest-VolumesCloneNegativeTest-1325760059 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:38:11 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-985a5442-6d71-407e-8801-15e5bf1b9d86 tempest-VolumesCloneNegativeTest-1325760059 None] Selected osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 as target Quobyte volume. {{(pid=87329) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 06:38:11 devstack cinder-volume[87329]: INFO cinder.volume.drivers.remotefs [None req-985a5442-6d71-407e-8801-15e5bf1b9d86 tempest-VolumesCloneNegativeTest-1325760059 None] casted to osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 Sep 06 06:38:11 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-985a5442-6d71-407e-8801-15e5bf1b9d86 tempest-VolumesCloneNegativeTest-1325760059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-d48b9360-8b74-421f-9e66-7cb20c66b419 2147483648 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:38:11 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-49fd47d7-6bc2-4137-96b3-58c696d9c8cf tempest-ServersNegativeTestJSON-819510877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e53adb2a-6a45-4d48-9f6a-ff8bc0f65bc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27234d6f-c693-4a4d-955e-472b41961383', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:38:11 devstack sudo[96310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-d48b9360-8b74-421f-9e66-7cb20c66b419 2147483648 Sep 06 06:38:11 devstack sudo[96310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:38:11 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-49fd47d7-6bc2-4137-96b3-58c696d9c8cf tempest-ServersNegativeTestJSON-819510877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86b2beef-5495-43b0-9fa5-0baa4a90039b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:38:11 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-49fd47d7-6bc2-4137-96b3-58c696d9c8cf tempest-ServersNegativeTestJSON-819510877 None] Volume volume-27234d6f-c693-4a4d-955e-472b41961383 (27234d6f-c693-4a4d-955e-472b41961383): created successfully Sep 06 06:38:11 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-49fd47d7-6bc2-4137-96b3-58c696d9c8cf tempest-ServersNegativeTestJSON-819510877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86b2beef-5495-43b0-9fa5-0baa4a90039b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:38:11 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-49fd47d7-6bc2-4137-96b3-58c696d9c8cf tempest-ServersNegativeTestJSON-819510877 None] Flow 'volume_create_manager' (c23f2f71-8b3c-4a9e-a4aa-4086eeff1cf5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:38:11 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-49fd47d7-6bc2-4137-96b3-58c696d9c8cf tempest-ServersNegativeTestJSON-819510877 None] Created volume successfully. Sep 06 06:38:11 devstack sudo[96310]: pam_unix(sudo:session): session closed for user root Sep 06 06:38:11 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-985a5442-6d71-407e-8801-15e5bf1b9d86 tempest-VolumesCloneNegativeTest-1325760059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-d48b9360-8b74-421f-9e66-7cb20c66b419 2147483648" returned: 0 in 0.494s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:38:11 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-985a5442-6d71-407e-8801-15e5bf1b9d86 tempest-VolumesCloneNegativeTest-1325760059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-d48b9360-8b74-421f-9e66-7cb20c66b419 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:38:11 devstack sudo[96316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-d48b9360-8b74-421f-9e66-7cb20c66b419 Sep 06 06:38:11 devstack sudo[96316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:38:11 devstack sudo[96316]: pam_unix(sudo:session): session closed for user root Sep 06 06:38:11 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-985a5442-6d71-407e-8801-15e5bf1b9d86 tempest-VolumesCloneNegativeTest-1325760059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-d48b9360-8b74-421f-9e66-7cb20c66b419" returned: 0 in 0.242s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:38:11 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-985a5442-6d71-407e-8801-15e5bf1b9d86 tempest-VolumesCloneNegativeTest-1325760059 None] <== create_volume: return (774ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'} {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 06:38:11 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-985a5442-6d71-407e-8801-15e5bf1b9d86 tempest-VolumesCloneNegativeTest-1325760059 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.777s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:38:11 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-985a5442-6d71-407e-8801-15e5bf1b9d86 tempest-VolumesCloneNegativeTest-1325760059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b15dd5f8-4407-4d4c-b325-4384f0b41cb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d48b9360-8b74-421f-9e66-7cb20c66b419', 'volume_size': 2}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:38:11 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-985a5442-6d71-407e-8801-15e5bf1b9d86 tempest-VolumesCloneNegativeTest-1325760059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cab69815-6d3c-45aa-ace4-0e3dc59c14a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:38:11 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-985a5442-6d71-407e-8801-15e5bf1b9d86 tempest-VolumesCloneNegativeTest-1325760059 None] Volume volume-d48b9360-8b74-421f-9e66-7cb20c66b419 (d48b9360-8b74-421f-9e66-7cb20c66b419): created successfully Sep 06 06:38:11 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-985a5442-6d71-407e-8801-15e5bf1b9d86 tempest-VolumesCloneNegativeTest-1325760059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cab69815-6d3c-45aa-ace4-0e3dc59c14a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:38:11 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-985a5442-6d71-407e-8801-15e5bf1b9d86 tempest-VolumesCloneNegativeTest-1325760059 None] Flow 'volume_create_manager' (5de78ed3-68b1-4ec2-a73e-3c57cb757870) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:38:11 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-985a5442-6d71-407e-8801-15e5bf1b9d86 tempest-VolumesCloneNegativeTest-1325760059 None] Created volume successfully. Sep 06 06:38:12 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-56b9b78e-9447-4d1d-945d-9ae5826b6ea7 tempest-VolumesCloneNegativeTest-1325760059 None] Acquiring lock "cinder-d48b9360-8b74-421f-9e66-7cb20c66b419-delete_volume" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:38:12 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-56b9b78e-9447-4d1d-945d-9ae5826b6ea7 tempest-VolumesCloneNegativeTest-1325760059 None] Lock "cinder-d48b9360-8b74-421f-9e66-7cb20c66b419-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:38:12 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-56b9b78e-9447-4d1d-945d-9ae5826b6ea7 tempest-VolumesCloneNegativeTest-1325760059 None] Acquiring lock "cinder-quobyte-d48b9360-8b74-421f-9e66-7cb20c66b419" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:38:12 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-56b9b78e-9447-4d1d-945d-9ae5826b6ea7 tempest-VolumesCloneNegativeTest-1325760059 None] Lock "cinder-quobyte-d48b9360-8b74-421f-9e66-7cb20c66b419" acquired by "delete_volume" :: waited 0.034s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:38:12 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f0c93dc-d6b6-4fe3-9187-08d17c7d5a01]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:38:12 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-56b9b78e-9447-4d1d-945d-9ae5826b6ea7 tempest-VolumesCloneNegativeTest-1325760059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-d48b9360-8b74-421f-9e66-7cb20c66b419 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:38:12 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-b65bff3a-d68b-4a57-86b2-8edd5e84ce71 tempest-ServersNegativeTestJSON-819510877 None] Acquiring lock "cinder-27234d6f-c693-4a4d-955e-472b41961383-delete_volume" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:38:12 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-b65bff3a-d68b-4a57-86b2-8edd5e84ce71 tempest-ServersNegativeTestJSON-819510877 None] Lock "cinder-27234d6f-c693-4a4d-955e-472b41961383-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:38:12 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-b65bff3a-d68b-4a57-86b2-8edd5e84ce71 tempest-ServersNegativeTestJSON-819510877 None] Acquiring lock "cinder-quobyte-27234d6f-c693-4a4d-955e-472b41961383" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:38:12 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-b65bff3a-d68b-4a57-86b2-8edd5e84ce71 tempest-ServersNegativeTestJSON-819510877 None] Lock "cinder-quobyte-27234d6f-c693-4a4d-955e-472b41961383" acquired by "delete_volume" :: waited 0.015s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:38:12 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[79cf0784-6bdc-4c78-84f8-c2ce6f7d953a]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:38:12 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-b65bff3a-d68b-4a57-86b2-8edd5e84ce71 tempest-ServersNegativeTestJSON-819510877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-27234d6f-c693-4a4d-955e-472b41961383 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:38:12 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-6493b7ef-29f6-49aa-87a8-69010992d2da tempest-VolumeSnapshotQuotasNegativeTestJSON-1630173945 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87329) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 06:38:12 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-6493b7ef-29f6-49aa-87a8-69010992d2da tempest-VolumeSnapshotQuotasNegativeTestJSON-1630173945 None] Flow 'volume_create_manager' (ccdd66e1-81a9-4a19-9fe1-ac289e15f45b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:38:12 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-6493b7ef-29f6-49aa-87a8-69010992d2da tempest-VolumeSnapshotQuotasNegativeTestJSON-1630173945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34ab46ee-3ece-4d9c-9ad5-1fd61c27f39f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:38:12 devstack sudo[96319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-d48b9360-8b74-421f-9e66-7cb20c66b419 Sep 06 06:38:12 devstack sudo[96319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:38:12 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-6493b7ef-29f6-49aa-87a8-69010992d2da tempest-VolumeSnapshotQuotasNegativeTestJSON-1630173945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34ab46ee-3ece-4d9c-9ad5-1fd61c27f39f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:38:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-695500666',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05d735f8-0c99-4deb-913d-05d37b27d103,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='017f34ef39af4fb28ab0fe672fbbdc8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:38:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:38:13Z,use_quota=True,user_id='5012913349734b70b13eb075a743ef3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:38:12 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-6493b7ef-29f6-49aa-87a8-69010992d2da tempest-VolumeSnapshotQuotasNegativeTestJSON-1630173945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66123de1-f2f9-4028-84c1-c2f292f4c04f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:38:12 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-6493b7ef-29f6-49aa-87a8-69010992d2da tempest-VolumeSnapshotQuotasNegativeTestJSON-1630173945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66123de1-f2f9-4028-84c1-c2f292f4c04f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:38:12 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-6493b7ef-29f6-49aa-87a8-69010992d2da tempest-VolumeSnapshotQuotasNegativeTestJSON-1630173945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66788cd8-4b5b-410f-95aa-2f37bb1b2a91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:38:12 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-6493b7ef-29f6-49aa-87a8-69010992d2da tempest-VolumeSnapshotQuotasNegativeTestJSON-1630173945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66788cd8-4b5b-410f-95aa-2f37bb1b2a91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05d735f8-0c99-4deb-913d-05d37b27d103', 'volume_name': 'volume-05d735f8-0c99-4deb-913d-05d37b27d103', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:38:12 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-6493b7ef-29f6-49aa-87a8-69010992d2da tempest-VolumeSnapshotQuotasNegativeTestJSON-1630173945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45f1bfe9-5997-4067-bce6-4726ce2d054a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:38:12 devstack sudo[96320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-27234d6f-c693-4a4d-955e-472b41961383 Sep 06 06:38:12 devstack sudo[96320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:38:12 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-6493b7ef-29f6-49aa-87a8-69010992d2da tempest-VolumeSnapshotQuotasNegativeTestJSON-1630173945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45f1bfe9-5997-4067-bce6-4726ce2d054a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:38:12 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-6493b7ef-29f6-49aa-87a8-69010992d2da tempest-VolumeSnapshotQuotasNegativeTestJSON-1630173945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f9024fb-6cf6-4dbf-8215-a5685a98c68a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:38:12 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-6493b7ef-29f6-49aa-87a8-69010992d2da tempest-VolumeSnapshotQuotasNegativeTestJSON-1630173945 None] Volume 05d735f8-0c99-4deb-913d-05d37b27d103: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05d735f8-0c99-4deb-913d-05d37b27d103', 'volume_size': 1} Sep 06 06:38:12 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-6493b7ef-29f6-49aa-87a8-69010992d2da tempest-VolumeSnapshotQuotasNegativeTestJSON-1630173945 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:38:12 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-6493b7ef-29f6-49aa-87a8-69010992d2da tempest-VolumeSnapshotQuotasNegativeTestJSON-1630173945 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:38:12 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-6493b7ef-29f6-49aa-87a8-69010992d2da tempest-VolumeSnapshotQuotasNegativeTestJSON-1630173945 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:38:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-695500666',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05d735f8-0c99-4deb-913d-05d37b27d103,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='017f34ef39af4fb28ab0fe672fbbdc8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:38:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:38:13Z,use_quota=True,user_id='5012913349734b70b13eb075a743ef3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)}" {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 06:38:12 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-6493b7ef-29f6-49aa-87a8-69010992d2da tempest-VolumeSnapshotQuotasNegativeTestJSON-1630173945 None] Creating volume 05d735f8-0c99-4deb-913d-05d37b27d103 {{(pid=87329) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 06:38:12 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-6493b7ef-29f6-49aa-87a8-69010992d2da tempest-VolumeSnapshotQuotasNegativeTestJSON-1630173945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:38:12 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-6493b7ef-29f6-49aa-87a8-69010992d2da tempest-VolumeSnapshotQuotasNegativeTestJSON-1630173945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:38:12 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-6493b7ef-29f6-49aa-87a8-69010992d2da tempest-VolumeSnapshotQuotasNegativeTestJSON-1630173945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:38:12 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-6493b7ef-29f6-49aa-87a8-69010992d2da tempest-VolumeSnapshotQuotasNegativeTestJSON-1630173945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:38:12 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-6493b7ef-29f6-49aa-87a8-69010992d2da tempest-VolumeSnapshotQuotasNegativeTestJSON-1630173945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:38:12 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-6493b7ef-29f6-49aa-87a8-69010992d2da tempest-VolumeSnapshotQuotasNegativeTestJSON-1630173945 None] Selected osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 as target Quobyte volume. {{(pid=87329) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 06:38:12 devstack cinder-volume[87329]: INFO cinder.volume.drivers.remotefs [None req-6493b7ef-29f6-49aa-87a8-69010992d2da tempest-VolumeSnapshotQuotasNegativeTestJSON-1630173945 None] casted to osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 Sep 06 06:38:12 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-6493b7ef-29f6-49aa-87a8-69010992d2da tempest-VolumeSnapshotQuotasNegativeTestJSON-1630173945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-05d735f8-0c99-4deb-913d-05d37b27d103 1073741824 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:38:12 devstack sudo[96323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-05d735f8-0c99-4deb-913d-05d37b27d103 1073741824 Sep 06 06:38:12 devstack sudo[96323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:38:13 devstack sudo[96319]: pam_unix(sudo:session): session closed for user root Sep 06 06:38:13 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-56b9b78e-9447-4d1d-945d-9ae5826b6ea7 tempest-VolumesCloneNegativeTest-1325760059 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-d48b9360-8b74-421f-9e66-7cb20c66b419" returned: 0 in 0.518s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:38:13 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-56b9b78e-9447-4d1d-945d-9ae5826b6ea7 tempest-VolumesCloneNegativeTest-1325760059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-d48b9360-8b74-421f-9e66-7cb20c66b419 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:38:13 devstack sudo[96331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-d48b9360-8b74-421f-9e66-7cb20c66b419 Sep 06 06:38:13 devstack sudo[96331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:38:13 devstack sudo[96320]: pam_unix(sudo:session): session closed for user root Sep 06 06:38:13 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-b65bff3a-d68b-4a57-86b2-8edd5e84ce71 tempest-ServersNegativeTestJSON-819510877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-27234d6f-c693-4a4d-955e-472b41961383" returned: 0 in 0.429s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:38:13 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-b65bff3a-d68b-4a57-86b2-8edd5e84ce71 tempest-ServersNegativeTestJSON-819510877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-27234d6f-c693-4a4d-955e-472b41961383 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:38:13 devstack sudo[96335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-27234d6f-c693-4a4d-955e-472b41961383 Sep 06 06:38:13 devstack sudo[96335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:38:13 devstack sudo[96331]: pam_unix(sudo:session): session closed for user root Sep 06 06:38:13 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-56b9b78e-9447-4d1d-945d-9ae5826b6ea7 tempest-VolumesCloneNegativeTest-1325760059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-d48b9360-8b74-421f-9e66-7cb20c66b419" returned: 0 in 0.331s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:38:13 devstack sudo[96323]: pam_unix(sudo:session): session closed for user root Sep 06 06:38:13 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-6493b7ef-29f6-49aa-87a8-69010992d2da tempest-VolumeSnapshotQuotasNegativeTestJSON-1630173945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-05d735f8-0c99-4deb-913d-05d37b27d103 1073741824" returned: 0 in 0.565s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:38:13 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-56b9b78e-9447-4d1d-945d-9ae5826b6ea7 tempest-VolumesCloneNegativeTest-1325760059 None] Lock "cinder-quobyte-d48b9360-8b74-421f-9e66-7cb20c66b419" released by "delete_volume" :: held 0.915s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:38:13 devstack sudo[96335]: pam_unix(sudo:session): session closed for user root Sep 06 06:38:13 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-b65bff3a-d68b-4a57-86b2-8edd5e84ce71 tempest-ServersNegativeTestJSON-819510877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-27234d6f-c693-4a4d-955e-472b41961383" returned: 0 in 0.299s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:38:13 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-b65bff3a-d68b-4a57-86b2-8edd5e84ce71 tempest-ServersNegativeTestJSON-819510877 None] Lock "cinder-quobyte-27234d6f-c693-4a4d-955e-472b41961383" released by "delete_volume" :: held 0.785s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:38:13 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-6493b7ef-29f6-49aa-87a8-69010992d2da tempest-VolumeSnapshotQuotasNegativeTestJSON-1630173945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-05d735f8-0c99-4deb-913d-05d37b27d103 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:38:13 devstack sudo[96341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-05d735f8-0c99-4deb-913d-05d37b27d103 Sep 06 06:38:13 devstack sudo[96341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:38:13 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-56b9b78e-9447-4d1d-945d-9ae5826b6ea7 tempest-VolumesCloneNegativeTest-1325760059 None] Created reservations ['eac57c4b-66aa-4b62-8fc0-66cc22519aea', '73a918c6-5abf-4920-bdaa-0ba5863d6cc7', '5000c0b8-b3b6-4840-8b5d-06525dfb2b1a', 'a1011c91-33a8-4868-9621-f0cfa041008d'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:38:13 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-b65bff3a-d68b-4a57-86b2-8edd5e84ce71 tempest-ServersNegativeTestJSON-819510877 None] Created reservations ['a7d8e58a-9084-482c-9e5d-7b1c3a81d0d8', '8e7f5d08-819a-4e97-9313-b3d0b11f439a', '2d83ab5a-450e-4efc-833b-12b0546018eb', 'e7b16c7f-3354-4fcf-9a8a-9c3f62d22611'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:38:13 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-56b9b78e-9447-4d1d-945d-9ae5826b6ea7 tempest-VolumesCloneNegativeTest-1325760059 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:38:13 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-56b9b78e-9447-4d1d-945d-9ae5826b6ea7 tempest-VolumesCloneNegativeTest-1325760059 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:38:13 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-56b9b78e-9447-4d1d-945d-9ae5826b6ea7 tempest-VolumesCloneNegativeTest-1325760059 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:38:13 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-56b9b78e-9447-4d1d-945d-9ae5826b6ea7 tempest-VolumesCloneNegativeTest-1325760059 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:38:13 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-56b9b78e-9447-4d1d-945d-9ae5826b6ea7 tempest-VolumesCloneNegativeTest-1325760059 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:38:13 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-56b9b78e-9447-4d1d-945d-9ae5826b6ea7 tempest-VolumesCloneNegativeTest-1325760059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:38:13 devstack sudo[96343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:38:13 devstack sudo[96343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:38:13 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-b65bff3a-d68b-4a57-86b2-8edd5e84ce71 tempest-ServersNegativeTestJSON-819510877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:38:13 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-b65bff3a-d68b-4a57-86b2-8edd5e84ce71 tempest-ServersNegativeTestJSON-819510877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:38:13 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-b65bff3a-d68b-4a57-86b2-8edd5e84ce71 tempest-ServersNegativeTestJSON-819510877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:38:13 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-b65bff3a-d68b-4a57-86b2-8edd5e84ce71 tempest-ServersNegativeTestJSON-819510877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:38:13 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-b65bff3a-d68b-4a57-86b2-8edd5e84ce71 tempest-ServersNegativeTestJSON-819510877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:38:13 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-b65bff3a-d68b-4a57-86b2-8edd5e84ce71 tempest-ServersNegativeTestJSON-819510877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:38:13 devstack sudo[96345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:38:13 devstack sudo[96345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:38:13 devstack sudo[96341]: pam_unix(sudo:session): session closed for user root Sep 06 06:38:13 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-b6d100eb-7bb9-4ee7-acad-baef74296e5f tempest-ServersNegativeTestJSON-819510877 None] Acquiring lock "cinder-c2bf113d-2332-41eb-9dc1-edfb656e9a48-delete_volume" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:38:13 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-6493b7ef-29f6-49aa-87a8-69010992d2da tempest-VolumeSnapshotQuotasNegativeTestJSON-1630173945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-05d735f8-0c99-4deb-913d-05d37b27d103" returned: 0 in 0.360s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:38:13 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-6493b7ef-29f6-49aa-87a8-69010992d2da tempest-VolumeSnapshotQuotasNegativeTestJSON-1630173945 None] <== create_volume: return (997ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'} {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 06:38:13 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-6493b7ef-29f6-49aa-87a8-69010992d2da tempest-VolumeSnapshotQuotasNegativeTestJSON-1630173945 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.999s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:38:13 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-b6d100eb-7bb9-4ee7-acad-baef74296e5f tempest-ServersNegativeTestJSON-819510877 None] Lock "cinder-c2bf113d-2332-41eb-9dc1-edfb656e9a48-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:38:13 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-6493b7ef-29f6-49aa-87a8-69010992d2da tempest-VolumeSnapshotQuotasNegativeTestJSON-1630173945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f9024fb-6cf6-4dbf-8215-a5685a98c68a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05d735f8-0c99-4deb-913d-05d37b27d103', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:38:13 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-6493b7ef-29f6-49aa-87a8-69010992d2da tempest-VolumeSnapshotQuotasNegativeTestJSON-1630173945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98f28835-d3eb-4a67-bb74-a63b90b97c3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:38:14 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-6493b7ef-29f6-49aa-87a8-69010992d2da tempest-VolumeSnapshotQuotasNegativeTestJSON-1630173945 None] Volume volume-05d735f8-0c99-4deb-913d-05d37b27d103 (05d735f8-0c99-4deb-913d-05d37b27d103): created successfully Sep 06 06:38:14 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-6493b7ef-29f6-49aa-87a8-69010992d2da tempest-VolumeSnapshotQuotasNegativeTestJSON-1630173945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98f28835-d3eb-4a67-bb74-a63b90b97c3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:38:14 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-6493b7ef-29f6-49aa-87a8-69010992d2da tempest-VolumeSnapshotQuotasNegativeTestJSON-1630173945 None] Flow 'volume_create_manager' (ccdd66e1-81a9-4a19-9fe1-ac289e15f45b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:38:14 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-6493b7ef-29f6-49aa-87a8-69010992d2da tempest-VolumeSnapshotQuotasNegativeTestJSON-1630173945 None] Created volume successfully. Sep 06 06:38:14 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-b6d100eb-7bb9-4ee7-acad-baef74296e5f tempest-ServersNegativeTestJSON-819510877 None] Acquiring lock "cinder-quobyte-c2bf113d-2332-41eb-9dc1-edfb656e9a48" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:38:14 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-b6d100eb-7bb9-4ee7-acad-baef74296e5f tempest-ServersNegativeTestJSON-819510877 None] Lock "cinder-quobyte-c2bf113d-2332-41eb-9dc1-edfb656e9a48" acquired by "delete_volume" :: waited 0.023s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:38:14 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d0867dc-7192-41a3-8a74-524fe4d2b304]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:38:14 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-b6d100eb-7bb9-4ee7-acad-baef74296e5f tempest-ServersNegativeTestJSON-819510877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-c2bf113d-2332-41eb-9dc1-edfb656e9a48 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:38:14 devstack sudo[96343]: pam_unix(sudo:session): session closed for user root Sep 06 06:38:14 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-56b9b78e-9447-4d1d-945d-9ae5826b6ea7 tempest-VolumesCloneNegativeTest-1325760059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.400s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:38:14 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-56b9b78e-9447-4d1d-945d-9ae5826b6ea7 tempest-VolumesCloneNegativeTest-1325760059 None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:38:14 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-56b9b78e-9447-4d1d-945d-9ae5826b6ea7 tempest-VolumesCloneNegativeTest-1325760059 None] Deleted volume successfully. Sep 06 06:38:14 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-56b9b78e-9447-4d1d-945d-9ae5826b6ea7 tempest-VolumesCloneNegativeTest-1325760059 None] Lock "cinder-d48b9360-8b74-421f-9e66-7cb20c66b419-delete_volume" released by "delete_volume" :: held 1.690s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:38:14 devstack sudo[96345]: pam_unix(sudo:session): session closed for user root Sep 06 06:38:14 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-b65bff3a-d68b-4a57-86b2-8edd5e84ce71 tempest-ServersNegativeTestJSON-819510877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.397s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:38:14 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-b65bff3a-d68b-4a57-86b2-8edd5e84ce71 tempest-ServersNegativeTestJSON-819510877 None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:38:14 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-b65bff3a-d68b-4a57-86b2-8edd5e84ce71 tempest-ServersNegativeTestJSON-819510877 None] Deleted volume successfully. Sep 06 06:38:14 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-b65bff3a-d68b-4a57-86b2-8edd5e84ce71 tempest-ServersNegativeTestJSON-819510877 None] Lock "cinder-27234d6f-c693-4a4d-955e-472b41961383-delete_volume" released by "delete_volume" :: held 1.553s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:38:14 devstack sudo[96349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-c2bf113d-2332-41eb-9dc1-edfb656e9a48 Sep 06 06:38:14 devstack sudo[96349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:38:14 devstack sudo[96349]: pam_unix(sudo:session): session closed for user root Sep 06 06:38:14 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-b6d100eb-7bb9-4ee7-acad-baef74296e5f tempest-ServersNegativeTestJSON-819510877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-c2bf113d-2332-41eb-9dc1-edfb656e9a48" returned: 0 in 0.418s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:38:14 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-b6d100eb-7bb9-4ee7-acad-baef74296e5f tempest-ServersNegativeTestJSON-819510877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-c2bf113d-2332-41eb-9dc1-edfb656e9a48 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:38:14 devstack sudo[96355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-c2bf113d-2332-41eb-9dc1-edfb656e9a48 Sep 06 06:38:14 devstack sudo[96355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:38:14 devstack sudo[96355]: pam_unix(sudo:session): session closed for user root Sep 06 06:38:14 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-b6d100eb-7bb9-4ee7-acad-baef74296e5f tempest-ServersNegativeTestJSON-819510877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-c2bf113d-2332-41eb-9dc1-edfb656e9a48" returned: 0 in 0.255s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:38:14 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-b6d100eb-7bb9-4ee7-acad-baef74296e5f tempest-ServersNegativeTestJSON-819510877 None] Lock "cinder-quobyte-c2bf113d-2332-41eb-9dc1-edfb656e9a48" released by "delete_volume" :: held 0.716s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:38:14 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-b6d100eb-7bb9-4ee7-acad-baef74296e5f tempest-ServersNegativeTestJSON-819510877 None] Created reservations ['50cac8c0-310d-4998-a937-0f898c14ea5e', 'aa740db5-4a83-46b1-bd37-b89cb0dc6551', '61bd5c8d-e468-4518-bc35-0a0919ea4d13', '1a8e4b1a-b664-4f57-ac41-777eb63ccc5c'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:38:14 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-b6d100eb-7bb9-4ee7-acad-baef74296e5f tempest-ServersNegativeTestJSON-819510877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:38:14 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-b6d100eb-7bb9-4ee7-acad-baef74296e5f tempest-ServersNegativeTestJSON-819510877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:38:14 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-b6d100eb-7bb9-4ee7-acad-baef74296e5f tempest-ServersNegativeTestJSON-819510877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:38:14 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-b6d100eb-7bb9-4ee7-acad-baef74296e5f tempest-ServersNegativeTestJSON-819510877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:38:14 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-b6d100eb-7bb9-4ee7-acad-baef74296e5f tempest-ServersNegativeTestJSON-819510877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:38:14 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-b6d100eb-7bb9-4ee7-acad-baef74296e5f tempest-ServersNegativeTestJSON-819510877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:38:14 devstack sudo[96358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:38:14 devstack sudo[96358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:38:15 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-d7d62c7f-1102-4f36-b39a-900c608c10d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1630173945 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:38:15 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-d7d62c7f-1102-4f36-b39a-900c608c10d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1630173945 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:38:15 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-d7d62c7f-1102-4f36-b39a-900c608c10d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1630173945 None] Creating offline snapshot cc2feb29-b6f1-44eb-94bd-2129bbbed437 of volume 05d735f8-0c99-4deb-913d-05d37b27d103 {{(pid=87329) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 06 06:38:15 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[58cbf897-b73d-4abb-9d92-bf9f807f9942]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:38:15 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-d7d62c7f-1102-4f36-b39a-900c608c10d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1630173945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-05d735f8-0c99-4deb-913d-05d37b27d103 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:38:15 devstack sudo[96358]: pam_unix(sudo:session): session closed for user root Sep 06 06:38:15 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-b6d100eb-7bb9-4ee7-acad-baef74296e5f tempest-ServersNegativeTestJSON-819510877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.377s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:38:15 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-b6d100eb-7bb9-4ee7-acad-baef74296e5f tempest-ServersNegativeTestJSON-819510877 None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:38:15 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-b6d100eb-7bb9-4ee7-acad-baef74296e5f tempest-ServersNegativeTestJSON-819510877 None] Deleted volume successfully. Sep 06 06:38:15 devstack sudo[96360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-05d735f8-0c99-4deb-913d-05d37b27d103 Sep 06 06:38:15 devstack sudo[96360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:38:15 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-b6d100eb-7bb9-4ee7-acad-baef74296e5f tempest-ServersNegativeTestJSON-819510877 None] Lock "cinder-c2bf113d-2332-41eb-9dc1-edfb656e9a48-delete_volume" released by "delete_volume" :: held 1.407s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:38:15 devstack sudo[96360]: pam_unix(sudo:session): session closed for user root Sep 06 06:38:15 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-d7d62c7f-1102-4f36-b39a-900c608c10d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1630173945 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-05d735f8-0c99-4deb-913d-05d37b27d103" returned: 0 in 0.542s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:38:15 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-d7d62c7f-1102-4f36-b39a-900c608c10d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1630173945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-05d735f8-0c99-4deb-913d-05d37b27d103,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-05d735f8-0c99-4deb-913d-05d37b27d103.cc2feb29-b6f1-44eb-94bd-2129bbbed437 1G {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:38:15 devstack sudo[96370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-05d735f8-0c99-4deb-913d-05d37b27d103,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-05d735f8-0c99-4deb-913d-05d37b27d103.cc2feb29-b6f1-44eb-94bd-2129bbbed437 1G Sep 06 06:38:15 devstack sudo[96370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:38:16 devstack sudo[96370]: pam_unix(sudo:session): session closed for user root Sep 06 06:38:16 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-d7d62c7f-1102-4f36-b39a-900c608c10d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1630173945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-05d735f8-0c99-4deb-913d-05d37b27d103,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-05d735f8-0c99-4deb-913d-05d37b27d103.cc2feb29-b6f1-44eb-94bd-2129bbbed437 1G" returned: 0 in 0.850s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:38:16 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-d7d62c7f-1102-4f36-b39a-900c608c10d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1630173945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05d735f8-0c99-4deb-913d-05d37b27d103 -F qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-05d735f8-0c99-4deb-913d-05d37b27d103.cc2feb29-b6f1-44eb-94bd-2129bbbed437 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:38:16 devstack sudo[96412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05d735f8-0c99-4deb-913d-05d37b27d103 -F qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-05d735f8-0c99-4deb-913d-05d37b27d103.cc2feb29-b6f1-44eb-94bd-2129bbbed437 Sep 06 06:38:16 devstack sudo[96412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:38:17 devstack sudo[96412]: pam_unix(sudo:session): session closed for user root Sep 06 06:38:17 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-d7d62c7f-1102-4f36-b39a-900c608c10d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1630173945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05d735f8-0c99-4deb-913d-05d37b27d103 -F qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-05d735f8-0c99-4deb-913d-05d37b27d103.cc2feb29-b6f1-44eb-94bd-2129bbbed437" returned: 0 in 0.444s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:38:17 devstack cinder-volume[87329]: WARNING cinder.volume.drivers.remotefs [None req-d7d62c7f-1102-4f36-b39a-900c608c10d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1630173945 None] /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-05d735f8-0c99-4deb-913d-05d37b27d103.cc2feb29-b6f1-44eb-94bd-2129bbbed437 is being set with open permissions: ugo+rw Sep 06 06:38:17 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-d7d62c7f-1102-4f36-b39a-900c608c10d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1630173945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-05d735f8-0c99-4deb-913d-05d37b27d103.cc2feb29-b6f1-44eb-94bd-2129bbbed437 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:38:17 devstack sudo[96418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-05d735f8-0c99-4deb-913d-05d37b27d103.cc2feb29-b6f1-44eb-94bd-2129bbbed437 Sep 06 06:38:17 devstack sudo[96418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:38:17 devstack sudo[96418]: pam_unix(sudo:session): session closed for user root Sep 06 06:38:17 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-d7d62c7f-1102-4f36-b39a-900c608c10d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1630173945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-05d735f8-0c99-4deb-913d-05d37b27d103.cc2feb29-b6f1-44eb-94bd-2129bbbed437" returned: 0 in 0.503s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:38:17 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-d7d62c7f-1102-4f36-b39a-900c608c10d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1630173945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-05d735f8-0c99-4deb-913d-05d37b27d103.info {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:38:17 devstack sudo[96426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-05d735f8-0c99-4deb-913d-05d37b27d103.info Sep 06 06:38:17 devstack sudo[96426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:38:17 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [req-b7fbb915-06cc-4a25-8181-3565a1a2ede5 req-54dbb1f5-138c-4500-a516-9e048fd8c8fb tempest-TestInstancesWithCinderVolumes-102430806 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:38:17 devstack sudo[96426]: pam_unix(sudo:session): session closed for user root Sep 06 06:38:17 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-d7d62c7f-1102-4f36-b39a-900c608c10d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1630173945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-05d735f8-0c99-4deb-913d-05d37b27d103.info" returned: 0 in 0.345s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:38:17 devstack cinder-volume[87329]: WARNING cinder.volume.drivers.remotefs [None req-d7d62c7f-1102-4f36-b39a-900c608c10d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1630173945 None] /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-05d735f8-0c99-4deb-913d-05d37b27d103.info is being set with open permissions: ugo+rw Sep 06 06:38:17 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-d7d62c7f-1102-4f36-b39a-900c608c10d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1630173945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-05d735f8-0c99-4deb-913d-05d37b27d103.info {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:38:18 devstack sudo[96435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-05d735f8-0c99-4deb-913d-05d37b27d103.info Sep 06 06:38:18 devstack sudo[96435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:38:18 devstack sudo[96435]: pam_unix(sudo:session): session closed for user root Sep 06 06:38:18 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-d7d62c7f-1102-4f36-b39a-900c608c10d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1630173945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-05d735f8-0c99-4deb-913d-05d37b27d103.info" returned: 0 in 0.267s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:38:18 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-d7d62c7f-1102-4f36-b39a-900c608c10d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1630173945 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.134s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:38:18 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [req-b7fbb915-06cc-4a25-8181-3565a1a2ede5 req-54dbb1f5-138c-4500-a516-9e048fd8c8fb tempest-TestInstancesWithCinderVolumes-102430806 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.355s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:38:18 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [req-b7fbb915-06cc-4a25-8181-3565a1a2ede5 req-54dbb1f5-138c-4500-a516-9e048fd8c8fb tempest-TestInstancesWithCinderVolumes-102430806 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.024s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:38:18 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-d7d62c7f-1102-4f36-b39a-900c608c10d5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1630173945 None] Create snapshot completed successfully Sep 06 06:38:18 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [req-b7fbb915-06cc-4a25-8181-3565a1a2ede5 req-54dbb1f5-138c-4500-a516-9e048fd8c8fb tempest-TestInstancesWithCinderVolumes-102430806 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6', 'name': 'volume-3880ea2c-60dc-4cb0-9186-8c98cad13ab1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2b269f55-74b9-401d-8822-23b503c3c028', 'enforce_multipath': True} {{(pid=87329) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 06 06:38:18 devstack cinder-volume[87329]: INFO cinder.volume.manager [req-b7fbb915-06cc-4a25-8181-3565a1a2ede5 req-54dbb1f5-138c-4500-a516-9e048fd8c8fb tempest-TestInstancesWithCinderVolumes-102430806 None] attachment_update completed successfully. Sep 06 06:38:19 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-639e8a05-299f-4322-be5f-60d72c67c63e tempest-VolumeSnapshotQuotasNegativeTestJSON-1630173945 None] Acquiring lock "cinder-cc2feb29-b6f1-44eb-94bd-2129bbbed437-delete_snapshot" by "delete_snapshot" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:38:20 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-639e8a05-299f-4322-be5f-60d72c67c63e tempest-VolumeSnapshotQuotasNegativeTestJSON-1630173945 None] Lock "cinder-cc2feb29-b6f1-44eb-94bd-2129bbbed437-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:38:20 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-639e8a05-299f-4322-be5f-60d72c67c63e tempest-VolumeSnapshotQuotasNegativeTestJSON-1630173945 None] Acquiring lock "cinder-quobyte-05d735f8-0c99-4deb-913d-05d37b27d103" by "delete_snapshot" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:38:20 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-639e8a05-299f-4322-be5f-60d72c67c63e tempest-VolumeSnapshotQuotasNegativeTestJSON-1630173945 None] Lock "cinder-quobyte-05d735f8-0c99-4deb-913d-05d37b27d103" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:38:20 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-639e8a05-299f-4322-be5f-60d72c67c63e tempest-VolumeSnapshotQuotasNegativeTestJSON-1630173945 None] Acquiring lock "cinder-quobyte-cc2feb29-b6f1-44eb-94bd-2129bbbed437" by "_delete_snapshot" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:38:20 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-639e8a05-299f-4322-be5f-60d72c67c63e tempest-VolumeSnapshotQuotasNegativeTestJSON-1630173945 None] Lock "cinder-quobyte-cc2feb29-b6f1-44eb-94bd-2129bbbed437" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:38:20 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-639e8a05-299f-4322-be5f-60d72c67c63e tempest-VolumeSnapshotQuotasNegativeTestJSON-1630173945 None] Deleting offline snapshot cc2feb29-b6f1-44eb-94bd-2129bbbed437 of volume 05d735f8-0c99-4deb-913d-05d37b27d103 {{(pid=87329) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 06 06:38:20 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-639e8a05-299f-4322-be5f-60d72c67c63e tempest-VolumeSnapshotQuotasNegativeTestJSON-1630173945 None] snapshot_file for this snap is: volume-05d735f8-0c99-4deb-913d-05d37b27d103.cc2feb29-b6f1-44eb-94bd-2129bbbed437 {{(pid=87329) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 06 06:38:20 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[3653cb87-c0db-4549-acbb-77768068e3ca]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:38:20 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-639e8a05-299f-4322-be5f-60d72c67c63e tempest-VolumeSnapshotQuotasNegativeTestJSON-1630173945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-05d735f8-0c99-4deb-913d-05d37b27d103.cc2feb29-b6f1-44eb-94bd-2129bbbed437 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:38:20 devstack sudo[96447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-05d735f8-0c99-4deb-913d-05d37b27d103.cc2feb29-b6f1-44eb-94bd-2129bbbed437 Sep 06 06:38:20 devstack sudo[96447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:38:20 devstack sudo[96447]: pam_unix(sudo:session): session closed for user root Sep 06 06:38:20 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-639e8a05-299f-4322-be5f-60d72c67c63e tempest-VolumeSnapshotQuotasNegativeTestJSON-1630173945 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-05d735f8-0c99-4deb-913d-05d37b27d103.cc2feb29-b6f1-44eb-94bd-2129bbbed437" returned: 0 in 0.435s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:38:20 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-639e8a05-299f-4322-be5f-60d72c67c63e tempest-VolumeSnapshotQuotasNegativeTestJSON-1630173945 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-05d735f8-0c99-4deb-913d-05d37b27d103(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87329) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 06:38:20 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[18c6a05a-5593-4d87-b076-bc3d6925bf0e]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:38:20 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-639e8a05-299f-4322-be5f-60d72c67c63e tempest-VolumeSnapshotQuotasNegativeTestJSON-1630173945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-05d735f8-0c99-4deb-913d-05d37b27d103 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:38:20 devstack sudo[96457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-05d735f8-0c99-4deb-913d-05d37b27d103 Sep 06 06:38:20 devstack sudo[96457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:38:21 devstack sudo[96457]: pam_unix(sudo:session): session closed for user root Sep 06 06:38:21 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-639e8a05-299f-4322-be5f-60d72c67c63e tempest-VolumeSnapshotQuotasNegativeTestJSON-1630173945 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-05d735f8-0c99-4deb-913d-05d37b27d103" returned: 0 in 0.539s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:38:21 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-639e8a05-299f-4322-be5f-60d72c67c63e tempest-VolumeSnapshotQuotasNegativeTestJSON-1630173945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-05d735f8-0c99-4deb-913d-05d37b27d103.cc2feb29-b6f1-44eb-94bd-2129bbbed437 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:38:21 devstack sudo[96463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-05d735f8-0c99-4deb-913d-05d37b27d103.cc2feb29-b6f1-44eb-94bd-2129bbbed437 Sep 06 06:38:21 devstack sudo[96463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:38:21 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [req-d2fc77f3-896e-4535-8aad-957fe2d621c8 req-b929e93b-b5e6-4b00-8aa6-3f57d3b22d0d tempest-TestInstancesWithCinderVolumes-102430806 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:38:21 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [req-d2fc77f3-896e-4535-8aad-957fe2d621c8 req-b929e93b-b5e6-4b00-8aa6-3f57d3b22d0d tempest-TestInstancesWithCinderVolumes-102430806 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:38:21 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [req-d2fc77f3-896e-4535-8aad-957fe2d621c8 req-b929e93b-b5e6-4b00-8aa6-3f57d3b22d0d tempest-TestInstancesWithCinderVolumes-102430806 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:38:21 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [req-d2fc77f3-896e-4535-8aad-957fe2d621c8 req-b929e93b-b5e6-4b00-8aa6-3f57d3b22d0d tempest-TestInstancesWithCinderVolumes-102430806 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6', 'name': 'volume-1efe1c77-2770-4e7d-8293-625d554592a8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8a3fbb25-35cc-4815-b1db-651114443700', 'enforce_multipath': True} {{(pid=87329) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 06 06:38:21 devstack sudo[96463]: pam_unix(sudo:session): session closed for user root Sep 06 06:38:21 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-639e8a05-299f-4322-be5f-60d72c67c63e tempest-VolumeSnapshotQuotasNegativeTestJSON-1630173945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-05d735f8-0c99-4deb-913d-05d37b27d103.cc2feb29-b6f1-44eb-94bd-2129bbbed437" returned: 0 in 0.462s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:38:21 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-639e8a05-299f-4322-be5f-60d72c67c63e tempest-VolumeSnapshotQuotasNegativeTestJSON-1630173945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-05d735f8-0c99-4deb-913d-05d37b27d103.cc2feb29-b6f1-44eb-94bd-2129bbbed437 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:38:21 devstack cinder-volume[87329]: INFO cinder.volume.manager [req-d2fc77f3-896e-4535-8aad-957fe2d621c8 req-b929e93b-b5e6-4b00-8aa6-3f57d3b22d0d tempest-TestInstancesWithCinderVolumes-102430806 None] attachment_update completed successfully. Sep 06 06:38:21 devstack sudo[96476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-05d735f8-0c99-4deb-913d-05d37b27d103.cc2feb29-b6f1-44eb-94bd-2129bbbed437 Sep 06 06:38:21 devstack sudo[96476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:38:21 devstack sudo[96476]: pam_unix(sudo:session): session closed for user root Sep 06 06:38:21 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-639e8a05-299f-4322-be5f-60d72c67c63e tempest-VolumeSnapshotQuotasNegativeTestJSON-1630173945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-05d735f8-0c99-4deb-913d-05d37b27d103.cc2feb29-b6f1-44eb-94bd-2129bbbed437" returned: 0 in 0.308s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:38:21 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-639e8a05-299f-4322-be5f-60d72c67c63e tempest-VolumeSnapshotQuotasNegativeTestJSON-1630173945 None] Lock "cinder-quobyte-cc2feb29-b6f1-44eb-94bd-2129bbbed437" released by "_delete_snapshot" :: held 1.923s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:38:21 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-639e8a05-299f-4322-be5f-60d72c67c63e tempest-VolumeSnapshotQuotasNegativeTestJSON-1630173945 None] Lock "cinder-quobyte-05d735f8-0c99-4deb-913d-05d37b27d103" released by "delete_snapshot" :: held 1.963s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:38:22 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-639e8a05-299f-4322-be5f-60d72c67c63e tempest-VolumeSnapshotQuotasNegativeTestJSON-1630173945 None] Created reservations ['2c11fcc4-a74d-4634-be98-e72b63d3883e', 'feff50e7-44cc-426a-9515-5f9e714cd152', '2c420aa2-7727-4c42-961d-a9d6b8a85a1a', 'dfd934f0-71e5-499d-b76f-36da179aab5f'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:38:22 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-639e8a05-299f-4322-be5f-60d72c67c63e tempest-VolumeSnapshotQuotasNegativeTestJSON-1630173945 None] Delete snapshot completed successfully. Sep 06 06:38:22 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-639e8a05-299f-4322-be5f-60d72c67c63e tempest-VolumeSnapshotQuotasNegativeTestJSON-1630173945 None] Lock "cinder-cc2feb29-b6f1-44eb-94bd-2129bbbed437-delete_snapshot" released by "delete_snapshot" :: held 2.193s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:38:23 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-ea36f3a5-f911-4522-9981-9bbe1a039000 tempest-VolumeSnapshotQuotasNegativeTestJSON-1630173945 None] Acquiring lock "cinder-05d735f8-0c99-4deb-913d-05d37b27d103-delete_volume" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:38:23 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-ea36f3a5-f911-4522-9981-9bbe1a039000 tempest-VolumeSnapshotQuotasNegativeTestJSON-1630173945 None] Lock "cinder-05d735f8-0c99-4deb-913d-05d37b27d103-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:38:23 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-ea36f3a5-f911-4522-9981-9bbe1a039000 tempest-VolumeSnapshotQuotasNegativeTestJSON-1630173945 None] Acquiring lock "cinder-quobyte-05d735f8-0c99-4deb-913d-05d37b27d103" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:38:23 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-ea36f3a5-f911-4522-9981-9bbe1a039000 tempest-VolumeSnapshotQuotasNegativeTestJSON-1630173945 None] Lock "cinder-quobyte-05d735f8-0c99-4deb-913d-05d37b27d103" acquired by "delete_volume" :: waited 0.022s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:38:23 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1657c8b-c2fe-4056-b05b-3140f39e5c3f]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:38:23 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-ea36f3a5-f911-4522-9981-9bbe1a039000 tempest-VolumeSnapshotQuotasNegativeTestJSON-1630173945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-05d735f8-0c99-4deb-913d-05d37b27d103 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:38:23 devstack sudo[96483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-05d735f8-0c99-4deb-913d-05d37b27d103 Sep 06 06:38:23 devstack sudo[96483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:38:23 devstack sudo[96483]: pam_unix(sudo:session): session closed for user root Sep 06 06:38:23 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-ea36f3a5-f911-4522-9981-9bbe1a039000 tempest-VolumeSnapshotQuotasNegativeTestJSON-1630173945 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-05d735f8-0c99-4deb-913d-05d37b27d103" returned: 0 in 0.454s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:38:23 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-ea36f3a5-f911-4522-9981-9bbe1a039000 tempest-VolumeSnapshotQuotasNegativeTestJSON-1630173945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-05d735f8-0c99-4deb-913d-05d37b27d103 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:38:23 devstack sudo[96495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-05d735f8-0c99-4deb-913d-05d37b27d103 Sep 06 06:38:23 devstack sudo[96495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:38:24 devstack sudo[96495]: pam_unix(sudo:session): session closed for user root Sep 06 06:38:24 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-ea36f3a5-f911-4522-9981-9bbe1a039000 tempest-VolumeSnapshotQuotasNegativeTestJSON-1630173945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-05d735f8-0c99-4deb-913d-05d37b27d103" returned: 0 in 0.366s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:38:24 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-ea36f3a5-f911-4522-9981-9bbe1a039000 tempest-VolumeSnapshotQuotasNegativeTestJSON-1630173945 None] Lock "cinder-quobyte-05d735f8-0c99-4deb-913d-05d37b27d103" released by "delete_volume" :: held 0.904s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:38:24 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-ea36f3a5-f911-4522-9981-9bbe1a039000 tempest-VolumeSnapshotQuotasNegativeTestJSON-1630173945 None] Created reservations ['18584626-0450-4ac5-bf59-6e7ddb3f0d67', '75c9d5d5-2cb4-4b14-a352-789e8b9d6199', 'c72a25db-f036-4ab6-9706-3938ea19b163', '3f37aed9-99ee-4fa4-8c4f-0a13ce266bcb'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:38:24 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c295cf8-997c-4121-ba48-70c7d6fc9ae0 tempest-VolumesListTestJSON-1176125850 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87329) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 06:38:24 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-9c295cf8-997c-4121-ba48-70c7d6fc9ae0 tempest-VolumesListTestJSON-1176125850 None] Flow 'volume_create_manager' (7570d94a-07e8-47ae-ab42-be8afb94deda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:38:24 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-9c295cf8-997c-4121-ba48-70c7d6fc9ae0 tempest-VolumesListTestJSON-1176125850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (071ecff7-7595-4bba-aa29-e06539de1652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:38:24 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-9c295cf8-997c-4121-ba48-70c7d6fc9ae0 tempest-VolumesListTestJSON-1176125850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (071ecff7-7595-4bba-aa29-e06539de1652) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:38:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1519273448',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=070f529d-d582-4625-9821-cb5e4aadc223,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c1713e6b3cec41f7906ad1add383f1b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:38:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:38:24Z,use_quota=True,user_id='84484d812fff43608501343ee38bfa38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:38:24 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-9c295cf8-997c-4121-ba48-70c7d6fc9ae0 tempest-VolumesListTestJSON-1176125850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef3a0ecd-b9cf-4598-b9e7-dc3755585459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:38:24 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-9c295cf8-997c-4121-ba48-70c7d6fc9ae0 tempest-VolumesListTestJSON-1176125850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef3a0ecd-b9cf-4598-b9e7-dc3755585459) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:38:24 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-9c295cf8-997c-4121-ba48-70c7d6fc9ae0 tempest-VolumesListTestJSON-1176125850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3b7414d-b766-442b-9e59-b9c349c3d50d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:38:24 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-9c295cf8-997c-4121-ba48-70c7d6fc9ae0 tempest-VolumesListTestJSON-1176125850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3b7414d-b766-442b-9e59-b9c349c3d50d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '070f529d-d582-4625-9821-cb5e4aadc223', 'volume_name': 'volume-070f529d-d582-4625-9821-cb5e4aadc223', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:38:24 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-9c295cf8-997c-4121-ba48-70c7d6fc9ae0 tempest-VolumesListTestJSON-1176125850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a350f65-5319-465b-bdd5-fe7d889e2ad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:38:24 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-9c295cf8-997c-4121-ba48-70c7d6fc9ae0 tempest-VolumesListTestJSON-1176125850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a350f65-5319-465b-bdd5-fe7d889e2ad8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:38:24 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-9c295cf8-997c-4121-ba48-70c7d6fc9ae0 tempest-VolumesListTestJSON-1176125850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f81cbdf-b4e6-45be-9e9c-04203661968e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:38:24 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-9c295cf8-997c-4121-ba48-70c7d6fc9ae0 tempest-VolumesListTestJSON-1176125850 None] Volume 070f529d-d582-4625-9821-cb5e4aadc223: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-070f529d-d582-4625-9821-cb5e4aadc223', 'volume_size': 1} Sep 06 06:38:24 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-9c295cf8-997c-4121-ba48-70c7d6fc9ae0 tempest-VolumesListTestJSON-1176125850 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:38:24 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-9c295cf8-997c-4121-ba48-70c7d6fc9ae0 tempest-VolumesListTestJSON-1176125850 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:38:24 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-9c295cf8-997c-4121-ba48-70c7d6fc9ae0 tempest-VolumesListTestJSON-1176125850 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:38:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1519273448',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=070f529d-d582-4625-9821-cb5e4aadc223,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c1713e6b3cec41f7906ad1add383f1b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:38:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:38:24Z,use_quota=True,user_id='84484d812fff43608501343ee38bfa38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)}" {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 06:38:24 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-9c295cf8-997c-4121-ba48-70c7d6fc9ae0 tempest-VolumesListTestJSON-1176125850 None] Creating volume 070f529d-d582-4625-9821-cb5e4aadc223 {{(pid=87329) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 06:38:24 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-9c295cf8-997c-4121-ba48-70c7d6fc9ae0 tempest-VolumesListTestJSON-1176125850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:38:24 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-9c295cf8-997c-4121-ba48-70c7d6fc9ae0 tempest-VolumesListTestJSON-1176125850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:38:24 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-9c295cf8-997c-4121-ba48-70c7d6fc9ae0 tempest-VolumesListTestJSON-1176125850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:38:24 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-9c295cf8-997c-4121-ba48-70c7d6fc9ae0 tempest-VolumesListTestJSON-1176125850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:38:24 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-9c295cf8-997c-4121-ba48-70c7d6fc9ae0 tempest-VolumesListTestJSON-1176125850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:38:24 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-9c295cf8-997c-4121-ba48-70c7d6fc9ae0 tempest-VolumesListTestJSON-1176125850 None] Selected osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 as target Quobyte volume. {{(pid=87329) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 06:38:24 devstack cinder-volume[87329]: INFO cinder.volume.drivers.remotefs [None req-9c295cf8-997c-4121-ba48-70c7d6fc9ae0 tempest-VolumesListTestJSON-1176125850 None] casted to osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 Sep 06 06:38:24 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-9c295cf8-997c-4121-ba48-70c7d6fc9ae0 tempest-VolumesListTestJSON-1176125850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-070f529d-d582-4625-9821-cb5e4aadc223 1073741824 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:38:24 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-ea36f3a5-f911-4522-9981-9bbe1a039000 tempest-VolumeSnapshotQuotasNegativeTestJSON-1630173945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:38:24 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-ea36f3a5-f911-4522-9981-9bbe1a039000 tempest-VolumeSnapshotQuotasNegativeTestJSON-1630173945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:38:24 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-ea36f3a5-f911-4522-9981-9bbe1a039000 tempest-VolumeSnapshotQuotasNegativeTestJSON-1630173945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:38:24 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-ea36f3a5-f911-4522-9981-9bbe1a039000 tempest-VolumeSnapshotQuotasNegativeTestJSON-1630173945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:38:24 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-ea36f3a5-f911-4522-9981-9bbe1a039000 tempest-VolumeSnapshotQuotasNegativeTestJSON-1630173945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:38:24 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-ea36f3a5-f911-4522-9981-9bbe1a039000 tempest-VolumeSnapshotQuotasNegativeTestJSON-1630173945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:38:24 devstack sudo[96499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-070f529d-d582-4625-9821-cb5e4aadc223 1073741824 Sep 06 06:38:24 devstack sudo[96499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:38:24 devstack sudo[96500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:38:24 devstack sudo[96500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:38:24 devstack sudo[96500]: pam_unix(sudo:session): session closed for user root Sep 06 06:38:24 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-ea36f3a5-f911-4522-9981-9bbe1a039000 tempest-VolumeSnapshotQuotasNegativeTestJSON-1630173945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.323s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:38:24 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-ea36f3a5-f911-4522-9981-9bbe1a039000 tempest-VolumeSnapshotQuotasNegativeTestJSON-1630173945 None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:38:24 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-ea36f3a5-f911-4522-9981-9bbe1a039000 tempest-VolumeSnapshotQuotasNegativeTestJSON-1630173945 None] Deleted volume successfully. Sep 06 06:38:25 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-ea36f3a5-f911-4522-9981-9bbe1a039000 tempest-VolumeSnapshotQuotasNegativeTestJSON-1630173945 None] Lock "cinder-05d735f8-0c99-4deb-913d-05d37b27d103-delete_volume" released by "delete_volume" :: held 1.669s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:38:25 devstack sudo[96499]: pam_unix(sudo:session): session closed for user root Sep 06 06:38:25 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-9c295cf8-997c-4121-ba48-70c7d6fc9ae0 tempest-VolumesListTestJSON-1176125850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-070f529d-d582-4625-9821-cb5e4aadc223 1073741824" returned: 0 in 0.600s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:38:25 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-9c295cf8-997c-4121-ba48-70c7d6fc9ae0 tempest-VolumesListTestJSON-1176125850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-070f529d-d582-4625-9821-cb5e4aadc223 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:38:25 devstack sudo[96509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-070f529d-d582-4625-9821-cb5e4aadc223 Sep 06 06:38:25 devstack sudo[96509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:38:25 devstack sudo[96509]: pam_unix(sudo:session): session closed for user root Sep 06 06:38:25 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-9c295cf8-997c-4121-ba48-70c7d6fc9ae0 tempest-VolumesListTestJSON-1176125850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-070f529d-d582-4625-9821-cb5e4aadc223" returned: 0 in 0.371s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:38:25 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-9c295cf8-997c-4121-ba48-70c7d6fc9ae0 tempest-VolumesListTestJSON-1176125850 None] <== create_volume: return (1031ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'} {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 06:38:25 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-9c295cf8-997c-4121-ba48-70c7d6fc9ae0 tempest-VolumesListTestJSON-1176125850 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.033s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:38:25 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-9c295cf8-997c-4121-ba48-70c7d6fc9ae0 tempest-VolumesListTestJSON-1176125850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f81cbdf-b4e6-45be-9e9c-04203661968e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-070f529d-d582-4625-9821-cb5e4aadc223', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:38:25 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-9c295cf8-997c-4121-ba48-70c7d6fc9ae0 tempest-VolumesListTestJSON-1176125850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e812c3d6-2335-4fc4-918a-9be23c5be200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:38:25 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-9c295cf8-997c-4121-ba48-70c7d6fc9ae0 tempest-VolumesListTestJSON-1176125850 None] Volume volume-070f529d-d582-4625-9821-cb5e4aadc223 (070f529d-d582-4625-9821-cb5e4aadc223): created successfully Sep 06 06:38:25 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-9c295cf8-997c-4121-ba48-70c7d6fc9ae0 tempest-VolumesListTestJSON-1176125850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e812c3d6-2335-4fc4-918a-9be23c5be200) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:38:25 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-9c295cf8-997c-4121-ba48-70c7d6fc9ae0 tempest-VolumesListTestJSON-1176125850 None] Flow 'volume_create_manager' (7570d94a-07e8-47ae-ab42-be8afb94deda) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:38:25 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-9c295cf8-997c-4121-ba48-70c7d6fc9ae0 tempest-VolumesListTestJSON-1176125850 None] Created volume successfully. Sep 06 06:38:27 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-b005167d-779f-4474-954f-bad80a13cd5d tempest-VolumesListTestJSON-1176125850 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87329) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 06:38:27 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-b005167d-779f-4474-954f-bad80a13cd5d tempest-VolumesListTestJSON-1176125850 None] Flow 'volume_create_manager' (3a6a6149-642c-4a54-b20c-966364238e46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:38:27 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-b005167d-779f-4474-954f-bad80a13cd5d tempest-VolumesListTestJSON-1176125850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (492e2435-34b6-4e28-b14b-d0fa37c712f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:38:27 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-b005167d-779f-4474-954f-bad80a13cd5d tempest-VolumesListTestJSON-1176125850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (492e2435-34b6-4e28-b14b-d0fa37c712f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:38:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1940968541',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3b138aa-dd41-4839-a412-ff968aacde18,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c1713e6b3cec41f7906ad1add383f1b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:38:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:38:27Z,use_quota=True,user_id='84484d812fff43608501343ee38bfa38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:38:27 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-b005167d-779f-4474-954f-bad80a13cd5d tempest-VolumesListTestJSON-1176125850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46f8c22e-3ec8-42b2-b7a3-bafc37bb0d26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:38:27 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-b005167d-779f-4474-954f-bad80a13cd5d tempest-VolumesListTestJSON-1176125850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46f8c22e-3ec8-42b2-b7a3-bafc37bb0d26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:38:27 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-b005167d-779f-4474-954f-bad80a13cd5d tempest-VolumesListTestJSON-1176125850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2ccc8b6-ad49-4205-8c64-17866652e5ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:38:27 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-b005167d-779f-4474-954f-bad80a13cd5d tempest-VolumesListTestJSON-1176125850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2ccc8b6-ad49-4205-8c64-17866652e5ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3b138aa-dd41-4839-a412-ff968aacde18', 'volume_name': 'volume-e3b138aa-dd41-4839-a412-ff968aacde18', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:38:27 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-b005167d-779f-4474-954f-bad80a13cd5d tempest-VolumesListTestJSON-1176125850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e3e0bc5-de88-4804-8bba-c511ba47eec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:38:27 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-b005167d-779f-4474-954f-bad80a13cd5d tempest-VolumesListTestJSON-1176125850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e3e0bc5-de88-4804-8bba-c511ba47eec2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:38:27 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-b005167d-779f-4474-954f-bad80a13cd5d tempest-VolumesListTestJSON-1176125850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33da2d29-0536-4f96-a542-8506080afb3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:38:27 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-b005167d-779f-4474-954f-bad80a13cd5d tempest-VolumesListTestJSON-1176125850 None] Volume e3b138aa-dd41-4839-a412-ff968aacde18: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3b138aa-dd41-4839-a412-ff968aacde18', 'volume_size': 1} Sep 06 06:38:27 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-b005167d-779f-4474-954f-bad80a13cd5d tempest-VolumesListTestJSON-1176125850 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:38:27 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-b005167d-779f-4474-954f-bad80a13cd5d tempest-VolumesListTestJSON-1176125850 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:38:27 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-b005167d-779f-4474-954f-bad80a13cd5d tempest-VolumesListTestJSON-1176125850 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:38:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1940968541',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3b138aa-dd41-4839-a412-ff968aacde18,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c1713e6b3cec41f7906ad1add383f1b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:38:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:38:27Z,use_quota=True,user_id='84484d812fff43608501343ee38bfa38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)}" {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 06:38:27 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-b005167d-779f-4474-954f-bad80a13cd5d tempest-VolumesListTestJSON-1176125850 None] Creating volume e3b138aa-dd41-4839-a412-ff968aacde18 {{(pid=87329) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 06:38:27 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-b005167d-779f-4474-954f-bad80a13cd5d tempest-VolumesListTestJSON-1176125850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:38:27 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-b005167d-779f-4474-954f-bad80a13cd5d tempest-VolumesListTestJSON-1176125850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:38:27 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-b005167d-779f-4474-954f-bad80a13cd5d tempest-VolumesListTestJSON-1176125850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:38:27 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-b005167d-779f-4474-954f-bad80a13cd5d tempest-VolumesListTestJSON-1176125850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:38:27 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-b005167d-779f-4474-954f-bad80a13cd5d tempest-VolumesListTestJSON-1176125850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:38:27 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-b005167d-779f-4474-954f-bad80a13cd5d tempest-VolumesListTestJSON-1176125850 None] Selected osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 as target Quobyte volume. {{(pid=87329) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 06:38:27 devstack cinder-volume[87329]: INFO cinder.volume.drivers.remotefs [None req-b005167d-779f-4474-954f-bad80a13cd5d tempest-VolumesListTestJSON-1176125850 None] casted to osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 Sep 06 06:38:27 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-b005167d-779f-4474-954f-bad80a13cd5d tempest-VolumesListTestJSON-1176125850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e3b138aa-dd41-4839-a412-ff968aacde18 1073741824 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:38:27 devstack sudo[96534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e3b138aa-dd41-4839-a412-ff968aacde18 1073741824 Sep 06 06:38:27 devstack sudo[96534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:38:28 devstack sudo[96534]: pam_unix(sudo:session): session closed for user root Sep 06 06:38:28 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-b005167d-779f-4474-954f-bad80a13cd5d tempest-VolumesListTestJSON-1176125850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e3b138aa-dd41-4839-a412-ff968aacde18 1073741824" returned: 0 in 0.599s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:38:28 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-b005167d-779f-4474-954f-bad80a13cd5d tempest-VolumesListTestJSON-1176125850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e3b138aa-dd41-4839-a412-ff968aacde18 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:38:28 devstack sudo[96542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e3b138aa-dd41-4839-a412-ff968aacde18 Sep 06 06:38:28 devstack sudo[96542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:38:28 devstack cinder-volume[87329]: INFO cinder.volume.manager [req-50e2ef7a-41a3-4b9f-97eb-820693e5d3ca req-74693ea1-ea60-48ee-83fd-140c86c4578c tempest-TestInstancesWithCinderVolumes-102430806 None] Terminate volume connection completed successfully. Sep 06 06:38:28 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [req-50e2ef7a-41a3-4b9f-97eb-820693e5d3ca req-74693ea1-ea60-48ee-83fd-140c86c4578c tempest-TestInstancesWithCinderVolumes-102430806 None] Deleting attachment 2b269f55-74b9-401d-8822-23b503c3c028. {{(pid=87329) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 06 06:38:28 devstack sudo[96542]: pam_unix(sudo:session): session closed for user root Sep 06 06:38:28 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-b005167d-779f-4474-954f-bad80a13cd5d tempest-VolumesListTestJSON-1176125850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e3b138aa-dd41-4839-a412-ff968aacde18" returned: 0 in 0.361s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:38:28 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-b005167d-779f-4474-954f-bad80a13cd5d tempest-VolumesListTestJSON-1176125850 None] <== create_volume: return (1022ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'} {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 06:38:28 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-b005167d-779f-4474-954f-bad80a13cd5d tempest-VolumesListTestJSON-1176125850 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.026s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:38:28 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-b005167d-779f-4474-954f-bad80a13cd5d tempest-VolumesListTestJSON-1176125850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33da2d29-0536-4f96-a542-8506080afb3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3b138aa-dd41-4839-a412-ff968aacde18', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:38:28 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-b005167d-779f-4474-954f-bad80a13cd5d tempest-VolumesListTestJSON-1176125850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eebfb879-0013-4bd0-b82f-adfd83cfdefe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:38:28 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-b005167d-779f-4474-954f-bad80a13cd5d tempest-VolumesListTestJSON-1176125850 None] Volume volume-e3b138aa-dd41-4839-a412-ff968aacde18 (e3b138aa-dd41-4839-a412-ff968aacde18): created successfully Sep 06 06:38:28 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-b005167d-779f-4474-954f-bad80a13cd5d tempest-VolumesListTestJSON-1176125850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eebfb879-0013-4bd0-b82f-adfd83cfdefe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:38:28 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-b005167d-779f-4474-954f-bad80a13cd5d tempest-VolumesListTestJSON-1176125850 None] Flow 'volume_create_manager' (3a6a6149-642c-4a54-b20c-966364238e46) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:38:28 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-b005167d-779f-4474-954f-bad80a13cd5d tempest-VolumesListTestJSON-1176125850 None] Created volume successfully. Sep 06 06:38:28 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-0944414a-9e48-4bc0-b10d-ffb69c6bb900 tempest-TestInstancesWithCinderVolumes-102430806 None] Acquiring lock "cinder-3880ea2c-60dc-4cb0-9186-8c98cad13ab1-delete_volume" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:38:28 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-0944414a-9e48-4bc0-b10d-ffb69c6bb900 tempest-TestInstancesWithCinderVolumes-102430806 None] Lock "cinder-3880ea2c-60dc-4cb0-9186-8c98cad13ab1-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:38:28 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-0944414a-9e48-4bc0-b10d-ffb69c6bb900 tempest-TestInstancesWithCinderVolumes-102430806 None] Acquiring lock "cinder-quobyte-3880ea2c-60dc-4cb0-9186-8c98cad13ab1" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:38:28 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-0944414a-9e48-4bc0-b10d-ffb69c6bb900 tempest-TestInstancesWithCinderVolumes-102430806 None] Lock "cinder-quobyte-3880ea2c-60dc-4cb0-9186-8c98cad13ab1" acquired by "delete_volume" :: waited 0.025s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:38:28 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[614ed3b8-49ba-4e62-934f-3964a39587a8]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:38:28 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-0944414a-9e48-4bc0-b10d-ffb69c6bb900 tempest-TestInstancesWithCinderVolumes-102430806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-3880ea2c-60dc-4cb0-9186-8c98cad13ab1 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:38:29 devstack sudo[96549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-3880ea2c-60dc-4cb0-9186-8c98cad13ab1 Sep 06 06:38:29 devstack sudo[96549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:38:29 devstack sudo[96549]: pam_unix(sudo:session): session closed for user root Sep 06 06:38:29 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-0944414a-9e48-4bc0-b10d-ffb69c6bb900 tempest-TestInstancesWithCinderVolumes-102430806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-3880ea2c-60dc-4cb0-9186-8c98cad13ab1" returned: 0 in 0.462s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:38:29 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-0944414a-9e48-4bc0-b10d-ffb69c6bb900 tempest-TestInstancesWithCinderVolumes-102430806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-3880ea2c-60dc-4cb0-9186-8c98cad13ab1 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:38:29 devstack sudo[96557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-3880ea2c-60dc-4cb0-9186-8c98cad13ab1 Sep 06 06:38:29 devstack sudo[96557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:38:29 devstack sudo[96557]: pam_unix(sudo:session): session closed for user root Sep 06 06:38:29 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-0944414a-9e48-4bc0-b10d-ffb69c6bb900 tempest-TestInstancesWithCinderVolumes-102430806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-3880ea2c-60dc-4cb0-9186-8c98cad13ab1" returned: 0 in 0.416s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:38:29 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-0944414a-9e48-4bc0-b10d-ffb69c6bb900 tempest-TestInstancesWithCinderVolumes-102430806 None] Lock "cinder-quobyte-3880ea2c-60dc-4cb0-9186-8c98cad13ab1" released by "delete_volume" :: held 0.944s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:38:29 devstack cinder-volume[87329]: WARNING cinder.quota [None req-0944414a-9e48-4bc0-b10d-ffb69c6bb900 tempest-TestInstancesWithCinderVolumes-102430806 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-435398310-2020306556 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-435398310-2020306556, it is now deprecated. Please use the default quota class for default quota. Sep 06 06:38:29 devstack cinder-volume[87329]: WARNING cinder.quota [None req-0944414a-9e48-4bc0-b10d-ffb69c6bb900 tempest-TestInstancesWithCinderVolumes-102430806 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-435398310-2020306556 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-435398310-2020306556, it is now deprecated. Please use the default quota class for default quota. Sep 06 06:38:29 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-0944414a-9e48-4bc0-b10d-ffb69c6bb900 tempest-TestInstancesWithCinderVolumes-102430806 None] Created reservations ['453707e2-c933-4c90-aa5f-5e8407ffdc90', '4e324dc0-4bfe-4027-b961-689399457741', 'e6eae11f-dd26-43d5-8778-90d5fd03f19e', '390a1d8e-7dc9-4553-9830-639c4f25546a'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:38:30 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-0944414a-9e48-4bc0-b10d-ffb69c6bb900 tempest-TestInstancesWithCinderVolumes-102430806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:38:30 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-0944414a-9e48-4bc0-b10d-ffb69c6bb900 tempest-TestInstancesWithCinderVolumes-102430806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:38:30 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-0944414a-9e48-4bc0-b10d-ffb69c6bb900 tempest-TestInstancesWithCinderVolumes-102430806 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:38:30 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-0944414a-9e48-4bc0-b10d-ffb69c6bb900 tempest-TestInstancesWithCinderVolumes-102430806 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:38:30 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-0944414a-9e48-4bc0-b10d-ffb69c6bb900 tempest-TestInstancesWithCinderVolumes-102430806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:38:30 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-0944414a-9e48-4bc0-b10d-ffb69c6bb900 tempest-TestInstancesWithCinderVolumes-102430806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:38:30 devstack sudo[96560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:38:30 devstack sudo[96560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:38:30 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-be67b73d-6c4e-42e4-8207-aab7301102d6 tempest-VolumesListTestJSON-1176125850 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87329) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 06:38:30 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-be67b73d-6c4e-42e4-8207-aab7301102d6 tempest-VolumesListTestJSON-1176125850 None] Flow 'volume_create_manager' (7d361d3d-21ef-4e16-982d-ef8995952da8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:38:30 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-be67b73d-6c4e-42e4-8207-aab7301102d6 tempest-VolumesListTestJSON-1176125850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fe6cab7-8898-4f8e-a59d-a4fbbdb197d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:38:30 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-be67b73d-6c4e-42e4-8207-aab7301102d6 tempest-VolumesListTestJSON-1176125850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fe6cab7-8898-4f8e-a59d-a4fbbdb197d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:38:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-316749936',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5bb72fa-6a74-44fb-ac8f-29e9745bd722,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c1713e6b3cec41f7906ad1add383f1b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:38:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:38:30Z,use_quota=True,user_id='84484d812fff43608501343ee38bfa38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:38:30 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-be67b73d-6c4e-42e4-8207-aab7301102d6 tempest-VolumesListTestJSON-1176125850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68b345f9-125c-4e54-9562-cd36f5a78ae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:38:30 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-be67b73d-6c4e-42e4-8207-aab7301102d6 tempest-VolumesListTestJSON-1176125850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68b345f9-125c-4e54-9562-cd36f5a78ae0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:38:30 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-be67b73d-6c4e-42e4-8207-aab7301102d6 tempest-VolumesListTestJSON-1176125850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46994420-a744-4d49-942c-7d987cba22fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:38:30 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-be67b73d-6c4e-42e4-8207-aab7301102d6 tempest-VolumesListTestJSON-1176125850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46994420-a744-4d49-942c-7d987cba22fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a5bb72fa-6a74-44fb-ac8f-29e9745bd722', 'volume_name': 'volume-a5bb72fa-6a74-44fb-ac8f-29e9745bd722', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:38:30 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-be67b73d-6c4e-42e4-8207-aab7301102d6 tempest-VolumesListTestJSON-1176125850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17ae3ee4-a8fb-4292-b6d3-327f6024c252) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:38:30 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-be67b73d-6c4e-42e4-8207-aab7301102d6 tempest-VolumesListTestJSON-1176125850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17ae3ee4-a8fb-4292-b6d3-327f6024c252) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:38:30 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-be67b73d-6c4e-42e4-8207-aab7301102d6 tempest-VolumesListTestJSON-1176125850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c372a64-7980-4a90-9e19-73026a0cc46a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:38:30 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-be67b73d-6c4e-42e4-8207-aab7301102d6 tempest-VolumesListTestJSON-1176125850 None] Volume a5bb72fa-6a74-44fb-ac8f-29e9745bd722: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a5bb72fa-6a74-44fb-ac8f-29e9745bd722', 'volume_size': 1} Sep 06 06:38:30 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-be67b73d-6c4e-42e4-8207-aab7301102d6 tempest-VolumesListTestJSON-1176125850 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:38:30 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-be67b73d-6c4e-42e4-8207-aab7301102d6 tempest-VolumesListTestJSON-1176125850 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:38:30 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-be67b73d-6c4e-42e4-8207-aab7301102d6 tempest-VolumesListTestJSON-1176125850 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:38:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-316749936',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5bb72fa-6a74-44fb-ac8f-29e9745bd722,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c1713e6b3cec41f7906ad1add383f1b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:38:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:38:30Z,use_quota=True,user_id='84484d812fff43608501343ee38bfa38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)}" {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 06:38:30 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-be67b73d-6c4e-42e4-8207-aab7301102d6 tempest-VolumesListTestJSON-1176125850 None] Creating volume a5bb72fa-6a74-44fb-ac8f-29e9745bd722 {{(pid=87329) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 06:38:30 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-be67b73d-6c4e-42e4-8207-aab7301102d6 tempest-VolumesListTestJSON-1176125850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:38:30 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-be67b73d-6c4e-42e4-8207-aab7301102d6 tempest-VolumesListTestJSON-1176125850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:38:30 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-be67b73d-6c4e-42e4-8207-aab7301102d6 tempest-VolumesListTestJSON-1176125850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:38:30 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-be67b73d-6c4e-42e4-8207-aab7301102d6 tempest-VolumesListTestJSON-1176125850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:38:30 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-be67b73d-6c4e-42e4-8207-aab7301102d6 tempest-VolumesListTestJSON-1176125850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:38:30 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-be67b73d-6c4e-42e4-8207-aab7301102d6 tempest-VolumesListTestJSON-1176125850 None] Selected osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 as target Quobyte volume. {{(pid=87329) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 06:38:30 devstack cinder-volume[87329]: INFO cinder.volume.drivers.remotefs [None req-be67b73d-6c4e-42e4-8207-aab7301102d6 tempest-VolumesListTestJSON-1176125850 None] casted to osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 Sep 06 06:38:30 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-be67b73d-6c4e-42e4-8207-aab7301102d6 tempest-VolumesListTestJSON-1176125850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-a5bb72fa-6a74-44fb-ac8f-29e9745bd722 1073741824 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:38:30 devstack sudo[96562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-a5bb72fa-6a74-44fb-ac8f-29e9745bd722 1073741824 Sep 06 06:38:30 devstack sudo[96562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:38:30 devstack sudo[96560]: pam_unix(sudo:session): session closed for user root Sep 06 06:38:30 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-0944414a-9e48-4bc0-b10d-ffb69c6bb900 tempest-TestInstancesWithCinderVolumes-102430806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.337s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:38:30 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-0944414a-9e48-4bc0-b10d-ffb69c6bb900 tempest-TestInstancesWithCinderVolumes-102430806 None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:38:30 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-0944414a-9e48-4bc0-b10d-ffb69c6bb900 tempest-TestInstancesWithCinderVolumes-102430806 None] Deleted volume successfully. Sep 06 06:38:30 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-0944414a-9e48-4bc0-b10d-ffb69c6bb900 tempest-TestInstancesWithCinderVolumes-102430806 None] Lock "cinder-3880ea2c-60dc-4cb0-9186-8c98cad13ab1-delete_volume" released by "delete_volume" :: held 1.588s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:38:30 devstack sudo[96562]: pam_unix(sudo:session): session closed for user root Sep 06 06:38:30 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-be67b73d-6c4e-42e4-8207-aab7301102d6 tempest-VolumesListTestJSON-1176125850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-a5bb72fa-6a74-44fb-ac8f-29e9745bd722 1073741824" returned: 0 in 0.580s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:38:30 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-be67b73d-6c4e-42e4-8207-aab7301102d6 tempest-VolumesListTestJSON-1176125850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-a5bb72fa-6a74-44fb-ac8f-29e9745bd722 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:38:30 devstack sudo[96569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-a5bb72fa-6a74-44fb-ac8f-29e9745bd722 Sep 06 06:38:30 devstack sudo[96569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:38:31 devstack sudo[96569]: pam_unix(sudo:session): session closed for user root Sep 06 06:38:31 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-be67b73d-6c4e-42e4-8207-aab7301102d6 tempest-VolumesListTestJSON-1176125850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-a5bb72fa-6a74-44fb-ac8f-29e9745bd722" returned: 0 in 0.318s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:38:31 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-be67b73d-6c4e-42e4-8207-aab7301102d6 tempest-VolumesListTestJSON-1176125850 None] <== create_volume: return (964ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'} {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 06:38:31 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-be67b73d-6c4e-42e4-8207-aab7301102d6 tempest-VolumesListTestJSON-1176125850 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.968s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:38:31 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-be67b73d-6c4e-42e4-8207-aab7301102d6 tempest-VolumesListTestJSON-1176125850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c372a64-7980-4a90-9e19-73026a0cc46a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5bb72fa-6a74-44fb-ac8f-29e9745bd722', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:38:31 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-be67b73d-6c4e-42e4-8207-aab7301102d6 tempest-VolumesListTestJSON-1176125850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d88142c3-adcb-449b-9401-1c1ab264b118) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:38:31 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-be67b73d-6c4e-42e4-8207-aab7301102d6 tempest-VolumesListTestJSON-1176125850 None] Volume volume-a5bb72fa-6a74-44fb-ac8f-29e9745bd722 (a5bb72fa-6a74-44fb-ac8f-29e9745bd722): created successfully Sep 06 06:38:31 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-be67b73d-6c4e-42e4-8207-aab7301102d6 tempest-VolumesListTestJSON-1176125850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d88142c3-adcb-449b-9401-1c1ab264b118) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:38:31 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-be67b73d-6c4e-42e4-8207-aab7301102d6 tempest-VolumesListTestJSON-1176125850 None] Flow 'volume_create_manager' (7d361d3d-21ef-4e16-982d-ef8995952da8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:38:31 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-be67b73d-6c4e-42e4-8207-aab7301102d6 tempest-VolumesListTestJSON-1176125850 None] Created volume successfully. Sep 06 06:38:33 devstack cinder-volume[87329]: INFO cinder.volume.manager [req-d396c2c3-099b-4a4c-8426-15e4843befaa req-e2f8019c-4d0e-4d14-bc9d-f6fe924941ec tempest-TestInstancesWithCinderVolumes-102430806 None] Terminate volume connection completed successfully. Sep 06 06:38:33 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [req-d396c2c3-099b-4a4c-8426-15e4843befaa req-e2f8019c-4d0e-4d14-bc9d-f6fe924941ec tempest-TestInstancesWithCinderVolumes-102430806 None] Deleting attachment 8a3fbb25-35cc-4815-b1db-651114443700. {{(pid=87329) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 06 06:38:34 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-ae633bed-0c78-4934-80c6-5f3488a267c3 tempest-TestInstancesWithCinderVolumes-102430806 None] Acquiring lock "cinder-1efe1c77-2770-4e7d-8293-625d554592a8-delete_volume" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:38:34 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-ae633bed-0c78-4934-80c6-5f3488a267c3 tempest-TestInstancesWithCinderVolumes-102430806 None] Lock "cinder-1efe1c77-2770-4e7d-8293-625d554592a8-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:38:34 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-ae633bed-0c78-4934-80c6-5f3488a267c3 tempest-TestInstancesWithCinderVolumes-102430806 None] Acquiring lock "cinder-quobyte-1efe1c77-2770-4e7d-8293-625d554592a8" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:38:34 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-ae633bed-0c78-4934-80c6-5f3488a267c3 tempest-TestInstancesWithCinderVolumes-102430806 None] Lock "cinder-quobyte-1efe1c77-2770-4e7d-8293-625d554592a8" acquired by "delete_volume" :: waited 0.021s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:38:34 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[09d479c9-fed4-4ad7-aed5-f02fbc21e0e9]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:38:34 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-ae633bed-0c78-4934-80c6-5f3488a267c3 tempest-TestInstancesWithCinderVolumes-102430806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-1efe1c77-2770-4e7d-8293-625d554592a8 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:38:34 devstack sudo[96595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-1efe1c77-2770-4e7d-8293-625d554592a8 Sep 06 06:38:34 devstack sudo[96595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:38:34 devstack sudo[96595]: pam_unix(sudo:session): session closed for user root Sep 06 06:38:34 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-ae633bed-0c78-4934-80c6-5f3488a267c3 tempest-TestInstancesWithCinderVolumes-102430806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-1efe1c77-2770-4e7d-8293-625d554592a8" returned: 0 in 0.473s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:38:34 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-ae633bed-0c78-4934-80c6-5f3488a267c3 tempest-TestInstancesWithCinderVolumes-102430806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-1efe1c77-2770-4e7d-8293-625d554592a8 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:38:34 devstack sudo[96600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-1efe1c77-2770-4e7d-8293-625d554592a8 Sep 06 06:38:34 devstack sudo[96600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:38:34 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-d15aed31-9bd1-4edd-aff6-9aedc4204290 tempest-VolumesListTestJSON-1176125850 None] Acquiring lock "cinder-a5bb72fa-6a74-44fb-ac8f-29e9745bd722-delete_volume" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:38:35 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-d15aed31-9bd1-4edd-aff6-9aedc4204290 tempest-VolumesListTestJSON-1176125850 None] Lock "cinder-a5bb72fa-6a74-44fb-ac8f-29e9745bd722-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:38:35 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-d15aed31-9bd1-4edd-aff6-9aedc4204290 tempest-VolumesListTestJSON-1176125850 None] Acquiring lock "cinder-quobyte-a5bb72fa-6a74-44fb-ac8f-29e9745bd722" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:38:35 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-d15aed31-9bd1-4edd-aff6-9aedc4204290 tempest-VolumesListTestJSON-1176125850 None] Lock "cinder-quobyte-a5bb72fa-6a74-44fb-ac8f-29e9745bd722" acquired by "delete_volume" :: waited 0.026s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:38:35 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ce62efd-90b5-4eed-8d99-62f97af64c7b]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:38:35 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-d15aed31-9bd1-4edd-aff6-9aedc4204290 tempest-VolumesListTestJSON-1176125850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-a5bb72fa-6a74-44fb-ac8f-29e9745bd722 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:38:35 devstack sudo[96600]: pam_unix(sudo:session): session closed for user root Sep 06 06:38:35 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-ae633bed-0c78-4934-80c6-5f3488a267c3 tempest-TestInstancesWithCinderVolumes-102430806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-1efe1c77-2770-4e7d-8293-625d554592a8" returned: 0 in 0.400s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:38:35 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-ae633bed-0c78-4934-80c6-5f3488a267c3 tempest-TestInstancesWithCinderVolumes-102430806 None] Lock "cinder-quobyte-1efe1c77-2770-4e7d-8293-625d554592a8" released by "delete_volume" :: held 0.951s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:38:35 devstack cinder-volume[87329]: WARNING cinder.quota [None req-ae633bed-0c78-4934-80c6-5f3488a267c3 tempest-TestInstancesWithCinderVolumes-102430806 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1539125019-167213971 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1539125019-167213971, it is now deprecated. Please use the default quota class for default quota. Sep 06 06:38:35 devstack cinder-volume[87329]: WARNING cinder.quota [None req-ae633bed-0c78-4934-80c6-5f3488a267c3 tempest-TestInstancesWithCinderVolumes-102430806 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1539125019-167213971 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1539125019-167213971, it is now deprecated. Please use the default quota class for default quota. Sep 06 06:38:35 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-ae633bed-0c78-4934-80c6-5f3488a267c3 tempest-TestInstancesWithCinderVolumes-102430806 None] Created reservations ['fe247ae5-d6e3-4959-a26f-716b9a965d6b', 'b6c5136b-fc2d-4ac8-b2e7-7915deb99309', '9b2df18c-f915-4412-937a-45be39f2644f', '5f9a6632-c071-41e4-a1e4-328469722521'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:38:35 devstack sudo[96603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-a5bb72fa-6a74-44fb-ac8f-29e9745bd722 Sep 06 06:38:35 devstack sudo[96603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:38:35 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-ae633bed-0c78-4934-80c6-5f3488a267c3 tempest-TestInstancesWithCinderVolumes-102430806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:38:35 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-ae633bed-0c78-4934-80c6-5f3488a267c3 tempest-TestInstancesWithCinderVolumes-102430806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:38:35 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-ae633bed-0c78-4934-80c6-5f3488a267c3 tempest-TestInstancesWithCinderVolumes-102430806 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:38:35 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-ae633bed-0c78-4934-80c6-5f3488a267c3 tempest-TestInstancesWithCinderVolumes-102430806 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:38:35 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-ae633bed-0c78-4934-80c6-5f3488a267c3 tempest-TestInstancesWithCinderVolumes-102430806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:38:35 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-ae633bed-0c78-4934-80c6-5f3488a267c3 tempest-TestInstancesWithCinderVolumes-102430806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:38:35 devstack sudo[96605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:38:35 devstack sudo[96605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:38:35 devstack sudo[96603]: pam_unix(sudo:session): session closed for user root Sep 06 06:38:35 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-d15aed31-9bd1-4edd-aff6-9aedc4204290 tempest-VolumesListTestJSON-1176125850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-a5bb72fa-6a74-44fb-ac8f-29e9745bd722" returned: 0 in 0.558s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:38:35 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-d15aed31-9bd1-4edd-aff6-9aedc4204290 tempest-VolumesListTestJSON-1176125850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-a5bb72fa-6a74-44fb-ac8f-29e9745bd722 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:38:35 devstack sudo[96605]: pam_unix(sudo:session): session closed for user root Sep 06 06:38:35 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-ae633bed-0c78-4934-80c6-5f3488a267c3 tempest-TestInstancesWithCinderVolumes-102430806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.331s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:38:35 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-ae633bed-0c78-4934-80c6-5f3488a267c3 tempest-TestInstancesWithCinderVolumes-102430806 None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:38:35 devstack sudo[96611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-a5bb72fa-6a74-44fb-ac8f-29e9745bd722 Sep 06 06:38:35 devstack sudo[96611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:38:35 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-ae633bed-0c78-4934-80c6-5f3488a267c3 tempest-TestInstancesWithCinderVolumes-102430806 None] Deleted volume successfully. Sep 06 06:38:35 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-ae633bed-0c78-4934-80c6-5f3488a267c3 tempest-TestInstancesWithCinderVolumes-102430806 None] Lock "cinder-1efe1c77-2770-4e7d-8293-625d554592a8-delete_volume" released by "delete_volume" :: held 1.576s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:38:36 devstack sudo[96611]: pam_unix(sudo:session): session closed for user root Sep 06 06:38:36 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-d15aed31-9bd1-4edd-aff6-9aedc4204290 tempest-VolumesListTestJSON-1176125850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-a5bb72fa-6a74-44fb-ac8f-29e9745bd722" returned: 0 in 0.323s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:38:36 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-d15aed31-9bd1-4edd-aff6-9aedc4204290 tempest-VolumesListTestJSON-1176125850 None] Lock "cinder-quobyte-a5bb72fa-6a74-44fb-ac8f-29e9745bd722" released by "delete_volume" :: held 0.943s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:38:36 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-d15aed31-9bd1-4edd-aff6-9aedc4204290 tempest-VolumesListTestJSON-1176125850 None] Created reservations ['b5b7a24f-f043-431b-9289-5719f93961ca', '0070d6f8-624c-4953-a276-12039878d4c2', '20c02bcb-6435-4bba-bf58-2e5dd1d1471b', '59bb59f7-978e-4f0a-b6eb-c16feb44f2c5'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:38:36 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-d15aed31-9bd1-4edd-aff6-9aedc4204290 tempest-VolumesListTestJSON-1176125850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:38:36 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-d15aed31-9bd1-4edd-aff6-9aedc4204290 tempest-VolumesListTestJSON-1176125850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:38:36 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-d15aed31-9bd1-4edd-aff6-9aedc4204290 tempest-VolumesListTestJSON-1176125850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:38:36 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-d15aed31-9bd1-4edd-aff6-9aedc4204290 tempest-VolumesListTestJSON-1176125850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:38:36 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-d15aed31-9bd1-4edd-aff6-9aedc4204290 tempest-VolumesListTestJSON-1176125850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:38:36 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-d15aed31-9bd1-4edd-aff6-9aedc4204290 tempest-VolumesListTestJSON-1176125850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:38:36 devstack sudo[96614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:38:36 devstack sudo[96614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:38:36 devstack sudo[96614]: pam_unix(sudo:session): session closed for user root Sep 06 06:38:36 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-d15aed31-9bd1-4edd-aff6-9aedc4204290 tempest-VolumesListTestJSON-1176125850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.355s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:38:36 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-d15aed31-9bd1-4edd-aff6-9aedc4204290 tempest-VolumesListTestJSON-1176125850 None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:38:36 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-d15aed31-9bd1-4edd-aff6-9aedc4204290 tempest-VolumesListTestJSON-1176125850 None] Deleted volume successfully. Sep 06 06:38:36 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-d15aed31-9bd1-4edd-aff6-9aedc4204290 tempest-VolumesListTestJSON-1176125850 None] Lock "cinder-a5bb72fa-6a74-44fb-ac8f-29e9745bd722-delete_volume" released by "delete_volume" :: held 1.668s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:38:37 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-0159cf16-90f5-4453-bc55-928f6370815f tempest-VolumesListTestJSON-1176125850 None] Acquiring lock "cinder-e3b138aa-dd41-4839-a412-ff968aacde18-delete_volume" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:38:37 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-0159cf16-90f5-4453-bc55-928f6370815f tempest-VolumesListTestJSON-1176125850 None] Lock "cinder-e3b138aa-dd41-4839-a412-ff968aacde18-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:38:37 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-0159cf16-90f5-4453-bc55-928f6370815f tempest-VolumesListTestJSON-1176125850 None] Acquiring lock "cinder-quobyte-e3b138aa-dd41-4839-a412-ff968aacde18" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:38:37 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-0159cf16-90f5-4453-bc55-928f6370815f tempest-VolumesListTestJSON-1176125850 None] Lock "cinder-quobyte-e3b138aa-dd41-4839-a412-ff968aacde18" acquired by "delete_volume" :: waited 0.020s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:38:37 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1a7bac7-8222-4908-881d-1e8f6bc31741]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:38:37 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-0159cf16-90f5-4453-bc55-928f6370815f tempest-VolumesListTestJSON-1176125850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e3b138aa-dd41-4839-a412-ff968aacde18 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:38:37 devstack sudo[96653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e3b138aa-dd41-4839-a412-ff968aacde18 Sep 06 06:38:37 devstack sudo[96653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:38:37 devstack sudo[96653]: pam_unix(sudo:session): session closed for user root Sep 06 06:38:37 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-0159cf16-90f5-4453-bc55-928f6370815f tempest-VolumesListTestJSON-1176125850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e3b138aa-dd41-4839-a412-ff968aacde18" returned: 0 in 0.405s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:38:37 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-0159cf16-90f5-4453-bc55-928f6370815f tempest-VolumesListTestJSON-1176125850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e3b138aa-dd41-4839-a412-ff968aacde18 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:38:37 devstack sudo[96658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e3b138aa-dd41-4839-a412-ff968aacde18 Sep 06 06:38:37 devstack sudo[96658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:38:38 devstack sudo[96658]: pam_unix(sudo:session): session closed for user root Sep 06 06:38:38 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-0159cf16-90f5-4453-bc55-928f6370815f tempest-VolumesListTestJSON-1176125850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e3b138aa-dd41-4839-a412-ff968aacde18" returned: 0 in 0.307s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:38:38 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-0159cf16-90f5-4453-bc55-928f6370815f tempest-VolumesListTestJSON-1176125850 None] Lock "cinder-quobyte-e3b138aa-dd41-4839-a412-ff968aacde18" released by "delete_volume" :: held 0.773s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:38:38 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-0159cf16-90f5-4453-bc55-928f6370815f tempest-VolumesListTestJSON-1176125850 None] Created reservations ['f9bee688-a27f-4c65-b65e-f3feaf497e8e', 'd2224adf-77be-44e7-b4c8-8675bed480cf', 'dd072597-176b-44cf-b606-471d691e080e', '64fbd725-9958-4aed-a24b-45949809c9a0'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:38:38 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-0159cf16-90f5-4453-bc55-928f6370815f tempest-VolumesListTestJSON-1176125850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:38:38 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-0159cf16-90f5-4453-bc55-928f6370815f tempest-VolumesListTestJSON-1176125850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:38:38 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-0159cf16-90f5-4453-bc55-928f6370815f tempest-VolumesListTestJSON-1176125850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:38:38 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-0159cf16-90f5-4453-bc55-928f6370815f tempest-VolumesListTestJSON-1176125850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:38:38 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-0159cf16-90f5-4453-bc55-928f6370815f tempest-VolumesListTestJSON-1176125850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:38:38 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-0159cf16-90f5-4453-bc55-928f6370815f tempest-VolumesListTestJSON-1176125850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:38:38 devstack sudo[96662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:38:38 devstack sudo[96662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:38:38 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-f71bed08-b73b-4f6d-a542-35c8da6a3bc3 tempest-VolumesListTestJSON-1176125850 None] Acquiring lock "cinder-070f529d-d582-4625-9821-cb5e4aadc223-delete_volume" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:38:38 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-f71bed08-b73b-4f6d-a542-35c8da6a3bc3 tempest-VolumesListTestJSON-1176125850 None] Lock "cinder-070f529d-d582-4625-9821-cb5e4aadc223-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:38:38 devstack sudo[96662]: pam_unix(sudo:session): session closed for user root Sep 06 06:38:38 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-f71bed08-b73b-4f6d-a542-35c8da6a3bc3 tempest-VolumesListTestJSON-1176125850 None] Acquiring lock "cinder-quobyte-070f529d-d582-4625-9821-cb5e4aadc223" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:38:38 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-0159cf16-90f5-4453-bc55-928f6370815f tempest-VolumesListTestJSON-1176125850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.392s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:38:38 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-0159cf16-90f5-4453-bc55-928f6370815f tempest-VolumesListTestJSON-1176125850 None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:38:38 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-0159cf16-90f5-4453-bc55-928f6370815f tempest-VolumesListTestJSON-1176125850 None] Deleted volume successfully. Sep 06 06:38:38 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-f71bed08-b73b-4f6d-a542-35c8da6a3bc3 tempest-VolumesListTestJSON-1176125850 None] Lock "cinder-quobyte-070f529d-d582-4625-9821-cb5e4aadc223" acquired by "delete_volume" :: waited 0.039s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:38:38 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-0159cf16-90f5-4453-bc55-928f6370815f tempest-VolumesListTestJSON-1176125850 None] Lock "cinder-e3b138aa-dd41-4839-a412-ff968aacde18-delete_volume" released by "delete_volume" :: held 1.572s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:38:38 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dbee683-87aa-4439-addc-df71826a1b42]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:38:38 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-f71bed08-b73b-4f6d-a542-35c8da6a3bc3 tempest-VolumesListTestJSON-1176125850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-070f529d-d582-4625-9821-cb5e4aadc223 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:38:39 devstack sudo[96665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-070f529d-d582-4625-9821-cb5e4aadc223 Sep 06 06:38:39 devstack sudo[96665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:38:39 devstack sudo[96665]: pam_unix(sudo:session): session closed for user root Sep 06 06:38:39 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-f71bed08-b73b-4f6d-a542-35c8da6a3bc3 tempest-VolumesListTestJSON-1176125850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-070f529d-d582-4625-9821-cb5e4aadc223" returned: 0 in 0.670s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:38:39 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-f71bed08-b73b-4f6d-a542-35c8da6a3bc3 tempest-VolumesListTestJSON-1176125850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-070f529d-d582-4625-9821-cb5e4aadc223 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:38:39 devstack sudo[96671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-070f529d-d582-4625-9821-cb5e4aadc223 Sep 06 06:38:39 devstack sudo[96671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:38:39 devstack sudo[96671]: pam_unix(sudo:session): session closed for user root Sep 06 06:38:39 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-f71bed08-b73b-4f6d-a542-35c8da6a3bc3 tempest-VolumesListTestJSON-1176125850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-070f529d-d582-4625-9821-cb5e4aadc223" returned: 0 in 0.354s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:38:40 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-f71bed08-b73b-4f6d-a542-35c8da6a3bc3 tempest-VolumesListTestJSON-1176125850 None] Lock "cinder-quobyte-070f529d-d582-4625-9821-cb5e4aadc223" released by "delete_volume" :: held 1.110s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:38:40 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-f71bed08-b73b-4f6d-a542-35c8da6a3bc3 tempest-VolumesListTestJSON-1176125850 None] Created reservations ['d2de8300-f352-4068-9b09-b21a1f9f3cf2', '12f4c57c-f6c7-4e59-83db-734cff57ce33', '5842ae36-bd32-4a37-8d60-0ea497ad9e60', '8a3e57eb-b8a7-463d-a2e4-e5b9ee5a557f'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:38:40 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-f71bed08-b73b-4f6d-a542-35c8da6a3bc3 tempest-VolumesListTestJSON-1176125850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:38:40 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-f71bed08-b73b-4f6d-a542-35c8da6a3bc3 tempest-VolumesListTestJSON-1176125850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:38:40 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-f71bed08-b73b-4f6d-a542-35c8da6a3bc3 tempest-VolumesListTestJSON-1176125850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:38:40 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-f71bed08-b73b-4f6d-a542-35c8da6a3bc3 tempest-VolumesListTestJSON-1176125850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:38:40 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-f71bed08-b73b-4f6d-a542-35c8da6a3bc3 tempest-VolumesListTestJSON-1176125850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:38:40 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-f71bed08-b73b-4f6d-a542-35c8da6a3bc3 tempest-VolumesListTestJSON-1176125850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:38:40 devstack sudo[96674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:38:40 devstack sudo[96674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:38:40 devstack sudo[96674]: pam_unix(sudo:session): session closed for user root Sep 06 06:38:40 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-f71bed08-b73b-4f6d-a542-35c8da6a3bc3 tempest-VolumesListTestJSON-1176125850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.434s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:38:40 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-f71bed08-b73b-4f6d-a542-35c8da6a3bc3 tempest-VolumesListTestJSON-1176125850 None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:38:40 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-f71bed08-b73b-4f6d-a542-35c8da6a3bc3 tempest-VolumesListTestJSON-1176125850 None] Deleted volume successfully. Sep 06 06:38:40 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-f71bed08-b73b-4f6d-a542-35c8da6a3bc3 tempest-VolumesListTestJSON-1176125850 None] Lock "cinder-070f529d-d582-4625-9821-cb5e4aadc223-delete_volume" released by "delete_volume" :: held 1.954s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:38:44 devstack cinder-volume[87329]: INFO cinder.volume.manager [req-edf63b29-c593-4324-ab3a-7a074e654bc4 req-c032a2c6-8790-4d46-bb90-36cba22c8283 tempest-TestInstancesWithCinderVolumes-102430806 None] Terminate volume connection completed successfully. Sep 06 06:38:44 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [req-edf63b29-c593-4324-ab3a-7a074e654bc4 req-c032a2c6-8790-4d46-bb90-36cba22c8283 tempest-TestInstancesWithCinderVolumes-102430806 None] Deleting attachment 834d5e61-130b-4ed1-98d1-3519ba00c9bc. {{(pid=87329) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 06 06:38:45 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-3245db79-0da7-45e6-90ac-a540fc89b4b2 tempest-TestInstancesWithCinderVolumes-102430806 None] Acquiring lock "cinder-3f9b73f7-6ebd-4f23-abb5-eeda5ff71799-delete_volume" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:38:45 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-3245db79-0da7-45e6-90ac-a540fc89b4b2 tempest-TestInstancesWithCinderVolumes-102430806 None] Lock "cinder-3f9b73f7-6ebd-4f23-abb5-eeda5ff71799-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:38:45 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-3245db79-0da7-45e6-90ac-a540fc89b4b2 tempest-TestInstancesWithCinderVolumes-102430806 None] Acquiring lock "cinder-quobyte-3f9b73f7-6ebd-4f23-abb5-eeda5ff71799" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:38:45 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-3245db79-0da7-45e6-90ac-a540fc89b4b2 tempest-TestInstancesWithCinderVolumes-102430806 None] Lock "cinder-quobyte-3f9b73f7-6ebd-4f23-abb5-eeda5ff71799" acquired by "delete_volume" :: waited 0.021s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:38:45 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[92a1f4d6-9c38-4912-8d25-04876d449114]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:38:45 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-3245db79-0da7-45e6-90ac-a540fc89b4b2 tempest-TestInstancesWithCinderVolumes-102430806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-3f9b73f7-6ebd-4f23-abb5-eeda5ff71799 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:38:45 devstack sudo[96705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-3f9b73f7-6ebd-4f23-abb5-eeda5ff71799 Sep 06 06:38:45 devstack sudo[96705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:38:46 devstack sudo[96705]: pam_unix(sudo:session): session closed for user root Sep 06 06:38:46 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-3245db79-0da7-45e6-90ac-a540fc89b4b2 tempest-TestInstancesWithCinderVolumes-102430806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-3f9b73f7-6ebd-4f23-abb5-eeda5ff71799" returned: 0 in 0.436s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:38:46 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-3245db79-0da7-45e6-90ac-a540fc89b4b2 tempest-TestInstancesWithCinderVolumes-102430806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-3f9b73f7-6ebd-4f23-abb5-eeda5ff71799 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:38:46 devstack sudo[96710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-3f9b73f7-6ebd-4f23-abb5-eeda5ff71799 Sep 06 06:38:46 devstack sudo[96710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:38:46 devstack sudo[96710]: pam_unix(sudo:session): session closed for user root Sep 06 06:38:46 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-3245db79-0da7-45e6-90ac-a540fc89b4b2 tempest-TestInstancesWithCinderVolumes-102430806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-3f9b73f7-6ebd-4f23-abb5-eeda5ff71799" returned: 0 in 0.369s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:38:46 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-3245db79-0da7-45e6-90ac-a540fc89b4b2 tempest-TestInstancesWithCinderVolumes-102430806 None] Lock "cinder-quobyte-3f9b73f7-6ebd-4f23-abb5-eeda5ff71799" released by "delete_volume" :: held 0.878s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:38:46 devstack cinder-volume[87329]: DEBUG dbcounter [-] [87329] Writing DB stats cinder:UPDATE=127,cinder:SELECT=114,cinder:INSERT=35,cinder:DELETE=8 {{(pid=87329) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 06:38:46 devstack cinder-volume[87329]: WARNING cinder.quota [None req-3245db79-0da7-45e6-90ac-a540fc89b4b2 tempest-TestInstancesWithCinderVolumes-102430806 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-86897055-2117254016 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-86897055-2117254016, it is now deprecated. Please use the default quota class for default quota. Sep 06 06:38:46 devstack cinder-volume[87329]: WARNING cinder.quota [None req-3245db79-0da7-45e6-90ac-a540fc89b4b2 tempest-TestInstancesWithCinderVolumes-102430806 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-86897055-2117254016 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-86897055-2117254016, it is now deprecated. Please use the default quota class for default quota. Sep 06 06:38:46 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-3245db79-0da7-45e6-90ac-a540fc89b4b2 tempest-TestInstancesWithCinderVolumes-102430806 None] Created reservations ['77c720de-9588-40fa-9e71-cf3b001d4fbe', '00eeb815-62d2-4865-ba34-499914b796ba', 'e8494015-f038-453d-b163-53cf71e817b5', 'da41b6ca-de17-4994-8920-1e821c01bfce'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:38:46 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-3245db79-0da7-45e6-90ac-a540fc89b4b2 tempest-TestInstancesWithCinderVolumes-102430806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:38:46 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-3245db79-0da7-45e6-90ac-a540fc89b4b2 tempest-TestInstancesWithCinderVolumes-102430806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:38:46 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-3245db79-0da7-45e6-90ac-a540fc89b4b2 tempest-TestInstancesWithCinderVolumes-102430806 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:38:46 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-3245db79-0da7-45e6-90ac-a540fc89b4b2 tempest-TestInstancesWithCinderVolumes-102430806 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:38:46 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-3245db79-0da7-45e6-90ac-a540fc89b4b2 tempest-TestInstancesWithCinderVolumes-102430806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:38:46 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-3245db79-0da7-45e6-90ac-a540fc89b4b2 tempest-TestInstancesWithCinderVolumes-102430806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:38:46 devstack sudo[96713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:38:46 devstack sudo[96713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:38:47 devstack sudo[96713]: pam_unix(sudo:session): session closed for user root Sep 06 06:38:47 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-3245db79-0da7-45e6-90ac-a540fc89b4b2 tempest-TestInstancesWithCinderVolumes-102430806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.392s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:38:47 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-3245db79-0da7-45e6-90ac-a540fc89b4b2 tempest-TestInstancesWithCinderVolumes-102430806 None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:38:47 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-3245db79-0da7-45e6-90ac-a540fc89b4b2 tempest-TestInstancesWithCinderVolumes-102430806 None] Deleted volume successfully. Sep 06 06:38:47 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-3245db79-0da7-45e6-90ac-a540fc89b4b2 tempest-TestInstancesWithCinderVolumes-102430806 None] Lock "cinder-3f9b73f7-6ebd-4f23-abb5-eeda5ff71799-delete_volume" released by "delete_volume" :: held 1.719s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:38:48 devstack cinder-volume[87329]: DEBUG oslo_service.periodic_task [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87329) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 06 06:38:48 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:38:48 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:38:48 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:38:48 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:38:48 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:38:48 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:38:48 devstack sudo[96734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:38:48 devstack sudo[96734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:38:48 devstack sudo[96734]: pam_unix(sudo:session): session closed for user root Sep 06 06:38:48 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.352s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:38:48 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:38:48 devstack cinder-volume[87329]: DEBUG oslo_service.periodic_task [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Running periodic task VolumeManager._thread_info {{(pid=87329) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 06 06:38:48 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] thread count: 28 {{(pid=87329) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 06 06:38:48 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] thread info: [<_MainThread(MainThread, started 126855043821696)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87329) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 06 06:38:49 devstack cinder-volume[87329]: DEBUG dbcounter [-] [87329] Writing DB stats cinder:SELECT=101,cinder:INSERT=29,cinder:UPDATE=150,cinder:DELETE=15 {{(pid=87329) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 06:38:49 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca4bf37c-f011-487f-b6f8-9eea9a8d0831 tempest-VolumesSnapshotNegativeTestJSON-704733707 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87329) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 06:38:49 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-ca4bf37c-f011-487f-b6f8-9eea9a8d0831 tempest-VolumesSnapshotNegativeTestJSON-704733707 None] Flow 'volume_create_manager' (006e7814-67f0-40fb-b1b5-bce0a98e3559) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:38:49 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-ca4bf37c-f011-487f-b6f8-9eea9a8d0831 tempest-VolumesSnapshotNegativeTestJSON-704733707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (488a49fa-31e2-4486-abf2-a89251ef317c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:38:49 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-ca4bf37c-f011-487f-b6f8-9eea9a8d0831 tempest-VolumesSnapshotNegativeTestJSON-704733707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (488a49fa-31e2-4486-abf2-a89251ef317c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:38:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1103315292',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a013ef45-cd9f-4b73-aaf0-568c754d6fa3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0d7442ba7ef4726b9626dff405f9059',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:38:49Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:38:49Z,use_quota=True,user_id='e4664c6e9cc54eaab071713f88355f71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:38:49 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-ca4bf37c-f011-487f-b6f8-9eea9a8d0831 tempest-VolumesSnapshotNegativeTestJSON-704733707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e794419-7e98-4924-ada4-85f9b2bc248e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:38:49 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-ca4bf37c-f011-487f-b6f8-9eea9a8d0831 tempest-VolumesSnapshotNegativeTestJSON-704733707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e794419-7e98-4924-ada4-85f9b2bc248e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:38:49 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-ca4bf37c-f011-487f-b6f8-9eea9a8d0831 tempest-VolumesSnapshotNegativeTestJSON-704733707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db59a9b6-5702-4e5c-8063-bf4a011dfcf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:38:49 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-ca4bf37c-f011-487f-b6f8-9eea9a8d0831 tempest-VolumesSnapshotNegativeTestJSON-704733707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db59a9b6-5702-4e5c-8063-bf4a011dfcf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a013ef45-cd9f-4b73-aaf0-568c754d6fa3', 'volume_name': 'volume-a013ef45-cd9f-4b73-aaf0-568c754d6fa3', 'volume_size': 2}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:38:49 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-ca4bf37c-f011-487f-b6f8-9eea9a8d0831 tempest-VolumesSnapshotNegativeTestJSON-704733707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15063851-ae64-4297-af35-de7598067884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:38:49 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-ca4bf37c-f011-487f-b6f8-9eea9a8d0831 tempest-VolumesSnapshotNegativeTestJSON-704733707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15063851-ae64-4297-af35-de7598067884) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:38:49 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-ca4bf37c-f011-487f-b6f8-9eea9a8d0831 tempest-VolumesSnapshotNegativeTestJSON-704733707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bfba836-eb9c-450c-a3af-adb3fe9f4459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:38:49 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-ca4bf37c-f011-487f-b6f8-9eea9a8d0831 tempest-VolumesSnapshotNegativeTestJSON-704733707 None] Volume a013ef45-cd9f-4b73-aaf0-568c754d6fa3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a013ef45-cd9f-4b73-aaf0-568c754d6fa3', 'volume_size': 2} Sep 06 06:38:49 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-ca4bf37c-f011-487f-b6f8-9eea9a8d0831 tempest-VolumesSnapshotNegativeTestJSON-704733707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:38:49 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-ca4bf37c-f011-487f-b6f8-9eea9a8d0831 tempest-VolumesSnapshotNegativeTestJSON-704733707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:38:49 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-ca4bf37c-f011-487f-b6f8-9eea9a8d0831 tempest-VolumesSnapshotNegativeTestJSON-704733707 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:38:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1103315292',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a013ef45-cd9f-4b73-aaf0-568c754d6fa3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0d7442ba7ef4726b9626dff405f9059',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:38:49Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:38:49Z,use_quota=True,user_id='e4664c6e9cc54eaab071713f88355f71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)}" {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 06:38:49 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-ca4bf37c-f011-487f-b6f8-9eea9a8d0831 tempest-VolumesSnapshotNegativeTestJSON-704733707 None] Creating volume a013ef45-cd9f-4b73-aaf0-568c754d6fa3 {{(pid=87329) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 06:38:49 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-ca4bf37c-f011-487f-b6f8-9eea9a8d0831 tempest-VolumesSnapshotNegativeTestJSON-704733707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:38:49 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-ca4bf37c-f011-487f-b6f8-9eea9a8d0831 tempest-VolumesSnapshotNegativeTestJSON-704733707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:38:49 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-ca4bf37c-f011-487f-b6f8-9eea9a8d0831 tempest-VolumesSnapshotNegativeTestJSON-704733707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:38:49 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-ca4bf37c-f011-487f-b6f8-9eea9a8d0831 tempest-VolumesSnapshotNegativeTestJSON-704733707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:38:49 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-ca4bf37c-f011-487f-b6f8-9eea9a8d0831 tempest-VolumesSnapshotNegativeTestJSON-704733707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:38:49 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-ca4bf37c-f011-487f-b6f8-9eea9a8d0831 tempest-VolumesSnapshotNegativeTestJSON-704733707 None] Selected osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 as target Quobyte volume. {{(pid=87329) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 06:38:49 devstack cinder-volume[87329]: INFO cinder.volume.drivers.remotefs [None req-ca4bf37c-f011-487f-b6f8-9eea9a8d0831 tempest-VolumesSnapshotNegativeTestJSON-704733707 None] casted to osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 Sep 06 06:38:49 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-ca4bf37c-f011-487f-b6f8-9eea9a8d0831 tempest-VolumesSnapshotNegativeTestJSON-704733707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-a013ef45-cd9f-4b73-aaf0-568c754d6fa3 2147483648 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:38:49 devstack sudo[96737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-a013ef45-cd9f-4b73-aaf0-568c754d6fa3 2147483648 Sep 06 06:38:49 devstack sudo[96737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:38:49 devstack sudo[96737]: pam_unix(sudo:session): session closed for user root Sep 06 06:38:49 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-ca4bf37c-f011-487f-b6f8-9eea9a8d0831 tempest-VolumesSnapshotNegativeTestJSON-704733707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-a013ef45-cd9f-4b73-aaf0-568c754d6fa3 2147483648" returned: 0 in 0.695s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:38:49 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-ca4bf37c-f011-487f-b6f8-9eea9a8d0831 tempest-VolumesSnapshotNegativeTestJSON-704733707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-a013ef45-cd9f-4b73-aaf0-568c754d6fa3 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:38:49 devstack sudo[96744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-a013ef45-cd9f-4b73-aaf0-568c754d6fa3 Sep 06 06:38:49 devstack sudo[96744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:38:50 devstack sudo[96744]: pam_unix(sudo:session): session closed for user root Sep 06 06:38:50 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-ca4bf37c-f011-487f-b6f8-9eea9a8d0831 tempest-VolumesSnapshotNegativeTestJSON-704733707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-a013ef45-cd9f-4b73-aaf0-568c754d6fa3" returned: 0 in 0.366s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:38:50 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-ca4bf37c-f011-487f-b6f8-9eea9a8d0831 tempest-VolumesSnapshotNegativeTestJSON-704733707 None] <== create_volume: return (1137ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'} {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 06:38:50 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-ca4bf37c-f011-487f-b6f8-9eea9a8d0831 tempest-VolumesSnapshotNegativeTestJSON-704733707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.141s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:38:50 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-ca4bf37c-f011-487f-b6f8-9eea9a8d0831 tempest-VolumesSnapshotNegativeTestJSON-704733707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bfba836-eb9c-450c-a3af-adb3fe9f4459) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a013ef45-cd9f-4b73-aaf0-568c754d6fa3', 'volume_size': 2}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:38:50 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-ca4bf37c-f011-487f-b6f8-9eea9a8d0831 tempest-VolumesSnapshotNegativeTestJSON-704733707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55a49b4b-4065-44a6-bb0a-b21313b00c6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:38:50 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-ca4bf37c-f011-487f-b6f8-9eea9a8d0831 tempest-VolumesSnapshotNegativeTestJSON-704733707 None] Volume volume-a013ef45-cd9f-4b73-aaf0-568c754d6fa3 (a013ef45-cd9f-4b73-aaf0-568c754d6fa3): created successfully Sep 06 06:38:50 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-ca4bf37c-f011-487f-b6f8-9eea9a8d0831 tempest-VolumesSnapshotNegativeTestJSON-704733707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55a49b4b-4065-44a6-bb0a-b21313b00c6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:38:50 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-ca4bf37c-f011-487f-b6f8-9eea9a8d0831 tempest-VolumesSnapshotNegativeTestJSON-704733707 None] Flow 'volume_create_manager' (006e7814-67f0-40fb-b1b5-bce0a98e3559) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:38:50 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-ca4bf37c-f011-487f-b6f8-9eea9a8d0831 tempest-VolumesSnapshotNegativeTestJSON-704733707 None] Created volume successfully. Sep 06 06:38:51 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-3459e0e1-0b55-4dcb-a777-9538f76298af tempest-VolumesSnapshotNegativeTestJSON-704733707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:38:51 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-3459e0e1-0b55-4dcb-a777-9538f76298af tempest-VolumesSnapshotNegativeTestJSON-704733707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:38:51 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-3459e0e1-0b55-4dcb-a777-9538f76298af tempest-VolumesSnapshotNegativeTestJSON-704733707 None] Creating offline snapshot 48dd4fe0-1262-4b7f-acba-c3c81e296103 of volume a013ef45-cd9f-4b73-aaf0-568c754d6fa3 {{(pid=87329) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 06 06:38:51 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cd863f9-1e14-445f-860f-07f3406e5c31]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:38:51 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-3459e0e1-0b55-4dcb-a777-9538f76298af tempest-VolumesSnapshotNegativeTestJSON-704733707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-a013ef45-cd9f-4b73-aaf0-568c754d6fa3 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:38:51 devstack sudo[96806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-a013ef45-cd9f-4b73-aaf0-568c754d6fa3 Sep 06 06:38:51 devstack sudo[96806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:38:52 devstack sudo[96806]: pam_unix(sudo:session): session closed for user root Sep 06 06:38:52 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-3459e0e1-0b55-4dcb-a777-9538f76298af tempest-VolumesSnapshotNegativeTestJSON-704733707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-a013ef45-cd9f-4b73-aaf0-568c754d6fa3" returned: 0 in 0.565s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:38:52 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-3459e0e1-0b55-4dcb-a777-9538f76298af tempest-VolumesSnapshotNegativeTestJSON-704733707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-a013ef45-cd9f-4b73-aaf0-568c754d6fa3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-a013ef45-cd9f-4b73-aaf0-568c754d6fa3.48dd4fe0-1262-4b7f-acba-c3c81e296103 2G {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:38:52 devstack sudo[96820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-a013ef45-cd9f-4b73-aaf0-568c754d6fa3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-a013ef45-cd9f-4b73-aaf0-568c754d6fa3.48dd4fe0-1262-4b7f-acba-c3c81e296103 2G Sep 06 06:38:52 devstack sudo[96820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:38:53 devstack sudo[96820]: pam_unix(sudo:session): session closed for user root Sep 06 06:38:53 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-3459e0e1-0b55-4dcb-a777-9538f76298af tempest-VolumesSnapshotNegativeTestJSON-704733707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-a013ef45-cd9f-4b73-aaf0-568c754d6fa3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-a013ef45-cd9f-4b73-aaf0-568c754d6fa3.48dd4fe0-1262-4b7f-acba-c3c81e296103 2G" returned: 0 in 0.853s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:38:53 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-3459e0e1-0b55-4dcb-a777-9538f76298af tempest-VolumesSnapshotNegativeTestJSON-704733707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a013ef45-cd9f-4b73-aaf0-568c754d6fa3 -F qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-a013ef45-cd9f-4b73-aaf0-568c754d6fa3.48dd4fe0-1262-4b7f-acba-c3c81e296103 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:38:53 devstack sudo[96828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a013ef45-cd9f-4b73-aaf0-568c754d6fa3 -F qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-a013ef45-cd9f-4b73-aaf0-568c754d6fa3.48dd4fe0-1262-4b7f-acba-c3c81e296103 Sep 06 06:38:53 devstack sudo[96828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:38:53 devstack sudo[96828]: pam_unix(sudo:session): session closed for user root Sep 06 06:38:53 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-3459e0e1-0b55-4dcb-a777-9538f76298af tempest-VolumesSnapshotNegativeTestJSON-704733707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a013ef45-cd9f-4b73-aaf0-568c754d6fa3 -F qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-a013ef45-cd9f-4b73-aaf0-568c754d6fa3.48dd4fe0-1262-4b7f-acba-c3c81e296103" returned: 0 in 0.377s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:38:53 devstack cinder-volume[87329]: WARNING cinder.volume.drivers.remotefs [None req-3459e0e1-0b55-4dcb-a777-9538f76298af tempest-VolumesSnapshotNegativeTestJSON-704733707 None] /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-a013ef45-cd9f-4b73-aaf0-568c754d6fa3.48dd4fe0-1262-4b7f-acba-c3c81e296103 is being set with open permissions: ugo+rw Sep 06 06:38:53 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-3459e0e1-0b55-4dcb-a777-9538f76298af tempest-VolumesSnapshotNegativeTestJSON-704733707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-a013ef45-cd9f-4b73-aaf0-568c754d6fa3.48dd4fe0-1262-4b7f-acba-c3c81e296103 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:38:53 devstack sudo[96834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-a013ef45-cd9f-4b73-aaf0-568c754d6fa3.48dd4fe0-1262-4b7f-acba-c3c81e296103 Sep 06 06:38:53 devstack sudo[96834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:38:53 devstack sudo[96834]: pam_unix(sudo:session): session closed for user root Sep 06 06:38:53 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-3459e0e1-0b55-4dcb-a777-9538f76298af tempest-VolumesSnapshotNegativeTestJSON-704733707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-a013ef45-cd9f-4b73-aaf0-568c754d6fa3.48dd4fe0-1262-4b7f-acba-c3c81e296103" returned: 0 in 0.305s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:38:53 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-3459e0e1-0b55-4dcb-a777-9538f76298af tempest-VolumesSnapshotNegativeTestJSON-704733707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-a013ef45-cd9f-4b73-aaf0-568c754d6fa3.info {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:38:54 devstack sudo[96837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-a013ef45-cd9f-4b73-aaf0-568c754d6fa3.info Sep 06 06:38:54 devstack sudo[96837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:38:54 devstack sudo[96837]: pam_unix(sudo:session): session closed for user root Sep 06 06:38:54 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-3459e0e1-0b55-4dcb-a777-9538f76298af tempest-VolumesSnapshotNegativeTestJSON-704733707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-a013ef45-cd9f-4b73-aaf0-568c754d6fa3.info" returned: 0 in 0.448s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:38:54 devstack cinder-volume[87329]: WARNING cinder.volume.drivers.remotefs [None req-3459e0e1-0b55-4dcb-a777-9538f76298af tempest-VolumesSnapshotNegativeTestJSON-704733707 None] /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-a013ef45-cd9f-4b73-aaf0-568c754d6fa3.info is being set with open permissions: ugo+rw Sep 06 06:38:54 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-3459e0e1-0b55-4dcb-a777-9538f76298af tempest-VolumesSnapshotNegativeTestJSON-704733707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-a013ef45-cd9f-4b73-aaf0-568c754d6fa3.info {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:38:54 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-efb9c3e4-f004-4611-9ace-db050c5a0ce4 tempest-VolumesListAdminTestJSON-1496945980 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87329) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 06:38:54 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-efb9c3e4-f004-4611-9ace-db050c5a0ce4 tempest-VolumesListAdminTestJSON-1496945980 None] Flow 'volume_create_manager' (72fce3b9-ee0e-43d5-94fb-fcc84dee5a32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:38:54 devstack sudo[96840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-a013ef45-cd9f-4b73-aaf0-568c754d6fa3.info Sep 06 06:38:54 devstack sudo[96840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:38:54 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-efb9c3e4-f004-4611-9ace-db050c5a0ce4 tempest-VolumesListAdminTestJSON-1496945980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afa30bd0-aae3-42c8-b726-0978cc782e43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:38:54 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-efb9c3e4-f004-4611-9ace-db050c5a0ce4 tempest-VolumesListAdminTestJSON-1496945980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afa30bd0-aae3-42c8-b726-0978cc782e43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:38:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1473905197',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f24533f9-cd95-40d4-98e6-9a9886faf3d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c118791808d4c159d077fd695a1a8c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:38:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:38:54Z,use_quota=True,user_id='e9781df6f60b438698fb7ebf4744a56e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:38:54 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-efb9c3e4-f004-4611-9ace-db050c5a0ce4 tempest-VolumesListAdminTestJSON-1496945980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (feaace12-3ab0-43b6-9149-2a8c46ad26b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:38:54 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-efb9c3e4-f004-4611-9ace-db050c5a0ce4 tempest-VolumesListAdminTestJSON-1496945980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (feaace12-3ab0-43b6-9149-2a8c46ad26b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:38:54 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-efb9c3e4-f004-4611-9ace-db050c5a0ce4 tempest-VolumesListAdminTestJSON-1496945980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (988d7619-ccaa-498a-90ae-18013aa38b86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:38:54 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-efb9c3e4-f004-4611-9ace-db050c5a0ce4 tempest-VolumesListAdminTestJSON-1496945980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (988d7619-ccaa-498a-90ae-18013aa38b86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f24533f9-cd95-40d4-98e6-9a9886faf3d0', 'volume_name': 'volume-f24533f9-cd95-40d4-98e6-9a9886faf3d0', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:38:54 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-efb9c3e4-f004-4611-9ace-db050c5a0ce4 tempest-VolumesListAdminTestJSON-1496945980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (733d7800-8091-477a-a0b8-5b047aa93b37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:38:54 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-efb9c3e4-f004-4611-9ace-db050c5a0ce4 tempest-VolumesListAdminTestJSON-1496945980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (733d7800-8091-477a-a0b8-5b047aa93b37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:38:54 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-efb9c3e4-f004-4611-9ace-db050c5a0ce4 tempest-VolumesListAdminTestJSON-1496945980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (298d3f0c-1ff4-4d30-829e-0b549a3bd5c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:38:54 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-efb9c3e4-f004-4611-9ace-db050c5a0ce4 tempest-VolumesListAdminTestJSON-1496945980 None] Volume f24533f9-cd95-40d4-98e6-9a9886faf3d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f24533f9-cd95-40d4-98e6-9a9886faf3d0', 'volume_size': 1} Sep 06 06:38:54 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-efb9c3e4-f004-4611-9ace-db050c5a0ce4 tempest-VolumesListAdminTestJSON-1496945980 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:38:54 devstack sudo[96840]: pam_unix(sudo:session): session closed for user root Sep 06 06:38:54 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-3459e0e1-0b55-4dcb-a777-9538f76298af tempest-VolumesSnapshotNegativeTestJSON-704733707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-a013ef45-cd9f-4b73-aaf0-568c754d6fa3.info" returned: 0 in 0.374s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:38:54 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-3459e0e1-0b55-4dcb-a777-9538f76298af tempest-VolumesSnapshotNegativeTestJSON-704733707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.125s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:38:54 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-efb9c3e4-f004-4611-9ace-db050c5a0ce4 tempest-VolumesListAdminTestJSON-1496945980 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.185s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:38:54 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-efb9c3e4-f004-4611-9ace-db050c5a0ce4 tempest-VolumesListAdminTestJSON-1496945980 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:38:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1473905197',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f24533f9-cd95-40d4-98e6-9a9886faf3d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c118791808d4c159d077fd695a1a8c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:38:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:38:54Z,use_quota=True,user_id='e9781df6f60b438698fb7ebf4744a56e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)}" {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 06:38:54 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-efb9c3e4-f004-4611-9ace-db050c5a0ce4 tempest-VolumesListAdminTestJSON-1496945980 None] Creating volume f24533f9-cd95-40d4-98e6-9a9886faf3d0 {{(pid=87329) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 06:38:54 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-efb9c3e4-f004-4611-9ace-db050c5a0ce4 tempest-VolumesListAdminTestJSON-1496945980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:38:54 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-efb9c3e4-f004-4611-9ace-db050c5a0ce4 tempest-VolumesListAdminTestJSON-1496945980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:38:54 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-efb9c3e4-f004-4611-9ace-db050c5a0ce4 tempest-VolumesListAdminTestJSON-1496945980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:38:54 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-efb9c3e4-f004-4611-9ace-db050c5a0ce4 tempest-VolumesListAdminTestJSON-1496945980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:38:54 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-efb9c3e4-f004-4611-9ace-db050c5a0ce4 tempest-VolumesListAdminTestJSON-1496945980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:38:54 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-efb9c3e4-f004-4611-9ace-db050c5a0ce4 tempest-VolumesListAdminTestJSON-1496945980 None] Selected osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 as target Quobyte volume. {{(pid=87329) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 06:38:54 devstack cinder-volume[87329]: INFO cinder.volume.drivers.remotefs [None req-efb9c3e4-f004-4611-9ace-db050c5a0ce4 tempest-VolumesListAdminTestJSON-1496945980 None] casted to osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 Sep 06 06:38:54 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-efb9c3e4-f004-4611-9ace-db050c5a0ce4 tempest-VolumesListAdminTestJSON-1496945980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-f24533f9-cd95-40d4-98e6-9a9886faf3d0 1073741824 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:38:54 devstack sudo[96843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-f24533f9-cd95-40d4-98e6-9a9886faf3d0 1073741824 Sep 06 06:38:54 devstack sudo[96843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:38:54 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-3459e0e1-0b55-4dcb-a777-9538f76298af tempest-VolumesSnapshotNegativeTestJSON-704733707 None] Create snapshot completed successfully Sep 06 06:38:55 devstack sudo[96843]: pam_unix(sudo:session): session closed for user root Sep 06 06:38:55 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-efb9c3e4-f004-4611-9ace-db050c5a0ce4 tempest-VolumesListAdminTestJSON-1496945980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-f24533f9-cd95-40d4-98e6-9a9886faf3d0 1073741824" returned: 0 in 0.673s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:38:55 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-efb9c3e4-f004-4611-9ace-db050c5a0ce4 tempest-VolumesListAdminTestJSON-1496945980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-f24533f9-cd95-40d4-98e6-9a9886faf3d0 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:38:55 devstack sudo[96850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-f24533f9-cd95-40d4-98e6-9a9886faf3d0 Sep 06 06:38:55 devstack sudo[96850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:38:56 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-7d84f183-2cc8-4860-9bd2-2bad5e9b72ea tempest-VolumesSnapshotNegativeTestJSON-704733707 None] Acquiring lock "cinder-48dd4fe0-1262-4b7f-acba-c3c81e296103-delete_snapshot" by "delete_snapshot" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:38:56 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-7d84f183-2cc8-4860-9bd2-2bad5e9b72ea tempest-VolumesSnapshotNegativeTestJSON-704733707 None] Lock "cinder-48dd4fe0-1262-4b7f-acba-c3c81e296103-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:38:56 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-7d84f183-2cc8-4860-9bd2-2bad5e9b72ea tempest-VolumesSnapshotNegativeTestJSON-704733707 None] Acquiring lock "cinder-quobyte-a013ef45-cd9f-4b73-aaf0-568c754d6fa3" by "delete_snapshot" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:38:56 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-7d84f183-2cc8-4860-9bd2-2bad5e9b72ea tempest-VolumesSnapshotNegativeTestJSON-704733707 None] Lock "cinder-quobyte-a013ef45-cd9f-4b73-aaf0-568c754d6fa3" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:38:56 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-7d84f183-2cc8-4860-9bd2-2bad5e9b72ea tempest-VolumesSnapshotNegativeTestJSON-704733707 None] Acquiring lock "cinder-quobyte-48dd4fe0-1262-4b7f-acba-c3c81e296103" by "_delete_snapshot" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:38:56 devstack sudo[96850]: pam_unix(sudo:session): session closed for user root Sep 06 06:38:56 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-7d84f183-2cc8-4860-9bd2-2bad5e9b72ea tempest-VolumesSnapshotNegativeTestJSON-704733707 None] Lock "cinder-quobyte-48dd4fe0-1262-4b7f-acba-c3c81e296103" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:38:56 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-7d84f183-2cc8-4860-9bd2-2bad5e9b72ea tempest-VolumesSnapshotNegativeTestJSON-704733707 None] Deleting offline snapshot 48dd4fe0-1262-4b7f-acba-c3c81e296103 of volume a013ef45-cd9f-4b73-aaf0-568c754d6fa3 {{(pid=87329) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 06 06:38:56 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-7d84f183-2cc8-4860-9bd2-2bad5e9b72ea tempest-VolumesSnapshotNegativeTestJSON-704733707 None] snapshot_file for this snap is: volume-a013ef45-cd9f-4b73-aaf0-568c754d6fa3.48dd4fe0-1262-4b7f-acba-c3c81e296103 {{(pid=87329) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 06 06:38:56 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-efb9c3e4-f004-4611-9ace-db050c5a0ce4 tempest-VolumesListAdminTestJSON-1496945980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-f24533f9-cd95-40d4-98e6-9a9886faf3d0" returned: 0 in 0.656s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:38:56 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-efb9c3e4-f004-4611-9ace-db050c5a0ce4 tempest-VolumesListAdminTestJSON-1496945980 None] <== create_volume: return (1436ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'} {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 06:38:56 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-efb9c3e4-f004-4611-9ace-db050c5a0ce4 tempest-VolumesListAdminTestJSON-1496945980 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.442s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:38:56 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-efb9c3e4-f004-4611-9ace-db050c5a0ce4 tempest-VolumesListAdminTestJSON-1496945980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (298d3f0c-1ff4-4d30-829e-0b549a3bd5c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f24533f9-cd95-40d4-98e6-9a9886faf3d0', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:38:56 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-efb9c3e4-f004-4611-9ace-db050c5a0ce4 tempest-VolumesListAdminTestJSON-1496945980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e876b2a8-9a75-4fbb-ba60-45060ef227aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:38:56 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[94f75999-5f82-4962-b0e3-12aac704eed1]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:38:56 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-7d84f183-2cc8-4860-9bd2-2bad5e9b72ea tempest-VolumesSnapshotNegativeTestJSON-704733707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-a013ef45-cd9f-4b73-aaf0-568c754d6fa3.48dd4fe0-1262-4b7f-acba-c3c81e296103 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:38:56 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-efb9c3e4-f004-4611-9ace-db050c5a0ce4 tempest-VolumesListAdminTestJSON-1496945980 None] Volume volume-f24533f9-cd95-40d4-98e6-9a9886faf3d0 (f24533f9-cd95-40d4-98e6-9a9886faf3d0): created successfully Sep 06 06:38:56 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-efb9c3e4-f004-4611-9ace-db050c5a0ce4 tempest-VolumesListAdminTestJSON-1496945980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e876b2a8-9a75-4fbb-ba60-45060ef227aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:38:56 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-efb9c3e4-f004-4611-9ace-db050c5a0ce4 tempest-VolumesListAdminTestJSON-1496945980 None] Flow 'volume_create_manager' (72fce3b9-ee0e-43d5-94fb-fcc84dee5a32) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:38:56 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-efb9c3e4-f004-4611-9ace-db050c5a0ce4 tempest-VolumesListAdminTestJSON-1496945980 None] Created volume successfully. Sep 06 06:38:56 devstack sudo[96854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-a013ef45-cd9f-4b73-aaf0-568c754d6fa3.48dd4fe0-1262-4b7f-acba-c3c81e296103 Sep 06 06:38:56 devstack sudo[96854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:38:56 devstack sudo[96854]: pam_unix(sudo:session): session closed for user root Sep 06 06:38:56 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-7d84f183-2cc8-4860-9bd2-2bad5e9b72ea tempest-VolumesSnapshotNegativeTestJSON-704733707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-a013ef45-cd9f-4b73-aaf0-568c754d6fa3.48dd4fe0-1262-4b7f-acba-c3c81e296103" returned: 0 in 0.514s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:38:56 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-7d84f183-2cc8-4860-9bd2-2bad5e9b72ea tempest-VolumesSnapshotNegativeTestJSON-704733707 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a013ef45-cd9f-4b73-aaf0-568c754d6fa3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87329) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 06:38:56 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[005c10b4-be42-4cf4-91e1-7dfe7b5bb0ee]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:38:56 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-7d84f183-2cc8-4860-9bd2-2bad5e9b72ea tempest-VolumesSnapshotNegativeTestJSON-704733707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-a013ef45-cd9f-4b73-aaf0-568c754d6fa3 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:38:57 devstack sudo[96860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-a013ef45-cd9f-4b73-aaf0-568c754d6fa3 Sep 06 06:38:57 devstack sudo[96860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:38:57 devstack sudo[96860]: pam_unix(sudo:session): session closed for user root Sep 06 06:38:57 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-7d84f183-2cc8-4860-9bd2-2bad5e9b72ea tempest-VolumesSnapshotNegativeTestJSON-704733707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-a013ef45-cd9f-4b73-aaf0-568c754d6fa3" returned: 0 in 0.634s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:38:57 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-7d84f183-2cc8-4860-9bd2-2bad5e9b72ea tempest-VolumesSnapshotNegativeTestJSON-704733707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-a013ef45-cd9f-4b73-aaf0-568c754d6fa3.48dd4fe0-1262-4b7f-acba-c3c81e296103 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:38:57 devstack sudo[96871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-a013ef45-cd9f-4b73-aaf0-568c754d6fa3.48dd4fe0-1262-4b7f-acba-c3c81e296103 Sep 06 06:38:57 devstack sudo[96871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:38:57 devstack sudo[96871]: pam_unix(sudo:session): session closed for user root Sep 06 06:38:57 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-7d84f183-2cc8-4860-9bd2-2bad5e9b72ea tempest-VolumesSnapshotNegativeTestJSON-704733707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-a013ef45-cd9f-4b73-aaf0-568c754d6fa3.48dd4fe0-1262-4b7f-acba-c3c81e296103" returned: 0 in 0.489s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:38:57 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-7d84f183-2cc8-4860-9bd2-2bad5e9b72ea tempest-VolumesSnapshotNegativeTestJSON-704733707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-a013ef45-cd9f-4b73-aaf0-568c754d6fa3.48dd4fe0-1262-4b7f-acba-c3c81e296103 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:38:57 devstack sudo[96878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-a013ef45-cd9f-4b73-aaf0-568c754d6fa3.48dd4fe0-1262-4b7f-acba-c3c81e296103 Sep 06 06:38:57 devstack sudo[96878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:38:58 devstack sudo[96878]: pam_unix(sudo:session): session closed for user root Sep 06 06:38:58 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-7d84f183-2cc8-4860-9bd2-2bad5e9b72ea tempest-VolumesSnapshotNegativeTestJSON-704733707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-a013ef45-cd9f-4b73-aaf0-568c754d6fa3.48dd4fe0-1262-4b7f-acba-c3c81e296103" returned: 0 in 0.300s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:38:58 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb415911-c493-4c17-bec5-1d1e22ace99e tempest-VolumesListAdminTestJSON-1496945980 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87329) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 06:38:58 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-eb415911-c493-4c17-bec5-1d1e22ace99e tempest-VolumesListAdminTestJSON-1496945980 None] Flow 'volume_create_manager' (15b7b2ed-eb25-45da-b687-40ec1c7ad0b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:38:58 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-eb415911-c493-4c17-bec5-1d1e22ace99e tempest-VolumesListAdminTestJSON-1496945980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a285c9a-901a-4f4d-b941-46f96f6529eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:38:58 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-7d84f183-2cc8-4860-9bd2-2bad5e9b72ea tempest-VolumesSnapshotNegativeTestJSON-704733707 None] Lock "cinder-quobyte-48dd4fe0-1262-4b7f-acba-c3c81e296103" released by "_delete_snapshot" :: held 2.139s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:38:58 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-7d84f183-2cc8-4860-9bd2-2bad5e9b72ea tempest-VolumesSnapshotNegativeTestJSON-704733707 None] Lock "cinder-quobyte-a013ef45-cd9f-4b73-aaf0-568c754d6fa3" released by "delete_snapshot" :: held 2.185s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:38:58 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-eb415911-c493-4c17-bec5-1d1e22ace99e tempest-VolumesListAdminTestJSON-1496945980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a285c9a-901a-4f4d-b941-46f96f6529eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:38:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1817655171',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dad5b37f-5f4c-437d-afc0-f048dc8fd90b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c118791808d4c159d077fd695a1a8c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:38:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:38:58Z,use_quota=True,user_id='e9781df6f60b438698fb7ebf4744a56e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:38:58 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-eb415911-c493-4c17-bec5-1d1e22ace99e tempest-VolumesListAdminTestJSON-1496945980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (488b0ab5-013b-4dd6-8711-914d58293701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:38:58 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-eb415911-c493-4c17-bec5-1d1e22ace99e tempest-VolumesListAdminTestJSON-1496945980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (488b0ab5-013b-4dd6-8711-914d58293701) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:38:58 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-eb415911-c493-4c17-bec5-1d1e22ace99e tempest-VolumesListAdminTestJSON-1496945980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53758b56-2e7a-450e-ae38-c0bbdc0b21c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:38:58 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-eb415911-c493-4c17-bec5-1d1e22ace99e tempest-VolumesListAdminTestJSON-1496945980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53758b56-2e7a-450e-ae38-c0bbdc0b21c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dad5b37f-5f4c-437d-afc0-f048dc8fd90b', 'volume_name': 'volume-dad5b37f-5f4c-437d-afc0-f048dc8fd90b', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:38:58 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-eb415911-c493-4c17-bec5-1d1e22ace99e tempest-VolumesListAdminTestJSON-1496945980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cd5068c-c12e-4511-abdd-f2b082ee508d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:38:58 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-eb415911-c493-4c17-bec5-1d1e22ace99e tempest-VolumesListAdminTestJSON-1496945980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cd5068c-c12e-4511-abdd-f2b082ee508d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:38:58 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-eb415911-c493-4c17-bec5-1d1e22ace99e tempest-VolumesListAdminTestJSON-1496945980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0257b3e5-ca50-467a-8df8-19a9633bf768) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:38:58 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-eb415911-c493-4c17-bec5-1d1e22ace99e tempest-VolumesListAdminTestJSON-1496945980 None] Volume dad5b37f-5f4c-437d-afc0-f048dc8fd90b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dad5b37f-5f4c-437d-afc0-f048dc8fd90b', 'volume_size': 1} Sep 06 06:38:58 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-eb415911-c493-4c17-bec5-1d1e22ace99e tempest-VolumesListAdminTestJSON-1496945980 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:38:58 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-eb415911-c493-4c17-bec5-1d1e22ace99e tempest-VolumesListAdminTestJSON-1496945980 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:38:58 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-eb415911-c493-4c17-bec5-1d1e22ace99e tempest-VolumesListAdminTestJSON-1496945980 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:38:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1817655171',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dad5b37f-5f4c-437d-afc0-f048dc8fd90b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c118791808d4c159d077fd695a1a8c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:38:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:38:58Z,use_quota=True,user_id='e9781df6f60b438698fb7ebf4744a56e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)}" {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 06:38:58 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-eb415911-c493-4c17-bec5-1d1e22ace99e tempest-VolumesListAdminTestJSON-1496945980 None] Creating volume dad5b37f-5f4c-437d-afc0-f048dc8fd90b {{(pid=87329) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 06:38:58 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-eb415911-c493-4c17-bec5-1d1e22ace99e tempest-VolumesListAdminTestJSON-1496945980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:38:58 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-eb415911-c493-4c17-bec5-1d1e22ace99e tempest-VolumesListAdminTestJSON-1496945980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:38:58 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-eb415911-c493-4c17-bec5-1d1e22ace99e tempest-VolumesListAdminTestJSON-1496945980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:38:58 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-eb415911-c493-4c17-bec5-1d1e22ace99e tempest-VolumesListAdminTestJSON-1496945980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:38:58 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-eb415911-c493-4c17-bec5-1d1e22ace99e tempest-VolumesListAdminTestJSON-1496945980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:38:58 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-eb415911-c493-4c17-bec5-1d1e22ace99e tempest-VolumesListAdminTestJSON-1496945980 None] Selected osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 as target Quobyte volume. {{(pid=87329) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 06:38:58 devstack cinder-volume[87329]: INFO cinder.volume.drivers.remotefs [None req-eb415911-c493-4c17-bec5-1d1e22ace99e tempest-VolumesListAdminTestJSON-1496945980 None] casted to osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 Sep 06 06:38:58 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-eb415911-c493-4c17-bec5-1d1e22ace99e tempest-VolumesListAdminTestJSON-1496945980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-dad5b37f-5f4c-437d-afc0-f048dc8fd90b 1073741824 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:38:58 devstack sudo[96881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-dad5b37f-5f4c-437d-afc0-f048dc8fd90b 1073741824 Sep 06 06:38:58 devstack sudo[96881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:38:58 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-7d84f183-2cc8-4860-9bd2-2bad5e9b72ea tempest-VolumesSnapshotNegativeTestJSON-704733707 None] Created reservations ['cac79f9e-23e6-49c1-9bcd-7520a00644ad', '34a7d0ca-be5e-4fb1-a3a8-71bb58bd4ce7', '9d46e98a-b6de-43ef-b2d4-e6ff39cb3d6b', 'cdb34c1a-ad40-45e8-bcb6-11bd5cca2268'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:38:58 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-7d84f183-2cc8-4860-9bd2-2bad5e9b72ea tempest-VolumesSnapshotNegativeTestJSON-704733707 None] Delete snapshot completed successfully. Sep 06 06:38:58 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-7d84f183-2cc8-4860-9bd2-2bad5e9b72ea tempest-VolumesSnapshotNegativeTestJSON-704733707 None] Lock "cinder-48dd4fe0-1262-4b7f-acba-c3c81e296103-delete_snapshot" released by "delete_snapshot" :: held 2.488s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:38:58 devstack sudo[96881]: pam_unix(sudo:session): session closed for user root Sep 06 06:38:58 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-eb415911-c493-4c17-bec5-1d1e22ace99e tempest-VolumesListAdminTestJSON-1496945980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-dad5b37f-5f4c-437d-afc0-f048dc8fd90b 1073741824" returned: 0 in 0.476s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:38:58 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-eb415911-c493-4c17-bec5-1d1e22ace99e tempest-VolumesListAdminTestJSON-1496945980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-dad5b37f-5f4c-437d-afc0-f048dc8fd90b {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:38:58 devstack sudo[96887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-dad5b37f-5f4c-437d-afc0-f048dc8fd90b Sep 06 06:38:58 devstack sudo[96887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:38:59 devstack sudo[96887]: pam_unix(sudo:session): session closed for user root Sep 06 06:38:59 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-eb415911-c493-4c17-bec5-1d1e22ace99e tempest-VolumesListAdminTestJSON-1496945980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-dad5b37f-5f4c-437d-afc0-f048dc8fd90b" returned: 0 in 0.337s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:38:59 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-eb415911-c493-4c17-bec5-1d1e22ace99e tempest-VolumesListAdminTestJSON-1496945980 None] <== create_volume: return (861ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'} {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 06:38:59 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-eb415911-c493-4c17-bec5-1d1e22ace99e tempest-VolumesListAdminTestJSON-1496945980 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.864s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:38:59 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-eb415911-c493-4c17-bec5-1d1e22ace99e tempest-VolumesListAdminTestJSON-1496945980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0257b3e5-ca50-467a-8df8-19a9633bf768) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dad5b37f-5f4c-437d-afc0-f048dc8fd90b', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:38:59 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-eb415911-c493-4c17-bec5-1d1e22ace99e tempest-VolumesListAdminTestJSON-1496945980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c48c2de8-a8eb-4a4d-9535-c74afa9360be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:38:59 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-eb415911-c493-4c17-bec5-1d1e22ace99e tempest-VolumesListAdminTestJSON-1496945980 None] Volume volume-dad5b37f-5f4c-437d-afc0-f048dc8fd90b (dad5b37f-5f4c-437d-afc0-f048dc8fd90b): created successfully Sep 06 06:38:59 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-eb415911-c493-4c17-bec5-1d1e22ace99e tempest-VolumesListAdminTestJSON-1496945980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c48c2de8-a8eb-4a4d-9535-c74afa9360be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:38:59 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-eb415911-c493-4c17-bec5-1d1e22ace99e tempest-VolumesListAdminTestJSON-1496945980 None] Flow 'volume_create_manager' (15b7b2ed-eb25-45da-b687-40ec1c7ad0b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:38:59 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-eb415911-c493-4c17-bec5-1d1e22ace99e tempest-VolumesListAdminTestJSON-1496945980 None] Created volume successfully. Sep 06 06:38:59 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-be78a864-6448-42ce-9151-80d432572133 tempest-VolumesSnapshotNegativeTestJSON-704733707 None] Acquiring lock "cinder-a013ef45-cd9f-4b73-aaf0-568c754d6fa3-delete_volume" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:38:59 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-be78a864-6448-42ce-9151-80d432572133 tempest-VolumesSnapshotNegativeTestJSON-704733707 None] Lock "cinder-a013ef45-cd9f-4b73-aaf0-568c754d6fa3-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:38:59 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-be78a864-6448-42ce-9151-80d432572133 tempest-VolumesSnapshotNegativeTestJSON-704733707 None] Acquiring lock "cinder-quobyte-a013ef45-cd9f-4b73-aaf0-568c754d6fa3" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:38:59 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-be78a864-6448-42ce-9151-80d432572133 tempest-VolumesSnapshotNegativeTestJSON-704733707 None] Lock "cinder-quobyte-a013ef45-cd9f-4b73-aaf0-568c754d6fa3" acquired by "delete_volume" :: waited 0.016s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:38:59 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[36df65c8-b3d3-4b07-ae6f-bdd40c62a1d2]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:38:59 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-be78a864-6448-42ce-9151-80d432572133 tempest-VolumesSnapshotNegativeTestJSON-704733707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-a013ef45-cd9f-4b73-aaf0-568c754d6fa3 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:38:59 devstack sudo[96891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-a013ef45-cd9f-4b73-aaf0-568c754d6fa3 Sep 06 06:38:59 devstack sudo[96891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:38:59 devstack sudo[96891]: pam_unix(sudo:session): session closed for user root Sep 06 06:38:59 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-be78a864-6448-42ce-9151-80d432572133 tempest-VolumesSnapshotNegativeTestJSON-704733707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-a013ef45-cd9f-4b73-aaf0-568c754d6fa3" returned: 0 in 0.365s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:38:59 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-be78a864-6448-42ce-9151-80d432572133 tempest-VolumesSnapshotNegativeTestJSON-704733707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-a013ef45-cd9f-4b73-aaf0-568c754d6fa3 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:39:00 devstack sudo[96896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-a013ef45-cd9f-4b73-aaf0-568c754d6fa3 Sep 06 06:39:00 devstack sudo[96896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:39:00 devstack sudo[96896]: pam_unix(sudo:session): session closed for user root Sep 06 06:39:00 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-be78a864-6448-42ce-9151-80d432572133 tempest-VolumesSnapshotNegativeTestJSON-704733707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-a013ef45-cd9f-4b73-aaf0-568c754d6fa3" returned: 0 in 0.458s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:39:00 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-be78a864-6448-42ce-9151-80d432572133 tempest-VolumesSnapshotNegativeTestJSON-704733707 None] Lock "cinder-quobyte-a013ef45-cd9f-4b73-aaf0-568c754d6fa3" released by "delete_volume" :: held 0.885s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:39:00 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-be78a864-6448-42ce-9151-80d432572133 tempest-VolumesSnapshotNegativeTestJSON-704733707 None] Created reservations ['fd7cc366-de44-4fd3-93d6-f8efe8e557f9', '871b4214-3459-4694-b4d0-dd4fb514eb35', '31ebaf3e-101c-47a0-8fb8-ab8246c3d347', '23af60e0-4128-4b85-abe0-29a33fdba800'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:39:00 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-be78a864-6448-42ce-9151-80d432572133 tempest-VolumesSnapshotNegativeTestJSON-704733707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:39:00 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-be78a864-6448-42ce-9151-80d432572133 tempest-VolumesSnapshotNegativeTestJSON-704733707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:39:00 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-be78a864-6448-42ce-9151-80d432572133 tempest-VolumesSnapshotNegativeTestJSON-704733707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:39:00 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-be78a864-6448-42ce-9151-80d432572133 tempest-VolumesSnapshotNegativeTestJSON-704733707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:39:00 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-be78a864-6448-42ce-9151-80d432572133 tempest-VolumesSnapshotNegativeTestJSON-704733707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:39:00 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-be78a864-6448-42ce-9151-80d432572133 tempest-VolumesSnapshotNegativeTestJSON-704733707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:39:00 devstack sudo[96899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:39:00 devstack sudo[96899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:39:01 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8be8f63-cbed-4d9e-b7b5-02b03466c8db tempest-VolumesListAdminTestJSON-1496945980 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87329) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 06:39:01 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-f8be8f63-cbed-4d9e-b7b5-02b03466c8db tempest-VolumesListAdminTestJSON-1496945980 None] Flow 'volume_create_manager' (94a72091-d34c-4999-b4a7-0460dabe2a29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:39:01 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-f8be8f63-cbed-4d9e-b7b5-02b03466c8db tempest-VolumesListAdminTestJSON-1496945980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eed8b27c-03f4-4b9c-b514-78b47064ed5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:39:01 devstack sudo[96899]: pam_unix(sudo:session): session closed for user root Sep 06 06:39:01 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-be78a864-6448-42ce-9151-80d432572133 tempest-VolumesSnapshotNegativeTestJSON-704733707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.471s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:39:01 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-be78a864-6448-42ce-9151-80d432572133 tempest-VolumesSnapshotNegativeTestJSON-704733707 None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:39:01 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-f8be8f63-cbed-4d9e-b7b5-02b03466c8db tempest-VolumesListAdminTestJSON-1496945980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eed8b27c-03f4-4b9c-b514-78b47064ed5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:39:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1409494199',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56487097-f72e-4e49-b462-f9d397e5da38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c118791808d4c159d077fd695a1a8c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:39:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:39:01Z,use_quota=True,user_id='e9781df6f60b438698fb7ebf4744a56e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:39:01 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-f8be8f63-cbed-4d9e-b7b5-02b03466c8db tempest-VolumesListAdminTestJSON-1496945980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (267746a5-4d03-4964-8fa3-b9cc4204a846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:39:01 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-f8be8f63-cbed-4d9e-b7b5-02b03466c8db tempest-VolumesListAdminTestJSON-1496945980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (267746a5-4d03-4964-8fa3-b9cc4204a846) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:39:01 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-f8be8f63-cbed-4d9e-b7b5-02b03466c8db tempest-VolumesListAdminTestJSON-1496945980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bca26f58-7d24-4f50-9399-863b3c5c4c8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:39:01 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-f8be8f63-cbed-4d9e-b7b5-02b03466c8db tempest-VolumesListAdminTestJSON-1496945980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bca26f58-7d24-4f50-9399-863b3c5c4c8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56487097-f72e-4e49-b462-f9d397e5da38', 'volume_name': 'volume-56487097-f72e-4e49-b462-f9d397e5da38', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:39:01 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-f8be8f63-cbed-4d9e-b7b5-02b03466c8db tempest-VolumesListAdminTestJSON-1496945980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (077b7b56-ff92-4330-8738-7e4d0466bb94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:39:01 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-f8be8f63-cbed-4d9e-b7b5-02b03466c8db tempest-VolumesListAdminTestJSON-1496945980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (077b7b56-ff92-4330-8738-7e4d0466bb94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:39:01 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-f8be8f63-cbed-4d9e-b7b5-02b03466c8db tempest-VolumesListAdminTestJSON-1496945980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (298383bd-afa8-4c10-a492-99a05c8284e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:39:01 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-f8be8f63-cbed-4d9e-b7b5-02b03466c8db tempest-VolumesListAdminTestJSON-1496945980 None] Volume 56487097-f72e-4e49-b462-f9d397e5da38: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56487097-f72e-4e49-b462-f9d397e5da38', 'volume_size': 1} Sep 06 06:39:01 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-f8be8f63-cbed-4d9e-b7b5-02b03466c8db tempest-VolumesListAdminTestJSON-1496945980 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:39:01 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-f8be8f63-cbed-4d9e-b7b5-02b03466c8db tempest-VolumesListAdminTestJSON-1496945980 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:39:01 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-f8be8f63-cbed-4d9e-b7b5-02b03466c8db tempest-VolumesListAdminTestJSON-1496945980 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:39:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1409494199',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56487097-f72e-4e49-b462-f9d397e5da38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c118791808d4c159d077fd695a1a8c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:39:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:39:01Z,use_quota=True,user_id='e9781df6f60b438698fb7ebf4744a56e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)}" {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 06:39:01 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-f8be8f63-cbed-4d9e-b7b5-02b03466c8db tempest-VolumesListAdminTestJSON-1496945980 None] Creating volume 56487097-f72e-4e49-b462-f9d397e5da38 {{(pid=87329) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 06:39:01 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-f8be8f63-cbed-4d9e-b7b5-02b03466c8db tempest-VolumesListAdminTestJSON-1496945980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:39:01 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-f8be8f63-cbed-4d9e-b7b5-02b03466c8db tempest-VolumesListAdminTestJSON-1496945980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:39:01 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-f8be8f63-cbed-4d9e-b7b5-02b03466c8db tempest-VolumesListAdminTestJSON-1496945980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:39:01 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-f8be8f63-cbed-4d9e-b7b5-02b03466c8db tempest-VolumesListAdminTestJSON-1496945980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:39:01 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-f8be8f63-cbed-4d9e-b7b5-02b03466c8db tempest-VolumesListAdminTestJSON-1496945980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:39:01 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-f8be8f63-cbed-4d9e-b7b5-02b03466c8db tempest-VolumesListAdminTestJSON-1496945980 None] Selected osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 as target Quobyte volume. {{(pid=87329) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 06:39:01 devstack cinder-volume[87329]: INFO cinder.volume.drivers.remotefs [None req-f8be8f63-cbed-4d9e-b7b5-02b03466c8db tempest-VolumesListAdminTestJSON-1496945980 None] casted to osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 Sep 06 06:39:01 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-f8be8f63-cbed-4d9e-b7b5-02b03466c8db tempest-VolumesListAdminTestJSON-1496945980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-56487097-f72e-4e49-b462-f9d397e5da38 1073741824 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:39:01 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-be78a864-6448-42ce-9151-80d432572133 tempest-VolumesSnapshotNegativeTestJSON-704733707 None] Deleted volume successfully. Sep 06 06:39:01 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-be78a864-6448-42ce-9151-80d432572133 tempest-VolumesSnapshotNegativeTestJSON-704733707 None] Lock "cinder-a013ef45-cd9f-4b73-aaf0-568c754d6fa3-delete_volume" released by "delete_volume" :: held 1.807s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:39:01 devstack sudo[96902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-56487097-f72e-4e49-b462-f9d397e5da38 1073741824 Sep 06 06:39:01 devstack sudo[96902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:39:01 devstack sudo[96902]: pam_unix(sudo:session): session closed for user root Sep 06 06:39:01 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-f8be8f63-cbed-4d9e-b7b5-02b03466c8db tempest-VolumesListAdminTestJSON-1496945980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-56487097-f72e-4e49-b462-f9d397e5da38 1073741824" returned: 0 in 0.630s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:39:01 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-f8be8f63-cbed-4d9e-b7b5-02b03466c8db tempest-VolumesListAdminTestJSON-1496945980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-56487097-f72e-4e49-b462-f9d397e5da38 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:39:01 devstack sudo[96909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-56487097-f72e-4e49-b462-f9d397e5da38 Sep 06 06:39:01 devstack sudo[96909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:39:02 devstack sudo[96909]: pam_unix(sudo:session): session closed for user root Sep 06 06:39:02 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-f8be8f63-cbed-4d9e-b7b5-02b03466c8db tempest-VolumesListAdminTestJSON-1496945980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-56487097-f72e-4e49-b462-f9d397e5da38" returned: 0 in 0.349s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:39:02 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-f8be8f63-cbed-4d9e-b7b5-02b03466c8db tempest-VolumesListAdminTestJSON-1496945980 None] <== create_volume: return (1034ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'} {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 06:39:02 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-f8be8f63-cbed-4d9e-b7b5-02b03466c8db tempest-VolumesListAdminTestJSON-1496945980 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.036s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:39:02 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-f8be8f63-cbed-4d9e-b7b5-02b03466c8db tempest-VolumesListAdminTestJSON-1496945980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (298383bd-afa8-4c10-a492-99a05c8284e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56487097-f72e-4e49-b462-f9d397e5da38', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:39:02 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-f8be8f63-cbed-4d9e-b7b5-02b03466c8db tempest-VolumesListAdminTestJSON-1496945980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6f661f3-f55a-4f53-9e86-1d53ef51276c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:39:02 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-f8be8f63-cbed-4d9e-b7b5-02b03466c8db tempest-VolumesListAdminTestJSON-1496945980 None] Volume volume-56487097-f72e-4e49-b462-f9d397e5da38 (56487097-f72e-4e49-b462-f9d397e5da38): created successfully Sep 06 06:39:02 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-f8be8f63-cbed-4d9e-b7b5-02b03466c8db tempest-VolumesListAdminTestJSON-1496945980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6f661f3-f55a-4f53-9e86-1d53ef51276c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:39:02 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-f8be8f63-cbed-4d9e-b7b5-02b03466c8db tempest-VolumesListAdminTestJSON-1496945980 None] Flow 'volume_create_manager' (94a72091-d34c-4999-b4a7-0460dabe2a29) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:39:02 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-f8be8f63-cbed-4d9e-b7b5-02b03466c8db tempest-VolumesListAdminTestJSON-1496945980 None] Created volume successfully. Sep 06 06:39:04 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c085357-cd4c-4e9e-8536-9af876fd53b4 tempest-VolumesListAdminTestJSON-2130242956 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87329) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 06:39:04 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-2c085357-cd4c-4e9e-8536-9af876fd53b4 tempest-VolumesListAdminTestJSON-2130242956 None] Flow 'volume_create_manager' (c6f1bf68-48ab-4e7c-8d9b-74f5761b8225) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:39:04 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-2c085357-cd4c-4e9e-8536-9af876fd53b4 tempest-VolumesListAdminTestJSON-2130242956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (565b3456-8cd5-47bf-81c3-858db7a008dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:39:04 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-2c085357-cd4c-4e9e-8536-9af876fd53b4 tempest-VolumesListAdminTestJSON-2130242956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (565b3456-8cd5-47bf-81c3-858db7a008dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:39:04Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9db422a-0777-435b-8b4e-5f54c0b7b3c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1d64be2ccb8414fb883c7a82d27e4a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:39:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:39:04Z,use_quota=True,user_id='6c1dd4a5bff14d72bd714ff67f4366d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:39:04 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-2c085357-cd4c-4e9e-8536-9af876fd53b4 tempest-VolumesListAdminTestJSON-2130242956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5664e5be-56b6-4f02-b951-d2ee1c55c3f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:39:04 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-2c085357-cd4c-4e9e-8536-9af876fd53b4 tempest-VolumesListAdminTestJSON-2130242956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5664e5be-56b6-4f02-b951-d2ee1c55c3f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:39:04 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-2c085357-cd4c-4e9e-8536-9af876fd53b4 tempest-VolumesListAdminTestJSON-2130242956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9f3c576-4584-4bea-8228-9ac0edbd31ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:39:04 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-2c085357-cd4c-4e9e-8536-9af876fd53b4 tempest-VolumesListAdminTestJSON-2130242956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9f3c576-4584-4bea-8228-9ac0edbd31ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9db422a-0777-435b-8b4e-5f54c0b7b3c8', 'volume_name': 'volume-a9db422a-0777-435b-8b4e-5f54c0b7b3c8', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:39:04 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-2c085357-cd4c-4e9e-8536-9af876fd53b4 tempest-VolumesListAdminTestJSON-2130242956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f897207-1cdb-4685-aa93-f39464258d1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:39:04 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-2c085357-cd4c-4e9e-8536-9af876fd53b4 tempest-VolumesListAdminTestJSON-2130242956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f897207-1cdb-4685-aa93-f39464258d1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:39:04 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-2c085357-cd4c-4e9e-8536-9af876fd53b4 tempest-VolumesListAdminTestJSON-2130242956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3734d4ab-6bc0-4495-ada8-b1dd745024d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:39:04 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-2c085357-cd4c-4e9e-8536-9af876fd53b4 tempest-VolumesListAdminTestJSON-2130242956 None] Volume a9db422a-0777-435b-8b4e-5f54c0b7b3c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9db422a-0777-435b-8b4e-5f54c0b7b3c8', 'volume_size': 1} Sep 06 06:39:04 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-2c085357-cd4c-4e9e-8536-9af876fd53b4 tempest-VolumesListAdminTestJSON-2130242956 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:39:04 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-2c085357-cd4c-4e9e-8536-9af876fd53b4 tempest-VolumesListAdminTestJSON-2130242956 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:39:04 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-2c085357-cd4c-4e9e-8536-9af876fd53b4 tempest-VolumesListAdminTestJSON-2130242956 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:39:04Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9db422a-0777-435b-8b4e-5f54c0b7b3c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1d64be2ccb8414fb883c7a82d27e4a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:39:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:39:04Z,use_quota=True,user_id='6c1dd4a5bff14d72bd714ff67f4366d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)}" {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 06:39:04 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-2c085357-cd4c-4e9e-8536-9af876fd53b4 tempest-VolumesListAdminTestJSON-2130242956 None] Creating volume a9db422a-0777-435b-8b4e-5f54c0b7b3c8 {{(pid=87329) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 06:39:04 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-2c085357-cd4c-4e9e-8536-9af876fd53b4 tempest-VolumesListAdminTestJSON-2130242956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:39:04 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-2c085357-cd4c-4e9e-8536-9af876fd53b4 tempest-VolumesListAdminTestJSON-2130242956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:39:04 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-2c085357-cd4c-4e9e-8536-9af876fd53b4 tempest-VolumesListAdminTestJSON-2130242956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:39:04 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-2c085357-cd4c-4e9e-8536-9af876fd53b4 tempest-VolumesListAdminTestJSON-2130242956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:39:04 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-2c085357-cd4c-4e9e-8536-9af876fd53b4 tempest-VolumesListAdminTestJSON-2130242956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:39:04 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-2c085357-cd4c-4e9e-8536-9af876fd53b4 tempest-VolumesListAdminTestJSON-2130242956 None] Selected osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 as target Quobyte volume. {{(pid=87329) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 06:39:04 devstack cinder-volume[87329]: INFO cinder.volume.drivers.remotefs [None req-2c085357-cd4c-4e9e-8536-9af876fd53b4 tempest-VolumesListAdminTestJSON-2130242956 None] casted to osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 Sep 06 06:39:04 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-2c085357-cd4c-4e9e-8536-9af876fd53b4 tempest-VolumesListAdminTestJSON-2130242956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-a9db422a-0777-435b-8b4e-5f54c0b7b3c8 1073741824 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:39:04 devstack sudo[96915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-a9db422a-0777-435b-8b4e-5f54c0b7b3c8 1073741824 Sep 06 06:39:04 devstack sudo[96915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:39:05 devstack sudo[96915]: pam_unix(sudo:session): session closed for user root Sep 06 06:39:05 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-2c085357-cd4c-4e9e-8536-9af876fd53b4 tempest-VolumesListAdminTestJSON-2130242956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-a9db422a-0777-435b-8b4e-5f54c0b7b3c8 1073741824" returned: 0 in 0.649s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:39:05 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-2c085357-cd4c-4e9e-8536-9af876fd53b4 tempest-VolumesListAdminTestJSON-2130242956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-a9db422a-0777-435b-8b4e-5f54c0b7b3c8 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:39:05 devstack sudo[96935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-a9db422a-0777-435b-8b4e-5f54c0b7b3c8 Sep 06 06:39:05 devstack sudo[96935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:39:05 devstack sudo[96935]: pam_unix(sudo:session): session closed for user root Sep 06 06:39:05 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-2c085357-cd4c-4e9e-8536-9af876fd53b4 tempest-VolumesListAdminTestJSON-2130242956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-a9db422a-0777-435b-8b4e-5f54c0b7b3c8" returned: 0 in 0.520s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:39:05 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-2c085357-cd4c-4e9e-8536-9af876fd53b4 tempest-VolumesListAdminTestJSON-2130242956 None] <== create_volume: return (1286ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'} {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 06:39:05 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-2c085357-cd4c-4e9e-8536-9af876fd53b4 tempest-VolumesListAdminTestJSON-2130242956 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.291s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:39:05 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-2c085357-cd4c-4e9e-8536-9af876fd53b4 tempest-VolumesListAdminTestJSON-2130242956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3734d4ab-6bc0-4495-ada8-b1dd745024d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9db422a-0777-435b-8b4e-5f54c0b7b3c8', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:39:05 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-2c085357-cd4c-4e9e-8536-9af876fd53b4 tempest-VolumesListAdminTestJSON-2130242956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f2c3a9c-09a5-4e41-8793-abde07e59c9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:39:06 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-2c085357-cd4c-4e9e-8536-9af876fd53b4 tempest-VolumesListAdminTestJSON-2130242956 None] Volume volume-a9db422a-0777-435b-8b4e-5f54c0b7b3c8 (a9db422a-0777-435b-8b4e-5f54c0b7b3c8): created successfully Sep 06 06:39:06 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-2c085357-cd4c-4e9e-8536-9af876fd53b4 tempest-VolumesListAdminTestJSON-2130242956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f2c3a9c-09a5-4e41-8793-abde07e59c9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:39:06 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-2c085357-cd4c-4e9e-8536-9af876fd53b4 tempest-VolumesListAdminTestJSON-2130242956 None] Flow 'volume_create_manager' (c6f1bf68-48ab-4e7c-8d9b-74f5761b8225) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:39:06 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-2c085357-cd4c-4e9e-8536-9af876fd53b4 tempest-VolumesListAdminTestJSON-2130242956 None] Created volume successfully. Sep 06 06:39:06 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a90e9f7-5db1-434b-8c3b-63dc7abf0c31 tempest-CreateVolumesFromImageTest-237718682 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87329) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 06:39:06 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-2a90e9f7-5db1-434b-8c3b-63dc7abf0c31 tempest-CreateVolumesFromImageTest-237718682 None] Flow 'volume_create_manager' (5e8d68a3-903b-4316-92e4-6cbfb18600b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:39:06 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-2a90e9f7-5db1-434b-8c3b-63dc7abf0c31 tempest-CreateVolumesFromImageTest-237718682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35e381d5-826e-4689-886d-720d56d8c2e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:39:06 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-2a90e9f7-5db1-434b-8c3b-63dc7abf0c31 tempest-CreateVolumesFromImageTest-237718682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35e381d5-826e-4689-886d-720d56d8c2e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:39:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-284739564',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=524883e6-d874-4ee6-9ad0-146db54941c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82cc621f1aa04354a30a1f9be6f70d85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:39:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:39:06Z,use_quota=True,user_id='4ae46ca5b7e643b28209a7d374b21186',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:39:06 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-2a90e9f7-5db1-434b-8c3b-63dc7abf0c31 tempest-CreateVolumesFromImageTest-237718682 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91482c25-de5f-4987-aa0f-def0a8f3d4c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:39:06 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-2a90e9f7-5db1-434b-8c3b-63dc7abf0c31 tempest-CreateVolumesFromImageTest-237718682 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91482c25-de5f-4987-aa0f-def0a8f3d4c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:39:06 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-2a90e9f7-5db1-434b-8c3b-63dc7abf0c31 tempest-CreateVolumesFromImageTest-237718682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfd06781-38be-42db-acf2-49c6a849aa67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:39:06 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-2a90e9f7-5db1-434b-8c3b-63dc7abf0c31 tempest-CreateVolumesFromImageTest-237718682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfd06781-38be-42db-acf2-49c6a849aa67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '524883e6-d874-4ee6-9ad0-146db54941c5', 'volume_name': 'volume-524883e6-d874-4ee6-9ad0-146db54941c5', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:39:06 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-2a90e9f7-5db1-434b-8c3b-63dc7abf0c31 tempest-CreateVolumesFromImageTest-237718682 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c410657-d599-44f2-baaf-45db665172dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:39:06 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-2a90e9f7-5db1-434b-8c3b-63dc7abf0c31 tempest-CreateVolumesFromImageTest-237718682 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c410657-d599-44f2-baaf-45db665172dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:39:06 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-2a90e9f7-5db1-434b-8c3b-63dc7abf0c31 tempest-CreateVolumesFromImageTest-237718682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11b562d9-5a46-4be6-9777-42a7934087e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:39:06 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-2a90e9f7-5db1-434b-8c3b-63dc7abf0c31 tempest-CreateVolumesFromImageTest-237718682 None] Volume 524883e6-d874-4ee6-9ad0-146db54941c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-524883e6-d874-4ee6-9ad0-146db54941c5', 'volume_size': 1} Sep 06 06:39:06 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-2a90e9f7-5db1-434b-8c3b-63dc7abf0c31 tempest-CreateVolumesFromImageTest-237718682 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:39:06 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-2a90e9f7-5db1-434b-8c3b-63dc7abf0c31 tempest-CreateVolumesFromImageTest-237718682 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:39:06 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-2a90e9f7-5db1-434b-8c3b-63dc7abf0c31 tempest-CreateVolumesFromImageTest-237718682 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:39:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-284739564',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=524883e6-d874-4ee6-9ad0-146db54941c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82cc621f1aa04354a30a1f9be6f70d85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:39:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:39:06Z,use_quota=True,user_id='4ae46ca5b7e643b28209a7d374b21186',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)}" {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 06:39:06 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-2a90e9f7-5db1-434b-8c3b-63dc7abf0c31 tempest-CreateVolumesFromImageTest-237718682 None] Creating volume 524883e6-d874-4ee6-9ad0-146db54941c5 {{(pid=87329) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 06:39:06 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-2a90e9f7-5db1-434b-8c3b-63dc7abf0c31 tempest-CreateVolumesFromImageTest-237718682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:39:06 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-2a90e9f7-5db1-434b-8c3b-63dc7abf0c31 tempest-CreateVolumesFromImageTest-237718682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:39:06 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-2a90e9f7-5db1-434b-8c3b-63dc7abf0c31 tempest-CreateVolumesFromImageTest-237718682 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:39:06 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-2a90e9f7-5db1-434b-8c3b-63dc7abf0c31 tempest-CreateVolumesFromImageTest-237718682 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:39:06 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-2a90e9f7-5db1-434b-8c3b-63dc7abf0c31 tempest-CreateVolumesFromImageTest-237718682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:39:06 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-2a90e9f7-5db1-434b-8c3b-63dc7abf0c31 tempest-CreateVolumesFromImageTest-237718682 None] Selected osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 as target Quobyte volume. {{(pid=87329) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 06:39:06 devstack cinder-volume[87329]: INFO cinder.volume.drivers.remotefs [None req-2a90e9f7-5db1-434b-8c3b-63dc7abf0c31 tempest-CreateVolumesFromImageTest-237718682 None] casted to osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 Sep 06 06:39:06 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-2a90e9f7-5db1-434b-8c3b-63dc7abf0c31 tempest-CreateVolumesFromImageTest-237718682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-524883e6-d874-4ee6-9ad0-146db54941c5 1073741824 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:39:06 devstack sudo[96945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-524883e6-d874-4ee6-9ad0-146db54941c5 1073741824 Sep 06 06:39:06 devstack sudo[96945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:39:06 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-2f5131ba-93af-4a9f-a802-3aa03689814e tempest-VolumesListAdminTestJSON-2130242956 None] Acquiring lock "cinder-a9db422a-0777-435b-8b4e-5f54c0b7b3c8-delete_volume" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:39:06 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-2f5131ba-93af-4a9f-a802-3aa03689814e tempest-VolumesListAdminTestJSON-2130242956 None] Lock "cinder-a9db422a-0777-435b-8b4e-5f54c0b7b3c8-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:39:06 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8a4866e-2c4f-4690-83ad-a4c30d683f54 tempest-CreateVolumesFromImageTest-237718682 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87329) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 06:39:06 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-f8a4866e-2c4f-4690-83ad-a4c30d683f54 tempest-CreateVolumesFromImageTest-237718682 None] Flow 'volume_create_manager' (006ba3ec-bf7a-466f-a5ce-e6f89641a415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:39:06 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-f8a4866e-2c4f-4690-83ad-a4c30d683f54 tempest-CreateVolumesFromImageTest-237718682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0852da0-ba7c-496a-8390-2842b96ad0b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:39:06 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-f8a4866e-2c4f-4690-83ad-a4c30d683f54 tempest-CreateVolumesFromImageTest-237718682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0852da0-ba7c-496a-8390-2842b96ad0b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:39:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1119495407',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7c8b366-13b5-453e-bda4-ef7eabee0705,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82cc621f1aa04354a30a1f9be6f70d85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:39:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:39:07Z,use_quota=True,user_id='4ae46ca5b7e643b28209a7d374b21186',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:39:06 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-f8a4866e-2c4f-4690-83ad-a4c30d683f54 tempest-CreateVolumesFromImageTest-237718682 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eaa0eb35-8497-4c84-946b-5ce16845e67a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:39:06 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-f8a4866e-2c4f-4690-83ad-a4c30d683f54 tempest-CreateVolumesFromImageTest-237718682 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eaa0eb35-8497-4c84-946b-5ce16845e67a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:39:06 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-f8a4866e-2c4f-4690-83ad-a4c30d683f54 tempest-CreateVolumesFromImageTest-237718682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51b90bcd-51c5-41d8-b2fb-6af6dcda91fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:39:06 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-f8a4866e-2c4f-4690-83ad-a4c30d683f54 tempest-CreateVolumesFromImageTest-237718682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51b90bcd-51c5-41d8-b2fb-6af6dcda91fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7c8b366-13b5-453e-bda4-ef7eabee0705', 'volume_name': 'volume-c7c8b366-13b5-453e-bda4-ef7eabee0705', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:39:07 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-f8a4866e-2c4f-4690-83ad-a4c30d683f54 tempest-CreateVolumesFromImageTest-237718682 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (985068d2-1a75-42b0-af2b-5a5ac8f43463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:39:07 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-f8a4866e-2c4f-4690-83ad-a4c30d683f54 tempest-CreateVolumesFromImageTest-237718682 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (985068d2-1a75-42b0-af2b-5a5ac8f43463) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:39:07 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-f8a4866e-2c4f-4690-83ad-a4c30d683f54 tempest-CreateVolumesFromImageTest-237718682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d78280af-9b1f-4d33-97f7-e2135711b5ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:39:07 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-f8a4866e-2c4f-4690-83ad-a4c30d683f54 tempest-CreateVolumesFromImageTest-237718682 None] Volume c7c8b366-13b5-453e-bda4-ef7eabee0705: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7c8b366-13b5-453e-bda4-ef7eabee0705', 'volume_size': 1} Sep 06 06:39:07 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-f8a4866e-2c4f-4690-83ad-a4c30d683f54 tempest-CreateVolumesFromImageTest-237718682 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:39:07 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-a98499cd-fa74-4238-932d-d7da386e48d6 tempest-VolumesListAdminTestJSON-1496945980 None] Acquiring lock "cinder-56487097-f72e-4e49-b462-f9d397e5da38-delete_volume" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:39:07 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-2f5131ba-93af-4a9f-a802-3aa03689814e tempest-VolumesListAdminTestJSON-2130242956 None] Acquiring lock "cinder-quobyte-a9db422a-0777-435b-8b4e-5f54c0b7b3c8" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:39:07 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-a98499cd-fa74-4238-932d-d7da386e48d6 tempest-VolumesListAdminTestJSON-1496945980 None] Lock "cinder-56487097-f72e-4e49-b462-f9d397e5da38-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:39:07 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-2f5131ba-93af-4a9f-a802-3aa03689814e tempest-VolumesListAdminTestJSON-2130242956 None] Lock "cinder-quobyte-a9db422a-0777-435b-8b4e-5f54c0b7b3c8" acquired by "delete_volume" :: waited 0.048s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:39:07 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[062ce550-666a-4b14-94c2-c5df9d555d54]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:39:07 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-2f5131ba-93af-4a9f-a802-3aa03689814e tempest-VolumesListAdminTestJSON-2130242956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-a9db422a-0777-435b-8b4e-5f54c0b7b3c8 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:39:07 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-a98499cd-fa74-4238-932d-d7da386e48d6 tempest-VolumesListAdminTestJSON-1496945980 None] Acquiring lock "cinder-quobyte-56487097-f72e-4e49-b462-f9d397e5da38" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:39:07 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-a98499cd-fa74-4238-932d-d7da386e48d6 tempest-VolumesListAdminTestJSON-1496945980 None] Lock "cinder-quobyte-56487097-f72e-4e49-b462-f9d397e5da38" acquired by "delete_volume" :: waited 0.027s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:39:07 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4f37ca4-5ae4-45d6-8439-53be0a8331c9]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:39:07 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-a98499cd-fa74-4238-932d-d7da386e48d6 tempest-VolumesListAdminTestJSON-1496945980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-56487097-f72e-4e49-b462-f9d397e5da38 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:39:07 devstack sudo[96951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-a9db422a-0777-435b-8b4e-5f54c0b7b3c8 Sep 06 06:39:07 devstack sudo[96951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:39:07 devstack sudo[96945]: pam_unix(sudo:session): session closed for user root Sep 06 06:39:07 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-2a90e9f7-5db1-434b-8c3b-63dc7abf0c31 tempest-CreateVolumesFromImageTest-237718682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-524883e6-d874-4ee6-9ad0-146db54941c5 1073741824" returned: 0 in 0.717s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:39:07 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-2a90e9f7-5db1-434b-8c3b-63dc7abf0c31 tempest-CreateVolumesFromImageTest-237718682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-524883e6-d874-4ee6-9ad0-146db54941c5 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:39:07 devstack sudo[96952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-56487097-f72e-4e49-b462-f9d397e5da38 Sep 06 06:39:07 devstack sudo[96952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:39:07 devstack sudo[96954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-524883e6-d874-4ee6-9ad0-146db54941c5 Sep 06 06:39:07 devstack sudo[96954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:39:07 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-a71d20cb-113f-4622-a6a5-91a10d67780f tempest-CreateVolumesFromImageTest-237718682 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87329) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 06:39:07 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-a71d20cb-113f-4622-a6a5-91a10d67780f tempest-CreateVolumesFromImageTest-237718682 None] Flow 'volume_create_manager' (4564e7ec-3c06-4bab-a210-ab2ada92765e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:39:07 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-a71d20cb-113f-4622-a6a5-91a10d67780f tempest-CreateVolumesFromImageTest-237718682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9401b01-18ed-497b-a28e-aa3de3dcc053) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:39:07 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-a71d20cb-113f-4622-a6a5-91a10d67780f tempest-CreateVolumesFromImageTest-237718682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9401b01-18ed-497b-a28e-aa3de3dcc053) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:39:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1324357135',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7179551a-7197-4313-892a-1bdee2f669ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82cc621f1aa04354a30a1f9be6f70d85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:39:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:39:07Z,use_quota=True,user_id='4ae46ca5b7e643b28209a7d374b21186',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:39:07 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-a71d20cb-113f-4622-a6a5-91a10d67780f tempest-CreateVolumesFromImageTest-237718682 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4f3cad8-1f72-42e1-944c-88305c6d4ad2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:39:07 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-a71d20cb-113f-4622-a6a5-91a10d67780f tempest-CreateVolumesFromImageTest-237718682 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4f3cad8-1f72-42e1-944c-88305c6d4ad2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:39:07 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-a71d20cb-113f-4622-a6a5-91a10d67780f tempest-CreateVolumesFromImageTest-237718682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87a77aa6-8c7f-4db9-a709-fcb07889fc97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:39:07 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-a71d20cb-113f-4622-a6a5-91a10d67780f tempest-CreateVolumesFromImageTest-237718682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87a77aa6-8c7f-4db9-a709-fcb07889fc97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7179551a-7197-4313-892a-1bdee2f669ee', 'volume_name': 'volume-7179551a-7197-4313-892a-1bdee2f669ee', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:39:07 devstack sudo[96951]: pam_unix(sudo:session): session closed for user root Sep 06 06:39:07 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-a71d20cb-113f-4622-a6a5-91a10d67780f tempest-CreateVolumesFromImageTest-237718682 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4ea15ac-3cd0-4422-934a-25ebe5a12570) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:39:07 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-a71d20cb-113f-4622-a6a5-91a10d67780f tempest-CreateVolumesFromImageTest-237718682 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4ea15ac-3cd0-4422-934a-25ebe5a12570) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:39:07 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-a71d20cb-113f-4622-a6a5-91a10d67780f tempest-CreateVolumesFromImageTest-237718682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45abe9db-cfbf-4a94-a613-57509f39d883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:39:07 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-a71d20cb-113f-4622-a6a5-91a10d67780f tempest-CreateVolumesFromImageTest-237718682 None] Volume 7179551a-7197-4313-892a-1bdee2f669ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7179551a-7197-4313-892a-1bdee2f669ee', 'volume_size': 1} Sep 06 06:39:07 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-a71d20cb-113f-4622-a6a5-91a10d67780f tempest-CreateVolumesFromImageTest-237718682 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:39:07 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-2f5131ba-93af-4a9f-a802-3aa03689814e tempest-VolumesListAdminTestJSON-2130242956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-a9db422a-0777-435b-8b4e-5f54c0b7b3c8" returned: 0 in 0.587s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:39:07 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-2f5131ba-93af-4a9f-a802-3aa03689814e tempest-VolumesListAdminTestJSON-2130242956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-a9db422a-0777-435b-8b4e-5f54c0b7b3c8 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:39:07 devstack sudo[96962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-a9db422a-0777-435b-8b4e-5f54c0b7b3c8 Sep 06 06:39:07 devstack sudo[96962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:39:07 devstack sudo[96952]: pam_unix(sudo:session): session closed for user root Sep 06 06:39:07 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-a98499cd-fa74-4238-932d-d7da386e48d6 tempest-VolumesListAdminTestJSON-1496945980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-56487097-f72e-4e49-b462-f9d397e5da38" returned: 0 in 0.638s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:39:07 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-a98499cd-fa74-4238-932d-d7da386e48d6 tempest-VolumesListAdminTestJSON-1496945980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-56487097-f72e-4e49-b462-f9d397e5da38 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:39:07 devstack sudo[96954]: pam_unix(sudo:session): session closed for user root Sep 06 06:39:07 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-2a90e9f7-5db1-434b-8c3b-63dc7abf0c31 tempest-CreateVolumesFromImageTest-237718682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-524883e6-d874-4ee6-9ad0-146db54941c5" returned: 0 in 0.504s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:39:07 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-2a90e9f7-5db1-434b-8c3b-63dc7abf0c31 tempest-CreateVolumesFromImageTest-237718682 None] <== create_volume: return (1316ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'} {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 06:39:07 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-2a90e9f7-5db1-434b-8c3b-63dc7abf0c31 tempest-CreateVolumesFromImageTest-237718682 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.321s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:39:07 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-f8a4866e-2c4f-4690-83ad-a4c30d683f54 tempest-CreateVolumesFromImageTest-237718682 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.930s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:39:07 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-f8a4866e-2c4f-4690-83ad-a4c30d683f54 tempest-CreateVolumesFromImageTest-237718682 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:39:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1119495407',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7c8b366-13b5-453e-bda4-ef7eabee0705,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82cc621f1aa04354a30a1f9be6f70d85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:39:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:39:07Z,use_quota=True,user_id='4ae46ca5b7e643b28209a7d374b21186',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)}" {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 06:39:07 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-f8a4866e-2c4f-4690-83ad-a4c30d683f54 tempest-CreateVolumesFromImageTest-237718682 None] Creating volume c7c8b366-13b5-453e-bda4-ef7eabee0705 {{(pid=87329) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 06:39:07 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-f8a4866e-2c4f-4690-83ad-a4c30d683f54 tempest-CreateVolumesFromImageTest-237718682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:39:07 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-f8a4866e-2c4f-4690-83ad-a4c30d683f54 tempest-CreateVolumesFromImageTest-237718682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:39:07 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-f8a4866e-2c4f-4690-83ad-a4c30d683f54 tempest-CreateVolumesFromImageTest-237718682 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:39:07 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-f8a4866e-2c4f-4690-83ad-a4c30d683f54 tempest-CreateVolumesFromImageTest-237718682 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:39:07 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-f8a4866e-2c4f-4690-83ad-a4c30d683f54 tempest-CreateVolumesFromImageTest-237718682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:39:07 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-f8a4866e-2c4f-4690-83ad-a4c30d683f54 tempest-CreateVolumesFromImageTest-237718682 None] Selected osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 as target Quobyte volume. {{(pid=87329) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 06:39:07 devstack cinder-volume[87329]: INFO cinder.volume.drivers.remotefs [None req-f8a4866e-2c4f-4690-83ad-a4c30d683f54 tempest-CreateVolumesFromImageTest-237718682 None] casted to osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 Sep 06 06:39:07 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-f8a4866e-2c4f-4690-83ad-a4c30d683f54 tempest-CreateVolumesFromImageTest-237718682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-c7c8b366-13b5-453e-bda4-ef7eabee0705 1073741824 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:39:07 devstack sudo[96966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-56487097-f72e-4e49-b462-f9d397e5da38 Sep 06 06:39:07 devstack sudo[96966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:39:08 devstack sudo[96968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-c7c8b366-13b5-453e-bda4-ef7eabee0705 1073741824 Sep 06 06:39:08 devstack sudo[96968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:39:08 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-2a90e9f7-5db1-434b-8c3b-63dc7abf0c31 tempest-CreateVolumesFromImageTest-237718682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11b562d9-5a46-4be6-9777-42a7934087e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-524883e6-d874-4ee6-9ad0-146db54941c5', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:39:08 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-2a90e9f7-5db1-434b-8c3b-63dc7abf0c31 tempest-CreateVolumesFromImageTest-237718682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0af130c9-90b5-4f2a-878f-999aa6b0a25d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:39:08 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-2a90e9f7-5db1-434b-8c3b-63dc7abf0c31 tempest-CreateVolumesFromImageTest-237718682 None] Volume volume-524883e6-d874-4ee6-9ad0-146db54941c5 (524883e6-d874-4ee6-9ad0-146db54941c5): created successfully Sep 06 06:39:08 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-2a90e9f7-5db1-434b-8c3b-63dc7abf0c31 tempest-CreateVolumesFromImageTest-237718682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0af130c9-90b5-4f2a-878f-999aa6b0a25d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:39:08 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-2a90e9f7-5db1-434b-8c3b-63dc7abf0c31 tempest-CreateVolumesFromImageTest-237718682 None] Flow 'volume_create_manager' (5e8d68a3-903b-4316-92e4-6cbfb18600b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:39:08 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-2a90e9f7-5db1-434b-8c3b-63dc7abf0c31 tempest-CreateVolumesFromImageTest-237718682 None] Created volume successfully. Sep 06 06:39:08 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-608b43d5-0a7e-4c96-a278-661c16b86d85 tempest-CreateVolumesFromImageTest-237718682 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87329) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 06:39:08 devstack sudo[96962]: pam_unix(sudo:session): session closed for user root Sep 06 06:39:08 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-608b43d5-0a7e-4c96-a278-661c16b86d85 tempest-CreateVolumesFromImageTest-237718682 None] Flow 'volume_create_manager' (8b1a17b1-4aad-448d-88bb-a40725fd6d38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:39:08 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-608b43d5-0a7e-4c96-a278-661c16b86d85 tempest-CreateVolumesFromImageTest-237718682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abbfa348-32d8-4f40-ab5e-34fbc6504f56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:39:08 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-2f5131ba-93af-4a9f-a802-3aa03689814e tempest-VolumesListAdminTestJSON-2130242956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-a9db422a-0777-435b-8b4e-5f54c0b7b3c8" returned: 0 in 0.563s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:39:08 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-608b43d5-0a7e-4c96-a278-661c16b86d85 tempest-CreateVolumesFromImageTest-237718682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abbfa348-32d8-4f40-ab5e-34fbc6504f56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:39:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1176671462',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f377e3fa-6b9c-4f0a-90ce-4b1fb4254636,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82cc621f1aa04354a30a1f9be6f70d85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:39:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:39:08Z,use_quota=True,user_id='4ae46ca5b7e643b28209a7d374b21186',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:39:08 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-608b43d5-0a7e-4c96-a278-661c16b86d85 tempest-CreateVolumesFromImageTest-237718682 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bbdac73-6231-4df9-974d-3c277996f7ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:39:08 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-608b43d5-0a7e-4c96-a278-661c16b86d85 tempest-CreateVolumesFromImageTest-237718682 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bbdac73-6231-4df9-974d-3c277996f7ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:39:08 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-608b43d5-0a7e-4c96-a278-661c16b86d85 tempest-CreateVolumesFromImageTest-237718682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (677004e8-7b63-4c90-89f0-70ec213adc49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:39:08 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-608b43d5-0a7e-4c96-a278-661c16b86d85 tempest-CreateVolumesFromImageTest-237718682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (677004e8-7b63-4c90-89f0-70ec213adc49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f377e3fa-6b9c-4f0a-90ce-4b1fb4254636', 'volume_name': 'volume-f377e3fa-6b9c-4f0a-90ce-4b1fb4254636', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:39:08 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-608b43d5-0a7e-4c96-a278-661c16b86d85 tempest-CreateVolumesFromImageTest-237718682 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (514853f2-9f3f-4129-8b14-2e5a6effaab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:39:08 devstack sudo[96966]: pam_unix(sudo:session): session closed for user root Sep 06 06:39:08 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-608b43d5-0a7e-4c96-a278-661c16b86d85 tempest-CreateVolumesFromImageTest-237718682 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (514853f2-9f3f-4129-8b14-2e5a6effaab5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:39:08 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-608b43d5-0a7e-4c96-a278-661c16b86d85 tempest-CreateVolumesFromImageTest-237718682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de58abca-4fe6-490d-8277-4e8ce3d2b4e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:39:08 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-608b43d5-0a7e-4c96-a278-661c16b86d85 tempest-CreateVolumesFromImageTest-237718682 None] Volume f377e3fa-6b9c-4f0a-90ce-4b1fb4254636: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f377e3fa-6b9c-4f0a-90ce-4b1fb4254636', 'volume_size': 1} Sep 06 06:39:08 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-608b43d5-0a7e-4c96-a278-661c16b86d85 tempest-CreateVolumesFromImageTest-237718682 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:39:08 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-2f5131ba-93af-4a9f-a802-3aa03689814e tempest-VolumesListAdminTestJSON-2130242956 None] Lock "cinder-quobyte-a9db422a-0777-435b-8b4e-5f54c0b7b3c8" released by "delete_volume" :: held 1.343s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:39:08 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-a98499cd-fa74-4238-932d-d7da386e48d6 tempest-VolumesListAdminTestJSON-1496945980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-56487097-f72e-4e49-b462-f9d397e5da38" returned: 0 in 0.563s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:39:08 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-a98499cd-fa74-4238-932d-d7da386e48d6 tempest-VolumesListAdminTestJSON-1496945980 None] Lock "cinder-quobyte-56487097-f72e-4e49-b462-f9d397e5da38" released by "delete_volume" :: held 1.271s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:39:08 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-2f5131ba-93af-4a9f-a802-3aa03689814e tempest-VolumesListAdminTestJSON-2130242956 None] Created reservations ['b6307bd6-18b1-4623-b296-912ddeda58a2', '587aed33-3571-497f-a477-e24ee19e3ac5', '2cdf0e57-f474-45ac-9381-43c775d6d003', 'c5335347-1b1a-44bd-8dc9-3fe7cebd6153'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:39:08 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-a98499cd-fa74-4238-932d-d7da386e48d6 tempest-VolumesListAdminTestJSON-1496945980 None] Created reservations ['53b01a48-3bfc-43ef-ac6c-1edadbdcc5a9', '1394cd4d-0b6d-4a8d-b754-1d6863743327', '13938149-7273-4808-a2a6-05f717d84029', 'cb732aa4-aadb-4993-bff2-3ffb1c94403c'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:39:08 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-2f5131ba-93af-4a9f-a802-3aa03689814e tempest-VolumesListAdminTestJSON-2130242956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:39:08 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-2f5131ba-93af-4a9f-a802-3aa03689814e tempest-VolumesListAdminTestJSON-2130242956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:39:08 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-2f5131ba-93af-4a9f-a802-3aa03689814e tempest-VolumesListAdminTestJSON-2130242956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:39:08 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-2f5131ba-93af-4a9f-a802-3aa03689814e tempest-VolumesListAdminTestJSON-2130242956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:39:08 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-2f5131ba-93af-4a9f-a802-3aa03689814e tempest-VolumesListAdminTestJSON-2130242956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:39:08 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-2f5131ba-93af-4a9f-a802-3aa03689814e tempest-VolumesListAdminTestJSON-2130242956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:39:08 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-d230d7c7-8dbc-4d37-9d8a-c7c46e3c6237 tempest-CreateVolumesFromImageTest-237718682 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87329) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 06:39:08 devstack sudo[96976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:39:08 devstack sudo[96976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:39:08 devstack sudo[96968]: pam_unix(sudo:session): session closed for user root Sep 06 06:39:08 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-d230d7c7-8dbc-4d37-9d8a-c7c46e3c6237 tempest-CreateVolumesFromImageTest-237718682 None] Flow 'volume_create_manager' (b31253d4-058c-477c-9f4f-a40eb0515bfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:39:08 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-d230d7c7-8dbc-4d37-9d8a-c7c46e3c6237 tempest-CreateVolumesFromImageTest-237718682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96a7ae46-1e79-4090-b8f0-717d30e7b74d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:39:08 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-f8a4866e-2c4f-4690-83ad-a4c30d683f54 tempest-CreateVolumesFromImageTest-237718682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-c7c8b366-13b5-453e-bda4-ef7eabee0705 1073741824" returned: 0 in 0.773s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:39:08 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-d230d7c7-8dbc-4d37-9d8a-c7c46e3c6237 tempest-CreateVolumesFromImageTest-237718682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96a7ae46-1e79-4090-b8f0-717d30e7b74d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:39:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-414570460',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d75db783-529e-40ac-b191-1505f2a117df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82cc621f1aa04354a30a1f9be6f70d85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:39:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:39:09Z,use_quota=True,user_id='4ae46ca5b7e643b28209a7d374b21186',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:39:08 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-d230d7c7-8dbc-4d37-9d8a-c7c46e3c6237 tempest-CreateVolumesFromImageTest-237718682 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15cb4df1-2671-494d-a683-1efc9560fd3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:39:08 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-d230d7c7-8dbc-4d37-9d8a-c7c46e3c6237 tempest-CreateVolumesFromImageTest-237718682 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15cb4df1-2671-494d-a683-1efc9560fd3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:39:08 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-d230d7c7-8dbc-4d37-9d8a-c7c46e3c6237 tempest-CreateVolumesFromImageTest-237718682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a38a9def-1915-4e0e-8b7b-60d7e83c0267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:39:08 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-d230d7c7-8dbc-4d37-9d8a-c7c46e3c6237 tempest-CreateVolumesFromImageTest-237718682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a38a9def-1915-4e0e-8b7b-60d7e83c0267) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd75db783-529e-40ac-b191-1505f2a117df', 'volume_name': 'volume-d75db783-529e-40ac-b191-1505f2a117df', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:39:08 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-d230d7c7-8dbc-4d37-9d8a-c7c46e3c6237 tempest-CreateVolumesFromImageTest-237718682 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df467353-f56b-4b67-a069-f87fdb372dd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:39:08 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-d230d7c7-8dbc-4d37-9d8a-c7c46e3c6237 tempest-CreateVolumesFromImageTest-237718682 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df467353-f56b-4b67-a069-f87fdb372dd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:39:08 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-d230d7c7-8dbc-4d37-9d8a-c7c46e3c6237 tempest-CreateVolumesFromImageTest-237718682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1a48dd9-5b13-4d7a-bda9-d49a5f7710bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:39:08 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-d230d7c7-8dbc-4d37-9d8a-c7c46e3c6237 tempest-CreateVolumesFromImageTest-237718682 None] Volume d75db783-529e-40ac-b191-1505f2a117df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d75db783-529e-40ac-b191-1505f2a117df', 'volume_size': 1} Sep 06 06:39:08 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-d230d7c7-8dbc-4d37-9d8a-c7c46e3c6237 tempest-CreateVolumesFromImageTest-237718682 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:39:08 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-a98499cd-fa74-4238-932d-d7da386e48d6 tempest-VolumesListAdminTestJSON-1496945980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:39:08 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-a98499cd-fa74-4238-932d-d7da386e48d6 tempest-VolumesListAdminTestJSON-1496945980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:39:08 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-a98499cd-fa74-4238-932d-d7da386e48d6 tempest-VolumesListAdminTestJSON-1496945980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:39:08 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-a98499cd-fa74-4238-932d-d7da386e48d6 tempest-VolumesListAdminTestJSON-1496945980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:39:08 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-a98499cd-fa74-4238-932d-d7da386e48d6 tempest-VolumesListAdminTestJSON-1496945980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:39:08 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-a98499cd-fa74-4238-932d-d7da386e48d6 tempest-VolumesListAdminTestJSON-1496945980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:39:08 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-f8a4866e-2c4f-4690-83ad-a4c30d683f54 tempest-CreateVolumesFromImageTest-237718682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-c7c8b366-13b5-453e-bda4-ef7eabee0705 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:39:08 devstack sudo[96978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:39:08 devstack sudo[96978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:39:08 devstack sudo[96979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-c7c8b366-13b5-453e-bda4-ef7eabee0705 Sep 06 06:39:08 devstack sudo[96979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:39:08 devstack sudo[96976]: pam_unix(sudo:session): session closed for user root Sep 06 06:39:08 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-2f5131ba-93af-4a9f-a802-3aa03689814e tempest-VolumesListAdminTestJSON-2130242956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.286s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:39:08 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-2f5131ba-93af-4a9f-a802-3aa03689814e tempest-VolumesListAdminTestJSON-2130242956 None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:39:08 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-2f5131ba-93af-4a9f-a802-3aa03689814e tempest-VolumesListAdminTestJSON-2130242956 None] Deleted volume successfully. Sep 06 06:39:09 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-2f5131ba-93af-4a9f-a802-3aa03689814e tempest-VolumesListAdminTestJSON-2130242956 None] Lock "cinder-a9db422a-0777-435b-8b4e-5f54c0b7b3c8-delete_volume" released by "delete_volume" :: held 2.147s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:39:09 devstack sudo[96978]: pam_unix(sudo:session): session closed for user root Sep 06 06:39:09 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-a98499cd-fa74-4238-932d-d7da386e48d6 tempest-VolumesListAdminTestJSON-1496945980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.297s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:39:09 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-a98499cd-fa74-4238-932d-d7da386e48d6 tempest-VolumesListAdminTestJSON-1496945980 None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:39:09 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-a98499cd-fa74-4238-932d-d7da386e48d6 tempest-VolumesListAdminTestJSON-1496945980 None] Deleted volume successfully. Sep 06 06:39:09 devstack sudo[96979]: pam_unix(sudo:session): session closed for user root Sep 06 06:39:09 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-f8a4866e-2c4f-4690-83ad-a4c30d683f54 tempest-CreateVolumesFromImageTest-237718682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-c7c8b366-13b5-453e-bda4-ef7eabee0705" returned: 0 in 0.285s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:39:09 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-f8a4866e-2c4f-4690-83ad-a4c30d683f54 tempest-CreateVolumesFromImageTest-237718682 None] <== create_volume: return (1175ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'} {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 06:39:09 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-f8a4866e-2c4f-4690-83ad-a4c30d683f54 tempest-CreateVolumesFromImageTest-237718682 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.182s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:39:09 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-a71d20cb-113f-4622-a6a5-91a10d67780f tempest-CreateVolumesFromImageTest-237718682 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.393s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:39:09 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-a71d20cb-113f-4622-a6a5-91a10d67780f tempest-CreateVolumesFromImageTest-237718682 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:39:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1324357135',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7179551a-7197-4313-892a-1bdee2f669ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82cc621f1aa04354a30a1f9be6f70d85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:39:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:39:07Z,use_quota=True,user_id='4ae46ca5b7e643b28209a7d374b21186',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)}" {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 06:39:09 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-a71d20cb-113f-4622-a6a5-91a10d67780f tempest-CreateVolumesFromImageTest-237718682 None] Creating volume 7179551a-7197-4313-892a-1bdee2f669ee {{(pid=87329) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 06:39:09 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-a71d20cb-113f-4622-a6a5-91a10d67780f tempest-CreateVolumesFromImageTest-237718682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:39:09 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-a71d20cb-113f-4622-a6a5-91a10d67780f tempest-CreateVolumesFromImageTest-237718682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:39:09 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-a71d20cb-113f-4622-a6a5-91a10d67780f tempest-CreateVolumesFromImageTest-237718682 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:39:09 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-a71d20cb-113f-4622-a6a5-91a10d67780f tempest-CreateVolumesFromImageTest-237718682 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:39:09 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-a71d20cb-113f-4622-a6a5-91a10d67780f tempest-CreateVolumesFromImageTest-237718682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:39:09 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-a71d20cb-113f-4622-a6a5-91a10d67780f tempest-CreateVolumesFromImageTest-237718682 None] Selected osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 as target Quobyte volume. {{(pid=87329) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 06:39:09 devstack cinder-volume[87329]: INFO cinder.volume.drivers.remotefs [None req-a71d20cb-113f-4622-a6a5-91a10d67780f tempest-CreateVolumesFromImageTest-237718682 None] casted to osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 Sep 06 06:39:09 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-a71d20cb-113f-4622-a6a5-91a10d67780f tempest-CreateVolumesFromImageTest-237718682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-7179551a-7197-4313-892a-1bdee2f669ee 1073741824 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:39:09 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-f8a4866e-2c4f-4690-83ad-a4c30d683f54 tempest-CreateVolumesFromImageTest-237718682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d78280af-9b1f-4d33-97f7-e2135711b5ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7c8b366-13b5-453e-bda4-ef7eabee0705', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:39:09 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-f8a4866e-2c4f-4690-83ad-a4c30d683f54 tempest-CreateVolumesFromImageTest-237718682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2fa3356-daec-4382-9b33-eca2805ca058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:39:09 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-a98499cd-fa74-4238-932d-d7da386e48d6 tempest-VolumesListAdminTestJSON-1496945980 None] Lock "cinder-56487097-f72e-4e49-b462-f9d397e5da38-delete_volume" released by "delete_volume" :: held 2.105s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:39:09 devstack sudo[96985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-7179551a-7197-4313-892a-1bdee2f669ee 1073741824 Sep 06 06:39:09 devstack sudo[96985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:39:09 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-f8a4866e-2c4f-4690-83ad-a4c30d683f54 tempest-CreateVolumesFromImageTest-237718682 None] Volume volume-c7c8b366-13b5-453e-bda4-ef7eabee0705 (c7c8b366-13b5-453e-bda4-ef7eabee0705): created successfully Sep 06 06:39:09 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-f8a4866e-2c4f-4690-83ad-a4c30d683f54 tempest-CreateVolumesFromImageTest-237718682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2fa3356-daec-4382-9b33-eca2805ca058) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:39:09 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-f8a4866e-2c4f-4690-83ad-a4c30d683f54 tempest-CreateVolumesFromImageTest-237718682 None] Flow 'volume_create_manager' (006ba3ec-bf7a-466f-a5ce-e6f89641a415) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:39:09 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-f8a4866e-2c4f-4690-83ad-a4c30d683f54 tempest-CreateVolumesFromImageTest-237718682 None] Created volume successfully. Sep 06 06:39:09 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-f6ee13c4-fb8d-4f15-b205-d09a2d414033 tempest-VolumesListAdminTestJSON-1496945980 None] Acquiring lock "cinder-dad5b37f-5f4c-437d-afc0-f048dc8fd90b-delete_volume" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:39:09 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-f6ee13c4-fb8d-4f15-b205-d09a2d414033 tempest-VolumesListAdminTestJSON-1496945980 None] Lock "cinder-dad5b37f-5f4c-437d-afc0-f048dc8fd90b-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:39:09 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-f6ee13c4-fb8d-4f15-b205-d09a2d414033 tempest-VolumesListAdminTestJSON-1496945980 None] Acquiring lock "cinder-quobyte-dad5b37f-5f4c-437d-afc0-f048dc8fd90b" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:39:09 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-f6ee13c4-fb8d-4f15-b205-d09a2d414033 tempest-VolumesListAdminTestJSON-1496945980 None] Lock "cinder-quobyte-dad5b37f-5f4c-437d-afc0-f048dc8fd90b" acquired by "delete_volume" :: waited 0.017s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:39:09 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[475caa58-2a39-4d80-8f5a-d2391bb7d44b]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:39:09 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-f6ee13c4-fb8d-4f15-b205-d09a2d414033 tempest-VolumesListAdminTestJSON-1496945980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-dad5b37f-5f4c-437d-afc0-f048dc8fd90b {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:39:09 devstack sudo[96985]: pam_unix(sudo:session): session closed for user root Sep 06 06:39:09 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-a71d20cb-113f-4622-a6a5-91a10d67780f tempest-CreateVolumesFromImageTest-237718682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-7179551a-7197-4313-892a-1bdee2f669ee 1073741824" returned: 0 in 0.576s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:39:09 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-a71d20cb-113f-4622-a6a5-91a10d67780f tempest-CreateVolumesFromImageTest-237718682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-7179551a-7197-4313-892a-1bdee2f669ee {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:39:09 devstack sudo[96992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-dad5b37f-5f4c-437d-afc0-f048dc8fd90b Sep 06 06:39:09 devstack sudo[96992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:39:09 devstack sudo[96993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-7179551a-7197-4313-892a-1bdee2f669ee Sep 06 06:39:09 devstack sudo[96993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:39:10 devstack sudo[96993]: pam_unix(sudo:session): session closed for user root Sep 06 06:39:10 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-a71d20cb-113f-4622-a6a5-91a10d67780f tempest-CreateVolumesFromImageTest-237718682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-7179551a-7197-4313-892a-1bdee2f669ee" returned: 0 in 0.255s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:39:10 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-a71d20cb-113f-4622-a6a5-91a10d67780f tempest-CreateVolumesFromImageTest-237718682 None] <== create_volume: return (884ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'} {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 06:39:10 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-a71d20cb-113f-4622-a6a5-91a10d67780f tempest-CreateVolumesFromImageTest-237718682 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.887s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:39:10 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-608b43d5-0a7e-4c96-a278-661c16b86d85 tempest-CreateVolumesFromImageTest-237718682 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.586s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:39:10 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-608b43d5-0a7e-4c96-a278-661c16b86d85 tempest-CreateVolumesFromImageTest-237718682 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:39:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1176671462',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f377e3fa-6b9c-4f0a-90ce-4b1fb4254636,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82cc621f1aa04354a30a1f9be6f70d85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:39:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:39:08Z,use_quota=True,user_id='4ae46ca5b7e643b28209a7d374b21186',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)}" {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 06:39:10 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-608b43d5-0a7e-4c96-a278-661c16b86d85 tempest-CreateVolumesFromImageTest-237718682 None] Creating volume f377e3fa-6b9c-4f0a-90ce-4b1fb4254636 {{(pid=87329) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 06:39:10 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-608b43d5-0a7e-4c96-a278-661c16b86d85 tempest-CreateVolumesFromImageTest-237718682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:39:10 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-608b43d5-0a7e-4c96-a278-661c16b86d85 tempest-CreateVolumesFromImageTest-237718682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:39:10 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-608b43d5-0a7e-4c96-a278-661c16b86d85 tempest-CreateVolumesFromImageTest-237718682 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:39:10 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-608b43d5-0a7e-4c96-a278-661c16b86d85 tempest-CreateVolumesFromImageTest-237718682 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:39:10 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-608b43d5-0a7e-4c96-a278-661c16b86d85 tempest-CreateVolumesFromImageTest-237718682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:39:10 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-608b43d5-0a7e-4c96-a278-661c16b86d85 tempest-CreateVolumesFromImageTest-237718682 None] Selected osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 as target Quobyte volume. {{(pid=87329) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 06:39:10 devstack cinder-volume[87329]: INFO cinder.volume.drivers.remotefs [None req-608b43d5-0a7e-4c96-a278-661c16b86d85 tempest-CreateVolumesFromImageTest-237718682 None] casted to osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 Sep 06 06:39:10 devstack sudo[96992]: pam_unix(sudo:session): session closed for user root Sep 06 06:39:10 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-608b43d5-0a7e-4c96-a278-661c16b86d85 tempest-CreateVolumesFromImageTest-237718682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-f377e3fa-6b9c-4f0a-90ce-4b1fb4254636 1073741824 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:39:10 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-f6ee13c4-fb8d-4f15-b205-d09a2d414033 tempest-VolumesListAdminTestJSON-1496945980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-dad5b37f-5f4c-437d-afc0-f048dc8fd90b" returned: 0 in 0.427s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:39:10 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-f6ee13c4-fb8d-4f15-b205-d09a2d414033 tempest-VolumesListAdminTestJSON-1496945980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-dad5b37f-5f4c-437d-afc0-f048dc8fd90b {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:39:10 devstack sudo[97000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-f377e3fa-6b9c-4f0a-90ce-4b1fb4254636 1073741824 Sep 06 06:39:10 devstack sudo[97000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:39:10 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-a71d20cb-113f-4622-a6a5-91a10d67780f tempest-CreateVolumesFromImageTest-237718682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45abe9db-cfbf-4a94-a613-57509f39d883) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7179551a-7197-4313-892a-1bdee2f669ee', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:39:10 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-a71d20cb-113f-4622-a6a5-91a10d67780f tempest-CreateVolumesFromImageTest-237718682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (012542b4-f7c2-41c0-b478-1298782b55fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:39:10 devstack sudo[97001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-dad5b37f-5f4c-437d-afc0-f048dc8fd90b Sep 06 06:39:10 devstack sudo[97001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:39:10 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-a71d20cb-113f-4622-a6a5-91a10d67780f tempest-CreateVolumesFromImageTest-237718682 None] Volume volume-7179551a-7197-4313-892a-1bdee2f669ee (7179551a-7197-4313-892a-1bdee2f669ee): created successfully Sep 06 06:39:10 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-a71d20cb-113f-4622-a6a5-91a10d67780f tempest-CreateVolumesFromImageTest-237718682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (012542b4-f7c2-41c0-b478-1298782b55fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:39:10 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-a71d20cb-113f-4622-a6a5-91a10d67780f tempest-CreateVolumesFromImageTest-237718682 None] Flow 'volume_create_manager' (4564e7ec-3c06-4bab-a210-ab2ada92765e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:39:10 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-a71d20cb-113f-4622-a6a5-91a10d67780f tempest-CreateVolumesFromImageTest-237718682 None] Created volume successfully. Sep 06 06:39:10 devstack sudo[97001]: pam_unix(sudo:session): session closed for user root Sep 06 06:39:10 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-f6ee13c4-fb8d-4f15-b205-d09a2d414033 tempest-VolumesListAdminTestJSON-1496945980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-dad5b37f-5f4c-437d-afc0-f048dc8fd90b" returned: 0 in 0.254s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:39:10 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-f6ee13c4-fb8d-4f15-b205-d09a2d414033 tempest-VolumesListAdminTestJSON-1496945980 None] Lock "cinder-quobyte-dad5b37f-5f4c-437d-afc0-f048dc8fd90b" released by "delete_volume" :: held 0.731s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:39:10 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-f6ee13c4-fb8d-4f15-b205-d09a2d414033 tempest-VolumesListAdminTestJSON-1496945980 None] Created reservations ['2601454f-514c-4023-8b47-e22c510230d7', '76523261-5fd0-4185-a11d-0fc61d36f6b1', '3a5b7bf5-2fd7-46be-9dc8-fe4b9ad0c865', '3e09448f-3300-43a5-b047-1639bcbcd358'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:39:10 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-f6ee13c4-fb8d-4f15-b205-d09a2d414033 tempest-VolumesListAdminTestJSON-1496945980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:39:10 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-f6ee13c4-fb8d-4f15-b205-d09a2d414033 tempest-VolumesListAdminTestJSON-1496945980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:39:10 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-f6ee13c4-fb8d-4f15-b205-d09a2d414033 tempest-VolumesListAdminTestJSON-1496945980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:39:10 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-f6ee13c4-fb8d-4f15-b205-d09a2d414033 tempest-VolumesListAdminTestJSON-1496945980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:39:10 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-f6ee13c4-fb8d-4f15-b205-d09a2d414033 tempest-VolumesListAdminTestJSON-1496945980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:39:10 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-f6ee13c4-fb8d-4f15-b205-d09a2d414033 tempest-VolumesListAdminTestJSON-1496945980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:39:10 devstack sudo[97009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:39:10 devstack sudo[97009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:39:10 devstack sudo[97000]: pam_unix(sudo:session): session closed for user root Sep 06 06:39:10 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-608b43d5-0a7e-4c96-a278-661c16b86d85 tempest-CreateVolumesFromImageTest-237718682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-f377e3fa-6b9c-4f0a-90ce-4b1fb4254636 1073741824" returned: 0 in 0.475s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:39:10 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-608b43d5-0a7e-4c96-a278-661c16b86d85 tempest-CreateVolumesFromImageTest-237718682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-f377e3fa-6b9c-4f0a-90ce-4b1fb4254636 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:39:10 devstack sudo[97011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-f377e3fa-6b9c-4f0a-90ce-4b1fb4254636 Sep 06 06:39:10 devstack sudo[97011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:39:10 devstack sudo[97009]: pam_unix(sudo:session): session closed for user root Sep 06 06:39:10 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-f6ee13c4-fb8d-4f15-b205-d09a2d414033 tempest-VolumesListAdminTestJSON-1496945980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.258s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:39:10 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-f6ee13c4-fb8d-4f15-b205-d09a2d414033 tempest-VolumesListAdminTestJSON-1496945980 None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:39:10 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-2aedb2e3-5183-4340-be04-aa8ca2bde202 tempest-VolumesListAdminTestJSON-1496945980 None] Acquiring lock "cinder-f24533f9-cd95-40d4-98e6-9a9886faf3d0-delete_volume" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:39:10 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-f6ee13c4-fb8d-4f15-b205-d09a2d414033 tempest-VolumesListAdminTestJSON-1496945980 None] Deleted volume successfully. Sep 06 06:39:10 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-2aedb2e3-5183-4340-be04-aa8ca2bde202 tempest-VolumesListAdminTestJSON-1496945980 None] Lock "cinder-f24533f9-cd95-40d4-98e6-9a9886faf3d0-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:39:10 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-f6ee13c4-fb8d-4f15-b205-d09a2d414033 tempest-VolumesListAdminTestJSON-1496945980 None] Lock "cinder-dad5b37f-5f4c-437d-afc0-f048dc8fd90b-delete_volume" released by "delete_volume" :: held 1.275s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:39:10 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-2aedb2e3-5183-4340-be04-aa8ca2bde202 tempest-VolumesListAdminTestJSON-1496945980 None] Acquiring lock "cinder-quobyte-f24533f9-cd95-40d4-98e6-9a9886faf3d0" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:39:10 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-2aedb2e3-5183-4340-be04-aa8ca2bde202 tempest-VolumesListAdminTestJSON-1496945980 None] Lock "cinder-quobyte-f24533f9-cd95-40d4-98e6-9a9886faf3d0" acquired by "delete_volume" :: waited 0.016s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:39:10 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[08b5aa36-8a82-4b32-9e32-761a460c79de]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:39:10 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-2aedb2e3-5183-4340-be04-aa8ca2bde202 tempest-VolumesListAdminTestJSON-1496945980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-f24533f9-cd95-40d4-98e6-9a9886faf3d0 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:39:10 devstack sudo[97011]: pam_unix(sudo:session): session closed for user root Sep 06 06:39:10 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-608b43d5-0a7e-4c96-a278-661c16b86d85 tempest-CreateVolumesFromImageTest-237718682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-f377e3fa-6b9c-4f0a-90ce-4b1fb4254636" returned: 0 in 0.357s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:39:10 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-608b43d5-0a7e-4c96-a278-661c16b86d85 tempest-CreateVolumesFromImageTest-237718682 None] <== create_volume: return (876ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'} {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 06:39:10 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-608b43d5-0a7e-4c96-a278-661c16b86d85 tempest-CreateVolumesFromImageTest-237718682 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.879s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:39:10 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-d230d7c7-8dbc-4d37-9d8a-c7c46e3c6237 tempest-CreateVolumesFromImageTest-237718682 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.103s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:39:10 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-d230d7c7-8dbc-4d37-9d8a-c7c46e3c6237 tempest-CreateVolumesFromImageTest-237718682 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:39:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-414570460',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d75db783-529e-40ac-b191-1505f2a117df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82cc621f1aa04354a30a1f9be6f70d85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:39:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:39:09Z,use_quota=True,user_id='4ae46ca5b7e643b28209a7d374b21186',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)}" {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 06:39:10 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-d230d7c7-8dbc-4d37-9d8a-c7c46e3c6237 tempest-CreateVolumesFromImageTest-237718682 None] Creating volume d75db783-529e-40ac-b191-1505f2a117df {{(pid=87329) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 06:39:10 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-d230d7c7-8dbc-4d37-9d8a-c7c46e3c6237 tempest-CreateVolumesFromImageTest-237718682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:39:10 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-d230d7c7-8dbc-4d37-9d8a-c7c46e3c6237 tempest-CreateVolumesFromImageTest-237718682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:39:10 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-d230d7c7-8dbc-4d37-9d8a-c7c46e3c6237 tempest-CreateVolumesFromImageTest-237718682 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:39:10 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-d230d7c7-8dbc-4d37-9d8a-c7c46e3c6237 tempest-CreateVolumesFromImageTest-237718682 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:39:10 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-d230d7c7-8dbc-4d37-9d8a-c7c46e3c6237 tempest-CreateVolumesFromImageTest-237718682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:39:10 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-d230d7c7-8dbc-4d37-9d8a-c7c46e3c6237 tempest-CreateVolumesFromImageTest-237718682 None] Selected osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 as target Quobyte volume. {{(pid=87329) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 06:39:10 devstack cinder-volume[87329]: INFO cinder.volume.drivers.remotefs [None req-d230d7c7-8dbc-4d37-9d8a-c7c46e3c6237 tempest-CreateVolumesFromImageTest-237718682 None] casted to osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 Sep 06 06:39:10 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-d230d7c7-8dbc-4d37-9d8a-c7c46e3c6237 tempest-CreateVolumesFromImageTest-237718682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-d75db783-529e-40ac-b191-1505f2a117df 1073741824 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:39:10 devstack sudo[97016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-d75db783-529e-40ac-b191-1505f2a117df 1073741824 Sep 06 06:39:10 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-608b43d5-0a7e-4c96-a278-661c16b86d85 tempest-CreateVolumesFromImageTest-237718682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de58abca-4fe6-490d-8277-4e8ce3d2b4e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f377e3fa-6b9c-4f0a-90ce-4b1fb4254636', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:39:10 devstack sudo[97016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:39:10 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-608b43d5-0a7e-4c96-a278-661c16b86d85 tempest-CreateVolumesFromImageTest-237718682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abca992d-2da3-4fc8-984f-817596d0f3f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:39:10 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-608b43d5-0a7e-4c96-a278-661c16b86d85 tempest-CreateVolumesFromImageTest-237718682 None] Volume volume-f377e3fa-6b9c-4f0a-90ce-4b1fb4254636 (f377e3fa-6b9c-4f0a-90ce-4b1fb4254636): created successfully Sep 06 06:39:10 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-608b43d5-0a7e-4c96-a278-661c16b86d85 tempest-CreateVolumesFromImageTest-237718682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abca992d-2da3-4fc8-984f-817596d0f3f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:39:10 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-608b43d5-0a7e-4c96-a278-661c16b86d85 tempest-CreateVolumesFromImageTest-237718682 None] Flow 'volume_create_manager' (8b1a17b1-4aad-448d-88bb-a40725fd6d38) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:39:11 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-608b43d5-0a7e-4c96-a278-661c16b86d85 tempest-CreateVolumesFromImageTest-237718682 None] Created volume successfully. Sep 06 06:39:11 devstack sudo[97015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-f24533f9-cd95-40d4-98e6-9a9886faf3d0 Sep 06 06:39:11 devstack sudo[97015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:39:11 devstack sudo[97015]: pam_unix(sudo:session): session closed for user root Sep 06 06:39:11 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-2aedb2e3-5183-4340-be04-aa8ca2bde202 tempest-VolumesListAdminTestJSON-1496945980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-f24533f9-cd95-40d4-98e6-9a9886faf3d0" returned: 0 in 0.515s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:39:11 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-2aedb2e3-5183-4340-be04-aa8ca2bde202 tempest-VolumesListAdminTestJSON-1496945980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-f24533f9-cd95-40d4-98e6-9a9886faf3d0 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:39:11 devstack sudo[97025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-f24533f9-cd95-40d4-98e6-9a9886faf3d0 Sep 06 06:39:11 devstack sudo[97025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:39:11 devstack sudo[97016]: pam_unix(sudo:session): session closed for user root Sep 06 06:39:11 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-d230d7c7-8dbc-4d37-9d8a-c7c46e3c6237 tempest-CreateVolumesFromImageTest-237718682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-d75db783-529e-40ac-b191-1505f2a117df 1073741824" returned: 0 in 0.635s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:39:11 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-d230d7c7-8dbc-4d37-9d8a-c7c46e3c6237 tempest-CreateVolumesFromImageTest-237718682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-d75db783-529e-40ac-b191-1505f2a117df {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:39:11 devstack sudo[97027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-d75db783-529e-40ac-b191-1505f2a117df Sep 06 06:39:11 devstack sudo[97027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:39:11 devstack sudo[97025]: pam_unix(sudo:session): session closed for user root Sep 06 06:39:11 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-2aedb2e3-5183-4340-be04-aa8ca2bde202 tempest-VolumesListAdminTestJSON-1496945980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-f24533f9-cd95-40d4-98e6-9a9886faf3d0" returned: 0 in 0.287s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:39:11 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-2aedb2e3-5183-4340-be04-aa8ca2bde202 tempest-VolumesListAdminTestJSON-1496945980 None] Lock "cinder-quobyte-f24533f9-cd95-40d4-98e6-9a9886faf3d0" released by "delete_volume" :: held 0.860s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:39:11 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-2aedb2e3-5183-4340-be04-aa8ca2bde202 tempest-VolumesListAdminTestJSON-1496945980 None] Created reservations ['9d6d5d75-22d3-4b64-93ee-c5433b7b55a2', 'b205dfc7-8514-40e1-a802-f109c855f765', '64226222-bb7f-43c9-9fe8-f3500bb4c276', '706a182a-4b6b-4c93-b6fb-1385dc170a27'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:39:11 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-2aedb2e3-5183-4340-be04-aa8ca2bde202 tempest-VolumesListAdminTestJSON-1496945980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:39:11 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-2aedb2e3-5183-4340-be04-aa8ca2bde202 tempest-VolumesListAdminTestJSON-1496945980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:39:11 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-2aedb2e3-5183-4340-be04-aa8ca2bde202 tempest-VolumesListAdminTestJSON-1496945980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:39:11 devstack sudo[97027]: pam_unix(sudo:session): session closed for user root Sep 06 06:39:11 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-2aedb2e3-5183-4340-be04-aa8ca2bde202 tempest-VolumesListAdminTestJSON-1496945980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:39:11 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-2aedb2e3-5183-4340-be04-aa8ca2bde202 tempest-VolumesListAdminTestJSON-1496945980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:39:11 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-2aedb2e3-5183-4340-be04-aa8ca2bde202 tempest-VolumesListAdminTestJSON-1496945980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:39:11 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-d230d7c7-8dbc-4d37-9d8a-c7c46e3c6237 tempest-CreateVolumesFromImageTest-237718682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-d75db783-529e-40ac-b191-1505f2a117df" returned: 0 in 0.288s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:39:11 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-d230d7c7-8dbc-4d37-9d8a-c7c46e3c6237 tempest-CreateVolumesFromImageTest-237718682 None] <== create_volume: return (972ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'} {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 06:39:11 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-d230d7c7-8dbc-4d37-9d8a-c7c46e3c6237 tempest-CreateVolumesFromImageTest-237718682 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.977s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:39:11 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-d230d7c7-8dbc-4d37-9d8a-c7c46e3c6237 tempest-CreateVolumesFromImageTest-237718682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1a48dd9-5b13-4d7a-bda9-d49a5f7710bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d75db783-529e-40ac-b191-1505f2a117df', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:39:11 devstack sudo[97031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:39:11 devstack sudo[97031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:39:11 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-d230d7c7-8dbc-4d37-9d8a-c7c46e3c6237 tempest-CreateVolumesFromImageTest-237718682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2a56e3f-1e19-45b2-af99-cbeeec0006bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:39:11 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-d230d7c7-8dbc-4d37-9d8a-c7c46e3c6237 tempest-CreateVolumesFromImageTest-237718682 None] Volume volume-d75db783-529e-40ac-b191-1505f2a117df (d75db783-529e-40ac-b191-1505f2a117df): created successfully Sep 06 06:39:11 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-d230d7c7-8dbc-4d37-9d8a-c7c46e3c6237 tempest-CreateVolumesFromImageTest-237718682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2a56e3f-1e19-45b2-af99-cbeeec0006bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:39:11 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-d230d7c7-8dbc-4d37-9d8a-c7c46e3c6237 tempest-CreateVolumesFromImageTest-237718682 None] Flow 'volume_create_manager' (b31253d4-058c-477c-9f4f-a40eb0515bfd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:39:11 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-d230d7c7-8dbc-4d37-9d8a-c7c46e3c6237 tempest-CreateVolumesFromImageTest-237718682 None] Created volume successfully. Sep 06 06:39:12 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-e11dbbd8-3719-4dea-9ce7-882742ca68be tempest-CreateVolumesFromImageTest-237718682 None] Acquiring lock "cinder-d75db783-529e-40ac-b191-1505f2a117df-delete_volume" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:39:12 devstack sudo[97031]: pam_unix(sudo:session): session closed for user root Sep 06 06:39:12 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-2aedb2e3-5183-4340-be04-aa8ca2bde202 tempest-VolumesListAdminTestJSON-1496945980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.375s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:39:12 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-2aedb2e3-5183-4340-be04-aa8ca2bde202 tempest-VolumesListAdminTestJSON-1496945980 None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:39:12 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-2aedb2e3-5183-4340-be04-aa8ca2bde202 tempest-VolumesListAdminTestJSON-1496945980 None] Deleted volume successfully. Sep 06 06:39:12 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-e11dbbd8-3719-4dea-9ce7-882742ca68be tempest-CreateVolumesFromImageTest-237718682 None] Lock "cinder-d75db783-529e-40ac-b191-1505f2a117df-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:39:12 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-2aedb2e3-5183-4340-be04-aa8ca2bde202 tempest-VolumesListAdminTestJSON-1496945980 None] Lock "cinder-f24533f9-cd95-40d4-98e6-9a9886faf3d0-delete_volume" released by "delete_volume" :: held 1.527s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:39:12 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-e11dbbd8-3719-4dea-9ce7-882742ca68be tempest-CreateVolumesFromImageTest-237718682 None] Acquiring lock "cinder-quobyte-d75db783-529e-40ac-b191-1505f2a117df" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:39:12 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-e11dbbd8-3719-4dea-9ce7-882742ca68be tempest-CreateVolumesFromImageTest-237718682 None] Lock "cinder-quobyte-d75db783-529e-40ac-b191-1505f2a117df" acquired by "delete_volume" :: waited 0.031s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:39:12 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[b226273d-ad65-405a-b333-68ae679e6624]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:39:12 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-e11dbbd8-3719-4dea-9ce7-882742ca68be tempest-CreateVolumesFromImageTest-237718682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-d75db783-529e-40ac-b191-1505f2a117df {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:39:12 devstack sudo[97034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-d75db783-529e-40ac-b191-1505f2a117df Sep 06 06:39:12 devstack sudo[97034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:39:12 devstack sudo[97034]: pam_unix(sudo:session): session closed for user root Sep 06 06:39:12 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-e11dbbd8-3719-4dea-9ce7-882742ca68be tempest-CreateVolumesFromImageTest-237718682 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-d75db783-529e-40ac-b191-1505f2a117df" returned: 0 in 0.520s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:39:12 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-e11dbbd8-3719-4dea-9ce7-882742ca68be tempest-CreateVolumesFromImageTest-237718682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-d75db783-529e-40ac-b191-1505f2a117df {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:39:12 devstack sudo[97039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-d75db783-529e-40ac-b191-1505f2a117df Sep 06 06:39:12 devstack sudo[97039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:39:13 devstack sudo[97039]: pam_unix(sudo:session): session closed for user root Sep 06 06:39:13 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-e11dbbd8-3719-4dea-9ce7-882742ca68be tempest-CreateVolumesFromImageTest-237718682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-d75db783-529e-40ac-b191-1505f2a117df" returned: 0 in 0.459s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:39:13 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-e11dbbd8-3719-4dea-9ce7-882742ca68be tempest-CreateVolumesFromImageTest-237718682 None] Lock "cinder-quobyte-d75db783-529e-40ac-b191-1505f2a117df" released by "delete_volume" :: held 1.056s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:39:13 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-e11dbbd8-3719-4dea-9ce7-882742ca68be tempest-CreateVolumesFromImageTest-237718682 None] Created reservations ['e394ea2f-9eda-4cf6-ae82-5433cbaf508c', '3658de61-3fe0-4052-8b56-c54f1d1be12d', '109305fb-a7fa-408e-b1f3-26368a146ca8', '56f6fcb9-479a-4ac4-985d-fc2a70f77ea3'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:39:13 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-e11dbbd8-3719-4dea-9ce7-882742ca68be tempest-CreateVolumesFromImageTest-237718682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:39:13 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-e11dbbd8-3719-4dea-9ce7-882742ca68be tempest-CreateVolumesFromImageTest-237718682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:39:13 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-e11dbbd8-3719-4dea-9ce7-882742ca68be tempest-CreateVolumesFromImageTest-237718682 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:39:13 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-e11dbbd8-3719-4dea-9ce7-882742ca68be tempest-CreateVolumesFromImageTest-237718682 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:39:13 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-e11dbbd8-3719-4dea-9ce7-882742ca68be tempest-CreateVolumesFromImageTest-237718682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:39:13 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-e11dbbd8-3719-4dea-9ce7-882742ca68be tempest-CreateVolumesFromImageTest-237718682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:39:13 devstack sudo[97042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:39:13 devstack sudo[97042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:39:13 devstack sudo[97042]: pam_unix(sudo:session): session closed for user root Sep 06 06:39:13 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-e11dbbd8-3719-4dea-9ce7-882742ca68be tempest-CreateVolumesFromImageTest-237718682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.280s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:39:13 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-e11dbbd8-3719-4dea-9ce7-882742ca68be tempest-CreateVolumesFromImageTest-237718682 None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:39:13 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-e11dbbd8-3719-4dea-9ce7-882742ca68be tempest-CreateVolumesFromImageTest-237718682 None] Deleted volume successfully. Sep 06 06:39:13 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-e11dbbd8-3719-4dea-9ce7-882742ca68be tempest-CreateVolumesFromImageTest-237718682 None] Lock "cinder-d75db783-529e-40ac-b191-1505f2a117df-delete_volume" released by "delete_volume" :: held 1.678s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:39:14 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-27cb5b5f-3125-4024-ac68-59c55e1e4af6 tempest-CreateVolumesFromImageTest-237718682 None] Acquiring lock "cinder-f377e3fa-6b9c-4f0a-90ce-4b1fb4254636-delete_volume" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:39:14 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-27cb5b5f-3125-4024-ac68-59c55e1e4af6 tempest-CreateVolumesFromImageTest-237718682 None] Lock "cinder-f377e3fa-6b9c-4f0a-90ce-4b1fb4254636-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:39:14 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-27cb5b5f-3125-4024-ac68-59c55e1e4af6 tempest-CreateVolumesFromImageTest-237718682 None] Acquiring lock "cinder-quobyte-f377e3fa-6b9c-4f0a-90ce-4b1fb4254636" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:39:14 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-27cb5b5f-3125-4024-ac68-59c55e1e4af6 tempest-CreateVolumesFromImageTest-237718682 None] Lock "cinder-quobyte-f377e3fa-6b9c-4f0a-90ce-4b1fb4254636" acquired by "delete_volume" :: waited 0.017s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:39:14 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[872de060-9a75-40ab-bd74-2197bdb2bc92]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:39:14 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-27cb5b5f-3125-4024-ac68-59c55e1e4af6 tempest-CreateVolumesFromImageTest-237718682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-f377e3fa-6b9c-4f0a-90ce-4b1fb4254636 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:39:14 devstack sudo[97045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-f377e3fa-6b9c-4f0a-90ce-4b1fb4254636 Sep 06 06:39:14 devstack sudo[97045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:39:15 devstack sudo[97045]: pam_unix(sudo:session): session closed for user root Sep 06 06:39:15 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-27cb5b5f-3125-4024-ac68-59c55e1e4af6 tempest-CreateVolumesFromImageTest-237718682 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-f377e3fa-6b9c-4f0a-90ce-4b1fb4254636" returned: 0 in 0.580s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:39:15 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-27cb5b5f-3125-4024-ac68-59c55e1e4af6 tempest-CreateVolumesFromImageTest-237718682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-f377e3fa-6b9c-4f0a-90ce-4b1fb4254636 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:39:15 devstack sudo[97050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-f377e3fa-6b9c-4f0a-90ce-4b1fb4254636 Sep 06 06:39:15 devstack sudo[97050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:39:15 devstack sudo[97050]: pam_unix(sudo:session): session closed for user root Sep 06 06:39:15 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-27cb5b5f-3125-4024-ac68-59c55e1e4af6 tempest-CreateVolumesFromImageTest-237718682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-f377e3fa-6b9c-4f0a-90ce-4b1fb4254636" returned: 0 in 0.285s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:39:15 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-27cb5b5f-3125-4024-ac68-59c55e1e4af6 tempest-CreateVolumesFromImageTest-237718682 None] Lock "cinder-quobyte-f377e3fa-6b9c-4f0a-90ce-4b1fb4254636" released by "delete_volume" :: held 0.927s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:39:15 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-27cb5b5f-3125-4024-ac68-59c55e1e4af6 tempest-CreateVolumesFromImageTest-237718682 None] Created reservations ['e37337c5-f92a-41f5-90cc-08e7c47dfdda', '9bc6eba0-a839-4665-812b-fae7b87ec024', 'c86d1f98-5f05-4888-ac03-888509b23ee9', '46a85443-b086-460c-abef-af11e507e1c3'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:39:15 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-27cb5b5f-3125-4024-ac68-59c55e1e4af6 tempest-CreateVolumesFromImageTest-237718682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:39:15 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-27cb5b5f-3125-4024-ac68-59c55e1e4af6 tempest-CreateVolumesFromImageTest-237718682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:39:15 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-27cb5b5f-3125-4024-ac68-59c55e1e4af6 tempest-CreateVolumesFromImageTest-237718682 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:39:15 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-27cb5b5f-3125-4024-ac68-59c55e1e4af6 tempest-CreateVolumesFromImageTest-237718682 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:39:15 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-27cb5b5f-3125-4024-ac68-59c55e1e4af6 tempest-CreateVolumesFromImageTest-237718682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:39:15 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-27cb5b5f-3125-4024-ac68-59c55e1e4af6 tempest-CreateVolumesFromImageTest-237718682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:39:15 devstack sudo[97053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:39:15 devstack sudo[97053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:39:16 devstack sudo[97053]: pam_unix(sudo:session): session closed for user root Sep 06 06:39:16 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-27cb5b5f-3125-4024-ac68-59c55e1e4af6 tempest-CreateVolumesFromImageTest-237718682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.348s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:39:16 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-27cb5b5f-3125-4024-ac68-59c55e1e4af6 tempest-CreateVolumesFromImageTest-237718682 None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:39:16 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-27cb5b5f-3125-4024-ac68-59c55e1e4af6 tempest-CreateVolumesFromImageTest-237718682 None] Deleted volume successfully. Sep 06 06:39:16 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-27cb5b5f-3125-4024-ac68-59c55e1e4af6 tempest-CreateVolumesFromImageTest-237718682 None] Lock "cinder-f377e3fa-6b9c-4f0a-90ce-4b1fb4254636-delete_volume" released by "delete_volume" :: held 1.576s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:39:16 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-66106da0-c19f-449b-a1f6-2a1360faf308 tempest-CreateVolumesFromImageTest-237718682 None] Acquiring lock "cinder-7179551a-7197-4313-892a-1bdee2f669ee-delete_volume" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:39:16 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-66106da0-c19f-449b-a1f6-2a1360faf308 tempest-CreateVolumesFromImageTest-237718682 None] Lock "cinder-7179551a-7197-4313-892a-1bdee2f669ee-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:39:16 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-66106da0-c19f-449b-a1f6-2a1360faf308 tempest-CreateVolumesFromImageTest-237718682 None] Acquiring lock "cinder-quobyte-7179551a-7197-4313-892a-1bdee2f669ee" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:39:16 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-66106da0-c19f-449b-a1f6-2a1360faf308 tempest-CreateVolumesFromImageTest-237718682 None] Lock "cinder-quobyte-7179551a-7197-4313-892a-1bdee2f669ee" acquired by "delete_volume" :: waited 0.022s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:39:16 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[75dd90d5-db03-4477-97e3-b88ad3f58d79]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:39:16 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-66106da0-c19f-449b-a1f6-2a1360faf308 tempest-CreateVolumesFromImageTest-237718682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-7179551a-7197-4313-892a-1bdee2f669ee {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:39:17 devstack sudo[97058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-7179551a-7197-4313-892a-1bdee2f669ee Sep 06 06:39:17 devstack sudo[97058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:39:17 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f6cf0b7-bbe0-485b-a3c4-2037150eead8 tempest-AttachVolumeShelveTestJSON-1287215161 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87329) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 06:39:17 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-8f6cf0b7-bbe0-485b-a3c4-2037150eead8 tempest-AttachVolumeShelveTestJSON-1287215161 None] Flow 'volume_create_manager' (b3a4a31d-6cf5-42f5-8766-7f74466c8113) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:39:17 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-8f6cf0b7-bbe0-485b-a3c4-2037150eead8 tempest-AttachVolumeShelveTestJSON-1287215161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d72e7940-c2de-40c2-912e-fa26d11bbeb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:39:17 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-8f6cf0b7-bbe0-485b-a3c4-2037150eead8 tempest-AttachVolumeShelveTestJSON-1287215161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d72e7940-c2de-40c2-912e-fa26d11bbeb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:39:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-2108141744',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14923f28-f152-4f61-b2f2-a658646b422c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c417a275cec54bb598673f05552bcbd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:39:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:39:17Z,use_quota=True,user_id='a290002c4b5640a9824ccda4b74dbd41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:39:17 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-8f6cf0b7-bbe0-485b-a3c4-2037150eead8 tempest-AttachVolumeShelveTestJSON-1287215161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (baeb8c63-9b6a-4f16-b0a8-d2f4f905e444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:39:17 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-8f6cf0b7-bbe0-485b-a3c4-2037150eead8 tempest-AttachVolumeShelveTestJSON-1287215161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (baeb8c63-9b6a-4f16-b0a8-d2f4f905e444) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:39:17 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-8f6cf0b7-bbe0-485b-a3c4-2037150eead8 tempest-AttachVolumeShelveTestJSON-1287215161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (343ceeb7-f1b5-4b98-a1ef-3ef5ba2f299f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:39:17 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-8f6cf0b7-bbe0-485b-a3c4-2037150eead8 tempest-AttachVolumeShelveTestJSON-1287215161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (343ceeb7-f1b5-4b98-a1ef-3ef5ba2f299f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '14923f28-f152-4f61-b2f2-a658646b422c', 'volume_name': 'volume-14923f28-f152-4f61-b2f2-a658646b422c', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:39:17 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-8f6cf0b7-bbe0-485b-a3c4-2037150eead8 tempest-AttachVolumeShelveTestJSON-1287215161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca21d980-a7c2-4bf5-a209-9c87924861a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:39:17 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-8f6cf0b7-bbe0-485b-a3c4-2037150eead8 tempest-AttachVolumeShelveTestJSON-1287215161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca21d980-a7c2-4bf5-a209-9c87924861a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:39:17 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-8f6cf0b7-bbe0-485b-a3c4-2037150eead8 tempest-AttachVolumeShelveTestJSON-1287215161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a8329f3-1b78-487b-9fe9-dbb7e7c8f294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:39:17 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-8f6cf0b7-bbe0-485b-a3c4-2037150eead8 tempest-AttachVolumeShelveTestJSON-1287215161 None] Volume 14923f28-f152-4f61-b2f2-a658646b422c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-14923f28-f152-4f61-b2f2-a658646b422c', 'volume_size': 1} Sep 06 06:39:17 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-8f6cf0b7-bbe0-485b-a3c4-2037150eead8 tempest-AttachVolumeShelveTestJSON-1287215161 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:39:17 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-8f6cf0b7-bbe0-485b-a3c4-2037150eead8 tempest-AttachVolumeShelveTestJSON-1287215161 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:39:17 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-8f6cf0b7-bbe0-485b-a3c4-2037150eead8 tempest-AttachVolumeShelveTestJSON-1287215161 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:39:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-2108141744',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14923f28-f152-4f61-b2f2-a658646b422c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c417a275cec54bb598673f05552bcbd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:39:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:39:17Z,use_quota=True,user_id='a290002c4b5640a9824ccda4b74dbd41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)}" {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 06:39:17 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-8f6cf0b7-bbe0-485b-a3c4-2037150eead8 tempest-AttachVolumeShelveTestJSON-1287215161 None] Creating volume 14923f28-f152-4f61-b2f2-a658646b422c {{(pid=87329) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 06:39:17 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-8f6cf0b7-bbe0-485b-a3c4-2037150eead8 tempest-AttachVolumeShelveTestJSON-1287215161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:39:17 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-8f6cf0b7-bbe0-485b-a3c4-2037150eead8 tempest-AttachVolumeShelveTestJSON-1287215161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:39:17 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-8f6cf0b7-bbe0-485b-a3c4-2037150eead8 tempest-AttachVolumeShelveTestJSON-1287215161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:39:17 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-8f6cf0b7-bbe0-485b-a3c4-2037150eead8 tempest-AttachVolumeShelveTestJSON-1287215161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:39:17 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-8f6cf0b7-bbe0-485b-a3c4-2037150eead8 tempest-AttachVolumeShelveTestJSON-1287215161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:39:17 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-8f6cf0b7-bbe0-485b-a3c4-2037150eead8 tempest-AttachVolumeShelveTestJSON-1287215161 None] Selected osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 as target Quobyte volume. {{(pid=87329) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 06:39:17 devstack cinder-volume[87329]: INFO cinder.volume.drivers.remotefs [None req-8f6cf0b7-bbe0-485b-a3c4-2037150eead8 tempest-AttachVolumeShelveTestJSON-1287215161 None] casted to osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 Sep 06 06:39:17 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-8f6cf0b7-bbe0-485b-a3c4-2037150eead8 tempest-AttachVolumeShelveTestJSON-1287215161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-14923f28-f152-4f61-b2f2-a658646b422c 1073741824 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:39:17 devstack sudo[97060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-14923f28-f152-4f61-b2f2-a658646b422c 1073741824 Sep 06 06:39:17 devstack sudo[97060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:39:17 devstack sudo[97058]: pam_unix(sudo:session): session closed for user root Sep 06 06:39:17 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-66106da0-c19f-449b-a1f6-2a1360faf308 tempest-CreateVolumesFromImageTest-237718682 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-7179551a-7197-4313-892a-1bdee2f669ee" returned: 0 in 0.479s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:39:17 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-66106da0-c19f-449b-a1f6-2a1360faf308 tempest-CreateVolumesFromImageTest-237718682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-7179551a-7197-4313-892a-1bdee2f669ee {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:39:17 devstack sudo[97065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-7179551a-7197-4313-892a-1bdee2f669ee Sep 06 06:39:17 devstack sudo[97065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:39:17 devstack sudo[97065]: pam_unix(sudo:session): session closed for user root Sep 06 06:39:17 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-66106da0-c19f-449b-a1f6-2a1360faf308 tempest-CreateVolumesFromImageTest-237718682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-7179551a-7197-4313-892a-1bdee2f669ee" returned: 0 in 0.313s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:39:17 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-66106da0-c19f-449b-a1f6-2a1360faf308 tempest-CreateVolumesFromImageTest-237718682 None] Lock "cinder-quobyte-7179551a-7197-4313-892a-1bdee2f669ee" released by "delete_volume" :: held 0.854s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:39:17 devstack sudo[97060]: pam_unix(sudo:session): session closed for user root Sep 06 06:39:17 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-8f6cf0b7-bbe0-485b-a3c4-2037150eead8 tempest-AttachVolumeShelveTestJSON-1287215161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-14923f28-f152-4f61-b2f2-a658646b422c 1073741824" returned: 0 in 0.542s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:39:17 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-66106da0-c19f-449b-a1f6-2a1360faf308 tempest-CreateVolumesFromImageTest-237718682 None] Created reservations ['b768db5f-b68e-4a53-a767-4b19bc00d323', '1cb5ff9e-44c4-47e6-9cdc-8f3071955252', '7e2af27c-5050-4466-9a79-88b503f7451f', 'a65031d3-3614-460c-b1a8-9894c458ed77'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:39:17 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-8f6cf0b7-bbe0-485b-a3c4-2037150eead8 tempest-AttachVolumeShelveTestJSON-1287215161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-14923f28-f152-4f61-b2f2-a658646b422c {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:39:17 devstack sudo[97072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-14923f28-f152-4f61-b2f2-a658646b422c Sep 06 06:39:17 devstack sudo[97072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:39:18 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-66106da0-c19f-449b-a1f6-2a1360faf308 tempest-CreateVolumesFromImageTest-237718682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:39:18 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-66106da0-c19f-449b-a1f6-2a1360faf308 tempest-CreateVolumesFromImageTest-237718682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:39:18 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-66106da0-c19f-449b-a1f6-2a1360faf308 tempest-CreateVolumesFromImageTest-237718682 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:39:18 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-66106da0-c19f-449b-a1f6-2a1360faf308 tempest-CreateVolumesFromImageTest-237718682 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:39:18 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-66106da0-c19f-449b-a1f6-2a1360faf308 tempest-CreateVolumesFromImageTest-237718682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:39:18 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-66106da0-c19f-449b-a1f6-2a1360faf308 tempest-CreateVolumesFromImageTest-237718682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:39:18 devstack sudo[97074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:39:18 devstack sudo[97074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:39:18 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-b8661b40-0a96-4417-95c3-e8ac302705d3 tempest-CreateVolumesFromImageTest-237718682 None] Acquiring lock "cinder-c7c8b366-13b5-453e-bda4-ef7eabee0705-delete_volume" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:39:18 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-b8661b40-0a96-4417-95c3-e8ac302705d3 tempest-CreateVolumesFromImageTest-237718682 None] Lock "cinder-c7c8b366-13b5-453e-bda4-ef7eabee0705-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:39:18 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-b8661b40-0a96-4417-95c3-e8ac302705d3 tempest-CreateVolumesFromImageTest-237718682 None] Acquiring lock "cinder-quobyte-c7c8b366-13b5-453e-bda4-ef7eabee0705" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:39:18 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-b8661b40-0a96-4417-95c3-e8ac302705d3 tempest-CreateVolumesFromImageTest-237718682 None] Lock "cinder-quobyte-c7c8b366-13b5-453e-bda4-ef7eabee0705" acquired by "delete_volume" :: waited 0.027s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:39:18 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[a764db36-07a9-41ff-9475-e60f73da5c56]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:39:18 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-b8661b40-0a96-4417-95c3-e8ac302705d3 tempest-CreateVolumesFromImageTest-237718682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-c7c8b366-13b5-453e-bda4-ef7eabee0705 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:39:18 devstack sudo[97074]: pam_unix(sudo:session): session closed for user root Sep 06 06:39:18 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-66106da0-c19f-449b-a1f6-2a1360faf308 tempest-CreateVolumesFromImageTest-237718682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.352s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:39:18 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-66106da0-c19f-449b-a1f6-2a1360faf308 tempest-CreateVolumesFromImageTest-237718682 None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:39:18 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-66106da0-c19f-449b-a1f6-2a1360faf308 tempest-CreateVolumesFromImageTest-237718682 None] Deleted volume successfully. Sep 06 06:39:18 devstack sudo[97072]: pam_unix(sudo:session): session closed for user root Sep 06 06:39:18 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-8f6cf0b7-bbe0-485b-a3c4-2037150eead8 tempest-AttachVolumeShelveTestJSON-1287215161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-14923f28-f152-4f61-b2f2-a658646b422c" returned: 0 in 0.524s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:39:18 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-8f6cf0b7-bbe0-485b-a3c4-2037150eead8 tempest-AttachVolumeShelveTestJSON-1287215161 None] <== create_volume: return (1135ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'} {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 06:39:18 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-8f6cf0b7-bbe0-485b-a3c4-2037150eead8 tempest-AttachVolumeShelveTestJSON-1287215161 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.138s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:39:18 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-66106da0-c19f-449b-a1f6-2a1360faf308 tempest-CreateVolumesFromImageTest-237718682 None] Lock "cinder-7179551a-7197-4313-892a-1bdee2f669ee-delete_volume" released by "delete_volume" :: held 1.587s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:39:18 devstack sudo[97076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-c7c8b366-13b5-453e-bda4-ef7eabee0705 Sep 06 06:39:18 devstack sudo[97076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:39:18 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-8f6cf0b7-bbe0-485b-a3c4-2037150eead8 tempest-AttachVolumeShelveTestJSON-1287215161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a8329f3-1b78-487b-9fe9-dbb7e7c8f294) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14923f28-f152-4f61-b2f2-a658646b422c', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:39:18 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-8f6cf0b7-bbe0-485b-a3c4-2037150eead8 tempest-AttachVolumeShelveTestJSON-1287215161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (748e4450-7cc9-4b56-84e5-6f187b5ad421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:39:18 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-8f6cf0b7-bbe0-485b-a3c4-2037150eead8 tempest-AttachVolumeShelveTestJSON-1287215161 None] Volume volume-14923f28-f152-4f61-b2f2-a658646b422c (14923f28-f152-4f61-b2f2-a658646b422c): created successfully Sep 06 06:39:18 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-8f6cf0b7-bbe0-485b-a3c4-2037150eead8 tempest-AttachVolumeShelveTestJSON-1287215161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (748e4450-7cc9-4b56-84e5-6f187b5ad421) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:39:18 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-8f6cf0b7-bbe0-485b-a3c4-2037150eead8 tempest-AttachVolumeShelveTestJSON-1287215161 None] Flow 'volume_create_manager' (b3a4a31d-6cf5-42f5-8766-7f74466c8113) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:39:18 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-8f6cf0b7-bbe0-485b-a3c4-2037150eead8 tempest-AttachVolumeShelveTestJSON-1287215161 None] Created volume successfully. Sep 06 06:39:18 devstack sudo[97076]: pam_unix(sudo:session): session closed for user root Sep 06 06:39:18 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-b8661b40-0a96-4417-95c3-e8ac302705d3 tempest-CreateVolumesFromImageTest-237718682 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-c7c8b366-13b5-453e-bda4-ef7eabee0705" returned: 0 in 0.511s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:39:18 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-b8661b40-0a96-4417-95c3-e8ac302705d3 tempest-CreateVolumesFromImageTest-237718682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-c7c8b366-13b5-453e-bda4-ef7eabee0705 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:39:18 devstack sudo[97083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-c7c8b366-13b5-453e-bda4-ef7eabee0705 Sep 06 06:39:18 devstack sudo[97083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:39:19 devstack sudo[97083]: pam_unix(sudo:session): session closed for user root Sep 06 06:39:19 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-b8661b40-0a96-4417-95c3-e8ac302705d3 tempest-CreateVolumesFromImageTest-237718682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-c7c8b366-13b5-453e-bda4-ef7eabee0705" returned: 0 in 0.298s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:39:19 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-b8661b40-0a96-4417-95c3-e8ac302705d3 tempest-CreateVolumesFromImageTest-237718682 None] Lock "cinder-quobyte-c7c8b366-13b5-453e-bda4-ef7eabee0705" released by "delete_volume" :: held 0.881s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:39:19 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-b8661b40-0a96-4417-95c3-e8ac302705d3 tempest-CreateVolumesFromImageTest-237718682 None] Created reservations ['80aa40f5-ccce-41a5-abdf-133327778449', '4242a9db-2d73-4b98-82c6-a0c8ae137deb', 'c0ff24a9-e624-42ae-bfa4-755658d53448', '53f45b1c-0fc6-447c-bdb4-f37a7dff082c'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:39:19 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-b8661b40-0a96-4417-95c3-e8ac302705d3 tempest-CreateVolumesFromImageTest-237718682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:39:19 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-b8661b40-0a96-4417-95c3-e8ac302705d3 tempest-CreateVolumesFromImageTest-237718682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:39:19 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-b8661b40-0a96-4417-95c3-e8ac302705d3 tempest-CreateVolumesFromImageTest-237718682 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:39:19 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-b8661b40-0a96-4417-95c3-e8ac302705d3 tempest-CreateVolumesFromImageTest-237718682 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:39:19 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-b8661b40-0a96-4417-95c3-e8ac302705d3 tempest-CreateVolumesFromImageTest-237718682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:39:19 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-b8661b40-0a96-4417-95c3-e8ac302705d3 tempest-CreateVolumesFromImageTest-237718682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:39:19 devstack sudo[97088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:39:19 devstack sudo[97088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:39:19 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-8a26d0f4-86c8-4f51-9ed1-ef2982cf5d93 tempest-CreateVolumesFromImageTest-237718682 None] Acquiring lock "cinder-524883e6-d874-4ee6-9ad0-146db54941c5-delete_volume" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:39:19 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-8a26d0f4-86c8-4f51-9ed1-ef2982cf5d93 tempest-CreateVolumesFromImageTest-237718682 None] Lock "cinder-524883e6-d874-4ee6-9ad0-146db54941c5-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:39:19 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-8a26d0f4-86c8-4f51-9ed1-ef2982cf5d93 tempest-CreateVolumesFromImageTest-237718682 None] Acquiring lock "cinder-quobyte-524883e6-d874-4ee6-9ad0-146db54941c5" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:39:19 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-8a26d0f4-86c8-4f51-9ed1-ef2982cf5d93 tempest-CreateVolumesFromImageTest-237718682 None] Lock "cinder-quobyte-524883e6-d874-4ee6-9ad0-146db54941c5" acquired by "delete_volume" :: waited 0.027s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:39:19 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c67a41e-9512-4ad5-ba34-e4a3a1020128]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:39:19 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-8a26d0f4-86c8-4f51-9ed1-ef2982cf5d93 tempest-CreateVolumesFromImageTest-237718682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-524883e6-d874-4ee6-9ad0-146db54941c5 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:39:19 devstack sudo[97088]: pam_unix(sudo:session): session closed for user root Sep 06 06:39:19 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-b8661b40-0a96-4417-95c3-e8ac302705d3 tempest-CreateVolumesFromImageTest-237718682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.483s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:39:19 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-b8661b40-0a96-4417-95c3-e8ac302705d3 tempest-CreateVolumesFromImageTest-237718682 None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:39:19 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-b8661b40-0a96-4417-95c3-e8ac302705d3 tempest-CreateVolumesFromImageTest-237718682 None] Deleted volume successfully. Sep 06 06:39:19 devstack sudo[97093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-524883e6-d874-4ee6-9ad0-146db54941c5 Sep 06 06:39:19 devstack sudo[97093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:39:19 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-b8661b40-0a96-4417-95c3-e8ac302705d3 tempest-CreateVolumesFromImageTest-237718682 None] Lock "cinder-c7c8b366-13b5-453e-bda4-ef7eabee0705-delete_volume" released by "delete_volume" :: held 1.664s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:39:20 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-f647385a-c1de-41b1-8eb6-97cb4186694f tempest-SnapshotMetadataTestJSON-677755387 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87329) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 06:39:20 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-f647385a-c1de-41b1-8eb6-97cb4186694f tempest-SnapshotMetadataTestJSON-677755387 None] Flow 'volume_create_manager' (ec4c58ec-9115-4052-91f2-a0c6f6ed6b57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:39:20 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-f647385a-c1de-41b1-8eb6-97cb4186694f tempest-SnapshotMetadataTestJSON-677755387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edc16531-b8f8-44cd-b6f3-aef5ad2260bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:39:20 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-f647385a-c1de-41b1-8eb6-97cb4186694f tempest-SnapshotMetadataTestJSON-677755387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edc16531-b8f8-44cd-b6f3-aef5ad2260bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:39:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1409999988',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf09e294-8bad-46d0-9328-cbabe43fad8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebbb796f098e421eae8d6786167a9f94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:39:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:39:20Z,use_quota=True,user_id='7e736e1d3785494687b5f9cc2394a452',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:39:20 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-f647385a-c1de-41b1-8eb6-97cb4186694f tempest-SnapshotMetadataTestJSON-677755387 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc2d1039-63bc-4547-9df3-72a797fd29c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:39:20 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-f647385a-c1de-41b1-8eb6-97cb4186694f tempest-SnapshotMetadataTestJSON-677755387 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc2d1039-63bc-4547-9df3-72a797fd29c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:39:20 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-f647385a-c1de-41b1-8eb6-97cb4186694f tempest-SnapshotMetadataTestJSON-677755387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ac15e55-5637-4abb-a909-545b99433f2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:39:20 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-f647385a-c1de-41b1-8eb6-97cb4186694f tempest-SnapshotMetadataTestJSON-677755387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ac15e55-5637-4abb-a909-545b99433f2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf09e294-8bad-46d0-9328-cbabe43fad8c', 'volume_name': 'volume-bf09e294-8bad-46d0-9328-cbabe43fad8c', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:39:20 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-f647385a-c1de-41b1-8eb6-97cb4186694f tempest-SnapshotMetadataTestJSON-677755387 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (084a86f2-5342-4b8b-bdc1-183627f4c7cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:39:20 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-f647385a-c1de-41b1-8eb6-97cb4186694f tempest-SnapshotMetadataTestJSON-677755387 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (084a86f2-5342-4b8b-bdc1-183627f4c7cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:39:20 devstack sudo[97093]: pam_unix(sudo:session): session closed for user root Sep 06 06:39:20 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-f647385a-c1de-41b1-8eb6-97cb4186694f tempest-SnapshotMetadataTestJSON-677755387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ceaabc49-b3ca-4283-ae91-725cd72a2c74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:39:20 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-f647385a-c1de-41b1-8eb6-97cb4186694f tempest-SnapshotMetadataTestJSON-677755387 None] Volume bf09e294-8bad-46d0-9328-cbabe43fad8c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf09e294-8bad-46d0-9328-cbabe43fad8c', 'volume_size': 1} Sep 06 06:39:20 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-f647385a-c1de-41b1-8eb6-97cb4186694f tempest-SnapshotMetadataTestJSON-677755387 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:39:20 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-f647385a-c1de-41b1-8eb6-97cb4186694f tempest-SnapshotMetadataTestJSON-677755387 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:39:20 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-f647385a-c1de-41b1-8eb6-97cb4186694f tempest-SnapshotMetadataTestJSON-677755387 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:39:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1409999988',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf09e294-8bad-46d0-9328-cbabe43fad8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebbb796f098e421eae8d6786167a9f94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:39:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:39:20Z,use_quota=True,user_id='7e736e1d3785494687b5f9cc2394a452',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)}" {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 06:39:20 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-f647385a-c1de-41b1-8eb6-97cb4186694f tempest-SnapshotMetadataTestJSON-677755387 None] Creating volume bf09e294-8bad-46d0-9328-cbabe43fad8c {{(pid=87329) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 06:39:20 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-f647385a-c1de-41b1-8eb6-97cb4186694f tempest-SnapshotMetadataTestJSON-677755387 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:39:20 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-f647385a-c1de-41b1-8eb6-97cb4186694f tempest-SnapshotMetadataTestJSON-677755387 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:39:20 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-f647385a-c1de-41b1-8eb6-97cb4186694f tempest-SnapshotMetadataTestJSON-677755387 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:39:20 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-f647385a-c1de-41b1-8eb6-97cb4186694f tempest-SnapshotMetadataTestJSON-677755387 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:39:20 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-f647385a-c1de-41b1-8eb6-97cb4186694f tempest-SnapshotMetadataTestJSON-677755387 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:39:20 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-f647385a-c1de-41b1-8eb6-97cb4186694f tempest-SnapshotMetadataTestJSON-677755387 None] Selected osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 as target Quobyte volume. {{(pid=87329) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 06:39:20 devstack cinder-volume[87329]: INFO cinder.volume.drivers.remotefs [None req-f647385a-c1de-41b1-8eb6-97cb4186694f tempest-SnapshotMetadataTestJSON-677755387 None] casted to osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 Sep 06 06:39:20 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-f647385a-c1de-41b1-8eb6-97cb4186694f tempest-SnapshotMetadataTestJSON-677755387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bf09e294-8bad-46d0-9328-cbabe43fad8c 1073741824 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:39:20 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-8a26d0f4-86c8-4f51-9ed1-ef2982cf5d93 tempest-CreateVolumesFromImageTest-237718682 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-524883e6-d874-4ee6-9ad0-146db54941c5" returned: 0 in 0.593s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:39:20 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-8a26d0f4-86c8-4f51-9ed1-ef2982cf5d93 tempest-CreateVolumesFromImageTest-237718682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-524883e6-d874-4ee6-9ad0-146db54941c5 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:39:20 devstack sudo[97101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bf09e294-8bad-46d0-9328-cbabe43fad8c 1073741824 Sep 06 06:39:20 devstack sudo[97101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:39:20 devstack sudo[97102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-524883e6-d874-4ee6-9ad0-146db54941c5 Sep 06 06:39:20 devstack sudo[97102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:39:20 devstack sudo[97102]: pam_unix(sudo:session): session closed for user root Sep 06 06:39:20 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-8a26d0f4-86c8-4f51-9ed1-ef2982cf5d93 tempest-CreateVolumesFromImageTest-237718682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-524883e6-d874-4ee6-9ad0-146db54941c5" returned: 0 in 0.307s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:39:20 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-8a26d0f4-86c8-4f51-9ed1-ef2982cf5d93 tempest-CreateVolumesFromImageTest-237718682 None] Lock "cinder-quobyte-524883e6-d874-4ee6-9ad0-146db54941c5" released by "delete_volume" :: held 0.998s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:39:20 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-8a26d0f4-86c8-4f51-9ed1-ef2982cf5d93 tempest-CreateVolumesFromImageTest-237718682 None] Created reservations ['94f19b64-2c50-4576-9b14-27a4fb85fce9', '60d6d89e-1e57-4b0b-b9c6-ad7898433c69', '95c3f85a-ecb5-4cde-a0e4-7d255e6971de', 'fa3c3b4d-ab59-4835-bc6b-b81b7fc863d5'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:39:20 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-8a26d0f4-86c8-4f51-9ed1-ef2982cf5d93 tempest-CreateVolumesFromImageTest-237718682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:39:20 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-8a26d0f4-86c8-4f51-9ed1-ef2982cf5d93 tempest-CreateVolumesFromImageTest-237718682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:39:20 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-8a26d0f4-86c8-4f51-9ed1-ef2982cf5d93 tempest-CreateVolumesFromImageTest-237718682 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:39:20 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-8a26d0f4-86c8-4f51-9ed1-ef2982cf5d93 tempest-CreateVolumesFromImageTest-237718682 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:39:20 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-8a26d0f4-86c8-4f51-9ed1-ef2982cf5d93 tempest-CreateVolumesFromImageTest-237718682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:39:20 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-8a26d0f4-86c8-4f51-9ed1-ef2982cf5d93 tempest-CreateVolumesFromImageTest-237718682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:39:20 devstack sudo[97109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:39:20 devstack sudo[97109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:39:20 devstack sudo[97101]: pam_unix(sudo:session): session closed for user root Sep 06 06:39:20 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-f647385a-c1de-41b1-8eb6-97cb4186694f tempest-SnapshotMetadataTestJSON-677755387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bf09e294-8bad-46d0-9328-cbabe43fad8c 1073741824" returned: 0 in 0.622s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:39:20 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-f647385a-c1de-41b1-8eb6-97cb4186694f tempest-SnapshotMetadataTestJSON-677755387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bf09e294-8bad-46d0-9328-cbabe43fad8c {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:39:20 devstack sudo[97111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bf09e294-8bad-46d0-9328-cbabe43fad8c Sep 06 06:39:20 devstack sudo[97111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:39:21 devstack sudo[97109]: pam_unix(sudo:session): session closed for user root Sep 06 06:39:21 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-8a26d0f4-86c8-4f51-9ed1-ef2982cf5d93 tempest-CreateVolumesFromImageTest-237718682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.406s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:39:21 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-8a26d0f4-86c8-4f51-9ed1-ef2982cf5d93 tempest-CreateVolumesFromImageTest-237718682 None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:39:21 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-8a26d0f4-86c8-4f51-9ed1-ef2982cf5d93 tempest-CreateVolumesFromImageTest-237718682 None] Deleted volume successfully. Sep 06 06:39:21 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-8a26d0f4-86c8-4f51-9ed1-ef2982cf5d93 tempest-CreateVolumesFromImageTest-237718682 None] Lock "cinder-524883e6-d874-4ee6-9ad0-146db54941c5-delete_volume" released by "delete_volume" :: held 1.720s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:39:21 devstack sudo[97111]: pam_unix(sudo:session): session closed for user root Sep 06 06:39:21 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-f647385a-c1de-41b1-8eb6-97cb4186694f tempest-SnapshotMetadataTestJSON-677755387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bf09e294-8bad-46d0-9328-cbabe43fad8c" returned: 0 in 0.378s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:39:21 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-f647385a-c1de-41b1-8eb6-97cb4186694f tempest-SnapshotMetadataTestJSON-677755387 None] <== create_volume: return (1061ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'} {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 06:39:21 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-f647385a-c1de-41b1-8eb6-97cb4186694f tempest-SnapshotMetadataTestJSON-677755387 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.064s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:39:21 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-f647385a-c1de-41b1-8eb6-97cb4186694f tempest-SnapshotMetadataTestJSON-677755387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ceaabc49-b3ca-4283-ae91-725cd72a2c74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf09e294-8bad-46d0-9328-cbabe43fad8c', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:39:21 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-f647385a-c1de-41b1-8eb6-97cb4186694f tempest-SnapshotMetadataTestJSON-677755387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (080466be-876a-43af-9139-f0b666183357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:39:21 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-f647385a-c1de-41b1-8eb6-97cb4186694f tempest-SnapshotMetadataTestJSON-677755387 None] Volume volume-bf09e294-8bad-46d0-9328-cbabe43fad8c (bf09e294-8bad-46d0-9328-cbabe43fad8c): created successfully Sep 06 06:39:21 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-f647385a-c1de-41b1-8eb6-97cb4186694f tempest-SnapshotMetadataTestJSON-677755387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (080466be-876a-43af-9139-f0b666183357) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:39:21 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-f647385a-c1de-41b1-8eb6-97cb4186694f tempest-SnapshotMetadataTestJSON-677755387 None] Flow 'volume_create_manager' (ec4c58ec-9115-4052-91f2-a0c6f6ed6b57) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:39:21 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-f647385a-c1de-41b1-8eb6-97cb4186694f tempest-SnapshotMetadataTestJSON-677755387 None] Created volume successfully. Sep 06 06:39:22 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-d1dbd558-e170-41f9-a5c1-62cc78eec526 tempest-SnapshotMetadataTestJSON-677755387 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:39:22 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-d1dbd558-e170-41f9-a5c1-62cc78eec526 tempest-SnapshotMetadataTestJSON-677755387 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:39:22 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-d1dbd558-e170-41f9-a5c1-62cc78eec526 tempest-SnapshotMetadataTestJSON-677755387 None] Creating offline snapshot 1b34f5c7-5706-444a-8349-b8b3b7a9d791 of volume bf09e294-8bad-46d0-9328-cbabe43fad8c {{(pid=87329) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 06 06:39:22 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d8c6652-e994-4bc0-85bb-4621b380b10f]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:39:22 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-d1dbd558-e170-41f9-a5c1-62cc78eec526 tempest-SnapshotMetadataTestJSON-677755387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bf09e294-8bad-46d0-9328-cbabe43fad8c {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:39:22 devstack sudo[97127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bf09e294-8bad-46d0-9328-cbabe43fad8c Sep 06 06:39:22 devstack sudo[97127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:39:23 devstack sudo[97127]: pam_unix(sudo:session): session closed for user root Sep 06 06:39:23 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-d1dbd558-e170-41f9-a5c1-62cc78eec526 tempest-SnapshotMetadataTestJSON-677755387 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bf09e294-8bad-46d0-9328-cbabe43fad8c" returned: 0 in 0.529s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:39:23 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-d1dbd558-e170-41f9-a5c1-62cc78eec526 tempest-SnapshotMetadataTestJSON-677755387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bf09e294-8bad-46d0-9328-cbabe43fad8c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bf09e294-8bad-46d0-9328-cbabe43fad8c.1b34f5c7-5706-444a-8349-b8b3b7a9d791 1G {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:39:23 devstack sudo[97133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bf09e294-8bad-46d0-9328-cbabe43fad8c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bf09e294-8bad-46d0-9328-cbabe43fad8c.1b34f5c7-5706-444a-8349-b8b3b7a9d791 1G Sep 06 06:39:23 devstack sudo[97133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:39:23 devstack sudo[97133]: pam_unix(sudo:session): session closed for user root Sep 06 06:39:23 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-d1dbd558-e170-41f9-a5c1-62cc78eec526 tempest-SnapshotMetadataTestJSON-677755387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bf09e294-8bad-46d0-9328-cbabe43fad8c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bf09e294-8bad-46d0-9328-cbabe43fad8c.1b34f5c7-5706-444a-8349-b8b3b7a9d791 1G" returned: 0 in 0.561s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:39:23 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-d1dbd558-e170-41f9-a5c1-62cc78eec526 tempest-SnapshotMetadataTestJSON-677755387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf09e294-8bad-46d0-9328-cbabe43fad8c -F qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bf09e294-8bad-46d0-9328-cbabe43fad8c.1b34f5c7-5706-444a-8349-b8b3b7a9d791 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:39:23 devstack sudo[97139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf09e294-8bad-46d0-9328-cbabe43fad8c -F qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bf09e294-8bad-46d0-9328-cbabe43fad8c.1b34f5c7-5706-444a-8349-b8b3b7a9d791 Sep 06 06:39:23 devstack sudo[97139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:39:24 devstack sudo[97139]: pam_unix(sudo:session): session closed for user root Sep 06 06:39:24 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-d1dbd558-e170-41f9-a5c1-62cc78eec526 tempest-SnapshotMetadataTestJSON-677755387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf09e294-8bad-46d0-9328-cbabe43fad8c -F qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bf09e294-8bad-46d0-9328-cbabe43fad8c.1b34f5c7-5706-444a-8349-b8b3b7a9d791" returned: 0 in 0.415s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:39:24 devstack cinder-volume[87329]: WARNING cinder.volume.drivers.remotefs [None req-d1dbd558-e170-41f9-a5c1-62cc78eec526 tempest-SnapshotMetadataTestJSON-677755387 None] /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bf09e294-8bad-46d0-9328-cbabe43fad8c.1b34f5c7-5706-444a-8349-b8b3b7a9d791 is being set with open permissions: ugo+rw Sep 06 06:39:24 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-d1dbd558-e170-41f9-a5c1-62cc78eec526 tempest-SnapshotMetadataTestJSON-677755387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bf09e294-8bad-46d0-9328-cbabe43fad8c.1b34f5c7-5706-444a-8349-b8b3b7a9d791 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:39:24 devstack sudo[97145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bf09e294-8bad-46d0-9328-cbabe43fad8c.1b34f5c7-5706-444a-8349-b8b3b7a9d791 Sep 06 06:39:24 devstack sudo[97145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:39:24 devstack sudo[97145]: pam_unix(sudo:session): session closed for user root Sep 06 06:39:24 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-d1dbd558-e170-41f9-a5c1-62cc78eec526 tempest-SnapshotMetadataTestJSON-677755387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bf09e294-8bad-46d0-9328-cbabe43fad8c.1b34f5c7-5706-444a-8349-b8b3b7a9d791" returned: 0 in 0.378s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:39:24 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-d1dbd558-e170-41f9-a5c1-62cc78eec526 tempest-SnapshotMetadataTestJSON-677755387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bf09e294-8bad-46d0-9328-cbabe43fad8c.info {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:39:24 devstack sudo[97148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bf09e294-8bad-46d0-9328-cbabe43fad8c.info Sep 06 06:39:24 devstack sudo[97148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:39:24 devstack sudo[97148]: pam_unix(sudo:session): session closed for user root Sep 06 06:39:24 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-d1dbd558-e170-41f9-a5c1-62cc78eec526 tempest-SnapshotMetadataTestJSON-677755387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bf09e294-8bad-46d0-9328-cbabe43fad8c.info" returned: 0 in 0.436s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:39:24 devstack cinder-volume[87329]: WARNING cinder.volume.drivers.remotefs [None req-d1dbd558-e170-41f9-a5c1-62cc78eec526 tempest-SnapshotMetadataTestJSON-677755387 None] /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bf09e294-8bad-46d0-9328-cbabe43fad8c.info is being set with open permissions: ugo+rw Sep 06 06:39:24 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-d1dbd558-e170-41f9-a5c1-62cc78eec526 tempest-SnapshotMetadataTestJSON-677755387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bf09e294-8bad-46d0-9328-cbabe43fad8c.info {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:39:24 devstack sudo[97151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bf09e294-8bad-46d0-9328-cbabe43fad8c.info Sep 06 06:39:24 devstack sudo[97151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:39:25 devstack sudo[97151]: pam_unix(sudo:session): session closed for user root Sep 06 06:39:25 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-d1dbd558-e170-41f9-a5c1-62cc78eec526 tempest-SnapshotMetadataTestJSON-677755387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bf09e294-8bad-46d0-9328-cbabe43fad8c.info" returned: 0 in 0.322s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:39:25 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-d1dbd558-e170-41f9-a5c1-62cc78eec526 tempest-SnapshotMetadataTestJSON-677755387 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.821s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:39:25 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-d1dbd558-e170-41f9-a5c1-62cc78eec526 tempest-SnapshotMetadataTestJSON-677755387 None] Create snapshot completed successfully Sep 06 06:39:25 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-446633f6-f9f0-41b6-b8ea-09aba98e563e tempest-CreateVolumesFromSnapshotTest-1337710689 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87329) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 06:39:25 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-446633f6-f9f0-41b6-b8ea-09aba98e563e tempest-CreateVolumesFromSnapshotTest-1337710689 None] Flow 'volume_create_manager' (75499c3a-6cca-476d-8e70-427762cbabb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:39:25 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-446633f6-f9f0-41b6-b8ea-09aba98e563e tempest-CreateVolumesFromSnapshotTest-1337710689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ed4a6d1-270c-447c-a489-b829213084a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:39:25 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-446633f6-f9f0-41b6-b8ea-09aba98e563e tempest-CreateVolumesFromSnapshotTest-1337710689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ed4a6d1-270c-447c-a489-b829213084a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:39:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-725576320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11514717-d5a4-4e5e-8269-d526ed8dc3f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a48b8b1a02bc4aa79ad2803b2be55536',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:39:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:39:26Z,use_quota=True,user_id='b83ce38d41b4486499aacacd05274c92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:39:25 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-446633f6-f9f0-41b6-b8ea-09aba98e563e tempest-CreateVolumesFromSnapshotTest-1337710689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb219297-1eef-4b18-a950-9a22c221266c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:39:25 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-446633f6-f9f0-41b6-b8ea-09aba98e563e tempest-CreateVolumesFromSnapshotTest-1337710689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb219297-1eef-4b18-a950-9a22c221266c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:39:25 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-446633f6-f9f0-41b6-b8ea-09aba98e563e tempest-CreateVolumesFromSnapshotTest-1337710689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69e46626-8993-40d7-bcf1-efbf8f927300) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:39:25 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-446633f6-f9f0-41b6-b8ea-09aba98e563e tempest-CreateVolumesFromSnapshotTest-1337710689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69e46626-8993-40d7-bcf1-efbf8f927300) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11514717-d5a4-4e5e-8269-d526ed8dc3f0', 'volume_name': 'volume-11514717-d5a4-4e5e-8269-d526ed8dc3f0', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:39:25 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-446633f6-f9f0-41b6-b8ea-09aba98e563e tempest-CreateVolumesFromSnapshotTest-1337710689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab463e1a-f6bc-4565-88c2-6a7ec2075afb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:39:25 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-446633f6-f9f0-41b6-b8ea-09aba98e563e tempest-CreateVolumesFromSnapshotTest-1337710689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab463e1a-f6bc-4565-88c2-6a7ec2075afb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:39:25 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-446633f6-f9f0-41b6-b8ea-09aba98e563e tempest-CreateVolumesFromSnapshotTest-1337710689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24abb716-78ae-4312-954f-9541266a2a3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:39:25 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-446633f6-f9f0-41b6-b8ea-09aba98e563e tempest-CreateVolumesFromSnapshotTest-1337710689 None] Volume 11514717-d5a4-4e5e-8269-d526ed8dc3f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11514717-d5a4-4e5e-8269-d526ed8dc3f0', 'volume_size': 1} Sep 06 06:39:25 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-446633f6-f9f0-41b6-b8ea-09aba98e563e tempest-CreateVolumesFromSnapshotTest-1337710689 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:39:25 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-446633f6-f9f0-41b6-b8ea-09aba98e563e tempest-CreateVolumesFromSnapshotTest-1337710689 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:39:25 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-446633f6-f9f0-41b6-b8ea-09aba98e563e tempest-CreateVolumesFromSnapshotTest-1337710689 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:39:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-725576320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11514717-d5a4-4e5e-8269-d526ed8dc3f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a48b8b1a02bc4aa79ad2803b2be55536',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:39:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:39:26Z,use_quota=True,user_id='b83ce38d41b4486499aacacd05274c92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)}" {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 06:39:25 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-446633f6-f9f0-41b6-b8ea-09aba98e563e tempest-CreateVolumesFromSnapshotTest-1337710689 None] Creating volume 11514717-d5a4-4e5e-8269-d526ed8dc3f0 {{(pid=87329) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 06:39:25 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-446633f6-f9f0-41b6-b8ea-09aba98e563e tempest-CreateVolumesFromSnapshotTest-1337710689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:39:25 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-446633f6-f9f0-41b6-b8ea-09aba98e563e tempest-CreateVolumesFromSnapshotTest-1337710689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:39:25 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-446633f6-f9f0-41b6-b8ea-09aba98e563e tempest-CreateVolumesFromSnapshotTest-1337710689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:39:25 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-446633f6-f9f0-41b6-b8ea-09aba98e563e tempest-CreateVolumesFromSnapshotTest-1337710689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:39:25 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-446633f6-f9f0-41b6-b8ea-09aba98e563e tempest-CreateVolumesFromSnapshotTest-1337710689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:39:25 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-446633f6-f9f0-41b6-b8ea-09aba98e563e tempest-CreateVolumesFromSnapshotTest-1337710689 None] Selected osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 as target Quobyte volume. {{(pid=87329) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 06:39:25 devstack cinder-volume[87329]: INFO cinder.volume.drivers.remotefs [None req-446633f6-f9f0-41b6-b8ea-09aba98e563e tempest-CreateVolumesFromSnapshotTest-1337710689 None] casted to osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 Sep 06 06:39:25 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-446633f6-f9f0-41b6-b8ea-09aba98e563e tempest-CreateVolumesFromSnapshotTest-1337710689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-11514717-d5a4-4e5e-8269-d526ed8dc3f0 1073741824 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:39:25 devstack sudo[97155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-11514717-d5a4-4e5e-8269-d526ed8dc3f0 1073741824 Sep 06 06:39:25 devstack sudo[97155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:39:26 devstack sudo[97155]: pam_unix(sudo:session): session closed for user root Sep 06 06:39:26 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-446633f6-f9f0-41b6-b8ea-09aba98e563e tempest-CreateVolumesFromSnapshotTest-1337710689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-11514717-d5a4-4e5e-8269-d526ed8dc3f0 1073741824" returned: 0 in 0.605s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:39:26 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-446633f6-f9f0-41b6-b8ea-09aba98e563e tempest-CreateVolumesFromSnapshotTest-1337710689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-11514717-d5a4-4e5e-8269-d526ed8dc3f0 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:39:26 devstack sudo[97162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-11514717-d5a4-4e5e-8269-d526ed8dc3f0 Sep 06 06:39:26 devstack sudo[97162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:39:26 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-bd8b5822-3fcc-41dd-864d-0f138ba62303 tempest-SnapshotMetadataTestJSON-677755387 None] Acquiring lock "cinder-1b34f5c7-5706-444a-8349-b8b3b7a9d791-delete_snapshot" by "delete_snapshot" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:39:26 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-bd8b5822-3fcc-41dd-864d-0f138ba62303 tempest-SnapshotMetadataTestJSON-677755387 None] Lock "cinder-1b34f5c7-5706-444a-8349-b8b3b7a9d791-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:39:26 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-bd8b5822-3fcc-41dd-864d-0f138ba62303 tempest-SnapshotMetadataTestJSON-677755387 None] Acquiring lock "cinder-quobyte-bf09e294-8bad-46d0-9328-cbabe43fad8c" by "delete_snapshot" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:39:26 devstack sudo[97162]: pam_unix(sudo:session): session closed for user root Sep 06 06:39:26 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-446633f6-f9f0-41b6-b8ea-09aba98e563e tempest-CreateVolumesFromSnapshotTest-1337710689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-11514717-d5a4-4e5e-8269-d526ed8dc3f0" returned: 0 in 0.444s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:39:26 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-446633f6-f9f0-41b6-b8ea-09aba98e563e tempest-CreateVolumesFromSnapshotTest-1337710689 None] <== create_volume: return (1130ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'} {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 06:39:26 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-446633f6-f9f0-41b6-b8ea-09aba98e563e tempest-CreateVolumesFromSnapshotTest-1337710689 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.133s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:39:26 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-446633f6-f9f0-41b6-b8ea-09aba98e563e tempest-CreateVolumesFromSnapshotTest-1337710689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24abb716-78ae-4312-954f-9541266a2a3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11514717-d5a4-4e5e-8269-d526ed8dc3f0', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:39:26 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-446633f6-f9f0-41b6-b8ea-09aba98e563e tempest-CreateVolumesFromSnapshotTest-1337710689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9162bf96-403d-4770-8ab5-a676a3f8765a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:39:26 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-bd8b5822-3fcc-41dd-864d-0f138ba62303 tempest-SnapshotMetadataTestJSON-677755387 None] Lock "cinder-quobyte-bf09e294-8bad-46d0-9328-cbabe43fad8c" acquired by "delete_snapshot" :: waited 0.042s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:39:26 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-bd8b5822-3fcc-41dd-864d-0f138ba62303 tempest-SnapshotMetadataTestJSON-677755387 None] Acquiring lock "cinder-quobyte-1b34f5c7-5706-444a-8349-b8b3b7a9d791" by "_delete_snapshot" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:39:27 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-446633f6-f9f0-41b6-b8ea-09aba98e563e tempest-CreateVolumesFromSnapshotTest-1337710689 None] Volume volume-11514717-d5a4-4e5e-8269-d526ed8dc3f0 (11514717-d5a4-4e5e-8269-d526ed8dc3f0): created successfully Sep 06 06:39:27 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-446633f6-f9f0-41b6-b8ea-09aba98e563e tempest-CreateVolumesFromSnapshotTest-1337710689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9162bf96-403d-4770-8ab5-a676a3f8765a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:39:27 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-446633f6-f9f0-41b6-b8ea-09aba98e563e tempest-CreateVolumesFromSnapshotTest-1337710689 None] Flow 'volume_create_manager' (75499c3a-6cca-476d-8e70-427762cbabb0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:39:27 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-bd8b5822-3fcc-41dd-864d-0f138ba62303 tempest-SnapshotMetadataTestJSON-677755387 None] Lock "cinder-quobyte-1b34f5c7-5706-444a-8349-b8b3b7a9d791" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:39:27 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-bd8b5822-3fcc-41dd-864d-0f138ba62303 tempest-SnapshotMetadataTestJSON-677755387 None] Deleting offline snapshot 1b34f5c7-5706-444a-8349-b8b3b7a9d791 of volume bf09e294-8bad-46d0-9328-cbabe43fad8c {{(pid=87329) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 06 06:39:27 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-bd8b5822-3fcc-41dd-864d-0f138ba62303 tempest-SnapshotMetadataTestJSON-677755387 None] snapshot_file for this snap is: volume-bf09e294-8bad-46d0-9328-cbabe43fad8c.1b34f5c7-5706-444a-8349-b8b3b7a9d791 {{(pid=87329) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 06 06:39:27 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-446633f6-f9f0-41b6-b8ea-09aba98e563e tempest-CreateVolumesFromSnapshotTest-1337710689 None] Created volume successfully. Sep 06 06:39:27 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[c38bd474-c8df-4989-aab3-b18baaeb6bcb]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:39:27 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-bd8b5822-3fcc-41dd-864d-0f138ba62303 tempest-SnapshotMetadataTestJSON-677755387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bf09e294-8bad-46d0-9328-cbabe43fad8c.1b34f5c7-5706-444a-8349-b8b3b7a9d791 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:39:27 devstack sudo[97165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bf09e294-8bad-46d0-9328-cbabe43fad8c.1b34f5c7-5706-444a-8349-b8b3b7a9d791 Sep 06 06:39:27 devstack sudo[97165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:39:27 devstack sudo[97165]: pam_unix(sudo:session): session closed for user root Sep 06 06:39:27 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-bd8b5822-3fcc-41dd-864d-0f138ba62303 tempest-SnapshotMetadataTestJSON-677755387 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bf09e294-8bad-46d0-9328-cbabe43fad8c.1b34f5c7-5706-444a-8349-b8b3b7a9d791" returned: 0 in 0.455s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:39:27 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-bd8b5822-3fcc-41dd-864d-0f138ba62303 tempest-SnapshotMetadataTestJSON-677755387 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bf09e294-8bad-46d0-9328-cbabe43fad8c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87329) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 06:39:27 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[321d8a7c-9d9b-4a1d-a8cd-a62ce5c74a45]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:39:27 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-bd8b5822-3fcc-41dd-864d-0f138ba62303 tempest-SnapshotMetadataTestJSON-677755387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bf09e294-8bad-46d0-9328-cbabe43fad8c {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:39:27 devstack sudo[97170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bf09e294-8bad-46d0-9328-cbabe43fad8c Sep 06 06:39:27 devstack sudo[97170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:39:28 devstack sudo[97170]: pam_unix(sudo:session): session closed for user root Sep 06 06:39:28 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-bd8b5822-3fcc-41dd-864d-0f138ba62303 tempest-SnapshotMetadataTestJSON-677755387 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bf09e294-8bad-46d0-9328-cbabe43fad8c" returned: 0 in 0.660s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:39:28 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-bd8b5822-3fcc-41dd-864d-0f138ba62303 tempest-SnapshotMetadataTestJSON-677755387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bf09e294-8bad-46d0-9328-cbabe43fad8c.1b34f5c7-5706-444a-8349-b8b3b7a9d791 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:39:28 devstack sudo[97192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bf09e294-8bad-46d0-9328-cbabe43fad8c.1b34f5c7-5706-444a-8349-b8b3b7a9d791 Sep 06 06:39:28 devstack sudo[97192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:39:28 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-a4b53796-1783-44d2-99d2-2c031973d740 tempest-CreateVolumesFromSnapshotTest-1337710689 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:39:28 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-a4b53796-1783-44d2-99d2-2c031973d740 tempest-CreateVolumesFromSnapshotTest-1337710689 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:39:28 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-a4b53796-1783-44d2-99d2-2c031973d740 tempest-CreateVolumesFromSnapshotTest-1337710689 None] Creating offline snapshot 0b69a6a3-bae3-45a0-b413-b3eb62531ed0 of volume 11514717-d5a4-4e5e-8269-d526ed8dc3f0 {{(pid=87329) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 06 06:39:28 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[9050aab0-098c-4a24-b6e5-c11ae23243e2]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:39:28 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-a4b53796-1783-44d2-99d2-2c031973d740 tempest-CreateVolumesFromSnapshotTest-1337710689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-11514717-d5a4-4e5e-8269-d526ed8dc3f0 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:39:28 devstack sudo[97200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-11514717-d5a4-4e5e-8269-d526ed8dc3f0 Sep 06 06:39:28 devstack sudo[97200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:39:28 devstack sudo[97192]: pam_unix(sudo:session): session closed for user root Sep 06 06:39:28 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-bd8b5822-3fcc-41dd-864d-0f138ba62303 tempest-SnapshotMetadataTestJSON-677755387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bf09e294-8bad-46d0-9328-cbabe43fad8c.1b34f5c7-5706-444a-8349-b8b3b7a9d791" returned: 0 in 0.494s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:39:28 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-bd8b5822-3fcc-41dd-864d-0f138ba62303 tempest-SnapshotMetadataTestJSON-677755387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bf09e294-8bad-46d0-9328-cbabe43fad8c.1b34f5c7-5706-444a-8349-b8b3b7a9d791 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:39:28 devstack sudo[97202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bf09e294-8bad-46d0-9328-cbabe43fad8c.1b34f5c7-5706-444a-8349-b8b3b7a9d791 Sep 06 06:39:28 devstack sudo[97202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:39:28 devstack sudo[97200]: pam_unix(sudo:session): session closed for user root Sep 06 06:39:28 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-a4b53796-1783-44d2-99d2-2c031973d740 tempest-CreateVolumesFromSnapshotTest-1337710689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-11514717-d5a4-4e5e-8269-d526ed8dc3f0" returned: 0 in 0.419s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:39:28 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-a4b53796-1783-44d2-99d2-2c031973d740 tempest-CreateVolumesFromSnapshotTest-1337710689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-11514717-d5a4-4e5e-8269-d526ed8dc3f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-11514717-d5a4-4e5e-8269-d526ed8dc3f0.0b69a6a3-bae3-45a0-b413-b3eb62531ed0 1G {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:39:28 devstack sudo[97209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-11514717-d5a4-4e5e-8269-d526ed8dc3f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-11514717-d5a4-4e5e-8269-d526ed8dc3f0.0b69a6a3-bae3-45a0-b413-b3eb62531ed0 1G Sep 06 06:39:28 devstack sudo[97209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:39:29 devstack sudo[97202]: pam_unix(sudo:session): session closed for user root Sep 06 06:39:29 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-bd8b5822-3fcc-41dd-864d-0f138ba62303 tempest-SnapshotMetadataTestJSON-677755387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bf09e294-8bad-46d0-9328-cbabe43fad8c.1b34f5c7-5706-444a-8349-b8b3b7a9d791" returned: 0 in 0.312s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:39:29 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-bd8b5822-3fcc-41dd-864d-0f138ba62303 tempest-SnapshotMetadataTestJSON-677755387 None] Lock "cinder-quobyte-1b34f5c7-5706-444a-8349-b8b3b7a9d791" released by "_delete_snapshot" :: held 2.046s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:39:29 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-bd8b5822-3fcc-41dd-864d-0f138ba62303 tempest-SnapshotMetadataTestJSON-677755387 None] Lock "cinder-quobyte-bf09e294-8bad-46d0-9328-cbabe43fad8c" released by "delete_snapshot" :: held 2.086s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:39:29 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-bd8b5822-3fcc-41dd-864d-0f138ba62303 tempest-SnapshotMetadataTestJSON-677755387 None] Created reservations ['c1c62dea-a24a-4493-87f4-30090b131d43', 'de92699f-6205-4b12-b7f0-ad28f62f041b', '451375ae-c5d7-4ae5-9240-75e4c7a873d9', 'b30b8c66-adba-4d3f-a825-beeaa3bfaeb2'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:39:29 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-bd8b5822-3fcc-41dd-864d-0f138ba62303 tempest-SnapshotMetadataTestJSON-677755387 None] Delete snapshot completed successfully. Sep 06 06:39:29 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-bd8b5822-3fcc-41dd-864d-0f138ba62303 tempest-SnapshotMetadataTestJSON-677755387 None] Lock "cinder-1b34f5c7-5706-444a-8349-b8b3b7a9d791-delete_snapshot" released by "delete_snapshot" :: held 2.282s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:39:29 devstack sudo[97209]: pam_unix(sudo:session): session closed for user root Sep 06 06:39:29 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-a4b53796-1783-44d2-99d2-2c031973d740 tempest-CreateVolumesFromSnapshotTest-1337710689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-11514717-d5a4-4e5e-8269-d526ed8dc3f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-11514717-d5a4-4e5e-8269-d526ed8dc3f0.0b69a6a3-bae3-45a0-b413-b3eb62531ed0 1G" returned: 0 in 0.492s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:39:29 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-a4b53796-1783-44d2-99d2-2c031973d740 tempest-CreateVolumesFromSnapshotTest-1337710689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11514717-d5a4-4e5e-8269-d526ed8dc3f0 -F qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-11514717-d5a4-4e5e-8269-d526ed8dc3f0.0b69a6a3-bae3-45a0-b413-b3eb62531ed0 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:39:29 devstack sudo[97216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11514717-d5a4-4e5e-8269-d526ed8dc3f0 -F qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-11514717-d5a4-4e5e-8269-d526ed8dc3f0.0b69a6a3-bae3-45a0-b413-b3eb62531ed0 Sep 06 06:39:29 devstack sudo[97216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:39:29 devstack sudo[97216]: pam_unix(sudo:session): session closed for user root Sep 06 06:39:29 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-a4b53796-1783-44d2-99d2-2c031973d740 tempest-CreateVolumesFromSnapshotTest-1337710689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11514717-d5a4-4e5e-8269-d526ed8dc3f0 -F qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-11514717-d5a4-4e5e-8269-d526ed8dc3f0.0b69a6a3-bae3-45a0-b413-b3eb62531ed0" returned: 0 in 0.358s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:39:29 devstack cinder-volume[87329]: WARNING cinder.volume.drivers.remotefs [None req-a4b53796-1783-44d2-99d2-2c031973d740 tempest-CreateVolumesFromSnapshotTest-1337710689 None] /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-11514717-d5a4-4e5e-8269-d526ed8dc3f0.0b69a6a3-bae3-45a0-b413-b3eb62531ed0 is being set with open permissions: ugo+rw Sep 06 06:39:29 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-a4b53796-1783-44d2-99d2-2c031973d740 tempest-CreateVolumesFromSnapshotTest-1337710689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-11514717-d5a4-4e5e-8269-d526ed8dc3f0.0b69a6a3-bae3-45a0-b413-b3eb62531ed0 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:39:29 devstack sudo[97222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-11514717-d5a4-4e5e-8269-d526ed8dc3f0.0b69a6a3-bae3-45a0-b413-b3eb62531ed0 Sep 06 06:39:29 devstack sudo[97222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:39:30 devstack sudo[97222]: pam_unix(sudo:session): session closed for user root Sep 06 06:39:30 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-a4b53796-1783-44d2-99d2-2c031973d740 tempest-CreateVolumesFromSnapshotTest-1337710689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-11514717-d5a4-4e5e-8269-d526ed8dc3f0.0b69a6a3-bae3-45a0-b413-b3eb62531ed0" returned: 0 in 0.306s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:39:30 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-a4b53796-1783-44d2-99d2-2c031973d740 tempest-CreateVolumesFromSnapshotTest-1337710689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-11514717-d5a4-4e5e-8269-d526ed8dc3f0.info {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:39:30 devstack sudo[97225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-11514717-d5a4-4e5e-8269-d526ed8dc3f0.info Sep 06 06:39:30 devstack sudo[97225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:39:30 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-b8f366e8-6c21-4685-b87e-b7682634e47b tempest-SnapshotMetadataTestJSON-677755387 None] Acquiring lock "cinder-bf09e294-8bad-46d0-9328-cbabe43fad8c-delete_volume" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:39:30 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-b8f366e8-6c21-4685-b87e-b7682634e47b tempest-SnapshotMetadataTestJSON-677755387 None] Lock "cinder-bf09e294-8bad-46d0-9328-cbabe43fad8c-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:39:30 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-b8f366e8-6c21-4685-b87e-b7682634e47b tempest-SnapshotMetadataTestJSON-677755387 None] Acquiring lock "cinder-quobyte-bf09e294-8bad-46d0-9328-cbabe43fad8c" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:39:30 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-b8f366e8-6c21-4685-b87e-b7682634e47b tempest-SnapshotMetadataTestJSON-677755387 None] Lock "cinder-quobyte-bf09e294-8bad-46d0-9328-cbabe43fad8c" acquired by "delete_volume" :: waited 0.042s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:39:30 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [req-0c955a5e-67fc-4931-a74f-523c3d3ea0fa req-735cd2b9-180a-40ee-9ac4-aa7597ac38fa tempest-AttachVolumeShelveTestJSON-1287215161 None] No connector for attachment 5ee192dd-1720-4889-ac54-4155d9c7cca7; skipping storage backend terminate_connection call. {{(pid=87329) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Sep 06 06:39:30 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [req-0c955a5e-67fc-4931-a74f-523c3d3ea0fa req-735cd2b9-180a-40ee-9ac4-aa7597ac38fa tempest-AttachVolumeShelveTestJSON-1287215161 None] Deleting attachment 5ee192dd-1720-4889-ac54-4155d9c7cca7. {{(pid=87329) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 06 06:39:30 devstack sudo[97225]: pam_unix(sudo:session): session closed for user root Sep 06 06:39:30 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-a4b53796-1783-44d2-99d2-2c031973d740 tempest-CreateVolumesFromSnapshotTest-1337710689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-11514717-d5a4-4e5e-8269-d526ed8dc3f0.info" returned: 0 in 0.421s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:39:30 devstack cinder-volume[87329]: WARNING cinder.volume.drivers.remotefs [None req-a4b53796-1783-44d2-99d2-2c031973d740 tempest-CreateVolumesFromSnapshotTest-1337710689 None] /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-11514717-d5a4-4e5e-8269-d526ed8dc3f0.info is being set with open permissions: ugo+rw Sep 06 06:39:30 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-a4b53796-1783-44d2-99d2-2c031973d740 tempest-CreateVolumesFromSnapshotTest-1337710689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-11514717-d5a4-4e5e-8269-d526ed8dc3f0.info {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:39:30 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8a08618-fd2c-4044-958f-fd607e9b63dd]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:39:30 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-b8f366e8-6c21-4685-b87e-b7682634e47b tempest-SnapshotMetadataTestJSON-677755387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bf09e294-8bad-46d0-9328-cbabe43fad8c {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:39:30 devstack sudo[97228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-11514717-d5a4-4e5e-8269-d526ed8dc3f0.info Sep 06 06:39:30 devstack sudo[97228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:39:30 devstack sudo[97229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bf09e294-8bad-46d0-9328-cbabe43fad8c Sep 06 06:39:30 devstack sudo[97229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:39:31 devstack sudo[97228]: pam_unix(sudo:session): session closed for user root Sep 06 06:39:31 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-a4b53796-1783-44d2-99d2-2c031973d740 tempest-CreateVolumesFromSnapshotTest-1337710689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-11514717-d5a4-4e5e-8269-d526ed8dc3f0.info" returned: 0 in 0.480s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:39:31 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-a4b53796-1783-44d2-99d2-2c031973d740 tempest-CreateVolumesFromSnapshotTest-1337710689 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.610s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:39:31 devstack sudo[97229]: pam_unix(sudo:session): session closed for user root Sep 06 06:39:31 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-a4b53796-1783-44d2-99d2-2c031973d740 tempest-CreateVolumesFromSnapshotTest-1337710689 None] Create snapshot completed successfully Sep 06 06:39:31 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-b8f366e8-6c21-4685-b87e-b7682634e47b tempest-SnapshotMetadataTestJSON-677755387 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bf09e294-8bad-46d0-9328-cbabe43fad8c" returned: 0 in 0.539s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:39:31 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-b8f366e8-6c21-4685-b87e-b7682634e47b tempest-SnapshotMetadataTestJSON-677755387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bf09e294-8bad-46d0-9328-cbabe43fad8c {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:39:31 devstack sudo[97237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bf09e294-8bad-46d0-9328-cbabe43fad8c Sep 06 06:39:31 devstack sudo[97237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:39:31 devstack sudo[97237]: pam_unix(sudo:session): session closed for user root Sep 06 06:39:31 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-b8f366e8-6c21-4685-b87e-b7682634e47b tempest-SnapshotMetadataTestJSON-677755387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bf09e294-8bad-46d0-9328-cbabe43fad8c" returned: 0 in 0.324s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:39:31 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-b8f366e8-6c21-4685-b87e-b7682634e47b tempest-SnapshotMetadataTestJSON-677755387 None] Lock "cinder-quobyte-bf09e294-8bad-46d0-9328-cbabe43fad8c" released by "delete_volume" :: held 0.973s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:39:31 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-b8f366e8-6c21-4685-b87e-b7682634e47b tempest-SnapshotMetadataTestJSON-677755387 None] Created reservations ['9fbabd44-7f9f-4547-a874-09043bb8dee5', 'f809ec5a-c363-46fb-b0eb-cfccb7b6de5e', '271549a8-4704-4531-a24b-aa05cfb2a35f', '5231517d-fc8f-4158-8156-1fce663e543a'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:39:31 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-b8f366e8-6c21-4685-b87e-b7682634e47b tempest-SnapshotMetadataTestJSON-677755387 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:39:31 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-b8f366e8-6c21-4685-b87e-b7682634e47b tempest-SnapshotMetadataTestJSON-677755387 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:39:31 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-b8f366e8-6c21-4685-b87e-b7682634e47b tempest-SnapshotMetadataTestJSON-677755387 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:39:31 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-b8f366e8-6c21-4685-b87e-b7682634e47b tempest-SnapshotMetadataTestJSON-677755387 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:39:31 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-b8f366e8-6c21-4685-b87e-b7682634e47b tempest-SnapshotMetadataTestJSON-677755387 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:39:31 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-b8f366e8-6c21-4685-b87e-b7682634e47b tempest-SnapshotMetadataTestJSON-677755387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:39:31 devstack sudo[97240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:39:31 devstack sudo[97240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:39:32 devstack sudo[97240]: pam_unix(sudo:session): session closed for user root Sep 06 06:39:32 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-b8f366e8-6c21-4685-b87e-b7682634e47b tempest-SnapshotMetadataTestJSON-677755387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.348s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:39:32 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-b8f366e8-6c21-4685-b87e-b7682634e47b tempest-SnapshotMetadataTestJSON-677755387 None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:39:32 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-b8f366e8-6c21-4685-b87e-b7682634e47b tempest-SnapshotMetadataTestJSON-677755387 None] Deleted volume successfully. Sep 06 06:39:32 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-b8f366e8-6c21-4685-b87e-b7682634e47b tempest-SnapshotMetadataTestJSON-677755387 None] Lock "cinder-bf09e294-8bad-46d0-9328-cbabe43fad8c-delete_volume" released by "delete_volume" :: held 1.673s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:39:32 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec81e387-f363-461b-9625-52716b74ab76 tempest-CreateVolumesFromSnapshotTest-1337710689 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87329) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 06:39:32 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-ec81e387-f363-461b-9625-52716b74ab76 tempest-CreateVolumesFromSnapshotTest-1337710689 None] Flow 'volume_create_manager' (6f43289b-88e8-46b9-a6bc-9d55ecab4646) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:39:32 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-ec81e387-f363-461b-9625-52716b74ab76 tempest-CreateVolumesFromSnapshotTest-1337710689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef59e592-be2a-4d50-9346-4ec7df17214f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:39:32 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-ec81e387-f363-461b-9625-52716b74ab76 tempest-CreateVolumesFromSnapshotTest-1337710689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef59e592-be2a-4d50-9346-4ec7df17214f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:39:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-895731608',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=642b0aff-717c-4105-9f26-1d9ff28794b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a48b8b1a02bc4aa79ad2803b2be55536',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:39:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:39:32Z,use_quota=True,user_id='b83ce38d41b4486499aacacd05274c92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:39:32 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-ec81e387-f363-461b-9625-52716b74ab76 tempest-CreateVolumesFromSnapshotTest-1337710689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5baa2573-3c9b-45b8-a533-b51d9eabe185) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:39:32 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-ec81e387-f363-461b-9625-52716b74ab76 tempest-CreateVolumesFromSnapshotTest-1337710689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5baa2573-3c9b-45b8-a533-b51d9eabe185) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:39:32 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-ec81e387-f363-461b-9625-52716b74ab76 tempest-CreateVolumesFromSnapshotTest-1337710689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e339617-e522-4355-8e52-191f011526ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:39:32 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-ec81e387-f363-461b-9625-52716b74ab76 tempest-CreateVolumesFromSnapshotTest-1337710689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e339617-e522-4355-8e52-191f011526ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '642b0aff-717c-4105-9f26-1d9ff28794b5', 'volume_name': 'volume-642b0aff-717c-4105-9f26-1d9ff28794b5', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:39:32 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-ec81e387-f363-461b-9625-52716b74ab76 tempest-CreateVolumesFromSnapshotTest-1337710689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8589e43-2be7-4d10-b951-cdf63a793371) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:39:32 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-ec81e387-f363-461b-9625-52716b74ab76 tempest-CreateVolumesFromSnapshotTest-1337710689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8589e43-2be7-4d10-b951-cdf63a793371) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:39:32 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-ec81e387-f363-461b-9625-52716b74ab76 tempest-CreateVolumesFromSnapshotTest-1337710689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f68461d-608f-4613-9717-4c8caff2372c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:39:32 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-ec81e387-f363-461b-9625-52716b74ab76 tempest-CreateVolumesFromSnapshotTest-1337710689 None] Volume 642b0aff-717c-4105-9f26-1d9ff28794b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-642b0aff-717c-4105-9f26-1d9ff28794b5', 'volume_size': 1} Sep 06 06:39:32 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-ec81e387-f363-461b-9625-52716b74ab76 tempest-CreateVolumesFromSnapshotTest-1337710689 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:39:32 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-ec81e387-f363-461b-9625-52716b74ab76 tempest-CreateVolumesFromSnapshotTest-1337710689 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:39:32 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-ec81e387-f363-461b-9625-52716b74ab76 tempest-CreateVolumesFromSnapshotTest-1337710689 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:39:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-895731608',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=642b0aff-717c-4105-9f26-1d9ff28794b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a48b8b1a02bc4aa79ad2803b2be55536',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:39:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:39:32Z,use_quota=True,user_id='b83ce38d41b4486499aacacd05274c92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)}" {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 06:39:32 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-ec81e387-f363-461b-9625-52716b74ab76 tempest-CreateVolumesFromSnapshotTest-1337710689 None] Creating volume 642b0aff-717c-4105-9f26-1d9ff28794b5 {{(pid=87329) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 06:39:32 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-ec81e387-f363-461b-9625-52716b74ab76 tempest-CreateVolumesFromSnapshotTest-1337710689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:39:32 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-ec81e387-f363-461b-9625-52716b74ab76 tempest-CreateVolumesFromSnapshotTest-1337710689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:39:32 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-ec81e387-f363-461b-9625-52716b74ab76 tempest-CreateVolumesFromSnapshotTest-1337710689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:39:32 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-ec81e387-f363-461b-9625-52716b74ab76 tempest-CreateVolumesFromSnapshotTest-1337710689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:39:32 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-ec81e387-f363-461b-9625-52716b74ab76 tempest-CreateVolumesFromSnapshotTest-1337710689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:39:32 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-ec81e387-f363-461b-9625-52716b74ab76 tempest-CreateVolumesFromSnapshotTest-1337710689 None] Selected osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 as target Quobyte volume. {{(pid=87329) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 06:39:32 devstack cinder-volume[87329]: INFO cinder.volume.drivers.remotefs [None req-ec81e387-f363-461b-9625-52716b74ab76 tempest-CreateVolumesFromSnapshotTest-1337710689 None] casted to osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 Sep 06 06:39:32 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-ec81e387-f363-461b-9625-52716b74ab76 tempest-CreateVolumesFromSnapshotTest-1337710689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-642b0aff-717c-4105-9f26-1d9ff28794b5 1073741824 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:39:32 devstack sudo[97245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-642b0aff-717c-4105-9f26-1d9ff28794b5 1073741824 Sep 06 06:39:32 devstack sudo[97245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:39:32 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-0557bb99-4405-4379-a4ac-c70cf98a9aa5 tempest-CreateVolumesFromSnapshotTest-1337710689 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87329) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 06:39:32 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-0557bb99-4405-4379-a4ac-c70cf98a9aa5 tempest-CreateVolumesFromSnapshotTest-1337710689 None] Flow 'volume_create_manager' (f8a2f10a-aba9-49ad-94e7-7ee3d30bf0eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:39:32 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-0557bb99-4405-4379-a4ac-c70cf98a9aa5 tempest-CreateVolumesFromSnapshotTest-1337710689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (993eb326-95b9-4472-bfbe-1f895fae38d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:39:32 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-0557bb99-4405-4379-a4ac-c70cf98a9aa5 tempest-CreateVolumesFromSnapshotTest-1337710689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (993eb326-95b9-4472-bfbe-1f895fae38d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:39:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1975168905',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=394f0ada-a8b8-46b5-804d-6d37838a39a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a48b8b1a02bc4aa79ad2803b2be55536',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:39:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:39:33Z,use_quota=True,user_id='b83ce38d41b4486499aacacd05274c92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:39:32 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-0557bb99-4405-4379-a4ac-c70cf98a9aa5 tempest-CreateVolumesFromSnapshotTest-1337710689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a08a698-8599-4f2b-8b92-f381e737793c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:39:32 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-0557bb99-4405-4379-a4ac-c70cf98a9aa5 tempest-CreateVolumesFromSnapshotTest-1337710689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a08a698-8599-4f2b-8b92-f381e737793c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:39:32 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-0557bb99-4405-4379-a4ac-c70cf98a9aa5 tempest-CreateVolumesFromSnapshotTest-1337710689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e96665dc-336b-4f62-ba45-c13d8599fe46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:39:32 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-0557bb99-4405-4379-a4ac-c70cf98a9aa5 tempest-CreateVolumesFromSnapshotTest-1337710689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e96665dc-336b-4f62-ba45-c13d8599fe46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '394f0ada-a8b8-46b5-804d-6d37838a39a2', 'volume_name': 'volume-394f0ada-a8b8-46b5-804d-6d37838a39a2', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:39:33 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-0557bb99-4405-4379-a4ac-c70cf98a9aa5 tempest-CreateVolumesFromSnapshotTest-1337710689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d97e772c-e21d-4d82-8131-4df11ee00e8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:39:33 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-0557bb99-4405-4379-a4ac-c70cf98a9aa5 tempest-CreateVolumesFromSnapshotTest-1337710689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d97e772c-e21d-4d82-8131-4df11ee00e8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:39:33 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-0557bb99-4405-4379-a4ac-c70cf98a9aa5 tempest-CreateVolumesFromSnapshotTest-1337710689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20c53842-1392-4384-848a-bdd732747054) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:39:33 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-0557bb99-4405-4379-a4ac-c70cf98a9aa5 tempest-CreateVolumesFromSnapshotTest-1337710689 None] Volume 394f0ada-a8b8-46b5-804d-6d37838a39a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-394f0ada-a8b8-46b5-804d-6d37838a39a2', 'volume_size': 1} Sep 06 06:39:33 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-0557bb99-4405-4379-a4ac-c70cf98a9aa5 tempest-CreateVolumesFromSnapshotTest-1337710689 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:39:33 devstack sudo[97245]: pam_unix(sudo:session): session closed for user root Sep 06 06:39:33 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-ec81e387-f363-461b-9625-52716b74ab76 tempest-CreateVolumesFromSnapshotTest-1337710689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-642b0aff-717c-4105-9f26-1d9ff28794b5 1073741824" returned: 0 in 0.869s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:39:33 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-ec81e387-f363-461b-9625-52716b74ab76 tempest-CreateVolumesFromSnapshotTest-1337710689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-642b0aff-717c-4105-9f26-1d9ff28794b5 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:39:33 devstack sudo[97251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-642b0aff-717c-4105-9f26-1d9ff28794b5 Sep 06 06:39:33 devstack sudo[97251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:39:33 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-16393cfa-804c-41f1-a6eb-fdee71ebb3dd tempest-CreateVolumesFromSnapshotTest-1337710689 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87329) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 06:39:33 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-16393cfa-804c-41f1-a6eb-fdee71ebb3dd tempest-CreateVolumesFromSnapshotTest-1337710689 None] Flow 'volume_create_manager' (6b2de034-c15f-4304-bcb8-771d342c741f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:39:33 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-16393cfa-804c-41f1-a6eb-fdee71ebb3dd tempest-CreateVolumesFromSnapshotTest-1337710689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba2c8295-f4ef-47ce-9375-3be07e7c43e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:39:33 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-16393cfa-804c-41f1-a6eb-fdee71ebb3dd tempest-CreateVolumesFromSnapshotTest-1337710689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba2c8295-f4ef-47ce-9375-3be07e7c43e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:39:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1092424859',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8294b8cb-6b6c-4a4f-b347-2df244dd852f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a48b8b1a02bc4aa79ad2803b2be55536',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:39:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:39:34Z,use_quota=True,user_id='b83ce38d41b4486499aacacd05274c92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:39:33 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-16393cfa-804c-41f1-a6eb-fdee71ebb3dd tempest-CreateVolumesFromSnapshotTest-1337710689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bae2cdbc-e01f-418d-8677-ae70d05d35ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:39:33 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-16393cfa-804c-41f1-a6eb-fdee71ebb3dd tempest-CreateVolumesFromSnapshotTest-1337710689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bae2cdbc-e01f-418d-8677-ae70d05d35ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:39:33 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-16393cfa-804c-41f1-a6eb-fdee71ebb3dd tempest-CreateVolumesFromSnapshotTest-1337710689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e6c209b-4eda-45eb-b670-5c362811cd31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:39:33 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-16393cfa-804c-41f1-a6eb-fdee71ebb3dd tempest-CreateVolumesFromSnapshotTest-1337710689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e6c209b-4eda-45eb-b670-5c362811cd31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8294b8cb-6b6c-4a4f-b347-2df244dd852f', 'volume_name': 'volume-8294b8cb-6b6c-4a4f-b347-2df244dd852f', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:39:33 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-16393cfa-804c-41f1-a6eb-fdee71ebb3dd tempest-CreateVolumesFromSnapshotTest-1337710689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdaf2e01-29eb-490d-8737-30afbda1e10b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:39:33 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-16393cfa-804c-41f1-a6eb-fdee71ebb3dd tempest-CreateVolumesFromSnapshotTest-1337710689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdaf2e01-29eb-490d-8737-30afbda1e10b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:39:33 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-16393cfa-804c-41f1-a6eb-fdee71ebb3dd tempest-CreateVolumesFromSnapshotTest-1337710689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d26d181-773d-4f8a-ac29-86eaf7e8767a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:39:33 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-16393cfa-804c-41f1-a6eb-fdee71ebb3dd tempest-CreateVolumesFromSnapshotTest-1337710689 None] Volume 8294b8cb-6b6c-4a4f-b347-2df244dd852f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8294b8cb-6b6c-4a4f-b347-2df244dd852f', 'volume_size': 1} Sep 06 06:39:33 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-16393cfa-804c-41f1-a6eb-fdee71ebb3dd tempest-CreateVolumesFromSnapshotTest-1337710689 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:39:33 devstack sudo[97251]: pam_unix(sudo:session): session closed for user root Sep 06 06:39:34 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-ec81e387-f363-461b-9625-52716b74ab76 tempest-CreateVolumesFromSnapshotTest-1337710689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-642b0aff-717c-4105-9f26-1d9ff28794b5" returned: 0 in 0.600s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:39:34 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-ec81e387-f363-461b-9625-52716b74ab76 tempest-CreateVolumesFromSnapshotTest-1337710689 None] <== create_volume: return (1561ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'} {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 06:39:34 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-ec81e387-f363-461b-9625-52716b74ab76 tempest-CreateVolumesFromSnapshotTest-1337710689 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.564s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:39:34 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-0557bb99-4405-4379-a4ac-c70cf98a9aa5 tempest-CreateVolumesFromSnapshotTest-1337710689 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.979s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:39:34 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-0557bb99-4405-4379-a4ac-c70cf98a9aa5 tempest-CreateVolumesFromSnapshotTest-1337710689 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:39:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1975168905',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=394f0ada-a8b8-46b5-804d-6d37838a39a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a48b8b1a02bc4aa79ad2803b2be55536',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:39:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:39:33Z,use_quota=True,user_id='b83ce38d41b4486499aacacd05274c92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)}" {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 06:39:34 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-0557bb99-4405-4379-a4ac-c70cf98a9aa5 tempest-CreateVolumesFromSnapshotTest-1337710689 None] Creating volume 394f0ada-a8b8-46b5-804d-6d37838a39a2 {{(pid=87329) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 06:39:34 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-0557bb99-4405-4379-a4ac-c70cf98a9aa5 tempest-CreateVolumesFromSnapshotTest-1337710689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:39:34 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-0557bb99-4405-4379-a4ac-c70cf98a9aa5 tempest-CreateVolumesFromSnapshotTest-1337710689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:39:34 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-0557bb99-4405-4379-a4ac-c70cf98a9aa5 tempest-CreateVolumesFromSnapshotTest-1337710689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:39:34 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-0557bb99-4405-4379-a4ac-c70cf98a9aa5 tempest-CreateVolumesFromSnapshotTest-1337710689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:39:34 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-0557bb99-4405-4379-a4ac-c70cf98a9aa5 tempest-CreateVolumesFromSnapshotTest-1337710689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:39:34 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-0557bb99-4405-4379-a4ac-c70cf98a9aa5 tempest-CreateVolumesFromSnapshotTest-1337710689 None] Selected osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 as target Quobyte volume. {{(pid=87329) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 06:39:34 devstack cinder-volume[87329]: INFO cinder.volume.drivers.remotefs [None req-0557bb99-4405-4379-a4ac-c70cf98a9aa5 tempest-CreateVolumesFromSnapshotTest-1337710689 None] casted to osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 Sep 06 06:39:34 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-0557bb99-4405-4379-a4ac-c70cf98a9aa5 tempest-CreateVolumesFromSnapshotTest-1337710689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-394f0ada-a8b8-46b5-804d-6d37838a39a2 1073741824 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:39:34 devstack sudo[97254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-394f0ada-a8b8-46b5-804d-6d37838a39a2 1073741824 Sep 06 06:39:34 devstack sudo[97254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:39:34 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-ec81e387-f363-461b-9625-52716b74ab76 tempest-CreateVolumesFromSnapshotTest-1337710689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f68461d-608f-4613-9717-4c8caff2372c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-642b0aff-717c-4105-9f26-1d9ff28794b5', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:39:34 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-ec81e387-f363-461b-9625-52716b74ab76 tempest-CreateVolumesFromSnapshotTest-1337710689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9f82ce0-76fb-4ab9-8f60-ee06b95193d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:39:34 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-ec81e387-f363-461b-9625-52716b74ab76 tempest-CreateVolumesFromSnapshotTest-1337710689 None] Volume volume-642b0aff-717c-4105-9f26-1d9ff28794b5 (642b0aff-717c-4105-9f26-1d9ff28794b5): created successfully Sep 06 06:39:34 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-ec81e387-f363-461b-9625-52716b74ab76 tempest-CreateVolumesFromSnapshotTest-1337710689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9f82ce0-76fb-4ab9-8f60-ee06b95193d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:39:34 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-ec81e387-f363-461b-9625-52716b74ab76 tempest-CreateVolumesFromSnapshotTest-1337710689 None] Flow 'volume_create_manager' (6f43289b-88e8-46b9-a6bc-9d55ecab4646) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:39:34 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-ec81e387-f363-461b-9625-52716b74ab76 tempest-CreateVolumesFromSnapshotTest-1337710689 None] Created volume successfully. Sep 06 06:39:34 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d6c7e34-5539-4774-b3fc-e8a90d602e64 tempest-CreateVolumesFromSnapshotTest-1337710689 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87329) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 06:39:34 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-2d6c7e34-5539-4774-b3fc-e8a90d602e64 tempest-CreateVolumesFromSnapshotTest-1337710689 None] Flow 'volume_create_manager' (f82fb3e8-2a71-4052-9133-cbf42e839fe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:39:34 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-2d6c7e34-5539-4774-b3fc-e8a90d602e64 tempest-CreateVolumesFromSnapshotTest-1337710689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7b8e59f-6bb7-4dbc-9a0a-fa98e03fb292) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:39:34 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-2d6c7e34-5539-4774-b3fc-e8a90d602e64 tempest-CreateVolumesFromSnapshotTest-1337710689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7b8e59f-6bb7-4dbc-9a0a-fa98e03fb292) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:39:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-498412058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12ec1c42-f0e9-4206-9c0f-f816d9d6345a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a48b8b1a02bc4aa79ad2803b2be55536',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:39:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:39:34Z,use_quota=True,user_id='b83ce38d41b4486499aacacd05274c92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:39:34 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-2d6c7e34-5539-4774-b3fc-e8a90d602e64 tempest-CreateVolumesFromSnapshotTest-1337710689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8927567e-144a-441d-9f21-209e256c26c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:39:34 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-2d6c7e34-5539-4774-b3fc-e8a90d602e64 tempest-CreateVolumesFromSnapshotTest-1337710689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8927567e-144a-441d-9f21-209e256c26c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:39:34 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-2d6c7e34-5539-4774-b3fc-e8a90d602e64 tempest-CreateVolumesFromSnapshotTest-1337710689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4b68e67-59d8-4699-b173-12fa5e8fd377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:39:34 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-2d6c7e34-5539-4774-b3fc-e8a90d602e64 tempest-CreateVolumesFromSnapshotTest-1337710689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4b68e67-59d8-4699-b173-12fa5e8fd377) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12ec1c42-f0e9-4206-9c0f-f816d9d6345a', 'volume_name': 'volume-12ec1c42-f0e9-4206-9c0f-f816d9d6345a', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:39:34 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-2d6c7e34-5539-4774-b3fc-e8a90d602e64 tempest-CreateVolumesFromSnapshotTest-1337710689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1043fd4-3cbf-417a-8fdb-31a042b229e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:39:34 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-2d6c7e34-5539-4774-b3fc-e8a90d602e64 tempest-CreateVolumesFromSnapshotTest-1337710689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1043fd4-3cbf-417a-8fdb-31a042b229e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:39:34 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-2d6c7e34-5539-4774-b3fc-e8a90d602e64 tempest-CreateVolumesFromSnapshotTest-1337710689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f00be0c1-5750-47d9-8582-e8683768a1a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:39:34 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-2d6c7e34-5539-4774-b3fc-e8a90d602e64 tempest-CreateVolumesFromSnapshotTest-1337710689 None] Volume 12ec1c42-f0e9-4206-9c0f-f816d9d6345a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12ec1c42-f0e9-4206-9c0f-f816d9d6345a', 'volume_size': 1} Sep 06 06:39:34 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-2d6c7e34-5539-4774-b3fc-e8a90d602e64 tempest-CreateVolumesFromSnapshotTest-1337710689 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:39:34 devstack sudo[97254]: pam_unix(sudo:session): session closed for user root Sep 06 06:39:34 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-0557bb99-4405-4379-a4ac-c70cf98a9aa5 tempest-CreateVolumesFromSnapshotTest-1337710689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-394f0ada-a8b8-46b5-804d-6d37838a39a2 1073741824" returned: 0 in 0.734s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:39:34 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-0557bb99-4405-4379-a4ac-c70cf98a9aa5 tempest-CreateVolumesFromSnapshotTest-1337710689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-394f0ada-a8b8-46b5-804d-6d37838a39a2 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:39:34 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5f3633e-e924-4393-818c-15cb04f5465a tempest-CreateVolumesFromSnapshotTest-1337710689 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87329) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 06:39:34 devstack sudo[97263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-394f0ada-a8b8-46b5-804d-6d37838a39a2 Sep 06 06:39:34 devstack sudo[97263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:39:34 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-c5f3633e-e924-4393-818c-15cb04f5465a tempest-CreateVolumesFromSnapshotTest-1337710689 None] Flow 'volume_create_manager' (66d33430-7869-4533-8903-c45941ec6a2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:39:34 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-c5f3633e-e924-4393-818c-15cb04f5465a tempest-CreateVolumesFromSnapshotTest-1337710689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (153531ab-7014-4b10-af6f-a0b6e154ce7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:39:34 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-c5f3633e-e924-4393-818c-15cb04f5465a tempest-CreateVolumesFromSnapshotTest-1337710689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (153531ab-7014-4b10-af6f-a0b6e154ce7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:39:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1585995268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=561ce14f-2365-487e-a919-236bf2e2172c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a48b8b1a02bc4aa79ad2803b2be55536',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:39:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:39:35Z,use_quota=True,user_id='b83ce38d41b4486499aacacd05274c92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:39:34 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-c5f3633e-e924-4393-818c-15cb04f5465a tempest-CreateVolumesFromSnapshotTest-1337710689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (480068dc-627f-4f59-bf88-0efbb314d22d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:39:34 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-c5f3633e-e924-4393-818c-15cb04f5465a tempest-CreateVolumesFromSnapshotTest-1337710689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (480068dc-627f-4f59-bf88-0efbb314d22d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:39:34 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-c5f3633e-e924-4393-818c-15cb04f5465a tempest-CreateVolumesFromSnapshotTest-1337710689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b26d6b00-4b41-4fd5-920f-53586153da71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:39:34 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-c5f3633e-e924-4393-818c-15cb04f5465a tempest-CreateVolumesFromSnapshotTest-1337710689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b26d6b00-4b41-4fd5-920f-53586153da71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '561ce14f-2365-487e-a919-236bf2e2172c', 'volume_name': 'volume-561ce14f-2365-487e-a919-236bf2e2172c', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:39:34 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-c5f3633e-e924-4393-818c-15cb04f5465a tempest-CreateVolumesFromSnapshotTest-1337710689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0172427-45ca-423c-af8d-fcfd825fc876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:39:34 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-c5f3633e-e924-4393-818c-15cb04f5465a tempest-CreateVolumesFromSnapshotTest-1337710689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0172427-45ca-423c-af8d-fcfd825fc876) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:39:34 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-c5f3633e-e924-4393-818c-15cb04f5465a tempest-CreateVolumesFromSnapshotTest-1337710689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36c7b407-51d8-4d20-8e8a-e3715ff81712) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:39:34 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-c5f3633e-e924-4393-818c-15cb04f5465a tempest-CreateVolumesFromSnapshotTest-1337710689 None] Volume 561ce14f-2365-487e-a919-236bf2e2172c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-561ce14f-2365-487e-a919-236bf2e2172c', 'volume_size': 1} Sep 06 06:39:34 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-c5f3633e-e924-4393-818c-15cb04f5465a tempest-CreateVolumesFromSnapshotTest-1337710689 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:39:35 devstack sudo[97263]: pam_unix(sudo:session): session closed for user root Sep 06 06:39:35 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-0557bb99-4405-4379-a4ac-c70cf98a9aa5 tempest-CreateVolumesFromSnapshotTest-1337710689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-394f0ada-a8b8-46b5-804d-6d37838a39a2" returned: 0 in 0.294s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:39:35 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-0557bb99-4405-4379-a4ac-c70cf98a9aa5 tempest-CreateVolumesFromSnapshotTest-1337710689 None] <== create_volume: return (1126ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'} {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 06:39:35 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-0557bb99-4405-4379-a4ac-c70cf98a9aa5 tempest-CreateVolumesFromSnapshotTest-1337710689 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.130s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:39:35 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-16393cfa-804c-41f1-a6eb-fdee71ebb3dd tempest-CreateVolumesFromSnapshotTest-1337710689 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.439s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:39:35 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-16393cfa-804c-41f1-a6eb-fdee71ebb3dd tempest-CreateVolumesFromSnapshotTest-1337710689 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:39:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1092424859',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8294b8cb-6b6c-4a4f-b347-2df244dd852f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a48b8b1a02bc4aa79ad2803b2be55536',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:39:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:39:34Z,use_quota=True,user_id='b83ce38d41b4486499aacacd05274c92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)}" {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 06:39:35 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-16393cfa-804c-41f1-a6eb-fdee71ebb3dd tempest-CreateVolumesFromSnapshotTest-1337710689 None] Creating volume 8294b8cb-6b6c-4a4f-b347-2df244dd852f {{(pid=87329) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 06:39:35 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-16393cfa-804c-41f1-a6eb-fdee71ebb3dd tempest-CreateVolumesFromSnapshotTest-1337710689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:39:35 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-16393cfa-804c-41f1-a6eb-fdee71ebb3dd tempest-CreateVolumesFromSnapshotTest-1337710689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:39:35 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-16393cfa-804c-41f1-a6eb-fdee71ebb3dd tempest-CreateVolumesFromSnapshotTest-1337710689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:39:35 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-16393cfa-804c-41f1-a6eb-fdee71ebb3dd tempest-CreateVolumesFromSnapshotTest-1337710689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:39:35 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-16393cfa-804c-41f1-a6eb-fdee71ebb3dd tempest-CreateVolumesFromSnapshotTest-1337710689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:39:35 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-16393cfa-804c-41f1-a6eb-fdee71ebb3dd tempest-CreateVolumesFromSnapshotTest-1337710689 None] Selected osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 as target Quobyte volume. {{(pid=87329) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 06:39:35 devstack cinder-volume[87329]: INFO cinder.volume.drivers.remotefs [None req-16393cfa-804c-41f1-a6eb-fdee71ebb3dd tempest-CreateVolumesFromSnapshotTest-1337710689 None] casted to osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 Sep 06 06:39:35 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-16393cfa-804c-41f1-a6eb-fdee71ebb3dd tempest-CreateVolumesFromSnapshotTest-1337710689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-8294b8cb-6b6c-4a4f-b347-2df244dd852f 1073741824 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:39:35 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-0557bb99-4405-4379-a4ac-c70cf98a9aa5 tempest-CreateVolumesFromSnapshotTest-1337710689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20c53842-1392-4384-848a-bdd732747054) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-394f0ada-a8b8-46b5-804d-6d37838a39a2', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:39:35 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-0557bb99-4405-4379-a4ac-c70cf98a9aa5 tempest-CreateVolumesFromSnapshotTest-1337710689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (962423c7-46e2-44f6-8120-e75893901e95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:39:35 devstack sudo[97267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-8294b8cb-6b6c-4a4f-b347-2df244dd852f 1073741824 Sep 06 06:39:35 devstack sudo[97267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:39:35 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-0557bb99-4405-4379-a4ac-c70cf98a9aa5 tempest-CreateVolumesFromSnapshotTest-1337710689 None] Volume volume-394f0ada-a8b8-46b5-804d-6d37838a39a2 (394f0ada-a8b8-46b5-804d-6d37838a39a2): created successfully Sep 06 06:39:35 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-0557bb99-4405-4379-a4ac-c70cf98a9aa5 tempest-CreateVolumesFromSnapshotTest-1337710689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (962423c7-46e2-44f6-8120-e75893901e95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:39:35 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-0557bb99-4405-4379-a4ac-c70cf98a9aa5 tempest-CreateVolumesFromSnapshotTest-1337710689 None] Flow 'volume_create_manager' (f8a2f10a-aba9-49ad-94e7-7ee3d30bf0eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:39:35 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-0557bb99-4405-4379-a4ac-c70cf98a9aa5 tempest-CreateVolumesFromSnapshotTest-1337710689 None] Created volume successfully. Sep 06 06:39:35 devstack sudo[97267]: pam_unix(sudo:session): session closed for user root Sep 06 06:39:35 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-16393cfa-804c-41f1-a6eb-fdee71ebb3dd tempest-CreateVolumesFromSnapshotTest-1337710689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-8294b8cb-6b6c-4a4f-b347-2df244dd852f 1073741824" returned: 0 in 0.530s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:39:35 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-16393cfa-804c-41f1-a6eb-fdee71ebb3dd tempest-CreateVolumesFromSnapshotTest-1337710689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-8294b8cb-6b6c-4a4f-b347-2df244dd852f {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:39:35 devstack sudo[97273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-8294b8cb-6b6c-4a4f-b347-2df244dd852f Sep 06 06:39:35 devstack sudo[97273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:39:36 devstack sudo[97273]: pam_unix(sudo:session): session closed for user root Sep 06 06:39:36 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-16393cfa-804c-41f1-a6eb-fdee71ebb3dd tempest-CreateVolumesFromSnapshotTest-1337710689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-8294b8cb-6b6c-4a4f-b347-2df244dd852f" returned: 0 in 0.321s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:39:36 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-16393cfa-804c-41f1-a6eb-fdee71ebb3dd tempest-CreateVolumesFromSnapshotTest-1337710689 None] <== create_volume: return (899ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'} {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 06:39:36 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-16393cfa-804c-41f1-a6eb-fdee71ebb3dd tempest-CreateVolumesFromSnapshotTest-1337710689 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.901s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:39:36 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-2d6c7e34-5539-4774-b3fc-e8a90d602e64 tempest-CreateVolumesFromSnapshotTest-1337710689 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.686s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:39:36 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-2d6c7e34-5539-4774-b3fc-e8a90d602e64 tempest-CreateVolumesFromSnapshotTest-1337710689 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:39:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-498412058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12ec1c42-f0e9-4206-9c0f-f816d9d6345a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a48b8b1a02bc4aa79ad2803b2be55536',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:39:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:39:34Z,use_quota=True,user_id='b83ce38d41b4486499aacacd05274c92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)}" {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 06:39:36 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-2d6c7e34-5539-4774-b3fc-e8a90d602e64 tempest-CreateVolumesFromSnapshotTest-1337710689 None] Creating volume 12ec1c42-f0e9-4206-9c0f-f816d9d6345a {{(pid=87329) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 06:39:36 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-2d6c7e34-5539-4774-b3fc-e8a90d602e64 tempest-CreateVolumesFromSnapshotTest-1337710689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:39:36 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-2d6c7e34-5539-4774-b3fc-e8a90d602e64 tempest-CreateVolumesFromSnapshotTest-1337710689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:39:36 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-2d6c7e34-5539-4774-b3fc-e8a90d602e64 tempest-CreateVolumesFromSnapshotTest-1337710689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:39:36 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-2d6c7e34-5539-4774-b3fc-e8a90d602e64 tempest-CreateVolumesFromSnapshotTest-1337710689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:39:36 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-2d6c7e34-5539-4774-b3fc-e8a90d602e64 tempest-CreateVolumesFromSnapshotTest-1337710689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:39:36 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-2d6c7e34-5539-4774-b3fc-e8a90d602e64 tempest-CreateVolumesFromSnapshotTest-1337710689 None] Selected osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 as target Quobyte volume. {{(pid=87329) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 06:39:36 devstack cinder-volume[87329]: INFO cinder.volume.drivers.remotefs [None req-2d6c7e34-5539-4774-b3fc-e8a90d602e64 tempest-CreateVolumesFromSnapshotTest-1337710689 None] casted to osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 Sep 06 06:39:36 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-2d6c7e34-5539-4774-b3fc-e8a90d602e64 tempest-CreateVolumesFromSnapshotTest-1337710689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-12ec1c42-f0e9-4206-9c0f-f816d9d6345a 1073741824 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:39:36 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-16393cfa-804c-41f1-a6eb-fdee71ebb3dd tempest-CreateVolumesFromSnapshotTest-1337710689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d26d181-773d-4f8a-ac29-86eaf7e8767a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8294b8cb-6b6c-4a4f-b347-2df244dd852f', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:39:36 devstack sudo[97276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-12ec1c42-f0e9-4206-9c0f-f816d9d6345a 1073741824 Sep 06 06:39:36 devstack sudo[97276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:39:36 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-16393cfa-804c-41f1-a6eb-fdee71ebb3dd tempest-CreateVolumesFromSnapshotTest-1337710689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e5af6de-670f-4c73-bbab-1df2b3ca9812) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:39:36 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-16393cfa-804c-41f1-a6eb-fdee71ebb3dd tempest-CreateVolumesFromSnapshotTest-1337710689 None] Volume volume-8294b8cb-6b6c-4a4f-b347-2df244dd852f (8294b8cb-6b6c-4a4f-b347-2df244dd852f): created successfully Sep 06 06:39:36 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-16393cfa-804c-41f1-a6eb-fdee71ebb3dd tempest-CreateVolumesFromSnapshotTest-1337710689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e5af6de-670f-4c73-bbab-1df2b3ca9812) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:39:36 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-16393cfa-804c-41f1-a6eb-fdee71ebb3dd tempest-CreateVolumesFromSnapshotTest-1337710689 None] Flow 'volume_create_manager' (6b2de034-c15f-4304-bcb8-771d342c741f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:39:36 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-16393cfa-804c-41f1-a6eb-fdee71ebb3dd tempest-CreateVolumesFromSnapshotTest-1337710689 None] Created volume successfully. Sep 06 06:39:36 devstack sudo[97276]: pam_unix(sudo:session): session closed for user root Sep 06 06:39:36 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-2d6c7e34-5539-4774-b3fc-e8a90d602e64 tempest-CreateVolumesFromSnapshotTest-1337710689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-12ec1c42-f0e9-4206-9c0f-f816d9d6345a 1073741824" returned: 0 in 0.664s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:39:36 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-2d6c7e34-5539-4774-b3fc-e8a90d602e64 tempest-CreateVolumesFromSnapshotTest-1337710689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-12ec1c42-f0e9-4206-9c0f-f816d9d6345a {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:39:36 devstack sudo[97285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-12ec1c42-f0e9-4206-9c0f-f816d9d6345a Sep 06 06:39:36 devstack sudo[97285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:39:37 devstack sudo[97285]: pam_unix(sudo:session): session closed for user root Sep 06 06:39:37 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-2d6c7e34-5539-4774-b3fc-e8a90d602e64 tempest-CreateVolumesFromSnapshotTest-1337710689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-12ec1c42-f0e9-4206-9c0f-f816d9d6345a" returned: 0 in 0.404s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:39:37 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-2d6c7e34-5539-4774-b3fc-e8a90d602e64 tempest-CreateVolumesFromSnapshotTest-1337710689 None] <== create_volume: return (1160ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'} {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 06:39:37 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-2d6c7e34-5539-4774-b3fc-e8a90d602e64 tempest-CreateVolumesFromSnapshotTest-1337710689 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.163s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:39:37 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-c5f3633e-e924-4393-818c-15cb04f5465a tempest-CreateVolumesFromSnapshotTest-1337710689 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.268s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:39:37 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-c5f3633e-e924-4393-818c-15cb04f5465a tempest-CreateVolumesFromSnapshotTest-1337710689 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:39:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1585995268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=561ce14f-2365-487e-a919-236bf2e2172c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a48b8b1a02bc4aa79ad2803b2be55536',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:39:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:39:35Z,use_quota=True,user_id='b83ce38d41b4486499aacacd05274c92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)}" {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 06:39:37 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-c5f3633e-e924-4393-818c-15cb04f5465a tempest-CreateVolumesFromSnapshotTest-1337710689 None] Creating volume 561ce14f-2365-487e-a919-236bf2e2172c {{(pid=87329) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 06:39:37 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-c5f3633e-e924-4393-818c-15cb04f5465a tempest-CreateVolumesFromSnapshotTest-1337710689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:39:37 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-c5f3633e-e924-4393-818c-15cb04f5465a tempest-CreateVolumesFromSnapshotTest-1337710689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:39:37 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-c5f3633e-e924-4393-818c-15cb04f5465a tempest-CreateVolumesFromSnapshotTest-1337710689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:39:37 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-c5f3633e-e924-4393-818c-15cb04f5465a tempest-CreateVolumesFromSnapshotTest-1337710689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:39:37 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-c5f3633e-e924-4393-818c-15cb04f5465a tempest-CreateVolumesFromSnapshotTest-1337710689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:39:37 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-c5f3633e-e924-4393-818c-15cb04f5465a tempest-CreateVolumesFromSnapshotTest-1337710689 None] Selected osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 as target Quobyte volume. {{(pid=87329) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 06:39:37 devstack cinder-volume[87329]: INFO cinder.volume.drivers.remotefs [None req-c5f3633e-e924-4393-818c-15cb04f5465a tempest-CreateVolumesFromSnapshotTest-1337710689 None] casted to osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 Sep 06 06:39:37 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-c5f3633e-e924-4393-818c-15cb04f5465a tempest-CreateVolumesFromSnapshotTest-1337710689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-561ce14f-2365-487e-a919-236bf2e2172c 1073741824 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:39:37 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-2d6c7e34-5539-4774-b3fc-e8a90d602e64 tempest-CreateVolumesFromSnapshotTest-1337710689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f00be0c1-5750-47d9-8582-e8683768a1a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12ec1c42-f0e9-4206-9c0f-f816d9d6345a', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:39:37 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-2d6c7e34-5539-4774-b3fc-e8a90d602e64 tempest-CreateVolumesFromSnapshotTest-1337710689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0d74df5-ddb1-4f03-806c-b3e9febf02bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:39:37 devstack sudo[97322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-561ce14f-2365-487e-a919-236bf2e2172c 1073741824 Sep 06 06:39:37 devstack sudo[97322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:39:37 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-2d6c7e34-5539-4774-b3fc-e8a90d602e64 tempest-CreateVolumesFromSnapshotTest-1337710689 None] Volume volume-12ec1c42-f0e9-4206-9c0f-f816d9d6345a (12ec1c42-f0e9-4206-9c0f-f816d9d6345a): created successfully Sep 06 06:39:37 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-2d6c7e34-5539-4774-b3fc-e8a90d602e64 tempest-CreateVolumesFromSnapshotTest-1337710689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0d74df5-ddb1-4f03-806c-b3e9febf02bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:39:37 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-2d6c7e34-5539-4774-b3fc-e8a90d602e64 tempest-CreateVolumesFromSnapshotTest-1337710689 None] Flow 'volume_create_manager' (f82fb3e8-2a71-4052-9133-cbf42e839fe9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:39:37 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-2d6c7e34-5539-4774-b3fc-e8a90d602e64 tempest-CreateVolumesFromSnapshotTest-1337710689 None] Created volume successfully. Sep 06 06:39:38 devstack sudo[97322]: pam_unix(sudo:session): session closed for user root Sep 06 06:39:38 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-c5f3633e-e924-4393-818c-15cb04f5465a tempest-CreateVolumesFromSnapshotTest-1337710689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-561ce14f-2365-487e-a919-236bf2e2172c 1073741824" returned: 0 in 0.852s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:39:38 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-c5f3633e-e924-4393-818c-15cb04f5465a tempest-CreateVolumesFromSnapshotTest-1337710689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-561ce14f-2365-487e-a919-236bf2e2172c {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:39:38 devstack sudo[97330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-561ce14f-2365-487e-a919-236bf2e2172c Sep 06 06:39:38 devstack sudo[97330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:39:38 devstack sudo[97330]: pam_unix(sudo:session): session closed for user root Sep 06 06:39:38 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-c5f3633e-e924-4393-818c-15cb04f5465a tempest-CreateVolumesFromSnapshotTest-1337710689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-561ce14f-2365-487e-a919-236bf2e2172c" returned: 0 in 0.354s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:39:38 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-c5f3633e-e924-4393-818c-15cb04f5465a tempest-CreateVolumesFromSnapshotTest-1337710689 None] <== create_volume: return (1289ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'} {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 06:39:38 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-c5f3633e-e924-4393-818c-15cb04f5465a tempest-CreateVolumesFromSnapshotTest-1337710689 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.299s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:39:38 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-c5f3633e-e924-4393-818c-15cb04f5465a tempest-CreateVolumesFromSnapshotTest-1337710689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36c7b407-51d8-4d20-8e8a-e3715ff81712) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-561ce14f-2365-487e-a919-236bf2e2172c', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:39:38 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-c5f3633e-e924-4393-818c-15cb04f5465a tempest-CreateVolumesFromSnapshotTest-1337710689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1636833-67c0-4130-b62e-68a41e3f01db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:39:38 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-c5f3633e-e924-4393-818c-15cb04f5465a tempest-CreateVolumesFromSnapshotTest-1337710689 None] Volume volume-561ce14f-2365-487e-a919-236bf2e2172c (561ce14f-2365-487e-a919-236bf2e2172c): created successfully Sep 06 06:39:38 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-c5f3633e-e924-4393-818c-15cb04f5465a tempest-CreateVolumesFromSnapshotTest-1337710689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1636833-67c0-4130-b62e-68a41e3f01db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:39:38 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-c5f3633e-e924-4393-818c-15cb04f5465a tempest-CreateVolumesFromSnapshotTest-1337710689 None] Flow 'volume_create_manager' (66d33430-7869-4533-8903-c45941ec6a2b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:39:38 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-c5f3633e-e924-4393-818c-15cb04f5465a tempest-CreateVolumesFromSnapshotTest-1337710689 None] Created volume successfully. Sep 06 06:39:39 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-b94c2950-1d4b-4483-a8df-d4914ecddd7f tempest-VolumesDeleteCascade-1697863049 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87329) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 06:39:39 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-b94c2950-1d4b-4483-a8df-d4914ecddd7f tempest-VolumesDeleteCascade-1697863049 None] Flow 'volume_create_manager' (9adf3735-fac0-41eb-8870-760560dccb78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:39:39 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-b94c2950-1d4b-4483-a8df-d4914ecddd7f tempest-VolumesDeleteCascade-1697863049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ad4bb21-00bd-4313-88ae-ce2db1092648) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:39:39 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-d4d9486a-e7ba-4c02-bec2-74832f48926e tempest-CreateVolumesFromSnapshotTest-1337710689 None] Acquiring lock "cinder-561ce14f-2365-487e-a919-236bf2e2172c-delete_volume" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:39:39 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-b94c2950-1d4b-4483-a8df-d4914ecddd7f tempest-VolumesDeleteCascade-1697863049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ad4bb21-00bd-4313-88ae-ce2db1092648) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:39:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-612068499',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c3134b1-aec6-4fad-bb5b-1c184fbc92b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80ea58b259f149e7ada783971acdfcb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:39:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:39:40Z,use_quota=True,user_id='50b5313700b94db385ea112cc128b1a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:39:39 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-b94c2950-1d4b-4483-a8df-d4914ecddd7f tempest-VolumesDeleteCascade-1697863049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f63732e-43c5-4313-a5d2-503e272d004d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:39:39 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-b94c2950-1d4b-4483-a8df-d4914ecddd7f tempest-VolumesDeleteCascade-1697863049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f63732e-43c5-4313-a5d2-503e272d004d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:39:39 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-b94c2950-1d4b-4483-a8df-d4914ecddd7f tempest-VolumesDeleteCascade-1697863049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7adb3f69-57c5-456d-9735-5c4b66e59343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:39:39 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-b94c2950-1d4b-4483-a8df-d4914ecddd7f tempest-VolumesDeleteCascade-1697863049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7adb3f69-57c5-456d-9735-5c4b66e59343) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c3134b1-aec6-4fad-bb5b-1c184fbc92b4', 'volume_name': 'volume-6c3134b1-aec6-4fad-bb5b-1c184fbc92b4', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:39:39 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-b94c2950-1d4b-4483-a8df-d4914ecddd7f tempest-VolumesDeleteCascade-1697863049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37de1e54-6809-401c-b939-1d61577d9633) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:39:39 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-b94c2950-1d4b-4483-a8df-d4914ecddd7f tempest-VolumesDeleteCascade-1697863049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37de1e54-6809-401c-b939-1d61577d9633) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:39:39 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-b94c2950-1d4b-4483-a8df-d4914ecddd7f tempest-VolumesDeleteCascade-1697863049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f617e092-febc-406d-833f-a028a1f25be7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:39:39 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-b94c2950-1d4b-4483-a8df-d4914ecddd7f tempest-VolumesDeleteCascade-1697863049 None] Volume 6c3134b1-aec6-4fad-bb5b-1c184fbc92b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c3134b1-aec6-4fad-bb5b-1c184fbc92b4', 'volume_size': 1} Sep 06 06:39:39 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-b94c2950-1d4b-4483-a8df-d4914ecddd7f tempest-VolumesDeleteCascade-1697863049 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:39:39 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-b94c2950-1d4b-4483-a8df-d4914ecddd7f tempest-VolumesDeleteCascade-1697863049 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:39:39 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-b94c2950-1d4b-4483-a8df-d4914ecddd7f tempest-VolumesDeleteCascade-1697863049 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:39:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-612068499',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c3134b1-aec6-4fad-bb5b-1c184fbc92b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80ea58b259f149e7ada783971acdfcb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:39:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:39:40Z,use_quota=True,user_id='50b5313700b94db385ea112cc128b1a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)}" {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 06:39:39 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-b94c2950-1d4b-4483-a8df-d4914ecddd7f tempest-VolumesDeleteCascade-1697863049 None] Creating volume 6c3134b1-aec6-4fad-bb5b-1c184fbc92b4 {{(pid=87329) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 06:39:39 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-b94c2950-1d4b-4483-a8df-d4914ecddd7f tempest-VolumesDeleteCascade-1697863049 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:39:39 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-b94c2950-1d4b-4483-a8df-d4914ecddd7f tempest-VolumesDeleteCascade-1697863049 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:39:39 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-b94c2950-1d4b-4483-a8df-d4914ecddd7f tempest-VolumesDeleteCascade-1697863049 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:39:39 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-b94c2950-1d4b-4483-a8df-d4914ecddd7f tempest-VolumesDeleteCascade-1697863049 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:39:39 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-b94c2950-1d4b-4483-a8df-d4914ecddd7f tempest-VolumesDeleteCascade-1697863049 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:39:39 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-b94c2950-1d4b-4483-a8df-d4914ecddd7f tempest-VolumesDeleteCascade-1697863049 None] Selected osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 as target Quobyte volume. {{(pid=87329) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 06:39:39 devstack cinder-volume[87329]: INFO cinder.volume.drivers.remotefs [None req-b94c2950-1d4b-4483-a8df-d4914ecddd7f tempest-VolumesDeleteCascade-1697863049 None] casted to osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 Sep 06 06:39:39 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-b94c2950-1d4b-4483-a8df-d4914ecddd7f tempest-VolumesDeleteCascade-1697863049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6c3134b1-aec6-4fad-bb5b-1c184fbc92b4 1073741824 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:39:39 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-d4d9486a-e7ba-4c02-bec2-74832f48926e tempest-CreateVolumesFromSnapshotTest-1337710689 None] Lock "cinder-561ce14f-2365-487e-a919-236bf2e2172c-delete_volume" acquired by "delete_volume" :: waited 0.113s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:39:39 devstack sudo[97368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6c3134b1-aec6-4fad-bb5b-1c184fbc92b4 1073741824 Sep 06 06:39:39 devstack sudo[97368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:39:39 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-d4d9486a-e7ba-4c02-bec2-74832f48926e tempest-CreateVolumesFromSnapshotTest-1337710689 None] Acquiring lock "cinder-quobyte-561ce14f-2365-487e-a919-236bf2e2172c" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:39:39 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-d4d9486a-e7ba-4c02-bec2-74832f48926e tempest-CreateVolumesFromSnapshotTest-1337710689 None] Lock "cinder-quobyte-561ce14f-2365-487e-a919-236bf2e2172c" acquired by "delete_volume" :: waited 0.033s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:39:39 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec78de7d-3bb3-496c-94c1-f1b806917b79]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:39:39 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-d4d9486a-e7ba-4c02-bec2-74832f48926e tempest-CreateVolumesFromSnapshotTest-1337710689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-561ce14f-2365-487e-a919-236bf2e2172c {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:39:40 devstack sudo[97373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-561ce14f-2365-487e-a919-236bf2e2172c Sep 06 06:39:40 devstack sudo[97373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:39:40 devstack sudo[97373]: pam_unix(sudo:session): session closed for user root Sep 06 06:39:40 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-d4d9486a-e7ba-4c02-bec2-74832f48926e tempest-CreateVolumesFromSnapshotTest-1337710689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-561ce14f-2365-487e-a919-236bf2e2172c" returned: 0 in 0.446s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:39:40 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-d4d9486a-e7ba-4c02-bec2-74832f48926e tempest-CreateVolumesFromSnapshotTest-1337710689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-561ce14f-2365-487e-a919-236bf2e2172c {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:39:40 devstack sudo[97368]: pam_unix(sudo:session): session closed for user root Sep 06 06:39:40 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-b94c2950-1d4b-4483-a8df-d4914ecddd7f tempest-VolumesDeleteCascade-1697863049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6c3134b1-aec6-4fad-bb5b-1c184fbc92b4 1073741824" returned: 0 in 0.624s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:39:40 devstack sudo[97396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-561ce14f-2365-487e-a919-236bf2e2172c Sep 06 06:39:40 devstack sudo[97396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:39:40 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-b94c2950-1d4b-4483-a8df-d4914ecddd7f tempest-VolumesDeleteCascade-1697863049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6c3134b1-aec6-4fad-bb5b-1c184fbc92b4 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:39:40 devstack sudo[97401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6c3134b1-aec6-4fad-bb5b-1c184fbc92b4 Sep 06 06:39:40 devstack sudo[97401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:39:40 devstack sudo[97396]: pam_unix(sudo:session): session closed for user root Sep 06 06:39:40 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-d4d9486a-e7ba-4c02-bec2-74832f48926e tempest-CreateVolumesFromSnapshotTest-1337710689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-561ce14f-2365-487e-a919-236bf2e2172c" returned: 0 in 0.299s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:39:40 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-d4d9486a-e7ba-4c02-bec2-74832f48926e tempest-CreateVolumesFromSnapshotTest-1337710689 None] Lock "cinder-quobyte-561ce14f-2365-487e-a919-236bf2e2172c" released by "delete_volume" :: held 0.820s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:39:40 devstack sudo[97401]: pam_unix(sudo:session): session closed for user root Sep 06 06:39:40 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-b94c2950-1d4b-4483-a8df-d4914ecddd7f tempest-VolumesDeleteCascade-1697863049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6c3134b1-aec6-4fad-bb5b-1c184fbc92b4" returned: 0 in 0.313s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:39:40 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-b94c2950-1d4b-4483-a8df-d4914ecddd7f tempest-VolumesDeleteCascade-1697863049 None] <== create_volume: return (1015ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'} {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 06:39:40 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-b94c2950-1d4b-4483-a8df-d4914ecddd7f tempest-VolumesDeleteCascade-1697863049 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.019s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:39:40 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-d4d9486a-e7ba-4c02-bec2-74832f48926e tempest-CreateVolumesFromSnapshotTest-1337710689 None] Created reservations ['20c96aa5-7691-4486-903c-a07b64ce630e', '9c0bba0f-4499-4123-97ae-7c8d4357f005', 'e2bc7b25-2ffc-4686-a56f-806279cabf33', '9fabc3bf-8edf-41ae-8091-84172237c0f6'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:39:40 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-b94c2950-1d4b-4483-a8df-d4914ecddd7f tempest-VolumesDeleteCascade-1697863049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f617e092-febc-406d-833f-a028a1f25be7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c3134b1-aec6-4fad-bb5b-1c184fbc92b4', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:39:40 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-b94c2950-1d4b-4483-a8df-d4914ecddd7f tempest-VolumesDeleteCascade-1697863049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60320755-26e6-4ed4-a095-100f399b988e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:39:40 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-b94c2950-1d4b-4483-a8df-d4914ecddd7f tempest-VolumesDeleteCascade-1697863049 None] Volume volume-6c3134b1-aec6-4fad-bb5b-1c184fbc92b4 (6c3134b1-aec6-4fad-bb5b-1c184fbc92b4): created successfully Sep 06 06:39:40 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-b94c2950-1d4b-4483-a8df-d4914ecddd7f tempest-VolumesDeleteCascade-1697863049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60320755-26e6-4ed4-a095-100f399b988e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:39:40 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-b94c2950-1d4b-4483-a8df-d4914ecddd7f tempest-VolumesDeleteCascade-1697863049 None] Flow 'volume_create_manager' (9adf3735-fac0-41eb-8870-760560dccb78) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:39:40 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-b94c2950-1d4b-4483-a8df-d4914ecddd7f tempest-VolumesDeleteCascade-1697863049 None] Created volume successfully. Sep 06 06:39:40 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-d4d9486a-e7ba-4c02-bec2-74832f48926e tempest-CreateVolumesFromSnapshotTest-1337710689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:39:40 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-d4d9486a-e7ba-4c02-bec2-74832f48926e tempest-CreateVolumesFromSnapshotTest-1337710689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:39:40 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-d4d9486a-e7ba-4c02-bec2-74832f48926e tempest-CreateVolumesFromSnapshotTest-1337710689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:39:40 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-d4d9486a-e7ba-4c02-bec2-74832f48926e tempest-CreateVolumesFromSnapshotTest-1337710689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:39:40 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-d4d9486a-e7ba-4c02-bec2-74832f48926e tempest-CreateVolumesFromSnapshotTest-1337710689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:39:40 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-d4d9486a-e7ba-4c02-bec2-74832f48926e tempest-CreateVolumesFromSnapshotTest-1337710689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:39:40 devstack sudo[97408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:39:40 devstack sudo[97408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:39:40 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-1d116b11-0d58-4835-b26d-167bbd7cd54b tempest-CreateVolumesFromSnapshotTest-1337710689 None] Acquiring lock "cinder-12ec1c42-f0e9-4206-9c0f-f816d9d6345a-delete_volume" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:39:41 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-1d116b11-0d58-4835-b26d-167bbd7cd54b tempest-CreateVolumesFromSnapshotTest-1337710689 None] Lock "cinder-12ec1c42-f0e9-4206-9c0f-f816d9d6345a-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:39:41 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-1d116b11-0d58-4835-b26d-167bbd7cd54b tempest-CreateVolumesFromSnapshotTest-1337710689 None] Acquiring lock "cinder-quobyte-12ec1c42-f0e9-4206-9c0f-f816d9d6345a" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:39:41 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-1d116b11-0d58-4835-b26d-167bbd7cd54b tempest-CreateVolumesFromSnapshotTest-1337710689 None] Lock "cinder-quobyte-12ec1c42-f0e9-4206-9c0f-f816d9d6345a" acquired by "delete_volume" :: waited 0.040s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:39:41 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[40c68480-19db-4d59-b603-1b567fd82f7d]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:39:41 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-1d116b11-0d58-4835-b26d-167bbd7cd54b tempest-CreateVolumesFromSnapshotTest-1337710689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-12ec1c42-f0e9-4206-9c0f-f816d9d6345a {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:39:41 devstack sudo[97408]: pam_unix(sudo:session): session closed for user root Sep 06 06:39:41 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-d4d9486a-e7ba-4c02-bec2-74832f48926e tempest-CreateVolumesFromSnapshotTest-1337710689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.326s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:39:41 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-d4d9486a-e7ba-4c02-bec2-74832f48926e tempest-CreateVolumesFromSnapshotTest-1337710689 None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:39:41 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-d4d9486a-e7ba-4c02-bec2-74832f48926e tempest-CreateVolumesFromSnapshotTest-1337710689 None] Deleted volume successfully. Sep 06 06:39:41 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-d4d9486a-e7ba-4c02-bec2-74832f48926e tempest-CreateVolumesFromSnapshotTest-1337710689 None] Lock "cinder-561ce14f-2365-487e-a919-236bf2e2172c-delete_volume" released by "delete_volume" :: held 1.494s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:39:41 devstack sudo[97410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-12ec1c42-f0e9-4206-9c0f-f816d9d6345a Sep 06 06:39:41 devstack sudo[97410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:39:41 devstack sudo[97410]: pam_unix(sudo:session): session closed for user root Sep 06 06:39:41 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-1d116b11-0d58-4835-b26d-167bbd7cd54b tempest-CreateVolumesFromSnapshotTest-1337710689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-12ec1c42-f0e9-4206-9c0f-f816d9d6345a" returned: 0 in 0.524s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:39:41 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-1d116b11-0d58-4835-b26d-167bbd7cd54b tempest-CreateVolumesFromSnapshotTest-1337710689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-12ec1c42-f0e9-4206-9c0f-f816d9d6345a {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:39:41 devstack sudo[97418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-12ec1c42-f0e9-4206-9c0f-f816d9d6345a Sep 06 06:39:41 devstack sudo[97418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:39:42 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-f0cdd0c6-872d-4999-9dca-2649320073af tempest-VolumesDeleteCascade-1697863049 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:39:42 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-f0cdd0c6-872d-4999-9dca-2649320073af tempest-VolumesDeleteCascade-1697863049 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:39:42 devstack sudo[97418]: pam_unix(sudo:session): session closed for user root Sep 06 06:39:42 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-1d116b11-0d58-4835-b26d-167bbd7cd54b tempest-CreateVolumesFromSnapshotTest-1337710689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-12ec1c42-f0e9-4206-9c0f-f816d9d6345a" returned: 0 in 0.325s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:39:42 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-f0cdd0c6-872d-4999-9dca-2649320073af tempest-VolumesDeleteCascade-1697863049 None] Creating offline snapshot 7b0bd551-6d41-4e42-9ee2-d51cbebc4a52 of volume 6c3134b1-aec6-4fad-bb5b-1c184fbc92b4 {{(pid=87329) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 06 06:39:42 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-1d116b11-0d58-4835-b26d-167bbd7cd54b tempest-CreateVolumesFromSnapshotTest-1337710689 None] Lock "cinder-quobyte-12ec1c42-f0e9-4206-9c0f-f816d9d6345a" released by "delete_volume" :: held 0.911s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:39:42 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c53c387-73f0-49f3-9cb6-2d8a5235edf0]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:39:42 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-f0cdd0c6-872d-4999-9dca-2649320073af tempest-VolumesDeleteCascade-1697863049 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6c3134b1-aec6-4fad-bb5b-1c184fbc92b4 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:39:42 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-1d116b11-0d58-4835-b26d-167bbd7cd54b tempest-CreateVolumesFromSnapshotTest-1337710689 None] Created reservations ['abd02beb-4585-4d47-918d-cadbb568a54b', 'e9f4ae64-08c3-4509-9391-65a9f16d3cc3', '25d5b60f-e3ad-49a4-ae00-f6728112da25', 'f1fd7871-6ef0-4987-a92a-c659282744f2'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:39:42 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-1d116b11-0d58-4835-b26d-167bbd7cd54b tempest-CreateVolumesFromSnapshotTest-1337710689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:39:42 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-1d116b11-0d58-4835-b26d-167bbd7cd54b tempest-CreateVolumesFromSnapshotTest-1337710689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:39:42 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-1d116b11-0d58-4835-b26d-167bbd7cd54b tempest-CreateVolumesFromSnapshotTest-1337710689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:39:42 devstack sudo[97421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6c3134b1-aec6-4fad-bb5b-1c184fbc92b4 Sep 06 06:39:42 devstack sudo[97421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:39:42 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-1d116b11-0d58-4835-b26d-167bbd7cd54b tempest-CreateVolumesFromSnapshotTest-1337710689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:39:42 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-1d116b11-0d58-4835-b26d-167bbd7cd54b tempest-CreateVolumesFromSnapshotTest-1337710689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:39:42 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-1d116b11-0d58-4835-b26d-167bbd7cd54b tempest-CreateVolumesFromSnapshotTest-1337710689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:39:42 devstack sudo[97438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:39:42 devstack sudo[97438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:39:42 devstack sudo[97438]: pam_unix(sudo:session): session closed for user root Sep 06 06:39:42 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-1d116b11-0d58-4835-b26d-167bbd7cd54b tempest-CreateVolumesFromSnapshotTest-1337710689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.549s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:39:42 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-1d116b11-0d58-4835-b26d-167bbd7cd54b tempest-CreateVolumesFromSnapshotTest-1337710689 None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:39:42 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-1d116b11-0d58-4835-b26d-167bbd7cd54b tempest-CreateVolumesFromSnapshotTest-1337710689 None] Deleted volume successfully. Sep 06 06:39:42 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-1d116b11-0d58-4835-b26d-167bbd7cd54b tempest-CreateVolumesFromSnapshotTest-1337710689 None] Lock "cinder-12ec1c42-f0e9-4206-9c0f-f816d9d6345a-delete_volume" released by "delete_volume" :: held 1.961s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:39:43 devstack sudo[97421]: pam_unix(sudo:session): session closed for user root Sep 06 06:39:43 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-f0cdd0c6-872d-4999-9dca-2649320073af tempest-VolumesDeleteCascade-1697863049 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6c3134b1-aec6-4fad-bb5b-1c184fbc92b4" returned: 0 in 1.045s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:39:43 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-f0cdd0c6-872d-4999-9dca-2649320073af tempest-VolumesDeleteCascade-1697863049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6c3134b1-aec6-4fad-bb5b-1c184fbc92b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6c3134b1-aec6-4fad-bb5b-1c184fbc92b4.7b0bd551-6d41-4e42-9ee2-d51cbebc4a52 1G {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:39:43 devstack sudo[97488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6c3134b1-aec6-4fad-bb5b-1c184fbc92b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6c3134b1-aec6-4fad-bb5b-1c184fbc92b4.7b0bd551-6d41-4e42-9ee2-d51cbebc4a52 1G Sep 06 06:39:43 devstack sudo[97488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:39:43 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-1fff51b9-8ab4-4633-a580-c2685b8af47a tempest-CreateVolumesFromSnapshotTest-1337710689 None] Acquiring lock "cinder-8294b8cb-6b6c-4a4f-b347-2df244dd852f-delete_volume" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:39:43 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-1fff51b9-8ab4-4633-a580-c2685b8af47a tempest-CreateVolumesFromSnapshotTest-1337710689 None] Lock "cinder-8294b8cb-6b6c-4a4f-b347-2df244dd852f-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:39:43 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-1fff51b9-8ab4-4633-a580-c2685b8af47a tempest-CreateVolumesFromSnapshotTest-1337710689 None] Acquiring lock "cinder-quobyte-8294b8cb-6b6c-4a4f-b347-2df244dd852f" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:39:43 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-1fff51b9-8ab4-4633-a580-c2685b8af47a tempest-CreateVolumesFromSnapshotTest-1337710689 None] Lock "cinder-quobyte-8294b8cb-6b6c-4a4f-b347-2df244dd852f" acquired by "delete_volume" :: waited 0.035s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:39:43 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[b74d06ab-a2ae-49ac-bac1-b1561329bf21]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:39:43 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-1fff51b9-8ab4-4633-a580-c2685b8af47a tempest-CreateVolumesFromSnapshotTest-1337710689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-8294b8cb-6b6c-4a4f-b347-2df244dd852f {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:39:43 devstack sudo[97488]: pam_unix(sudo:session): session closed for user root Sep 06 06:39:43 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-f0cdd0c6-872d-4999-9dca-2649320073af tempest-VolumesDeleteCascade-1697863049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6c3134b1-aec6-4fad-bb5b-1c184fbc92b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6c3134b1-aec6-4fad-bb5b-1c184fbc92b4.7b0bd551-6d41-4e42-9ee2-d51cbebc4a52 1G" returned: 0 in 0.805s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:39:43 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-f0cdd0c6-872d-4999-9dca-2649320073af tempest-VolumesDeleteCascade-1697863049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c3134b1-aec6-4fad-bb5b-1c184fbc92b4 -F qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6c3134b1-aec6-4fad-bb5b-1c184fbc92b4.7b0bd551-6d41-4e42-9ee2-d51cbebc4a52 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:39:43 devstack sudo[97501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-8294b8cb-6b6c-4a4f-b347-2df244dd852f Sep 06 06:39:43 devstack sudo[97501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:39:44 devstack sudo[97505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c3134b1-aec6-4fad-bb5b-1c184fbc92b4 -F qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6c3134b1-aec6-4fad-bb5b-1c184fbc92b4.7b0bd551-6d41-4e42-9ee2-d51cbebc4a52 Sep 06 06:39:44 devstack sudo[97505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:39:44 devstack sudo[97505]: pam_unix(sudo:session): session closed for user root Sep 06 06:39:44 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-f0cdd0c6-872d-4999-9dca-2649320073af tempest-VolumesDeleteCascade-1697863049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c3134b1-aec6-4fad-bb5b-1c184fbc92b4 -F qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6c3134b1-aec6-4fad-bb5b-1c184fbc92b4.7b0bd551-6d41-4e42-9ee2-d51cbebc4a52" returned: 0 in 0.935s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:39:44 devstack cinder-volume[87329]: WARNING cinder.volume.drivers.remotefs [None req-f0cdd0c6-872d-4999-9dca-2649320073af tempest-VolumesDeleteCascade-1697863049 None] /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6c3134b1-aec6-4fad-bb5b-1c184fbc92b4.7b0bd551-6d41-4e42-9ee2-d51cbebc4a52 is being set with open permissions: ugo+rw Sep 06 06:39:44 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-f0cdd0c6-872d-4999-9dca-2649320073af tempest-VolumesDeleteCascade-1697863049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6c3134b1-aec6-4fad-bb5b-1c184fbc92b4.7b0bd551-6d41-4e42-9ee2-d51cbebc4a52 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:39:44 devstack sudo[97501]: pam_unix(sudo:session): session closed for user root Sep 06 06:39:44 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-1fff51b9-8ab4-4633-a580-c2685b8af47a tempest-CreateVolumesFromSnapshotTest-1337710689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-8294b8cb-6b6c-4a4f-b347-2df244dd852f" returned: 0 in 1.206s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:39:44 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-1fff51b9-8ab4-4633-a580-c2685b8af47a tempest-CreateVolumesFromSnapshotTest-1337710689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-8294b8cb-6b6c-4a4f-b347-2df244dd852f {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:39:44 devstack sudo[97558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-8294b8cb-6b6c-4a4f-b347-2df244dd852f Sep 06 06:39:44 devstack sudo[97558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:39:44 devstack sudo[97557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6c3134b1-aec6-4fad-bb5b-1c184fbc92b4.7b0bd551-6d41-4e42-9ee2-d51cbebc4a52 Sep 06 06:39:44 devstack sudo[97557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:39:45 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-f0cdd0c6-872d-4999-9dca-2649320073af tempest-VolumesDeleteCascade-1697863049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6c3134b1-aec6-4fad-bb5b-1c184fbc92b4.7b0bd551-6d41-4e42-9ee2-d51cbebc4a52" returned: 0 in 0.707s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:39:45 devstack sudo[97557]: pam_unix(sudo:session): session closed for user root Sep 06 06:39:45 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-f0cdd0c6-872d-4999-9dca-2649320073af tempest-VolumesDeleteCascade-1697863049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6c3134b1-aec6-4fad-bb5b-1c184fbc92b4.info {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:39:45 devstack sudo[97558]: pam_unix(sudo:session): session closed for user root Sep 06 06:39:45 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-1fff51b9-8ab4-4633-a580-c2685b8af47a tempest-CreateVolumesFromSnapshotTest-1337710689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-8294b8cb-6b6c-4a4f-b347-2df244dd852f" returned: 0 in 0.817s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:39:45 devstack sudo[97575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6c3134b1-aec6-4fad-bb5b-1c184fbc92b4.info Sep 06 06:39:45 devstack sudo[97575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:39:45 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-1fff51b9-8ab4-4633-a580-c2685b8af47a tempest-CreateVolumesFromSnapshotTest-1337710689 None] Lock "cinder-quobyte-8294b8cb-6b6c-4a4f-b347-2df244dd852f" released by "delete_volume" :: held 2.096s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:39:45 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-1fff51b9-8ab4-4633-a580-c2685b8af47a tempest-CreateVolumesFromSnapshotTest-1337710689 None] Created reservations ['cf4843b5-1fe9-494e-971e-cbdb1af4afc4', '5aecf407-a55d-4160-a5a2-1666cd4d30fc', '26e32bcd-16c0-44ea-9879-25e61b0a6d55', '175f740c-2d90-4959-b334-94587818d4ee'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:39:46 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-1fff51b9-8ab4-4633-a580-c2685b8af47a tempest-CreateVolumesFromSnapshotTest-1337710689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:39:46 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-1fff51b9-8ab4-4633-a580-c2685b8af47a tempest-CreateVolumesFromSnapshotTest-1337710689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:39:46 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-1fff51b9-8ab4-4633-a580-c2685b8af47a tempest-CreateVolumesFromSnapshotTest-1337710689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:39:46 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-1fff51b9-8ab4-4633-a580-c2685b8af47a tempest-CreateVolumesFromSnapshotTest-1337710689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:39:46 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-1fff51b9-8ab4-4633-a580-c2685b8af47a tempest-CreateVolumesFromSnapshotTest-1337710689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:39:46 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-1fff51b9-8ab4-4633-a580-c2685b8af47a tempest-CreateVolumesFromSnapshotTest-1337710689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:39:46 devstack sudo[97580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:39:46 devstack sudo[97580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:39:46 devstack sudo[97575]: pam_unix(sudo:session): session closed for user root Sep 06 06:39:46 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-f0cdd0c6-872d-4999-9dca-2649320073af tempest-VolumesDeleteCascade-1697863049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6c3134b1-aec6-4fad-bb5b-1c184fbc92b4.info" returned: 0 in 0.520s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:39:46 devstack cinder-volume[87329]: WARNING cinder.volume.drivers.remotefs [None req-f0cdd0c6-872d-4999-9dca-2649320073af tempest-VolumesDeleteCascade-1697863049 None] /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6c3134b1-aec6-4fad-bb5b-1c184fbc92b4.info is being set with open permissions: ugo+rw Sep 06 06:39:46 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-f0cdd0c6-872d-4999-9dca-2649320073af tempest-VolumesDeleteCascade-1697863049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6c3134b1-aec6-4fad-bb5b-1c184fbc92b4.info {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:39:46 devstack sudo[97583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6c3134b1-aec6-4fad-bb5b-1c184fbc92b4.info Sep 06 06:39:46 devstack sudo[97583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:39:46 devstack sudo[97580]: pam_unix(sudo:session): session closed for user root Sep 06 06:39:46 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-1fff51b9-8ab4-4633-a580-c2685b8af47a tempest-CreateVolumesFromSnapshotTest-1337710689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.356s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:39:46 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-1fff51b9-8ab4-4633-a580-c2685b8af47a tempest-CreateVolumesFromSnapshotTest-1337710689 None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:39:46 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-1fff51b9-8ab4-4633-a580-c2685b8af47a tempest-CreateVolumesFromSnapshotTest-1337710689 None] Deleted volume successfully. Sep 06 06:39:46 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-1fff51b9-8ab4-4633-a580-c2685b8af47a tempest-CreateVolumesFromSnapshotTest-1337710689 None] Lock "cinder-8294b8cb-6b6c-4a4f-b347-2df244dd852f-delete_volume" released by "delete_volume" :: held 2.886s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:39:46 devstack sudo[97583]: pam_unix(sudo:session): session closed for user root Sep 06 06:39:46 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-f0cdd0c6-872d-4999-9dca-2649320073af tempest-VolumesDeleteCascade-1697863049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6c3134b1-aec6-4fad-bb5b-1c184fbc92b4.info" returned: 0 in 0.345s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:39:46 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-f0cdd0c6-872d-4999-9dca-2649320073af tempest-VolumesDeleteCascade-1697863049 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.535s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:39:46 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-f0cdd0c6-872d-4999-9dca-2649320073af tempest-VolumesDeleteCascade-1697863049 None] Create snapshot completed successfully Sep 06 06:39:46 devstack cinder-volume[87329]: DEBUG dbcounter [-] [87329] Writing DB stats cinder:INSERT=41,cinder:UPDATE=183,cinder:SELECT=130,cinder:DELETE=16 {{(pid=87329) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 06:39:47 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-f8ee2e6b-c0f8-4973-a650-431c9556de97 tempest-CreateVolumesFromSnapshotTest-1337710689 None] Acquiring lock "cinder-394f0ada-a8b8-46b5-804d-6d37838a39a2-delete_volume" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:39:47 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-f8ee2e6b-c0f8-4973-a650-431c9556de97 tempest-CreateVolumesFromSnapshotTest-1337710689 None] Lock "cinder-394f0ada-a8b8-46b5-804d-6d37838a39a2-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:39:47 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-f8ee2e6b-c0f8-4973-a650-431c9556de97 tempest-CreateVolumesFromSnapshotTest-1337710689 None] Acquiring lock "cinder-quobyte-394f0ada-a8b8-46b5-804d-6d37838a39a2" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:39:47 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-f8ee2e6b-c0f8-4973-a650-431c9556de97 tempest-CreateVolumesFromSnapshotTest-1337710689 None] Lock "cinder-quobyte-394f0ada-a8b8-46b5-804d-6d37838a39a2" acquired by "delete_volume" :: waited 0.017s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:39:47 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ad73004-a5c1-4b63-b67a-8e0e7f6cf2b4]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:39:47 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-f8ee2e6b-c0f8-4973-a650-431c9556de97 tempest-CreateVolumesFromSnapshotTest-1337710689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-394f0ada-a8b8-46b5-804d-6d37838a39a2 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:39:47 devstack sudo[97587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-394f0ada-a8b8-46b5-804d-6d37838a39a2 Sep 06 06:39:47 devstack sudo[97587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:39:47 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-3697f9cf-4908-45d5-bd35-0f7e19153e3e tempest-VolumesDeleteCascade-1697863049 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:39:47 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-3697f9cf-4908-45d5-bd35-0f7e19153e3e tempest-VolumesDeleteCascade-1697863049 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:39:47 devstack sudo[97587]: pam_unix(sudo:session): session closed for user root Sep 06 06:39:47 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-f8ee2e6b-c0f8-4973-a650-431c9556de97 tempest-CreateVolumesFromSnapshotTest-1337710689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-394f0ada-a8b8-46b5-804d-6d37838a39a2" returned: 0 in 0.531s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:39:47 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-f8ee2e6b-c0f8-4973-a650-431c9556de97 tempest-CreateVolumesFromSnapshotTest-1337710689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-394f0ada-a8b8-46b5-804d-6d37838a39a2 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:39:47 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-3697f9cf-4908-45d5-bd35-0f7e19153e3e tempest-VolumesDeleteCascade-1697863049 None] Creating offline snapshot ac6211dc-a548-404b-8331-feb393fabf7e of volume 6c3134b1-aec6-4fad-bb5b-1c184fbc92b4 {{(pid=87329) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 06 06:39:47 devstack sudo[97595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-394f0ada-a8b8-46b5-804d-6d37838a39a2 Sep 06 06:39:47 devstack sudo[97595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:39:47 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[a49a4240-0b25-44bb-9664-5c04430b74e0]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:39:47 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-3697f9cf-4908-45d5-bd35-0f7e19153e3e tempest-VolumesDeleteCascade-1697863049 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6c3134b1-aec6-4fad-bb5b-1c184fbc92b4.7b0bd551-6d41-4e42-9ee2-d51cbebc4a52 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:39:48 devstack sudo[97597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6c3134b1-aec6-4fad-bb5b-1c184fbc92b4.7b0bd551-6d41-4e42-9ee2-d51cbebc4a52 Sep 06 06:39:48 devstack sudo[97597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:39:48 devstack sudo[97595]: pam_unix(sudo:session): session closed for user root Sep 06 06:39:48 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-f8ee2e6b-c0f8-4973-a650-431c9556de97 tempest-CreateVolumesFromSnapshotTest-1337710689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-394f0ada-a8b8-46b5-804d-6d37838a39a2" returned: 0 in 0.576s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:39:48 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-f8ee2e6b-c0f8-4973-a650-431c9556de97 tempest-CreateVolumesFromSnapshotTest-1337710689 None] Lock "cinder-quobyte-394f0ada-a8b8-46b5-804d-6d37838a39a2" released by "delete_volume" :: held 1.200s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:39:48 devstack cinder-volume[87329]: DEBUG oslo_service.periodic_task [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87329) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 06 06:39:48 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:39:48 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:39:48 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:39:48 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:39:48 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:39:48 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:39:48 devstack sudo[97600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:39:48 devstack sudo[97600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:39:48 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-f8ee2e6b-c0f8-4973-a650-431c9556de97 tempest-CreateVolumesFromSnapshotTest-1337710689 None] Created reservations ['58067072-f8cb-4ef1-a630-34ae5de153c2', '4932ab9b-5164-4d3d-a528-6332f7331bbb', '7e9b6a19-4a1c-491a-a8a0-86a5c103fd69', 'd9684b18-684e-4fc0-824d-1d56f45c719b'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:39:48 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-f8ee2e6b-c0f8-4973-a650-431c9556de97 tempest-CreateVolumesFromSnapshotTest-1337710689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:39:48 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-f8ee2e6b-c0f8-4973-a650-431c9556de97 tempest-CreateVolumesFromSnapshotTest-1337710689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:39:48 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-f8ee2e6b-c0f8-4973-a650-431c9556de97 tempest-CreateVolumesFromSnapshotTest-1337710689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:39:48 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-f8ee2e6b-c0f8-4973-a650-431c9556de97 tempest-CreateVolumesFromSnapshotTest-1337710689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:39:48 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-f8ee2e6b-c0f8-4973-a650-431c9556de97 tempest-CreateVolumesFromSnapshotTest-1337710689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:39:48 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-f8ee2e6b-c0f8-4973-a650-431c9556de97 tempest-CreateVolumesFromSnapshotTest-1337710689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:39:48 devstack sudo[97605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:39:48 devstack sudo[97605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:39:48 devstack sudo[97597]: pam_unix(sudo:session): session closed for user root Sep 06 06:39:48 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-3697f9cf-4908-45d5-bd35-0f7e19153e3e tempest-VolumesDeleteCascade-1697863049 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6c3134b1-aec6-4fad-bb5b-1c184fbc92b4.7b0bd551-6d41-4e42-9ee2-d51cbebc4a52" returned: 0 in 1.023s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:39:48 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-3697f9cf-4908-45d5-bd35-0f7e19153e3e tempest-VolumesDeleteCascade-1697863049 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6c3134b1-aec6-4fad-bb5b-1c184fbc92b4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87329) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 06:39:48 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-3697f9cf-4908-45d5-bd35-0f7e19153e3e tempest-VolumesDeleteCascade-1697863049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6c3134b1-aec6-4fad-bb5b-1c184fbc92b4.7b0bd551-6d41-4e42-9ee2-d51cbebc4a52,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6c3134b1-aec6-4fad-bb5b-1c184fbc92b4.ac6211dc-a548-404b-8331-feb393fabf7e 1G {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:39:49 devstack sudo[97607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6c3134b1-aec6-4fad-bb5b-1c184fbc92b4.7b0bd551-6d41-4e42-9ee2-d51cbebc4a52,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6c3134b1-aec6-4fad-bb5b-1c184fbc92b4.ac6211dc-a548-404b-8331-feb393fabf7e 1G Sep 06 06:39:49 devstack sudo[97607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:39:49 devstack sudo[97600]: pam_unix(sudo:session): session closed for user root Sep 06 06:39:49 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.737s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:39:49 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:39:49 devstack cinder-volume[87329]: DEBUG oslo_service.periodic_task [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Running periodic task VolumeManager._thread_info {{(pid=87329) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 06 06:39:49 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] thread count: 28 {{(pid=87329) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 06 06:39:49 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] thread info: [<_MainThread(MainThread, started 126855043821696)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87329) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 06 06:39:49 devstack sudo[97605]: pam_unix(sudo:session): session closed for user root Sep 06 06:39:49 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-f8ee2e6b-c0f8-4973-a650-431c9556de97 tempest-CreateVolumesFromSnapshotTest-1337710689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.498s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:39:49 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-f8ee2e6b-c0f8-4973-a650-431c9556de97 tempest-CreateVolumesFromSnapshotTest-1337710689 None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:39:49 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-f8ee2e6b-c0f8-4973-a650-431c9556de97 tempest-CreateVolumesFromSnapshotTest-1337710689 None] Deleted volume successfully. Sep 06 06:39:49 devstack cinder-volume[87329]: DEBUG dbcounter [-] [87329] Writing DB stats cinder:SELECT=146,cinder:UPDATE=204,cinder:DELETE=22,cinder:INSERT=51 {{(pid=87329) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 06:39:49 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-f8ee2e6b-c0f8-4973-a650-431c9556de97 tempest-CreateVolumesFromSnapshotTest-1337710689 None] Lock "cinder-394f0ada-a8b8-46b5-804d-6d37838a39a2-delete_volume" released by "delete_volume" :: held 2.235s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:39:49 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-42407d01-03e5-467d-a6b7-da5834ca1068 tempest-CreateVolumesFromSnapshotTest-1337710689 None] Acquiring lock "cinder-642b0aff-717c-4105-9f26-1d9ff28794b5-delete_volume" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:39:49 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-42407d01-03e5-467d-a6b7-da5834ca1068 tempest-CreateVolumesFromSnapshotTest-1337710689 None] Lock "cinder-642b0aff-717c-4105-9f26-1d9ff28794b5-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:39:49 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-42407d01-03e5-467d-a6b7-da5834ca1068 tempest-CreateVolumesFromSnapshotTest-1337710689 None] Acquiring lock "cinder-quobyte-642b0aff-717c-4105-9f26-1d9ff28794b5" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:39:49 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-42407d01-03e5-467d-a6b7-da5834ca1068 tempest-CreateVolumesFromSnapshotTest-1337710689 None] Lock "cinder-quobyte-642b0aff-717c-4105-9f26-1d9ff28794b5" acquired by "delete_volume" :: waited 0.034s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:39:49 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[3905022f-56fb-4b14-81aa-5bfe749847fa]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:39:49 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-42407d01-03e5-467d-a6b7-da5834ca1068 tempest-CreateVolumesFromSnapshotTest-1337710689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-642b0aff-717c-4105-9f26-1d9ff28794b5 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:39:49 devstack sudo[97607]: pam_unix(sudo:session): session closed for user root Sep 06 06:39:49 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-3697f9cf-4908-45d5-bd35-0f7e19153e3e tempest-VolumesDeleteCascade-1697863049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6c3134b1-aec6-4fad-bb5b-1c184fbc92b4.7b0bd551-6d41-4e42-9ee2-d51cbebc4a52,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6c3134b1-aec6-4fad-bb5b-1c184fbc92b4.ac6211dc-a548-404b-8331-feb393fabf7e 1G" returned: 0 in 0.922s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:39:49 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-3697f9cf-4908-45d5-bd35-0f7e19153e3e tempest-VolumesDeleteCascade-1697863049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c3134b1-aec6-4fad-bb5b-1c184fbc92b4.7b0bd551-6d41-4e42-9ee2-d51cbebc4a52 -F qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6c3134b1-aec6-4fad-bb5b-1c184fbc92b4.ac6211dc-a548-404b-8331-feb393fabf7e {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:39:49 devstack sudo[97619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c3134b1-aec6-4fad-bb5b-1c184fbc92b4.7b0bd551-6d41-4e42-9ee2-d51cbebc4a52 -F qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6c3134b1-aec6-4fad-bb5b-1c184fbc92b4.ac6211dc-a548-404b-8331-feb393fabf7e Sep 06 06:39:49 devstack sudo[97619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:39:50 devstack sudo[97618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-642b0aff-717c-4105-9f26-1d9ff28794b5 Sep 06 06:39:50 devstack sudo[97618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:39:50 devstack sudo[97619]: pam_unix(sudo:session): session closed for user root Sep 06 06:39:50 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-3697f9cf-4908-45d5-bd35-0f7e19153e3e tempest-VolumesDeleteCascade-1697863049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c3134b1-aec6-4fad-bb5b-1c184fbc92b4.7b0bd551-6d41-4e42-9ee2-d51cbebc4a52 -F qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6c3134b1-aec6-4fad-bb5b-1c184fbc92b4.ac6211dc-a548-404b-8331-feb393fabf7e" returned: 0 in 0.534s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:39:50 devstack cinder-volume[87329]: WARNING cinder.volume.drivers.remotefs [None req-3697f9cf-4908-45d5-bd35-0f7e19153e3e tempest-VolumesDeleteCascade-1697863049 None] /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6c3134b1-aec6-4fad-bb5b-1c184fbc92b4.ac6211dc-a548-404b-8331-feb393fabf7e is being set with open permissions: ugo+rw Sep 06 06:39:50 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-3697f9cf-4908-45d5-bd35-0f7e19153e3e tempest-VolumesDeleteCascade-1697863049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6c3134b1-aec6-4fad-bb5b-1c184fbc92b4.ac6211dc-a548-404b-8331-feb393fabf7e {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:39:50 devstack sudo[97627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6c3134b1-aec6-4fad-bb5b-1c184fbc92b4.ac6211dc-a548-404b-8331-feb393fabf7e Sep 06 06:39:50 devstack sudo[97627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:39:50 devstack sudo[97618]: pam_unix(sudo:session): session closed for user root Sep 06 06:39:50 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-42407d01-03e5-467d-a6b7-da5834ca1068 tempest-CreateVolumesFromSnapshotTest-1337710689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-642b0aff-717c-4105-9f26-1d9ff28794b5" returned: 0 in 0.662s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:39:50 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-42407d01-03e5-467d-a6b7-da5834ca1068 tempest-CreateVolumesFromSnapshotTest-1337710689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-642b0aff-717c-4105-9f26-1d9ff28794b5 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:39:50 devstack sudo[97630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-642b0aff-717c-4105-9f26-1d9ff28794b5 Sep 06 06:39:50 devstack sudo[97630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:39:50 devstack sudo[97627]: pam_unix(sudo:session): session closed for user root Sep 06 06:39:50 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-3697f9cf-4908-45d5-bd35-0f7e19153e3e tempest-VolumesDeleteCascade-1697863049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6c3134b1-aec6-4fad-bb5b-1c184fbc92b4.ac6211dc-a548-404b-8331-feb393fabf7e" returned: 0 in 0.258s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:39:50 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-3697f9cf-4908-45d5-bd35-0f7e19153e3e tempest-VolumesDeleteCascade-1697863049 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.997s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:39:50 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-3697f9cf-4908-45d5-bd35-0f7e19153e3e tempest-VolumesDeleteCascade-1697863049 None] Create snapshot completed successfully Sep 06 06:39:50 devstack sudo[97630]: pam_unix(sudo:session): session closed for user root Sep 06 06:39:50 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-42407d01-03e5-467d-a6b7-da5834ca1068 tempest-CreateVolumesFromSnapshotTest-1337710689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-642b0aff-717c-4105-9f26-1d9ff28794b5" returned: 0 in 0.334s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:39:50 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-42407d01-03e5-467d-a6b7-da5834ca1068 tempest-CreateVolumesFromSnapshotTest-1337710689 None] Lock "cinder-quobyte-642b0aff-717c-4105-9f26-1d9ff28794b5" released by "delete_volume" :: held 1.087s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:39:50 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-42407d01-03e5-467d-a6b7-da5834ca1068 tempest-CreateVolumesFromSnapshotTest-1337710689 None] Created reservations ['d0cf0b4e-b3f5-42c7-916e-511d69ea8f3f', '27fbd455-373a-4346-9d4f-3f2060655d4c', '0242e8a2-2a82-4cf9-9b0a-d246757a3f21', '0e99d55a-34b1-4ef2-ad0c-3278b60a0b40'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:39:51 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-42407d01-03e5-467d-a6b7-da5834ca1068 tempest-CreateVolumesFromSnapshotTest-1337710689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:39:51 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-42407d01-03e5-467d-a6b7-da5834ca1068 tempest-CreateVolumesFromSnapshotTest-1337710689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:39:51 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-42407d01-03e5-467d-a6b7-da5834ca1068 tempest-CreateVolumesFromSnapshotTest-1337710689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:39:51 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-42407d01-03e5-467d-a6b7-da5834ca1068 tempest-CreateVolumesFromSnapshotTest-1337710689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:39:51 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-42407d01-03e5-467d-a6b7-da5834ca1068 tempest-CreateVolumesFromSnapshotTest-1337710689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:39:51 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-42407d01-03e5-467d-a6b7-da5834ca1068 tempest-CreateVolumesFromSnapshotTest-1337710689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:39:51 devstack sudo[97634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:39:51 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-5762f6b1-ead1-4689-9c0b-40b5dcf5cca3 tempest-VolumesDeleteCascade-1697863049 None] Acquiring lock "cinder-6c3134b1-aec6-4fad-bb5b-1c184fbc92b4-delete_volume" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:39:51 devstack sudo[97634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:39:51 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-5762f6b1-ead1-4689-9c0b-40b5dcf5cca3 tempest-VolumesDeleteCascade-1697863049 None] Lock "cinder-6c3134b1-aec6-4fad-bb5b-1c184fbc92b4-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:39:51 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-5762f6b1-ead1-4689-9c0b-40b5dcf5cca3 tempest-VolumesDeleteCascade-1697863049 None] Performing cascade delete. {{(pid=87329) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 06 06:39:51 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-5762f6b1-ead1-4689-9c0b-40b5dcf5cca3 tempest-VolumesDeleteCascade-1697863049 None] Acquiring lock "cinder-7b0bd551-6d41-4e42-9ee2-d51cbebc4a52-delete_snapshot" by "delete_snapshot" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:39:51 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-5762f6b1-ead1-4689-9c0b-40b5dcf5cca3 tempest-VolumesDeleteCascade-1697863049 None] Lock "cinder-7b0bd551-6d41-4e42-9ee2-d51cbebc4a52-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:39:51 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-5762f6b1-ead1-4689-9c0b-40b5dcf5cca3 tempest-VolumesDeleteCascade-1697863049 None] Acquiring lock "cinder-quobyte-6c3134b1-aec6-4fad-bb5b-1c184fbc92b4" by "delete_snapshot" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:39:51 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-5762f6b1-ead1-4689-9c0b-40b5dcf5cca3 tempest-VolumesDeleteCascade-1697863049 None] Lock "cinder-quobyte-6c3134b1-aec6-4fad-bb5b-1c184fbc92b4" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:39:51 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-5762f6b1-ead1-4689-9c0b-40b5dcf5cca3 tempest-VolumesDeleteCascade-1697863049 None] Acquiring lock "cinder-quobyte-7b0bd551-6d41-4e42-9ee2-d51cbebc4a52" by "_delete_snapshot" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:39:51 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-5762f6b1-ead1-4689-9c0b-40b5dcf5cca3 tempest-VolumesDeleteCascade-1697863049 None] Lock "cinder-quobyte-7b0bd551-6d41-4e42-9ee2-d51cbebc4a52" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:39:51 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-5762f6b1-ead1-4689-9c0b-40b5dcf5cca3 tempest-VolumesDeleteCascade-1697863049 None] Deleting offline snapshot 7b0bd551-6d41-4e42-9ee2-d51cbebc4a52 of volume 6c3134b1-aec6-4fad-bb5b-1c184fbc92b4 {{(pid=87329) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 06 06:39:51 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-5762f6b1-ead1-4689-9c0b-40b5dcf5cca3 tempest-VolumesDeleteCascade-1697863049 None] snapshot_file for this snap is: volume-6c3134b1-aec6-4fad-bb5b-1c184fbc92b4.7b0bd551-6d41-4e42-9ee2-d51cbebc4a52 {{(pid=87329) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 06 06:39:51 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[43217368-e2b7-4117-81f9-4514576da0c0]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:39:51 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-5762f6b1-ead1-4689-9c0b-40b5dcf5cca3 tempest-VolumesDeleteCascade-1697863049 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6c3134b1-aec6-4fad-bb5b-1c184fbc92b4.7b0bd551-6d41-4e42-9ee2-d51cbebc4a52 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:39:51 devstack sudo[97634]: pam_unix(sudo:session): session closed for user root Sep 06 06:39:51 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-42407d01-03e5-467d-a6b7-da5834ca1068 tempest-CreateVolumesFromSnapshotTest-1337710689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.435s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:39:51 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-42407d01-03e5-467d-a6b7-da5834ca1068 tempest-CreateVolumesFromSnapshotTest-1337710689 None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:39:51 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-42407d01-03e5-467d-a6b7-da5834ca1068 tempest-CreateVolumesFromSnapshotTest-1337710689 None] Deleted volume successfully. Sep 06 06:39:51 devstack sudo[97636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6c3134b1-aec6-4fad-bb5b-1c184fbc92b4.7b0bd551-6d41-4e42-9ee2-d51cbebc4a52 Sep 06 06:39:51 devstack sudo[97636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:39:51 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-42407d01-03e5-467d-a6b7-da5834ca1068 tempest-CreateVolumesFromSnapshotTest-1337710689 None] Lock "cinder-642b0aff-717c-4105-9f26-1d9ff28794b5-delete_volume" released by "delete_volume" :: held 1.869s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:39:51 devstack sudo[97636]: pam_unix(sudo:session): session closed for user root Sep 06 06:39:51 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-5762f6b1-ead1-4689-9c0b-40b5dcf5cca3 tempest-VolumesDeleteCascade-1697863049 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6c3134b1-aec6-4fad-bb5b-1c184fbc92b4.7b0bd551-6d41-4e42-9ee2-d51cbebc4a52" returned: 0 in 0.446s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:39:51 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-5762f6b1-ead1-4689-9c0b-40b5dcf5cca3 tempest-VolumesDeleteCascade-1697863049 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6c3134b1-aec6-4fad-bb5b-1c184fbc92b4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87329) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 06:39:51 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1493a15-005c-45c0-a8ba-81e6ece9eb20]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:39:51 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-5762f6b1-ead1-4689-9c0b-40b5dcf5cca3 tempest-VolumesDeleteCascade-1697863049 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6c3134b1-aec6-4fad-bb5b-1c184fbc92b4 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:39:51 devstack sudo[97642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6c3134b1-aec6-4fad-bb5b-1c184fbc92b4 Sep 06 06:39:51 devstack sudo[97642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:39:52 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-491a396f-371a-43f4-9a09-80b7e77160e9 tempest-CreateVolumesFromSnapshotTest-1337710689 None] Acquiring lock "cinder-0b69a6a3-bae3-45a0-b413-b3eb62531ed0-delete_snapshot" by "delete_snapshot" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:39:52 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-491a396f-371a-43f4-9a09-80b7e77160e9 tempest-CreateVolumesFromSnapshotTest-1337710689 None] Lock "cinder-0b69a6a3-bae3-45a0-b413-b3eb62531ed0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.062s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:39:52 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-491a396f-371a-43f4-9a09-80b7e77160e9 tempest-CreateVolumesFromSnapshotTest-1337710689 None] Acquiring lock "cinder-quobyte-11514717-d5a4-4e5e-8269-d526ed8dc3f0" by "delete_snapshot" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:39:52 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-491a396f-371a-43f4-9a09-80b7e77160e9 tempest-CreateVolumesFromSnapshotTest-1337710689 None] Lock "cinder-quobyte-11514717-d5a4-4e5e-8269-d526ed8dc3f0" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:39:52 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-491a396f-371a-43f4-9a09-80b7e77160e9 tempest-CreateVolumesFromSnapshotTest-1337710689 None] Acquiring lock "cinder-quobyte-0b69a6a3-bae3-45a0-b413-b3eb62531ed0" by "_delete_snapshot" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:39:52 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-491a396f-371a-43f4-9a09-80b7e77160e9 tempest-CreateVolumesFromSnapshotTest-1337710689 None] Lock "cinder-quobyte-0b69a6a3-bae3-45a0-b413-b3eb62531ed0" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:39:52 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-491a396f-371a-43f4-9a09-80b7e77160e9 tempest-CreateVolumesFromSnapshotTest-1337710689 None] Deleting offline snapshot 0b69a6a3-bae3-45a0-b413-b3eb62531ed0 of volume 11514717-d5a4-4e5e-8269-d526ed8dc3f0 {{(pid=87329) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 06 06:39:52 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-491a396f-371a-43f4-9a09-80b7e77160e9 tempest-CreateVolumesFromSnapshotTest-1337710689 None] snapshot_file for this snap is: volume-11514717-d5a4-4e5e-8269-d526ed8dc3f0.0b69a6a3-bae3-45a0-b413-b3eb62531ed0 {{(pid=87329) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 06 06:39:52 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b598163-3fdb-436f-8f44-c961d7b1c485]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:39:52 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-491a396f-371a-43f4-9a09-80b7e77160e9 tempest-CreateVolumesFromSnapshotTest-1337710689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-11514717-d5a4-4e5e-8269-d526ed8dc3f0.0b69a6a3-bae3-45a0-b413-b3eb62531ed0 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:39:52 devstack sudo[97644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-11514717-d5a4-4e5e-8269-d526ed8dc3f0.0b69a6a3-bae3-45a0-b413-b3eb62531ed0 Sep 06 06:39:52 devstack sudo[97644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:39:52 devstack sudo[97642]: pam_unix(sudo:session): session closed for user root Sep 06 06:39:52 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-5762f6b1-ead1-4689-9c0b-40b5dcf5cca3 tempest-VolumesDeleteCascade-1697863049 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6c3134b1-aec6-4fad-bb5b-1c184fbc92b4" returned: 0 in 0.504s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:39:52 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[414ce382-2773-45ad-b23d-4268cde548e3]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:39:52 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-5762f6b1-ead1-4689-9c0b-40b5dcf5cca3 tempest-VolumesDeleteCascade-1697863049 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6c3134b1-aec6-4fad-bb5b-1c184fbc92b4.ac6211dc-a548-404b-8331-feb393fabf7e {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:39:52 devstack sudo[97649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6c3134b1-aec6-4fad-bb5b-1c184fbc92b4.ac6211dc-a548-404b-8331-feb393fabf7e Sep 06 06:39:52 devstack sudo[97649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:39:52 devstack sudo[97644]: pam_unix(sudo:session): session closed for user root Sep 06 06:39:52 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-491a396f-371a-43f4-9a09-80b7e77160e9 tempest-CreateVolumesFromSnapshotTest-1337710689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-11514717-d5a4-4e5e-8269-d526ed8dc3f0.0b69a6a3-bae3-45a0-b413-b3eb62531ed0" returned: 0 in 0.539s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:39:52 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-491a396f-371a-43f4-9a09-80b7e77160e9 tempest-CreateVolumesFromSnapshotTest-1337710689 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-11514717-d5a4-4e5e-8269-d526ed8dc3f0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87329) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 06:39:52 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[75fe1f19-1cb0-4ef7-89f4-7676c3ededc1]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:39:52 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-491a396f-371a-43f4-9a09-80b7e77160e9 tempest-CreateVolumesFromSnapshotTest-1337710689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-11514717-d5a4-4e5e-8269-d526ed8dc3f0 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:39:52 devstack sudo[97649]: pam_unix(sudo:session): session closed for user root Sep 06 06:39:52 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-5762f6b1-ead1-4689-9c0b-40b5dcf5cca3 tempest-VolumesDeleteCascade-1697863049 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6c3134b1-aec6-4fad-bb5b-1c184fbc92b4.ac6211dc-a548-404b-8331-feb393fabf7e" returned: 0 in 0.419s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:39:52 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-5762f6b1-ead1-4689-9c0b-40b5dcf5cca3 tempest-VolumesDeleteCascade-1697863049 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6c3134b1-aec6-4fad-bb5b-1c184fbc92b4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87329) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 06:39:52 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[43cd7a55-cfca-423e-b5da-656a1ca1d6f9]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:39:52 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-5762f6b1-ead1-4689-9c0b-40b5dcf5cca3 tempest-VolumesDeleteCascade-1697863049 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6c3134b1-aec6-4fad-bb5b-1c184fbc92b4.7b0bd551-6d41-4e42-9ee2-d51cbebc4a52 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:39:52 devstack sudo[97658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-11514717-d5a4-4e5e-8269-d526ed8dc3f0 Sep 06 06:39:52 devstack sudo[97658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:39:52 devstack sudo[97659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6c3134b1-aec6-4fad-bb5b-1c184fbc92b4.7b0bd551-6d41-4e42-9ee2-d51cbebc4a52 Sep 06 06:39:52 devstack sudo[97659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:39:53 devstack sudo[97658]: pam_unix(sudo:session): session closed for user root Sep 06 06:39:53 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-491a396f-371a-43f4-9a09-80b7e77160e9 tempest-CreateVolumesFromSnapshotTest-1337710689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-11514717-d5a4-4e5e-8269-d526ed8dc3f0" returned: 0 in 0.430s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:39:53 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-491a396f-371a-43f4-9a09-80b7e77160e9 tempest-CreateVolumesFromSnapshotTest-1337710689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-11514717-d5a4-4e5e-8269-d526ed8dc3f0.0b69a6a3-bae3-45a0-b413-b3eb62531ed0 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:39:53 devstack sudo[97665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-11514717-d5a4-4e5e-8269-d526ed8dc3f0.0b69a6a3-bae3-45a0-b413-b3eb62531ed0 Sep 06 06:39:53 devstack sudo[97665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:39:53 devstack sudo[97659]: pam_unix(sudo:session): session closed for user root Sep 06 06:39:53 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-5762f6b1-ead1-4689-9c0b-40b5dcf5cca3 tempest-VolumesDeleteCascade-1697863049 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6c3134b1-aec6-4fad-bb5b-1c184fbc92b4.7b0bd551-6d41-4e42-9ee2-d51cbebc4a52" returned: 0 in 0.486s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:39:53 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-5762f6b1-ead1-4689-9c0b-40b5dcf5cca3 tempest-VolumesDeleteCascade-1697863049 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6c3134b1-aec6-4fad-bb5b-1c184fbc92b4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87329) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 06:39:53 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c19fd48-9a48-46dc-88df-3f057f5fdcfc]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:39:53 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-5762f6b1-ead1-4689-9c0b-40b5dcf5cca3 tempest-VolumesDeleteCascade-1697863049 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6c3134b1-aec6-4fad-bb5b-1c184fbc92b4 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:39:53 devstack sudo[97670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6c3134b1-aec6-4fad-bb5b-1c184fbc92b4 Sep 06 06:39:53 devstack sudo[97670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:39:53 devstack sudo[97665]: pam_unix(sudo:session): session closed for user root Sep 06 06:39:53 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-491a396f-371a-43f4-9a09-80b7e77160e9 tempest-CreateVolumesFromSnapshotTest-1337710689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-11514717-d5a4-4e5e-8269-d526ed8dc3f0.0b69a6a3-bae3-45a0-b413-b3eb62531ed0" returned: 0 in 0.406s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:39:53 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-491a396f-371a-43f4-9a09-80b7e77160e9 tempest-CreateVolumesFromSnapshotTest-1337710689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-11514717-d5a4-4e5e-8269-d526ed8dc3f0.0b69a6a3-bae3-45a0-b413-b3eb62531ed0 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:39:53 devstack sudo[97675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-11514717-d5a4-4e5e-8269-d526ed8dc3f0.0b69a6a3-bae3-45a0-b413-b3eb62531ed0 Sep 06 06:39:53 devstack sudo[97675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:39:53 devstack sudo[97670]: pam_unix(sudo:session): session closed for user root Sep 06 06:39:53 devstack sudo[97675]: pam_unix(sudo:session): session closed for user root Sep 06 06:39:53 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-5762f6b1-ead1-4689-9c0b-40b5dcf5cca3 tempest-VolumesDeleteCascade-1697863049 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6c3134b1-aec6-4fad-bb5b-1c184fbc92b4" returned: 0 in 0.499s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:39:53 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-5762f6b1-ead1-4689-9c0b-40b5dcf5cca3 tempest-VolumesDeleteCascade-1697863049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6c3134b1-aec6-4fad-bb5b-1c184fbc92b4.7b0bd551-6d41-4e42-9ee2-d51cbebc4a52 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:39:53 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-491a396f-371a-43f4-9a09-80b7e77160e9 tempest-CreateVolumesFromSnapshotTest-1337710689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-11514717-d5a4-4e5e-8269-d526ed8dc3f0.0b69a6a3-bae3-45a0-b413-b3eb62531ed0" returned: 0 in 0.267s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:39:53 devstack sudo[97681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6c3134b1-aec6-4fad-bb5b-1c184fbc92b4.7b0bd551-6d41-4e42-9ee2-d51cbebc4a52 Sep 06 06:39:53 devstack sudo[97681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:39:53 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-491a396f-371a-43f4-9a09-80b7e77160e9 tempest-CreateVolumesFromSnapshotTest-1337710689 None] Lock "cinder-quobyte-0b69a6a3-bae3-45a0-b413-b3eb62531ed0" released by "_delete_snapshot" :: held 1.775s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:39:53 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-491a396f-371a-43f4-9a09-80b7e77160e9 tempest-CreateVolumesFromSnapshotTest-1337710689 None] Lock "cinder-quobyte-11514717-d5a4-4e5e-8269-d526ed8dc3f0" released by "delete_snapshot" :: held 1.805s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:39:53 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-491a396f-371a-43f4-9a09-80b7e77160e9 tempest-CreateVolumesFromSnapshotTest-1337710689 None] Created reservations ['627ac37f-0fd2-4b6d-9b8b-1cfb893631f3', 'ecd41ea3-b585-4dfc-b107-d41bfe7831f9', '021dd6bc-bf39-4064-abc1-158b1ba95747', '280aedc3-dd88-4f7e-b4ee-224c04392f1b'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:39:54 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-491a396f-371a-43f4-9a09-80b7e77160e9 tempest-CreateVolumesFromSnapshotTest-1337710689 None] Delete snapshot completed successfully. Sep 06 06:39:54 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-491a396f-371a-43f4-9a09-80b7e77160e9 tempest-CreateVolumesFromSnapshotTest-1337710689 None] Lock "cinder-0b69a6a3-bae3-45a0-b413-b3eb62531ed0-delete_snapshot" released by "delete_snapshot" :: held 2.033s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:39:54 devstack sudo[97681]: pam_unix(sudo:session): session closed for user root Sep 06 06:39:54 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-c696a3ba-5f9f-4f4e-9853-7555146378d4 tempest-CreateVolumesFromSnapshotTest-1337710689 None] Acquiring lock "cinder-11514717-d5a4-4e5e-8269-d526ed8dc3f0-delete_volume" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:39:54 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-5762f6b1-ead1-4689-9c0b-40b5dcf5cca3 tempest-VolumesDeleteCascade-1697863049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6c3134b1-aec6-4fad-bb5b-1c184fbc92b4.7b0bd551-6d41-4e42-9ee2-d51cbebc4a52" returned: 0 in 0.429s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:39:54 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-5762f6b1-ead1-4689-9c0b-40b5dcf5cca3 tempest-VolumesDeleteCascade-1697863049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6c3134b1-aec6-4fad-bb5b-1c184fbc92b4.7b0bd551-6d41-4e42-9ee2-d51cbebc4a52 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:39:54 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-c696a3ba-5f9f-4f4e-9853-7555146378d4 tempest-CreateVolumesFromSnapshotTest-1337710689 None] Lock "cinder-11514717-d5a4-4e5e-8269-d526ed8dc3f0-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:39:54 devstack sudo[97686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6c3134b1-aec6-4fad-bb5b-1c184fbc92b4.7b0bd551-6d41-4e42-9ee2-d51cbebc4a52 Sep 06 06:39:54 devstack sudo[97686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:39:54 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-c696a3ba-5f9f-4f4e-9853-7555146378d4 tempest-CreateVolumesFromSnapshotTest-1337710689 None] Acquiring lock "cinder-quobyte-11514717-d5a4-4e5e-8269-d526ed8dc3f0" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:39:54 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-c696a3ba-5f9f-4f4e-9853-7555146378d4 tempest-CreateVolumesFromSnapshotTest-1337710689 None] Lock "cinder-quobyte-11514717-d5a4-4e5e-8269-d526ed8dc3f0" acquired by "delete_volume" :: waited 0.029s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:39:54 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[009497e5-2baf-4e55-bd67-2e695ea3f7e9]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:39:54 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-c696a3ba-5f9f-4f4e-9853-7555146378d4 tempest-CreateVolumesFromSnapshotTest-1337710689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-11514717-d5a4-4e5e-8269-d526ed8dc3f0 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:39:54 devstack sudo[97686]: pam_unix(sudo:session): session closed for user root Sep 06 06:39:54 devstack sudo[97688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-11514717-d5a4-4e5e-8269-d526ed8dc3f0 Sep 06 06:39:54 devstack sudo[97688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:39:54 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-5762f6b1-ead1-4689-9c0b-40b5dcf5cca3 tempest-VolumesDeleteCascade-1697863049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6c3134b1-aec6-4fad-bb5b-1c184fbc92b4.7b0bd551-6d41-4e42-9ee2-d51cbebc4a52" returned: 0 in 0.405s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:39:54 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-5762f6b1-ead1-4689-9c0b-40b5dcf5cca3 tempest-VolumesDeleteCascade-1697863049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c3134b1-aec6-4fad-bb5b-1c184fbc92b4 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6c3134b1-aec6-4fad-bb5b-1c184fbc92b4.ac6211dc-a548-404b-8331-feb393fabf7e -F qcow2 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:39:54 devstack sudo[97691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c3134b1-aec6-4fad-bb5b-1c184fbc92b4 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6c3134b1-aec6-4fad-bb5b-1c184fbc92b4.ac6211dc-a548-404b-8331-feb393fabf7e -F qcow2 Sep 06 06:39:54 devstack sudo[97691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:39:54 devstack sudo[97688]: pam_unix(sudo:session): session closed for user root Sep 06 06:39:54 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-c696a3ba-5f9f-4f4e-9853-7555146378d4 tempest-CreateVolumesFromSnapshotTest-1337710689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-11514717-d5a4-4e5e-8269-d526ed8dc3f0" returned: 0 in 0.523s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:39:54 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-c696a3ba-5f9f-4f4e-9853-7555146378d4 tempest-CreateVolumesFromSnapshotTest-1337710689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-11514717-d5a4-4e5e-8269-d526ed8dc3f0 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:39:54 devstack sudo[97691]: pam_unix(sudo:session): session closed for user root Sep 06 06:39:54 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-5762f6b1-ead1-4689-9c0b-40b5dcf5cca3 tempest-VolumesDeleteCascade-1697863049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c3134b1-aec6-4fad-bb5b-1c184fbc92b4 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6c3134b1-aec6-4fad-bb5b-1c184fbc92b4.ac6211dc-a548-404b-8331-feb393fabf7e -F qcow2" returned: 0 in 0.331s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:39:55 devstack sudo[97700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-11514717-d5a4-4e5e-8269-d526ed8dc3f0 Sep 06 06:39:55 devstack sudo[97700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:39:55 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-5762f6b1-ead1-4689-9c0b-40b5dcf5cca3 tempest-VolumesDeleteCascade-1697863049 None] Lock "cinder-quobyte-7b0bd551-6d41-4e42-9ee2-d51cbebc4a52" released by "_delete_snapshot" :: held 3.702s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:39:55 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-5762f6b1-ead1-4689-9c0b-40b5dcf5cca3 tempest-VolumesDeleteCascade-1697863049 None] Lock "cinder-quobyte-6c3134b1-aec6-4fad-bb5b-1c184fbc92b4" released by "delete_snapshot" :: held 3.738s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:39:55 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-5762f6b1-ead1-4689-9c0b-40b5dcf5cca3 tempest-VolumesDeleteCascade-1697863049 None] Created reservations ['f1a9e560-f8a9-4798-a1a9-63dc5043eafa', 'a149eb65-57b3-4bec-854c-5a25ef66a47b', '5d318990-1c8a-455f-baf6-0cb21c0102e9', '62890ab3-ef29-4cb2-8133-186518657aa5'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:39:55 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-5762f6b1-ead1-4689-9c0b-40b5dcf5cca3 tempest-VolumesDeleteCascade-1697863049 None] Delete snapshot completed successfully. Sep 06 06:39:55 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-5762f6b1-ead1-4689-9c0b-40b5dcf5cca3 tempest-VolumesDeleteCascade-1697863049 None] Lock "cinder-7b0bd551-6d41-4e42-9ee2-d51cbebc4a52-delete_snapshot" released by "delete_snapshot" :: held 3.931s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:39:55 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-5762f6b1-ead1-4689-9c0b-40b5dcf5cca3 tempest-VolumesDeleteCascade-1697863049 None] Acquiring lock "cinder-ac6211dc-a548-404b-8331-feb393fabf7e-delete_snapshot" by "delete_snapshot" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:39:55 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-5762f6b1-ead1-4689-9c0b-40b5dcf5cca3 tempest-VolumesDeleteCascade-1697863049 None] Lock "cinder-ac6211dc-a548-404b-8331-feb393fabf7e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:39:55 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-5762f6b1-ead1-4689-9c0b-40b5dcf5cca3 tempest-VolumesDeleteCascade-1697863049 None] Acquiring lock "cinder-quobyte-6c3134b1-aec6-4fad-bb5b-1c184fbc92b4" by "delete_snapshot" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:39:55 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-5762f6b1-ead1-4689-9c0b-40b5dcf5cca3 tempest-VolumesDeleteCascade-1697863049 None] Lock "cinder-quobyte-6c3134b1-aec6-4fad-bb5b-1c184fbc92b4" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:39:55 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-5762f6b1-ead1-4689-9c0b-40b5dcf5cca3 tempest-VolumesDeleteCascade-1697863049 None] Acquiring lock "cinder-quobyte-ac6211dc-a548-404b-8331-feb393fabf7e" by "_delete_snapshot" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:39:55 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-5762f6b1-ead1-4689-9c0b-40b5dcf5cca3 tempest-VolumesDeleteCascade-1697863049 None] Lock "cinder-quobyte-ac6211dc-a548-404b-8331-feb393fabf7e" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:39:55 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-5762f6b1-ead1-4689-9c0b-40b5dcf5cca3 tempest-VolumesDeleteCascade-1697863049 None] Deleting offline snapshot ac6211dc-a548-404b-8331-feb393fabf7e of volume 6c3134b1-aec6-4fad-bb5b-1c184fbc92b4 {{(pid=87329) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 06 06:39:55 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-5762f6b1-ead1-4689-9c0b-40b5dcf5cca3 tempest-VolumesDeleteCascade-1697863049 None] snapshot_file for this snap is: volume-6c3134b1-aec6-4fad-bb5b-1c184fbc92b4.ac6211dc-a548-404b-8331-feb393fabf7e {{(pid=87329) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 06 06:39:55 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[42ada059-797e-4878-b58e-105b6554fb6c]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:39:55 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-5762f6b1-ead1-4689-9c0b-40b5dcf5cca3 tempest-VolumesDeleteCascade-1697863049 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6c3134b1-aec6-4fad-bb5b-1c184fbc92b4.ac6211dc-a548-404b-8331-feb393fabf7e {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:39:55 devstack sudo[97700]: pam_unix(sudo:session): session closed for user root Sep 06 06:39:55 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-c696a3ba-5f9f-4f4e-9853-7555146378d4 tempest-CreateVolumesFromSnapshotTest-1337710689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-11514717-d5a4-4e5e-8269-d526ed8dc3f0" returned: 0 in 0.376s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:39:55 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-c696a3ba-5f9f-4f4e-9853-7555146378d4 tempest-CreateVolumesFromSnapshotTest-1337710689 None] Lock "cinder-quobyte-11514717-d5a4-4e5e-8269-d526ed8dc3f0" released by "delete_volume" :: held 1.003s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:39:55 devstack sudo[97703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6c3134b1-aec6-4fad-bb5b-1c184fbc92b4.ac6211dc-a548-404b-8331-feb393fabf7e Sep 06 06:39:55 devstack sudo[97703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:39:55 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-c696a3ba-5f9f-4f4e-9853-7555146378d4 tempest-CreateVolumesFromSnapshotTest-1337710689 None] Created reservations ['07377d2a-3071-4660-bcaf-29f5f9ce5bc3', '2a1d8da7-8883-42ce-b3e1-bba8cdb44c90', 'f3e6513c-db16-42d2-941a-439319d25553', 'ad4d450e-6d07-49e9-b01e-84ae0e432a04'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:39:55 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-c696a3ba-5f9f-4f4e-9853-7555146378d4 tempest-CreateVolumesFromSnapshotTest-1337710689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:39:55 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-c696a3ba-5f9f-4f4e-9853-7555146378d4 tempest-CreateVolumesFromSnapshotTest-1337710689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:39:55 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-c696a3ba-5f9f-4f4e-9853-7555146378d4 tempest-CreateVolumesFromSnapshotTest-1337710689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:39:55 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-c696a3ba-5f9f-4f4e-9853-7555146378d4 tempest-CreateVolumesFromSnapshotTest-1337710689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:39:55 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-c696a3ba-5f9f-4f4e-9853-7555146378d4 tempest-CreateVolumesFromSnapshotTest-1337710689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:39:55 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-c696a3ba-5f9f-4f4e-9853-7555146378d4 tempest-CreateVolumesFromSnapshotTest-1337710689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:39:55 devstack sudo[97705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:39:55 devstack sudo[97705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:39:55 devstack sudo[97703]: pam_unix(sudo:session): session closed for user root Sep 06 06:39:55 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-5762f6b1-ead1-4689-9c0b-40b5dcf5cca3 tempest-VolumesDeleteCascade-1697863049 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6c3134b1-aec6-4fad-bb5b-1c184fbc92b4.ac6211dc-a548-404b-8331-feb393fabf7e" returned: 0 in 0.519s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:39:55 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-5762f6b1-ead1-4689-9c0b-40b5dcf5cca3 tempest-VolumesDeleteCascade-1697863049 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6c3134b1-aec6-4fad-bb5b-1c184fbc92b4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87329) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 06:39:55 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[a310d1c0-adcb-44e5-838f-952d4fa39eb8]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:39:55 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-5762f6b1-ead1-4689-9c0b-40b5dcf5cca3 tempest-VolumesDeleteCascade-1697863049 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6c3134b1-aec6-4fad-bb5b-1c184fbc92b4 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:39:55 devstack sudo[97705]: pam_unix(sudo:session): session closed for user root Sep 06 06:39:55 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-c696a3ba-5f9f-4f4e-9853-7555146378d4 tempest-CreateVolumesFromSnapshotTest-1337710689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.314s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:39:55 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-c696a3ba-5f9f-4f4e-9853-7555146378d4 tempest-CreateVolumesFromSnapshotTest-1337710689 None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:39:55 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-c696a3ba-5f9f-4f4e-9853-7555146378d4 tempest-CreateVolumesFromSnapshotTest-1337710689 None] Deleted volume successfully. Sep 06 06:39:55 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-c696a3ba-5f9f-4f4e-9853-7555146378d4 tempest-CreateVolumesFromSnapshotTest-1337710689 None] Lock "cinder-11514717-d5a4-4e5e-8269-d526ed8dc3f0-delete_volume" released by "delete_volume" :: held 1.680s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:39:56 devstack sudo[97711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6c3134b1-aec6-4fad-bb5b-1c184fbc92b4 Sep 06 06:39:56 devstack sudo[97711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:39:56 devstack sudo[97711]: pam_unix(sudo:session): session closed for user root Sep 06 06:39:56 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-5762f6b1-ead1-4689-9c0b-40b5dcf5cca3 tempest-VolumesDeleteCascade-1697863049 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6c3134b1-aec6-4fad-bb5b-1c184fbc92b4" returned: 0 in 0.386s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:39:56 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-5762f6b1-ead1-4689-9c0b-40b5dcf5cca3 tempest-VolumesDeleteCascade-1697863049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6c3134b1-aec6-4fad-bb5b-1c184fbc92b4.ac6211dc-a548-404b-8331-feb393fabf7e {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:39:56 devstack sudo[97716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6c3134b1-aec6-4fad-bb5b-1c184fbc92b4.ac6211dc-a548-404b-8331-feb393fabf7e Sep 06 06:39:56 devstack sudo[97716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:39:56 devstack sudo[97716]: pam_unix(sudo:session): session closed for user root Sep 06 06:39:56 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-5762f6b1-ead1-4689-9c0b-40b5dcf5cca3 tempest-VolumesDeleteCascade-1697863049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6c3134b1-aec6-4fad-bb5b-1c184fbc92b4.ac6211dc-a548-404b-8331-feb393fabf7e" returned: 0 in 0.389s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:39:56 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-5762f6b1-ead1-4689-9c0b-40b5dcf5cca3 tempest-VolumesDeleteCascade-1697863049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6c3134b1-aec6-4fad-bb5b-1c184fbc92b4.ac6211dc-a548-404b-8331-feb393fabf7e {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:39:56 devstack sudo[97721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6c3134b1-aec6-4fad-bb5b-1c184fbc92b4.ac6211dc-a548-404b-8331-feb393fabf7e Sep 06 06:39:56 devstack sudo[97721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:39:57 devstack sudo[97721]: pam_unix(sudo:session): session closed for user root Sep 06 06:39:57 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-5762f6b1-ead1-4689-9c0b-40b5dcf5cca3 tempest-VolumesDeleteCascade-1697863049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6c3134b1-aec6-4fad-bb5b-1c184fbc92b4.ac6211dc-a548-404b-8331-feb393fabf7e" returned: 0 in 0.401s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:39:57 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-5762f6b1-ead1-4689-9c0b-40b5dcf5cca3 tempest-VolumesDeleteCascade-1697863049 None] Lock "cinder-quobyte-ac6211dc-a548-404b-8331-feb393fabf7e" released by "_delete_snapshot" :: held 1.814s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:39:57 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-5762f6b1-ead1-4689-9c0b-40b5dcf5cca3 tempest-VolumesDeleteCascade-1697863049 None] Lock "cinder-quobyte-6c3134b1-aec6-4fad-bb5b-1c184fbc92b4" released by "delete_snapshot" :: held 1.849s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:39:57 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-5762f6b1-ead1-4689-9c0b-40b5dcf5cca3 tempest-VolumesDeleteCascade-1697863049 None] Created reservations ['62b20fe5-0e71-45b4-ba14-dda977abb836', '8afdab8b-50b0-4d7f-b2cb-459a4e2b97ac', '4facb5e2-4345-487c-85a2-1ff06e278986', 'a5efcc5b-b52f-4d35-aa5d-74641ef101a9'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:39:57 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-5762f6b1-ead1-4689-9c0b-40b5dcf5cca3 tempest-VolumesDeleteCascade-1697863049 None] Delete snapshot completed successfully. Sep 06 06:39:57 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-5762f6b1-ead1-4689-9c0b-40b5dcf5cca3 tempest-VolumesDeleteCascade-1697863049 None] Lock "cinder-ac6211dc-a548-404b-8331-feb393fabf7e-delete_snapshot" released by "delete_snapshot" :: held 2.111s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:39:57 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-5762f6b1-ead1-4689-9c0b-40b5dcf5cca3 tempest-VolumesDeleteCascade-1697863049 None] Snapshots deleted, issuing volume delete {{(pid=87329) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 06 06:39:57 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-5762f6b1-ead1-4689-9c0b-40b5dcf5cca3 tempest-VolumesDeleteCascade-1697863049 None] Acquiring lock "cinder-quobyte-6c3134b1-aec6-4fad-bb5b-1c184fbc92b4" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:39:57 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-5762f6b1-ead1-4689-9c0b-40b5dcf5cca3 tempest-VolumesDeleteCascade-1697863049 None] Lock "cinder-quobyte-6c3134b1-aec6-4fad-bb5b-1c184fbc92b4" acquired by "delete_volume" :: waited 0.029s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:39:57 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[d92619ed-6ad0-4bd8-800e-af2ca23c11c3]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:39:57 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-5762f6b1-ead1-4689-9c0b-40b5dcf5cca3 tempest-VolumesDeleteCascade-1697863049 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6c3134b1-aec6-4fad-bb5b-1c184fbc92b4 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:39:57 devstack sudo[97731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6c3134b1-aec6-4fad-bb5b-1c184fbc92b4 Sep 06 06:39:57 devstack sudo[97731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:39:57 devstack sudo[97731]: pam_unix(sudo:session): session closed for user root Sep 06 06:39:57 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-5762f6b1-ead1-4689-9c0b-40b5dcf5cca3 tempest-VolumesDeleteCascade-1697863049 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6c3134b1-aec6-4fad-bb5b-1c184fbc92b4" returned: 0 in 0.516s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:39:57 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-5762f6b1-ead1-4689-9c0b-40b5dcf5cca3 tempest-VolumesDeleteCascade-1697863049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6c3134b1-aec6-4fad-bb5b-1c184fbc92b4 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:39:57 devstack sudo[97762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6c3134b1-aec6-4fad-bb5b-1c184fbc92b4 Sep 06 06:39:57 devstack sudo[97762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:39:58 devstack sudo[97762]: pam_unix(sudo:session): session closed for user root Sep 06 06:39:58 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-5762f6b1-ead1-4689-9c0b-40b5dcf5cca3 tempest-VolumesDeleteCascade-1697863049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6c3134b1-aec6-4fad-bb5b-1c184fbc92b4" returned: 0 in 0.343s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:39:58 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-5762f6b1-ead1-4689-9c0b-40b5dcf5cca3 tempest-VolumesDeleteCascade-1697863049 None] Lock "cinder-quobyte-6c3134b1-aec6-4fad-bb5b-1c184fbc92b4" released by "delete_volume" :: held 0.938s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:39:58 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-5762f6b1-ead1-4689-9c0b-40b5dcf5cca3 tempest-VolumesDeleteCascade-1697863049 None] Created reservations ['8bea7543-6003-4e8d-b6df-b0599e6235f6', '33b08b37-ee58-4c92-a4eb-37da5fef2e18', '20fab34f-dec9-4a28-9982-aa1489bfacdf', '7050ecde-228c-4e9a-a077-152d2584ae96'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:39:58 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-5762f6b1-ead1-4689-9c0b-40b5dcf5cca3 tempest-VolumesDeleteCascade-1697863049 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:39:58 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-5762f6b1-ead1-4689-9c0b-40b5dcf5cca3 tempest-VolumesDeleteCascade-1697863049 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:39:58 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-5762f6b1-ead1-4689-9c0b-40b5dcf5cca3 tempest-VolumesDeleteCascade-1697863049 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:39:58 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-5762f6b1-ead1-4689-9c0b-40b5dcf5cca3 tempest-VolumesDeleteCascade-1697863049 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:39:58 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-5762f6b1-ead1-4689-9c0b-40b5dcf5cca3 tempest-VolumesDeleteCascade-1697863049 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:39:58 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-5762f6b1-ead1-4689-9c0b-40b5dcf5cca3 tempest-VolumesDeleteCascade-1697863049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:39:58 devstack sudo[97765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:39:58 devstack sudo[97765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:39:58 devstack sudo[97765]: pam_unix(sudo:session): session closed for user root Sep 06 06:39:58 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-5762f6b1-ead1-4689-9c0b-40b5dcf5cca3 tempest-VolumesDeleteCascade-1697863049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.263s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:39:58 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-5762f6b1-ead1-4689-9c0b-40b5dcf5cca3 tempest-VolumesDeleteCascade-1697863049 None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:39:58 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-5762f6b1-ead1-4689-9c0b-40b5dcf5cca3 tempest-VolumesDeleteCascade-1697863049 None] Deleted volume successfully. Sep 06 06:39:58 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-5762f6b1-ead1-4689-9c0b-40b5dcf5cca3 tempest-VolumesDeleteCascade-1697863049 None] Lock "cinder-6c3134b1-aec6-4fad-bb5b-1c184fbc92b4-delete_volume" released by "delete_volume" :: held 7.596s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:40:00 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f7e73fe-4a3e-40ae-b0cb-694355db12c0 tempest-VolumesDeleteCascade-1697863049 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87329) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 06:40:00 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-3f7e73fe-4a3e-40ae-b0cb-694355db12c0 tempest-VolumesDeleteCascade-1697863049 None] Flow 'volume_create_manager' (29f429c7-dd00-48c4-aeca-129efd5adb16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:40:00 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-3f7e73fe-4a3e-40ae-b0cb-694355db12c0 tempest-VolumesDeleteCascade-1697863049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1198cbe2-98e1-46d7-9069-8e66ea0d84fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:40:00 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-3f7e73fe-4a3e-40ae-b0cb-694355db12c0 tempest-VolumesDeleteCascade-1697863049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1198cbe2-98e1-46d7-9069-8e66ea0d84fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:40:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-982825102',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03df205b-744d-4e5c-bb3c-31a03b1a4dbd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80ea58b259f149e7ada783971acdfcb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:40:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:40:00Z,use_quota=True,user_id='50b5313700b94db385ea112cc128b1a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:40:00 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-3f7e73fe-4a3e-40ae-b0cb-694355db12c0 tempest-VolumesDeleteCascade-1697863049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b76d762-643a-4770-aca9-35a78c5ce7fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:40:00 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-3f7e73fe-4a3e-40ae-b0cb-694355db12c0 tempest-VolumesDeleteCascade-1697863049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b76d762-643a-4770-aca9-35a78c5ce7fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:40:00 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-3f7e73fe-4a3e-40ae-b0cb-694355db12c0 tempest-VolumesDeleteCascade-1697863049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cdaaab21-7518-4884-89be-ec377ca8e7b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:40:00 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-3f7e73fe-4a3e-40ae-b0cb-694355db12c0 tempest-VolumesDeleteCascade-1697863049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cdaaab21-7518-4884-89be-ec377ca8e7b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03df205b-744d-4e5c-bb3c-31a03b1a4dbd', 'volume_name': 'volume-03df205b-744d-4e5c-bb3c-31a03b1a4dbd', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:40:00 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-3f7e73fe-4a3e-40ae-b0cb-694355db12c0 tempest-VolumesDeleteCascade-1697863049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (297ceef0-0e20-41d0-8f45-fc8592e135e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:40:00 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-3f7e73fe-4a3e-40ae-b0cb-694355db12c0 tempest-VolumesDeleteCascade-1697863049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (297ceef0-0e20-41d0-8f45-fc8592e135e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:40:00 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-3f7e73fe-4a3e-40ae-b0cb-694355db12c0 tempest-VolumesDeleteCascade-1697863049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38ead9b1-078d-427b-8ff2-a743db1a0541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:40:00 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-3f7e73fe-4a3e-40ae-b0cb-694355db12c0 tempest-VolumesDeleteCascade-1697863049 None] Volume 03df205b-744d-4e5c-bb3c-31a03b1a4dbd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03df205b-744d-4e5c-bb3c-31a03b1a4dbd', 'volume_size': 1} Sep 06 06:40:00 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-3f7e73fe-4a3e-40ae-b0cb-694355db12c0 tempest-VolumesDeleteCascade-1697863049 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:40:00 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-3f7e73fe-4a3e-40ae-b0cb-694355db12c0 tempest-VolumesDeleteCascade-1697863049 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:40:00 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-3f7e73fe-4a3e-40ae-b0cb-694355db12c0 tempest-VolumesDeleteCascade-1697863049 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:40:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-982825102',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03df205b-744d-4e5c-bb3c-31a03b1a4dbd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80ea58b259f149e7ada783971acdfcb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:40:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:40:00Z,use_quota=True,user_id='50b5313700b94db385ea112cc128b1a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)}" {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 06:40:00 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-3f7e73fe-4a3e-40ae-b0cb-694355db12c0 tempest-VolumesDeleteCascade-1697863049 None] Creating volume 03df205b-744d-4e5c-bb3c-31a03b1a4dbd {{(pid=87329) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 06:40:00 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-3f7e73fe-4a3e-40ae-b0cb-694355db12c0 tempest-VolumesDeleteCascade-1697863049 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:40:00 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-3f7e73fe-4a3e-40ae-b0cb-694355db12c0 tempest-VolumesDeleteCascade-1697863049 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:40:00 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-3f7e73fe-4a3e-40ae-b0cb-694355db12c0 tempest-VolumesDeleteCascade-1697863049 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:40:00 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-3f7e73fe-4a3e-40ae-b0cb-694355db12c0 tempest-VolumesDeleteCascade-1697863049 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:40:00 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-3f7e73fe-4a3e-40ae-b0cb-694355db12c0 tempest-VolumesDeleteCascade-1697863049 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:40:00 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-3f7e73fe-4a3e-40ae-b0cb-694355db12c0 tempest-VolumesDeleteCascade-1697863049 None] Selected osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 as target Quobyte volume. {{(pid=87329) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 06:40:00 devstack cinder-volume[87329]: INFO cinder.volume.drivers.remotefs [None req-3f7e73fe-4a3e-40ae-b0cb-694355db12c0 tempest-VolumesDeleteCascade-1697863049 None] casted to osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 Sep 06 06:40:00 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-3f7e73fe-4a3e-40ae-b0cb-694355db12c0 tempest-VolumesDeleteCascade-1697863049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-03df205b-744d-4e5c-bb3c-31a03b1a4dbd 1073741824 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:40:00 devstack sudo[97769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-03df205b-744d-4e5c-bb3c-31a03b1a4dbd 1073741824 Sep 06 06:40:00 devstack sudo[97769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:40:00 devstack sudo[97769]: pam_unix(sudo:session): session closed for user root Sep 06 06:40:00 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-3f7e73fe-4a3e-40ae-b0cb-694355db12c0 tempest-VolumesDeleteCascade-1697863049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-03df205b-744d-4e5c-bb3c-31a03b1a4dbd 1073741824" returned: 0 in 0.470s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:40:00 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-3f7e73fe-4a3e-40ae-b0cb-694355db12c0 tempest-VolumesDeleteCascade-1697863049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-03df205b-744d-4e5c-bb3c-31a03b1a4dbd {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:40:00 devstack sudo[97775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-03df205b-744d-4e5c-bb3c-31a03b1a4dbd Sep 06 06:40:00 devstack sudo[97775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:40:00 devstack sudo[97775]: pam_unix(sudo:session): session closed for user root Sep 06 06:40:00 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-3f7e73fe-4a3e-40ae-b0cb-694355db12c0 tempest-VolumesDeleteCascade-1697863049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-03df205b-744d-4e5c-bb3c-31a03b1a4dbd" returned: 0 in 0.305s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:40:00 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-3f7e73fe-4a3e-40ae-b0cb-694355db12c0 tempest-VolumesDeleteCascade-1697863049 None] <== create_volume: return (839ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'} {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 06:40:00 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-3f7e73fe-4a3e-40ae-b0cb-694355db12c0 tempest-VolumesDeleteCascade-1697863049 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.842s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:40:01 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-3f7e73fe-4a3e-40ae-b0cb-694355db12c0 tempest-VolumesDeleteCascade-1697863049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38ead9b1-078d-427b-8ff2-a743db1a0541) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03df205b-744d-4e5c-bb3c-31a03b1a4dbd', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:40:01 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-3f7e73fe-4a3e-40ae-b0cb-694355db12c0 tempest-VolumesDeleteCascade-1697863049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a740abc-c2e3-4506-8aee-2eea49d195d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:40:01 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-3f7e73fe-4a3e-40ae-b0cb-694355db12c0 tempest-VolumesDeleteCascade-1697863049 None] Volume volume-03df205b-744d-4e5c-bb3c-31a03b1a4dbd (03df205b-744d-4e5c-bb3c-31a03b1a4dbd): created successfully Sep 06 06:40:01 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-3f7e73fe-4a3e-40ae-b0cb-694355db12c0 tempest-VolumesDeleteCascade-1697863049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a740abc-c2e3-4506-8aee-2eea49d195d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:40:01 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-3f7e73fe-4a3e-40ae-b0cb-694355db12c0 tempest-VolumesDeleteCascade-1697863049 None] Flow 'volume_create_manager' (29f429c7-dd00-48c4-aeca-129efd5adb16) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:40:01 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-3f7e73fe-4a3e-40ae-b0cb-694355db12c0 tempest-VolumesDeleteCascade-1697863049 None] Created volume successfully. Sep 06 06:40:02 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-9fd80911-5966-4e00-b3e2-3c85beb99d52 tempest-VolumesDeleteCascade-1697863049 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:40:02 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-9fd80911-5966-4e00-b3e2-3c85beb99d52 tempest-VolumesDeleteCascade-1697863049 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:40:02 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-9fd80911-5966-4e00-b3e2-3c85beb99d52 tempest-VolumesDeleteCascade-1697863049 None] Creating offline snapshot 14d88ca9-1942-4a31-9a3b-715f56524bb9 of volume 03df205b-744d-4e5c-bb3c-31a03b1a4dbd {{(pid=87329) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 06 06:40:02 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[6717318e-7e20-40d8-955f-34ff44379465]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:40:02 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-9fd80911-5966-4e00-b3e2-3c85beb99d52 tempest-VolumesDeleteCascade-1697863049 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-03df205b-744d-4e5c-bb3c-31a03b1a4dbd {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:40:02 devstack sudo[97780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-03df205b-744d-4e5c-bb3c-31a03b1a4dbd Sep 06 06:40:02 devstack sudo[97780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:40:02 devstack sudo[97780]: pam_unix(sudo:session): session closed for user root Sep 06 06:40:02 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-9fd80911-5966-4e00-b3e2-3c85beb99d52 tempest-VolumesDeleteCascade-1697863049 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-03df205b-744d-4e5c-bb3c-31a03b1a4dbd" returned: 0 in 0.383s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:40:02 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-9fd80911-5966-4e00-b3e2-3c85beb99d52 tempest-VolumesDeleteCascade-1697863049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-03df205b-744d-4e5c-bb3c-31a03b1a4dbd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-03df205b-744d-4e5c-bb3c-31a03b1a4dbd.14d88ca9-1942-4a31-9a3b-715f56524bb9 1G {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:40:02 devstack sudo[97785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-03df205b-744d-4e5c-bb3c-31a03b1a4dbd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-03df205b-744d-4e5c-bb3c-31a03b1a4dbd.14d88ca9-1942-4a31-9a3b-715f56524bb9 1G Sep 06 06:40:02 devstack sudo[97785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:40:03 devstack sudo[97785]: pam_unix(sudo:session): session closed for user root Sep 06 06:40:03 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-9fd80911-5966-4e00-b3e2-3c85beb99d52 tempest-VolumesDeleteCascade-1697863049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-03df205b-744d-4e5c-bb3c-31a03b1a4dbd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-03df205b-744d-4e5c-bb3c-31a03b1a4dbd.14d88ca9-1942-4a31-9a3b-715f56524bb9 1G" returned: 0 in 0.427s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:40:03 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-9fd80911-5966-4e00-b3e2-3c85beb99d52 tempest-VolumesDeleteCascade-1697863049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-03df205b-744d-4e5c-bb3c-31a03b1a4dbd -F qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-03df205b-744d-4e5c-bb3c-31a03b1a4dbd.14d88ca9-1942-4a31-9a3b-715f56524bb9 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:40:03 devstack sudo[97791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-03df205b-744d-4e5c-bb3c-31a03b1a4dbd -F qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-03df205b-744d-4e5c-bb3c-31a03b1a4dbd.14d88ca9-1942-4a31-9a3b-715f56524bb9 Sep 06 06:40:03 devstack sudo[97791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:40:03 devstack sudo[97791]: pam_unix(sudo:session): session closed for user root Sep 06 06:40:03 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-9fd80911-5966-4e00-b3e2-3c85beb99d52 tempest-VolumesDeleteCascade-1697863049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-03df205b-744d-4e5c-bb3c-31a03b1a4dbd -F qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-03df205b-744d-4e5c-bb3c-31a03b1a4dbd.14d88ca9-1942-4a31-9a3b-715f56524bb9" returned: 0 in 0.303s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:40:03 devstack cinder-volume[87329]: WARNING cinder.volume.drivers.remotefs [None req-9fd80911-5966-4e00-b3e2-3c85beb99d52 tempest-VolumesDeleteCascade-1697863049 None] /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-03df205b-744d-4e5c-bb3c-31a03b1a4dbd.14d88ca9-1942-4a31-9a3b-715f56524bb9 is being set with open permissions: ugo+rw Sep 06 06:40:03 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-9fd80911-5966-4e00-b3e2-3c85beb99d52 tempest-VolumesDeleteCascade-1697863049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-03df205b-744d-4e5c-bb3c-31a03b1a4dbd.14d88ca9-1942-4a31-9a3b-715f56524bb9 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:40:03 devstack sudo[97796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-03df205b-744d-4e5c-bb3c-31a03b1a4dbd.14d88ca9-1942-4a31-9a3b-715f56524bb9 Sep 06 06:40:03 devstack sudo[97796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:40:03 devstack sudo[97796]: pam_unix(sudo:session): session closed for user root Sep 06 06:40:03 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-9fd80911-5966-4e00-b3e2-3c85beb99d52 tempest-VolumesDeleteCascade-1697863049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-03df205b-744d-4e5c-bb3c-31a03b1a4dbd.14d88ca9-1942-4a31-9a3b-715f56524bb9" returned: 0 in 0.257s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:40:03 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-9fd80911-5966-4e00-b3e2-3c85beb99d52 tempest-VolumesDeleteCascade-1697863049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-03df205b-744d-4e5c-bb3c-31a03b1a4dbd.info {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:40:03 devstack sudo[97799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-03df205b-744d-4e5c-bb3c-31a03b1a4dbd.info Sep 06 06:40:03 devstack sudo[97799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:40:03 devstack sudo[97799]: pam_unix(sudo:session): session closed for user root Sep 06 06:40:03 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-9fd80911-5966-4e00-b3e2-3c85beb99d52 tempest-VolumesDeleteCascade-1697863049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-03df205b-744d-4e5c-bb3c-31a03b1a4dbd.info" returned: 0 in 0.246s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:40:03 devstack cinder-volume[87329]: WARNING cinder.volume.drivers.remotefs [None req-9fd80911-5966-4e00-b3e2-3c85beb99d52 tempest-VolumesDeleteCascade-1697863049 None] /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-03df205b-744d-4e5c-bb3c-31a03b1a4dbd.info is being set with open permissions: ugo+rw Sep 06 06:40:03 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-9fd80911-5966-4e00-b3e2-3c85beb99d52 tempest-VolumesDeleteCascade-1697863049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-03df205b-744d-4e5c-bb3c-31a03b1a4dbd.info {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:40:03 devstack sudo[97802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-03df205b-744d-4e5c-bb3c-31a03b1a4dbd.info Sep 06 06:40:03 devstack sudo[97802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:40:04 devstack sudo[97802]: pam_unix(sudo:session): session closed for user root Sep 06 06:40:04 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-9fd80911-5966-4e00-b3e2-3c85beb99d52 tempest-VolumesDeleteCascade-1697863049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-03df205b-744d-4e5c-bb3c-31a03b1a4dbd.info" returned: 0 in 0.241s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:40:04 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-9fd80911-5966-4e00-b3e2-3c85beb99d52 tempest-VolumesDeleteCascade-1697863049 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.937s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:40:04 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-9fd80911-5966-4e00-b3e2-3c85beb99d52 tempest-VolumesDeleteCascade-1697863049 None] Create snapshot completed successfully Sep 06 06:40:04 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-abb5112b-3a06-477f-aed2-a166bf6b43fc tempest-VolumesDeleteCascade-1697863049 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87329) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 06:40:04 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-abb5112b-3a06-477f-aed2-a166bf6b43fc tempest-VolumesDeleteCascade-1697863049 None] Flow 'volume_create_manager' (341b4d38-39d5-4d05-9af5-ebe66d044cef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:40:04 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-abb5112b-3a06-477f-aed2-a166bf6b43fc tempest-VolumesDeleteCascade-1697863049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6096059-5b7f-4db2-930e-4450045f09f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:40:04 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-abb5112b-3a06-477f-aed2-a166bf6b43fc tempest-VolumesDeleteCascade-1697863049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6096059-5b7f-4db2-930e-4450045f09f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:40:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1731231567',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86251d98-4ebd-4a44-93ed-3d92e254584e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80ea58b259f149e7ada783971acdfcb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:40:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=14d88ca9-1942-4a31-9a3b-715f56524bb9,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:40:05Z,use_quota=True,user_id='50b5313700b94db385ea112cc128b1a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:40:04 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-abb5112b-3a06-477f-aed2-a166bf6b43fc tempest-VolumesDeleteCascade-1697863049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f950d525-5112-497f-b6af-4a89acc3b917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:40:04 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-abb5112b-3a06-477f-aed2-a166bf6b43fc tempest-VolumesDeleteCascade-1697863049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f950d525-5112-497f-b6af-4a89acc3b917) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:40:04 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-abb5112b-3a06-477f-aed2-a166bf6b43fc tempest-VolumesDeleteCascade-1697863049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (596aa378-406d-4874-b656-17de4a8e882c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:40:04 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-abb5112b-3a06-477f-aed2-a166bf6b43fc tempest-VolumesDeleteCascade-1697863049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (596aa378-406d-4874-b656-17de4a8e882c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '86251d98-4ebd-4a44-93ed-3d92e254584e', 'volume_name': 'volume-86251d98-4ebd-4a44-93ed-3d92e254584e', 'volume_size': 1, 'snapshot_id': '14d88ca9-1942-4a31-9a3b-715f56524bb9'}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:40:04 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-abb5112b-3a06-477f-aed2-a166bf6b43fc tempest-VolumesDeleteCascade-1697863049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (180a9bb0-61bd-4646-a86f-091967eb404f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:40:04 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-abb5112b-3a06-477f-aed2-a166bf6b43fc tempest-VolumesDeleteCascade-1697863049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (180a9bb0-61bd-4646-a86f-091967eb404f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:40:04 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-abb5112b-3a06-477f-aed2-a166bf6b43fc tempest-VolumesDeleteCascade-1697863049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c93e93c-b788-4ca5-8fd1-4222d6fdba3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:40:04 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-abb5112b-3a06-477f-aed2-a166bf6b43fc tempest-VolumesDeleteCascade-1697863049 None] Volume 86251d98-4ebd-4a44-93ed-3d92e254584e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-86251d98-4ebd-4a44-93ed-3d92e254584e', 'volume_size': 1, 'snapshot_id': '14d88ca9-1942-4a31-9a3b-715f56524bb9'} Sep 06 06:40:04 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-abb5112b-3a06-477f-aed2-a166bf6b43fc tempest-VolumesDeleteCascade-1697863049 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:40:04 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-abb5112b-3a06-477f-aed2-a166bf6b43fc tempest-VolumesDeleteCascade-1697863049 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:40:04 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-abb5112b-3a06-477f-aed2-a166bf6b43fc tempest-VolumesDeleteCascade-1697863049 None] Acquiring lock "cinder-quobyte-14d88ca9-1942-4a31-9a3b-715f56524bb9-86251d98-4ebd-4a44-93ed-3d92e254584e" by "_create_volume_from_snapshot" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:40:04 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-abb5112b-3a06-477f-aed2-a166bf6b43fc tempest-VolumesDeleteCascade-1697863049 None] Lock "cinder-quobyte-14d88ca9-1942-4a31-9a3b-715f56524bb9-86251d98-4ebd-4a44-93ed-3d92e254584e" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:40:04 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-abb5112b-3a06-477f-aed2-a166bf6b43fc tempest-VolumesDeleteCascade-1697863049 None] Creating volume 86251d98-4ebd-4a44-93ed-3d92e254584e from snapshot 14d88ca9-1942-4a31-9a3b-715f56524bb9 {{(pid=87329) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 06 06:40:04 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-abb5112b-3a06-477f-aed2-a166bf6b43fc tempest-VolumesDeleteCascade-1697863049 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:40:04 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-abb5112b-3a06-477f-aed2-a166bf6b43fc tempest-VolumesDeleteCascade-1697863049 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:40:04 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-abb5112b-3a06-477f-aed2-a166bf6b43fc tempest-VolumesDeleteCascade-1697863049 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:40:04 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-abb5112b-3a06-477f-aed2-a166bf6b43fc tempest-VolumesDeleteCascade-1697863049 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:40:04 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-abb5112b-3a06-477f-aed2-a166bf6b43fc tempest-VolumesDeleteCascade-1697863049 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:40:04 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-abb5112b-3a06-477f-aed2-a166bf6b43fc tempest-VolumesDeleteCascade-1697863049 None] Selected osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 as target Quobyte volume. {{(pid=87329) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 06:40:04 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-abb5112b-3a06-477f-aed2-a166bf6b43fc tempest-VolumesDeleteCascade-1697863049 None] Acquiring lock "cinder-quobyte-86251d98-4ebd-4a44-93ed-3d92e254584e" by "_copy_volume_from_snapshot" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:40:05 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-abb5112b-3a06-477f-aed2-a166bf6b43fc tempest-VolumesDeleteCascade-1697863049 None] Lock "cinder-quobyte-86251d98-4ebd-4a44-93ed-3d92e254584e" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:40:05 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-abb5112b-3a06-477f-aed2-a166bf6b43fc tempest-VolumesDeleteCascade-1697863049 None] snapshot: 14d88ca9-1942-4a31-9a3b-715f56524bb9, volume: 86251d98-4ebd-4a44-93ed-3d92e254584e, {{(pid=87329) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 06 06:40:05 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-abb5112b-3a06-477f-aed2-a166bf6b43fc tempest-VolumesDeleteCascade-1697863049 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:40:05 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-abb5112b-3a06-477f-aed2-a166bf6b43fc tempest-VolumesDeleteCascade-1697863049 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:40:05 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-abb5112b-3a06-477f-aed2-a166bf6b43fc tempest-VolumesDeleteCascade-1697863049 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:40:05 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-abb5112b-3a06-477f-aed2-a166bf6b43fc tempest-VolumesDeleteCascade-1697863049 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:40:05 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-abb5112b-3a06-477f-aed2-a166bf6b43fc tempest-VolumesDeleteCascade-1697863049 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:40:05 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c2fb26e-59d8-475a-937b-1a58d33f1846]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:40:05 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-abb5112b-3a06-477f-aed2-a166bf6b43fc tempest-VolumesDeleteCascade-1697863049 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-03df205b-744d-4e5c-bb3c-31a03b1a4dbd.14d88ca9-1942-4a31-9a3b-715f56524bb9 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:40:05 devstack sudo[97807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-03df205b-744d-4e5c-bb3c-31a03b1a4dbd.14d88ca9-1942-4a31-9a3b-715f56524bb9 Sep 06 06:40:05 devstack sudo[97807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:40:05 devstack sudo[97807]: pam_unix(sudo:session): session closed for user root Sep 06 06:40:05 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-abb5112b-3a06-477f-aed2-a166bf6b43fc tempest-VolumesDeleteCascade-1697863049 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-03df205b-744d-4e5c-bb3c-31a03b1a4dbd.14d88ca9-1942-4a31-9a3b-715f56524bb9" returned: 0 in 0.432s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:40:05 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-abb5112b-3a06-477f-aed2-a166bf6b43fc tempest-VolumesDeleteCascade-1697863049 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-03df205b-744d-4e5c-bb3c-31a03b1a4dbd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87329) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 06:40:05 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[128fd3cf-a88c-4fcd-83a4-f1cca1905840]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:40:05 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-abb5112b-3a06-477f-aed2-a166bf6b43fc tempest-VolumesDeleteCascade-1697863049 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-03df205b-744d-4e5c-bb3c-31a03b1a4dbd {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:40:05 devstack sudo[97821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-03df205b-744d-4e5c-bb3c-31a03b1a4dbd Sep 06 06:40:05 devstack sudo[97821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:40:05 devstack sudo[97821]: pam_unix(sudo:session): session closed for user root Sep 06 06:40:05 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-abb5112b-3a06-477f-aed2-a166bf6b43fc tempest-VolumesDeleteCascade-1697863049 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-03df205b-744d-4e5c-bb3c-31a03b1a4dbd" returned: 0 in 0.388s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:40:05 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-abb5112b-3a06-477f-aed2-a166bf6b43fc tempest-VolumesDeleteCascade-1697863049 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-03df205b-744d-4e5c-bb3c-31a03b1a4dbd {{(pid=87329) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 06 06:40:05 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-abb5112b-3a06-477f-aed2-a166bf6b43fc tempest-VolumesDeleteCascade-1697863049 None] Creating direct copy from snapshot {{(pid=87329) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 06 06:40:05 devstack cinder-volume[87329]: DEBUG cinder.utils [None req-abb5112b-3a06-477f-aed2-a166bf6b43fc tempest-VolumesDeleteCascade-1697863049 None] Path /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-86251d98-4ebd-4a44-93ed-3d92e254584e not found in is_blk_device check {{(pid=87329) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 06 06:40:05 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-abb5112b-3a06-477f-aed2-a166bf6b43fc tempest-VolumesDeleteCascade-1697863049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-03df205b-744d-4e5c-bb3c-31a03b1a4dbd /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-86251d98-4ebd-4a44-93ed-3d92e254584e {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:40:05 devstack sudo[97833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-03df205b-744d-4e5c-bb3c-31a03b1a4dbd /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-86251d98-4ebd-4a44-93ed-3d92e254584e Sep 06 06:40:05 devstack sudo[97833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:40:11 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-abb5112b-3a06-477f-aed2-a166bf6b43fc tempest-VolumesDeleteCascade-1697863049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-03df205b-744d-4e5c-bb3c-31a03b1a4dbd /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-86251d98-4ebd-4a44-93ed-3d92e254584e" returned: 0 in 5.239s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:40:11 devstack cinder-volume[87329]: DEBUG cinder.image.image_utils [None req-abb5112b-3a06-477f-aed2-a166bf6b43fc tempest-VolumesDeleteCascade-1697863049 None] Image conversion details: src /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-03df205b-744d-4e5c-bb3c-31a03b1a4dbd, size 1024.00 MB, duration 5.24 sec, destination /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-86251d98-4ebd-4a44-93ed-3d92e254584e {{(pid=87329) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 06 06:40:11 devstack cinder-volume[87329]: INFO cinder.image.image_utils [None req-abb5112b-3a06-477f-aed2-a166bf6b43fc tempest-VolumesDeleteCascade-1697863049 None] Converted 1024.00 MB image at 195.42 MB/s Sep 06 06:40:11 devstack cinder-volume[87329]: WARNING cinder.volume.drivers.remotefs [None req-abb5112b-3a06-477f-aed2-a166bf6b43fc tempest-VolumesDeleteCascade-1697863049 None] /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-86251d98-4ebd-4a44-93ed-3d92e254584e is being set with open permissions: ugo+rw Sep 06 06:40:11 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-abb5112b-3a06-477f-aed2-a166bf6b43fc tempest-VolumesDeleteCascade-1697863049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-86251d98-4ebd-4a44-93ed-3d92e254584e {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:40:11 devstack sudo[97853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-86251d98-4ebd-4a44-93ed-3d92e254584e Sep 06 06:40:11 devstack sudo[97853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:40:11 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c8f2e54-da3d-4d86-92c1-2ac14caa4c89 tempest-TestServerVolumeAttachScenarioOldVersion-631312841 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87329) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 06:40:11 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-3c8f2e54-da3d-4d86-92c1-2ac14caa4c89 tempest-TestServerVolumeAttachScenarioOldVersion-631312841 None] Flow 'volume_create_manager' (e02eada5-6972-4890-bfd9-d2f0695043c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:40:11 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-3c8f2e54-da3d-4d86-92c1-2ac14caa4c89 tempest-TestServerVolumeAttachScenarioOldVersion-631312841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c7d9f12-4160-41dc-aba9-2ede32f0e06c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:40:11 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-3c8f2e54-da3d-4d86-92c1-2ac14caa4c89 tempest-TestServerVolumeAttachScenarioOldVersion-631312841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c7d9f12-4160-41dc-aba9-2ede32f0e06c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:40:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1388867425',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b0162fb-263d-4286-a1de-30903afe84d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d951b3cc85734cffa8098e74e108a8a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:40:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:40:11Z,use_quota=True,user_id='efcb41b52be44623a642378eef5bfc6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:40:11 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-3c8f2e54-da3d-4d86-92c1-2ac14caa4c89 tempest-TestServerVolumeAttachScenarioOldVersion-631312841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1903afc8-ae2b-45e1-a91b-f274ac41d0da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:40:11 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-3c8f2e54-da3d-4d86-92c1-2ac14caa4c89 tempest-TestServerVolumeAttachScenarioOldVersion-631312841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1903afc8-ae2b-45e1-a91b-f274ac41d0da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:40:11 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-3c8f2e54-da3d-4d86-92c1-2ac14caa4c89 tempest-TestServerVolumeAttachScenarioOldVersion-631312841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed722473-151f-4c29-95bc-5b02dbb67186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:40:11 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-3c8f2e54-da3d-4d86-92c1-2ac14caa4c89 tempest-TestServerVolumeAttachScenarioOldVersion-631312841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed722473-151f-4c29-95bc-5b02dbb67186) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b0162fb-263d-4286-a1de-30903afe84d4', 'volume_name': 'volume-9b0162fb-263d-4286-a1de-30903afe84d4', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:40:11 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-3c8f2e54-da3d-4d86-92c1-2ac14caa4c89 tempest-TestServerVolumeAttachScenarioOldVersion-631312841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d040bad9-e77d-42fe-a7a8-c7822ad0f058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:40:11 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-3c8f2e54-da3d-4d86-92c1-2ac14caa4c89 tempest-TestServerVolumeAttachScenarioOldVersion-631312841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d040bad9-e77d-42fe-a7a8-c7822ad0f058) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:40:11 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-3c8f2e54-da3d-4d86-92c1-2ac14caa4c89 tempest-TestServerVolumeAttachScenarioOldVersion-631312841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc0442fb-f940-43bf-8192-179ea383c532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:40:11 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-3c8f2e54-da3d-4d86-92c1-2ac14caa4c89 tempest-TestServerVolumeAttachScenarioOldVersion-631312841 None] Volume 9b0162fb-263d-4286-a1de-30903afe84d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b0162fb-263d-4286-a1de-30903afe84d4', 'volume_size': 1} Sep 06 06:40:11 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-3c8f2e54-da3d-4d86-92c1-2ac14caa4c89 tempest-TestServerVolumeAttachScenarioOldVersion-631312841 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:40:11 devstack sudo[97853]: pam_unix(sudo:session): session closed for user root Sep 06 06:40:11 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-abb5112b-3a06-477f-aed2-a166bf6b43fc tempest-VolumesDeleteCascade-1697863049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-86251d98-4ebd-4a44-93ed-3d92e254584e" returned: 0 in 0.387s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:40:11 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-abb5112b-3a06-477f-aed2-a166bf6b43fc tempest-VolumesDeleteCascade-1697863049 None] Lock "cinder-quobyte-86251d98-4ebd-4a44-93ed-3d92e254584e" released by "_copy_volume_from_snapshot" :: held 6.537s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:40:11 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-abb5112b-3a06-477f-aed2-a166bf6b43fc tempest-VolumesDeleteCascade-1697863049 None] Lock "cinder-quobyte-14d88ca9-1942-4a31-9a3b-715f56524bb9-86251d98-4ebd-4a44-93ed-3d92e254584e" released by "_create_volume_from_snapshot" :: held 6.627s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:40:11 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-abb5112b-3a06-477f-aed2-a166bf6b43fc tempest-VolumesDeleteCascade-1697863049 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.650s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:40:11 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-3c8f2e54-da3d-4d86-92c1-2ac14caa4c89 tempest-TestServerVolumeAttachScenarioOldVersion-631312841 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.290s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:40:11 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-3c8f2e54-da3d-4d86-92c1-2ac14caa4c89 tempest-TestServerVolumeAttachScenarioOldVersion-631312841 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:40:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1388867425',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b0162fb-263d-4286-a1de-30903afe84d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d951b3cc85734cffa8098e74e108a8a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:40:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:40:11Z,use_quota=True,user_id='efcb41b52be44623a642378eef5bfc6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)}" {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 06:40:11 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-3c8f2e54-da3d-4d86-92c1-2ac14caa4c89 tempest-TestServerVolumeAttachScenarioOldVersion-631312841 None] Creating volume 9b0162fb-263d-4286-a1de-30903afe84d4 {{(pid=87329) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 06:40:11 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-3c8f2e54-da3d-4d86-92c1-2ac14caa4c89 tempest-TestServerVolumeAttachScenarioOldVersion-631312841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:40:11 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-3c8f2e54-da3d-4d86-92c1-2ac14caa4c89 tempest-TestServerVolumeAttachScenarioOldVersion-631312841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:40:11 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-3c8f2e54-da3d-4d86-92c1-2ac14caa4c89 tempest-TestServerVolumeAttachScenarioOldVersion-631312841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:40:11 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-3c8f2e54-da3d-4d86-92c1-2ac14caa4c89 tempest-TestServerVolumeAttachScenarioOldVersion-631312841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:40:11 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-3c8f2e54-da3d-4d86-92c1-2ac14caa4c89 tempest-TestServerVolumeAttachScenarioOldVersion-631312841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:40:11 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-3c8f2e54-da3d-4d86-92c1-2ac14caa4c89 tempest-TestServerVolumeAttachScenarioOldVersion-631312841 None] Selected osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 as target Quobyte volume. {{(pid=87329) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 06:40:11 devstack cinder-volume[87329]: INFO cinder.volume.drivers.remotefs [None req-3c8f2e54-da3d-4d86-92c1-2ac14caa4c89 tempest-TestServerVolumeAttachScenarioOldVersion-631312841 None] casted to osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 Sep 06 06:40:11 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-3c8f2e54-da3d-4d86-92c1-2ac14caa4c89 tempest-TestServerVolumeAttachScenarioOldVersion-631312841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-9b0162fb-263d-4286-a1de-30903afe84d4 1073741824 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:40:11 devstack sudo[97875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-9b0162fb-263d-4286-a1de-30903afe84d4 1073741824 Sep 06 06:40:11 devstack sudo[97875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:40:11 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-abb5112b-3a06-477f-aed2-a166bf6b43fc tempest-VolumesDeleteCascade-1697863049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c93e93c-b788-4ca5-8fd1-4222d6fdba3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86251d98-4ebd-4a44-93ed-3d92e254584e', 'volume_size': 1, 'snapshot_id': '14d88ca9-1942-4a31-9a3b-715f56524bb9'}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:40:11 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-abb5112b-3a06-477f-aed2-a166bf6b43fc tempest-VolumesDeleteCascade-1697863049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05469e1d-51ed-4901-9341-7355c3aae2ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:40:11 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-abb5112b-3a06-477f-aed2-a166bf6b43fc tempest-VolumesDeleteCascade-1697863049 None] Volume volume-86251d98-4ebd-4a44-93ed-3d92e254584e (86251d98-4ebd-4a44-93ed-3d92e254584e): created successfully Sep 06 06:40:11 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-abb5112b-3a06-477f-aed2-a166bf6b43fc tempest-VolumesDeleteCascade-1697863049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05469e1d-51ed-4901-9341-7355c3aae2ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:40:11 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-abb5112b-3a06-477f-aed2-a166bf6b43fc tempest-VolumesDeleteCascade-1697863049 None] Flow 'volume_create_manager' (341b4d38-39d5-4d05-9af5-ebe66d044cef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:40:11 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-abb5112b-3a06-477f-aed2-a166bf6b43fc tempest-VolumesDeleteCascade-1697863049 None] Created volume successfully. Sep 06 06:40:12 devstack sudo[97875]: pam_unix(sudo:session): session closed for user root Sep 06 06:40:12 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-3c8f2e54-da3d-4d86-92c1-2ac14caa4c89 tempest-TestServerVolumeAttachScenarioOldVersion-631312841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-9b0162fb-263d-4286-a1de-30903afe84d4 1073741824" returned: 0 in 0.493s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:40:12 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-3c8f2e54-da3d-4d86-92c1-2ac14caa4c89 tempest-TestServerVolumeAttachScenarioOldVersion-631312841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-9b0162fb-263d-4286-a1de-30903afe84d4 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:40:12 devstack sudo[97881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-9b0162fb-263d-4286-a1de-30903afe84d4 Sep 06 06:40:12 devstack sudo[97881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:40:12 devstack sudo[97881]: pam_unix(sudo:session): session closed for user root Sep 06 06:40:12 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-3c8f2e54-da3d-4d86-92c1-2ac14caa4c89 tempest-TestServerVolumeAttachScenarioOldVersion-631312841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-9b0162fb-263d-4286-a1de-30903afe84d4" returned: 0 in 0.258s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:40:12 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-3c8f2e54-da3d-4d86-92c1-2ac14caa4c89 tempest-TestServerVolumeAttachScenarioOldVersion-631312841 None] <== create_volume: return (814ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'} {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 06:40:12 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-3c8f2e54-da3d-4d86-92c1-2ac14caa4c89 tempest-TestServerVolumeAttachScenarioOldVersion-631312841 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.819s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:40:12 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-3c8f2e54-da3d-4d86-92c1-2ac14caa4c89 tempest-TestServerVolumeAttachScenarioOldVersion-631312841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc0442fb-f940-43bf-8192-179ea383c532) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b0162fb-263d-4286-a1de-30903afe84d4', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:40:12 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-3c8f2e54-da3d-4d86-92c1-2ac14caa4c89 tempest-TestServerVolumeAttachScenarioOldVersion-631312841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e754c77f-e2b4-4a19-8bb7-185fab03aceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:40:12 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-3c8f2e54-da3d-4d86-92c1-2ac14caa4c89 tempest-TestServerVolumeAttachScenarioOldVersion-631312841 None] Volume volume-9b0162fb-263d-4286-a1de-30903afe84d4 (9b0162fb-263d-4286-a1de-30903afe84d4): created successfully Sep 06 06:40:12 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-3c8f2e54-da3d-4d86-92c1-2ac14caa4c89 tempest-TestServerVolumeAttachScenarioOldVersion-631312841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e754c77f-e2b4-4a19-8bb7-185fab03aceb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:40:12 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-3c8f2e54-da3d-4d86-92c1-2ac14caa4c89 tempest-TestServerVolumeAttachScenarioOldVersion-631312841 None] Flow 'volume_create_manager' (e02eada5-6972-4890-bfd9-d2f0695043c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:40:12 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-3c8f2e54-da3d-4d86-92c1-2ac14caa4c89 tempest-TestServerVolumeAttachScenarioOldVersion-631312841 None] Created volume successfully. Sep 06 06:40:12 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-5c704959-b305-49b4-963d-de1e0de7c98a tempest-VolumesDeleteCascade-1697863049 None] Acquiring lock "cinder-03df205b-744d-4e5c-bb3c-31a03b1a4dbd-delete_volume" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:40:12 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-5c704959-b305-49b4-963d-de1e0de7c98a tempest-VolumesDeleteCascade-1697863049 None] Lock "cinder-03df205b-744d-4e5c-bb3c-31a03b1a4dbd-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:40:12 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-5c704959-b305-49b4-963d-de1e0de7c98a tempest-VolumesDeleteCascade-1697863049 None] Performing cascade delete. {{(pid=87329) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 06 06:40:12 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-5c704959-b305-49b4-963d-de1e0de7c98a tempest-VolumesDeleteCascade-1697863049 None] Acquiring lock "cinder-14d88ca9-1942-4a31-9a3b-715f56524bb9-delete_snapshot" by "delete_snapshot" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:40:12 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-5c704959-b305-49b4-963d-de1e0de7c98a tempest-VolumesDeleteCascade-1697863049 None] Lock "cinder-14d88ca9-1942-4a31-9a3b-715f56524bb9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:40:12 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-5c704959-b305-49b4-963d-de1e0de7c98a tempest-VolumesDeleteCascade-1697863049 None] Acquiring lock "cinder-quobyte-03df205b-744d-4e5c-bb3c-31a03b1a4dbd" by "delete_snapshot" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:40:12 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-5c704959-b305-49b4-963d-de1e0de7c98a tempest-VolumesDeleteCascade-1697863049 None] Lock "cinder-quobyte-03df205b-744d-4e5c-bb3c-31a03b1a4dbd" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:40:12 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-5c704959-b305-49b4-963d-de1e0de7c98a tempest-VolumesDeleteCascade-1697863049 None] Acquiring lock "cinder-quobyte-14d88ca9-1942-4a31-9a3b-715f56524bb9" by "_delete_snapshot" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:40:12 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-5c704959-b305-49b4-963d-de1e0de7c98a tempest-VolumesDeleteCascade-1697863049 None] Lock "cinder-quobyte-14d88ca9-1942-4a31-9a3b-715f56524bb9" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:40:12 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-5c704959-b305-49b4-963d-de1e0de7c98a tempest-VolumesDeleteCascade-1697863049 None] Deleting offline snapshot 14d88ca9-1942-4a31-9a3b-715f56524bb9 of volume 03df205b-744d-4e5c-bb3c-31a03b1a4dbd {{(pid=87329) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 06 06:40:12 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-5c704959-b305-49b4-963d-de1e0de7c98a tempest-VolumesDeleteCascade-1697863049 None] snapshot_file for this snap is: volume-03df205b-744d-4e5c-bb3c-31a03b1a4dbd.14d88ca9-1942-4a31-9a3b-715f56524bb9 {{(pid=87329) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 06 06:40:13 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a63820d-6cd5-484e-85ba-57a3ea0095b0]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:40:13 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-5c704959-b305-49b4-963d-de1e0de7c98a tempest-VolumesDeleteCascade-1697863049 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-03df205b-744d-4e5c-bb3c-31a03b1a4dbd.14d88ca9-1942-4a31-9a3b-715f56524bb9 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:40:13 devstack sudo[97887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-03df205b-744d-4e5c-bb3c-31a03b1a4dbd.14d88ca9-1942-4a31-9a3b-715f56524bb9 Sep 06 06:40:13 devstack sudo[97887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:40:13 devstack sudo[97887]: pam_unix(sudo:session): session closed for user root Sep 06 06:40:13 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-5c704959-b305-49b4-963d-de1e0de7c98a tempest-VolumesDeleteCascade-1697863049 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-03df205b-744d-4e5c-bb3c-31a03b1a4dbd.14d88ca9-1942-4a31-9a3b-715f56524bb9" returned: 0 in 0.406s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:40:13 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-5c704959-b305-49b4-963d-de1e0de7c98a tempest-VolumesDeleteCascade-1697863049 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-03df205b-744d-4e5c-bb3c-31a03b1a4dbd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87329) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 06:40:13 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0e94f54-129f-410e-a049-60def0b2e1f5]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:40:13 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-5c704959-b305-49b4-963d-de1e0de7c98a tempest-VolumesDeleteCascade-1697863049 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-03df205b-744d-4e5c-bb3c-31a03b1a4dbd {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:40:13 devstack sudo[97895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-03df205b-744d-4e5c-bb3c-31a03b1a4dbd Sep 06 06:40:13 devstack sudo[97895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:40:14 devstack sudo[97895]: pam_unix(sudo:session): session closed for user root Sep 06 06:40:14 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-5c704959-b305-49b4-963d-de1e0de7c98a tempest-VolumesDeleteCascade-1697863049 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-03df205b-744d-4e5c-bb3c-31a03b1a4dbd" returned: 0 in 0.605s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:40:14 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-5c704959-b305-49b4-963d-de1e0de7c98a tempest-VolumesDeleteCascade-1697863049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-03df205b-744d-4e5c-bb3c-31a03b1a4dbd.14d88ca9-1942-4a31-9a3b-715f56524bb9 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:40:14 devstack sudo[97909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-03df205b-744d-4e5c-bb3c-31a03b1a4dbd.14d88ca9-1942-4a31-9a3b-715f56524bb9 Sep 06 06:40:14 devstack sudo[97909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:40:14 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [req-0400d5f2-b20c-4e9a-98bd-a617dc74f283 req-2e2bcdfa-6568-492d-bdcb-b99dbc1a6e40 tempest-TestServerVolumeAttachScenarioOldVersion-631312841 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:40:14 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [req-0400d5f2-b20c-4e9a-98bd-a617dc74f283 req-2e2bcdfa-6568-492d-bdcb-b99dbc1a6e40 tempest-TestServerVolumeAttachScenarioOldVersion-631312841 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:40:14 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [req-0400d5f2-b20c-4e9a-98bd-a617dc74f283 req-2e2bcdfa-6568-492d-bdcb-b99dbc1a6e40 tempest-TestServerVolumeAttachScenarioOldVersion-631312841 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:40:14 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [req-0400d5f2-b20c-4e9a-98bd-a617dc74f283 req-2e2bcdfa-6568-492d-bdcb-b99dbc1a6e40 tempest-TestServerVolumeAttachScenarioOldVersion-631312841 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6', 'name': 'volume-9b0162fb-263d-4286-a1de-30903afe84d4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '429ee956-dbba-4c5b-9648-2f332ac5a960', 'enforce_multipath': True} {{(pid=87329) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 06 06:40:14 devstack cinder-volume[87329]: INFO cinder.volume.manager [req-0400d5f2-b20c-4e9a-98bd-a617dc74f283 req-2e2bcdfa-6568-492d-bdcb-b99dbc1a6e40 tempest-TestServerVolumeAttachScenarioOldVersion-631312841 None] attachment_update completed successfully. Sep 06 06:40:14 devstack sudo[97909]: pam_unix(sudo:session): session closed for user root Sep 06 06:40:14 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-5c704959-b305-49b4-963d-de1e0de7c98a tempest-VolumesDeleteCascade-1697863049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-03df205b-744d-4e5c-bb3c-31a03b1a4dbd.14d88ca9-1942-4a31-9a3b-715f56524bb9" returned: 0 in 0.393s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:40:14 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-5c704959-b305-49b4-963d-de1e0de7c98a tempest-VolumesDeleteCascade-1697863049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-03df205b-744d-4e5c-bb3c-31a03b1a4dbd.14d88ca9-1942-4a31-9a3b-715f56524bb9 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:40:14 devstack sudo[97980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-03df205b-744d-4e5c-bb3c-31a03b1a4dbd.14d88ca9-1942-4a31-9a3b-715f56524bb9 Sep 06 06:40:14 devstack sudo[97980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:40:14 devstack sudo[97980]: pam_unix(sudo:session): session closed for user root Sep 06 06:40:14 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-5c704959-b305-49b4-963d-de1e0de7c98a tempest-VolumesDeleteCascade-1697863049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-03df205b-744d-4e5c-bb3c-31a03b1a4dbd.14d88ca9-1942-4a31-9a3b-715f56524bb9" returned: 0 in 0.288s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:40:14 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-5c704959-b305-49b4-963d-de1e0de7c98a tempest-VolumesDeleteCascade-1697863049 None] Lock "cinder-quobyte-14d88ca9-1942-4a31-9a3b-715f56524bb9" released by "_delete_snapshot" :: held 1.857s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:40:14 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-5c704959-b305-49b4-963d-de1e0de7c98a tempest-VolumesDeleteCascade-1697863049 None] Lock "cinder-quobyte-03df205b-744d-4e5c-bb3c-31a03b1a4dbd" released by "delete_snapshot" :: held 1.888s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:40:14 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-3981f596-814f-46f4-b9eb-ba4420ed8e05 tempest-AttachVolumeShelveTestJSON-1287215161 None] Acquiring lock "cinder-14923f28-f152-4f61-b2f2-a658646b422c-delete_volume" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:40:14 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-3981f596-814f-46f4-b9eb-ba4420ed8e05 tempest-AttachVolumeShelveTestJSON-1287215161 None] Lock "cinder-14923f28-f152-4f61-b2f2-a658646b422c-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:40:14 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-5c704959-b305-49b4-963d-de1e0de7c98a tempest-VolumesDeleteCascade-1697863049 None] Created reservations ['84f1cfed-bb02-44fa-a465-2a59dc935daa', '7bc15ab1-e0c9-44a2-bcea-104c5d189405', '9653c947-4d95-464f-91e1-e76dc75ff93a', '656422ae-ecba-432d-a6f5-2a203cc24c75'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:40:14 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-3981f596-814f-46f4-b9eb-ba4420ed8e05 tempest-AttachVolumeShelveTestJSON-1287215161 None] Acquiring lock "cinder-quobyte-14923f28-f152-4f61-b2f2-a658646b422c" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:40:14 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-3981f596-814f-46f4-b9eb-ba4420ed8e05 tempest-AttachVolumeShelveTestJSON-1287215161 None] Lock "cinder-quobyte-14923f28-f152-4f61-b2f2-a658646b422c" acquired by "delete_volume" :: waited 0.034s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:40:15 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[5db0214c-d42b-4dda-95b6-703a48df61ae]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:40:15 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-3981f596-814f-46f4-b9eb-ba4420ed8e05 tempest-AttachVolumeShelveTestJSON-1287215161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-14923f28-f152-4f61-b2f2-a658646b422c {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:40:15 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-5c704959-b305-49b4-963d-de1e0de7c98a tempest-VolumesDeleteCascade-1697863049 None] Delete snapshot completed successfully. Sep 06 06:40:15 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-5c704959-b305-49b4-963d-de1e0de7c98a tempest-VolumesDeleteCascade-1697863049 None] Lock "cinder-14d88ca9-1942-4a31-9a3b-715f56524bb9-delete_snapshot" released by "delete_snapshot" :: held 2.188s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:40:15 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-5c704959-b305-49b4-963d-de1e0de7c98a tempest-VolumesDeleteCascade-1697863049 None] Snapshots deleted, issuing volume delete {{(pid=87329) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 06 06:40:15 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-5c704959-b305-49b4-963d-de1e0de7c98a tempest-VolumesDeleteCascade-1697863049 None] Acquiring lock "cinder-quobyte-03df205b-744d-4e5c-bb3c-31a03b1a4dbd" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:40:15 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-5c704959-b305-49b4-963d-de1e0de7c98a tempest-VolumesDeleteCascade-1697863049 None] Lock "cinder-quobyte-03df205b-744d-4e5c-bb3c-31a03b1a4dbd" acquired by "delete_volume" :: waited 0.014s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:40:15 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[e91d49cd-6713-49b7-a932-e26d60ec60e6]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:40:15 devstack sudo[98298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-14923f28-f152-4f61-b2f2-a658646b422c Sep 06 06:40:15 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-5c704959-b305-49b4-963d-de1e0de7c98a tempest-VolumesDeleteCascade-1697863049 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-03df205b-744d-4e5c-bb3c-31a03b1a4dbd {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:40:15 devstack sudo[98298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:40:15 devstack sudo[98300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-03df205b-744d-4e5c-bb3c-31a03b1a4dbd Sep 06 06:40:15 devstack sudo[98300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:40:15 devstack sudo[98298]: pam_unix(sudo:session): session closed for user root Sep 06 06:40:15 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-3981f596-814f-46f4-b9eb-ba4420ed8e05 tempest-AttachVolumeShelveTestJSON-1287215161 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-14923f28-f152-4f61-b2f2-a658646b422c" returned: 0 in 0.365s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:40:15 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-3981f596-814f-46f4-b9eb-ba4420ed8e05 tempest-AttachVolumeShelveTestJSON-1287215161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-14923f28-f152-4f61-b2f2-a658646b422c {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:40:15 devstack sudo[98305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-14923f28-f152-4f61-b2f2-a658646b422c Sep 06 06:40:15 devstack sudo[98305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:40:15 devstack sudo[98300]: pam_unix(sudo:session): session closed for user root Sep 06 06:40:15 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-5c704959-b305-49b4-963d-de1e0de7c98a tempest-VolumesDeleteCascade-1697863049 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-03df205b-744d-4e5c-bb3c-31a03b1a4dbd" returned: 0 in 0.369s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:40:15 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-5c704959-b305-49b4-963d-de1e0de7c98a tempest-VolumesDeleteCascade-1697863049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-03df205b-744d-4e5c-bb3c-31a03b1a4dbd {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:40:15 devstack sudo[98310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-03df205b-744d-4e5c-bb3c-31a03b1a4dbd Sep 06 06:40:15 devstack sudo[98310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:40:15 devstack sudo[98305]: pam_unix(sudo:session): session closed for user root Sep 06 06:40:15 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-3981f596-814f-46f4-b9eb-ba4420ed8e05 tempest-AttachVolumeShelveTestJSON-1287215161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-14923f28-f152-4f61-b2f2-a658646b422c" returned: 0 in 0.266s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:40:15 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-3981f596-814f-46f4-b9eb-ba4420ed8e05 tempest-AttachVolumeShelveTestJSON-1287215161 None] Lock "cinder-quobyte-14923f28-f152-4f61-b2f2-a658646b422c" released by "delete_volume" :: held 0.696s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:40:15 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-3981f596-814f-46f4-b9eb-ba4420ed8e05 tempest-AttachVolumeShelveTestJSON-1287215161 None] Created reservations ['86bd695d-af5c-4a4a-92a7-e94cac992d85', 'df05ee1d-bb09-47dd-9d82-d6860ba6e885', '63ffcff1-0152-450a-a1ba-648cc042a6a9', 'd46e93c5-1c9b-4e5d-8e91-b895f8f44225'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:40:15 devstack sudo[98310]: pam_unix(sudo:session): session closed for user root Sep 06 06:40:15 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-5c704959-b305-49b4-963d-de1e0de7c98a tempest-VolumesDeleteCascade-1697863049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-03df205b-744d-4e5c-bb3c-31a03b1a4dbd" returned: 0 in 0.251s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:40:15 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-5c704959-b305-49b4-963d-de1e0de7c98a tempest-VolumesDeleteCascade-1697863049 None] Lock "cinder-quobyte-03df205b-744d-4e5c-bb3c-31a03b1a4dbd" released by "delete_volume" :: held 0.692s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:40:15 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-3981f596-814f-46f4-b9eb-ba4420ed8e05 tempest-AttachVolumeShelveTestJSON-1287215161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:40:15 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-3981f596-814f-46f4-b9eb-ba4420ed8e05 tempest-AttachVolumeShelveTestJSON-1287215161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:40:15 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-3981f596-814f-46f4-b9eb-ba4420ed8e05 tempest-AttachVolumeShelveTestJSON-1287215161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:40:15 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-3981f596-814f-46f4-b9eb-ba4420ed8e05 tempest-AttachVolumeShelveTestJSON-1287215161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:40:15 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-3981f596-814f-46f4-b9eb-ba4420ed8e05 tempest-AttachVolumeShelveTestJSON-1287215161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:40:15 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-3981f596-814f-46f4-b9eb-ba4420ed8e05 tempest-AttachVolumeShelveTestJSON-1287215161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:40:15 devstack sudo[98314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:40:15 devstack sudo[98314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:40:15 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-5c704959-b305-49b4-963d-de1e0de7c98a tempest-VolumesDeleteCascade-1697863049 None] Created reservations ['8345eb38-7bf5-43a2-a452-b9f04e0a9f13', 'eeab1d1b-1e8b-4779-b40a-db2039d3a860', 'c70e4380-2b33-4091-910d-7d1313c649e6', '33783da7-3109-431e-ad37-12617c1bcc87'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:40:15 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-5c704959-b305-49b4-963d-de1e0de7c98a tempest-VolumesDeleteCascade-1697863049 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:40:15 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-5c704959-b305-49b4-963d-de1e0de7c98a tempest-VolumesDeleteCascade-1697863049 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:40:15 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-5c704959-b305-49b4-963d-de1e0de7c98a tempest-VolumesDeleteCascade-1697863049 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:40:15 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-5c704959-b305-49b4-963d-de1e0de7c98a tempest-VolumesDeleteCascade-1697863049 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:40:15 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-5c704959-b305-49b4-963d-de1e0de7c98a tempest-VolumesDeleteCascade-1697863049 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:40:15 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-5c704959-b305-49b4-963d-de1e0de7c98a tempest-VolumesDeleteCascade-1697863049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:40:15 devstack sudo[98316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:40:15 devstack sudo[98316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:40:16 devstack sudo[98314]: pam_unix(sudo:session): session closed for user root Sep 06 06:40:16 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-3981f596-814f-46f4-b9eb-ba4420ed8e05 tempest-AttachVolumeShelveTestJSON-1287215161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.292s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:40:16 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-3981f596-814f-46f4-b9eb-ba4420ed8e05 tempest-AttachVolumeShelveTestJSON-1287215161 None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:40:16 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-3981f596-814f-46f4-b9eb-ba4420ed8e05 tempest-AttachVolumeShelveTestJSON-1287215161 None] Deleted volume successfully. Sep 06 06:40:16 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-3981f596-814f-46f4-b9eb-ba4420ed8e05 tempest-AttachVolumeShelveTestJSON-1287215161 None] Lock "cinder-14923f28-f152-4f61-b2f2-a658646b422c-delete_volume" released by "delete_volume" :: held 1.243s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:40:16 devstack sudo[98316]: pam_unix(sudo:session): session closed for user root Sep 06 06:40:16 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-5c704959-b305-49b4-963d-de1e0de7c98a tempest-VolumesDeleteCascade-1697863049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.295s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:40:16 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-5c704959-b305-49b4-963d-de1e0de7c98a tempest-VolumesDeleteCascade-1697863049 None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:40:16 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-5c704959-b305-49b4-963d-de1e0de7c98a tempest-VolumesDeleteCascade-1697863049 None] Deleted volume successfully. Sep 06 06:40:16 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-5c704959-b305-49b4-963d-de1e0de7c98a tempest-VolumesDeleteCascade-1697863049 None] Lock "cinder-03df205b-744d-4e5c-bb3c-31a03b1a4dbd-delete_volume" released by "delete_volume" :: held 3.460s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:40:16 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-23becb41-5b52-4d5a-a526-f8c9cebe5722 tempest-VolumesDeleteCascade-1697863049 None] Acquiring lock "cinder-86251d98-4ebd-4a44-93ed-3d92e254584e-delete_volume" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:40:16 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-23becb41-5b52-4d5a-a526-f8c9cebe5722 tempest-VolumesDeleteCascade-1697863049 None] Lock "cinder-86251d98-4ebd-4a44-93ed-3d92e254584e-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:40:16 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-23becb41-5b52-4d5a-a526-f8c9cebe5722 tempest-VolumesDeleteCascade-1697863049 None] Acquiring lock "cinder-quobyte-86251d98-4ebd-4a44-93ed-3d92e254584e" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:40:16 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-23becb41-5b52-4d5a-a526-f8c9cebe5722 tempest-VolumesDeleteCascade-1697863049 None] Lock "cinder-quobyte-86251d98-4ebd-4a44-93ed-3d92e254584e" acquired by "delete_volume" :: waited 0.018s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:40:16 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[75088814-75e0-4c47-bb56-2c4440bd6c47]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:40:16 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-23becb41-5b52-4d5a-a526-f8c9cebe5722 tempest-VolumesDeleteCascade-1697863049 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-86251d98-4ebd-4a44-93ed-3d92e254584e {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:40:16 devstack sudo[98320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-86251d98-4ebd-4a44-93ed-3d92e254584e Sep 06 06:40:16 devstack sudo[98320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:40:16 devstack sudo[98320]: pam_unix(sudo:session): session closed for user root Sep 06 06:40:16 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-23becb41-5b52-4d5a-a526-f8c9cebe5722 tempest-VolumesDeleteCascade-1697863049 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-86251d98-4ebd-4a44-93ed-3d92e254584e" returned: 0 in 0.381s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:40:16 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-23becb41-5b52-4d5a-a526-f8c9cebe5722 tempest-VolumesDeleteCascade-1697863049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-86251d98-4ebd-4a44-93ed-3d92e254584e {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:40:16 devstack sudo[98325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-86251d98-4ebd-4a44-93ed-3d92e254584e Sep 06 06:40:16 devstack sudo[98325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:40:17 devstack sudo[98325]: pam_unix(sudo:session): session closed for user root Sep 06 06:40:17 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-23becb41-5b52-4d5a-a526-f8c9cebe5722 tempest-VolumesDeleteCascade-1697863049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-86251d98-4ebd-4a44-93ed-3d92e254584e" returned: 0 in 0.297s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:40:17 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-23becb41-5b52-4d5a-a526-f8c9cebe5722 tempest-VolumesDeleteCascade-1697863049 None] Lock "cinder-quobyte-86251d98-4ebd-4a44-93ed-3d92e254584e" released by "delete_volume" :: held 0.723s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:40:17 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-23becb41-5b52-4d5a-a526-f8c9cebe5722 tempest-VolumesDeleteCascade-1697863049 None] Created reservations ['2e9729a2-3f63-4601-ac19-ebc22ff4b743', 'a44eb145-5561-4184-adc0-1b01879ecf42', '93ca335d-7f3a-471a-a333-db5a1d72bbe6', 'b1d8bad9-c430-47dc-812a-6d835aace254'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:40:17 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-23becb41-5b52-4d5a-a526-f8c9cebe5722 tempest-VolumesDeleteCascade-1697863049 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:40:17 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-23becb41-5b52-4d5a-a526-f8c9cebe5722 tempest-VolumesDeleteCascade-1697863049 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:40:17 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-23becb41-5b52-4d5a-a526-f8c9cebe5722 tempest-VolumesDeleteCascade-1697863049 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:40:17 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-23becb41-5b52-4d5a-a526-f8c9cebe5722 tempest-VolumesDeleteCascade-1697863049 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:40:17 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-23becb41-5b52-4d5a-a526-f8c9cebe5722 tempest-VolumesDeleteCascade-1697863049 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:40:17 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-23becb41-5b52-4d5a-a526-f8c9cebe5722 tempest-VolumesDeleteCascade-1697863049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:40:17 devstack sudo[98328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:40:17 devstack sudo[98328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:40:17 devstack sudo[98328]: pam_unix(sudo:session): session closed for user root Sep 06 06:40:17 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-23becb41-5b52-4d5a-a526-f8c9cebe5722 tempest-VolumesDeleteCascade-1697863049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.312s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:40:17 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-23becb41-5b52-4d5a-a526-f8c9cebe5722 tempest-VolumesDeleteCascade-1697863049 None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:40:17 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-23becb41-5b52-4d5a-a526-f8c9cebe5722 tempest-VolumesDeleteCascade-1697863049 None] Deleted volume successfully. Sep 06 06:40:17 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-23becb41-5b52-4d5a-a526-f8c9cebe5722 tempest-VolumesDeleteCascade-1697863049 None] Lock "cinder-86251d98-4ebd-4a44-93ed-3d92e254584e-delete_volume" released by "delete_volume" :: held 1.298s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:40:17 devstack cinder-volume[87329]: INFO cinder.volume.manager [req-3082954d-38f1-4465-a451-1244579d3f3d req-bbdf26fd-9bbb-4231-93c4-88a65ac894f6 tempest-TestServerVolumeAttachScenarioOldVersion-631312841 None] Terminate volume connection completed successfully. Sep 06 06:40:17 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [req-3082954d-38f1-4465-a451-1244579d3f3d req-bbdf26fd-9bbb-4231-93c4-88a65ac894f6 tempest-TestServerVolumeAttachScenarioOldVersion-631312841 None] Deleting attachment 429ee956-dbba-4c5b-9648-2f332ac5a960. {{(pid=87329) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 06 06:40:18 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-992802a6-6ba2-49d3-a032-52071c4eeadd tempest-TestServerVolumeAttachScenarioOldVersion-631312841 None] Acquiring lock "cinder-9b0162fb-263d-4286-a1de-30903afe84d4-delete_volume" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:40:18 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-992802a6-6ba2-49d3-a032-52071c4eeadd tempest-TestServerVolumeAttachScenarioOldVersion-631312841 None] Lock "cinder-9b0162fb-263d-4286-a1de-30903afe84d4-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:40:18 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-992802a6-6ba2-49d3-a032-52071c4eeadd tempest-TestServerVolumeAttachScenarioOldVersion-631312841 None] Acquiring lock "cinder-quobyte-9b0162fb-263d-4286-a1de-30903afe84d4" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:40:18 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-992802a6-6ba2-49d3-a032-52071c4eeadd tempest-TestServerVolumeAttachScenarioOldVersion-631312841 None] Lock "cinder-quobyte-9b0162fb-263d-4286-a1de-30903afe84d4" acquired by "delete_volume" :: waited 0.024s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:40:18 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[6117cc7e-4165-4154-8500-305d59639771]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:40:18 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-992802a6-6ba2-49d3-a032-52071c4eeadd tempest-TestServerVolumeAttachScenarioOldVersion-631312841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-9b0162fb-263d-4286-a1de-30903afe84d4 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:40:18 devstack sudo[98359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-9b0162fb-263d-4286-a1de-30903afe84d4 Sep 06 06:40:18 devstack sudo[98359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:40:19 devstack sudo[98359]: pam_unix(sudo:session): session closed for user root Sep 06 06:40:19 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-992802a6-6ba2-49d3-a032-52071c4eeadd tempest-TestServerVolumeAttachScenarioOldVersion-631312841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-9b0162fb-263d-4286-a1de-30903afe84d4" returned: 0 in 0.414s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:40:19 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-992802a6-6ba2-49d3-a032-52071c4eeadd tempest-TestServerVolumeAttachScenarioOldVersion-631312841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-9b0162fb-263d-4286-a1de-30903afe84d4 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:40:19 devstack sudo[98364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-9b0162fb-263d-4286-a1de-30903afe84d4 Sep 06 06:40:19 devstack sudo[98364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:40:19 devstack sudo[98364]: pam_unix(sudo:session): session closed for user root Sep 06 06:40:19 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-992802a6-6ba2-49d3-a032-52071c4eeadd tempest-TestServerVolumeAttachScenarioOldVersion-631312841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-9b0162fb-263d-4286-a1de-30903afe84d4" returned: 0 in 0.265s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:40:19 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-992802a6-6ba2-49d3-a032-52071c4eeadd tempest-TestServerVolumeAttachScenarioOldVersion-631312841 None] Lock "cinder-quobyte-9b0162fb-263d-4286-a1de-30903afe84d4" released by "delete_volume" :: held 0.728s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:40:19 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-992802a6-6ba2-49d3-a032-52071c4eeadd tempest-TestServerVolumeAttachScenarioOldVersion-631312841 None] Created reservations ['eb7a99ef-2b07-4544-b5aa-94d82739d5e3', '418ca142-3a47-48e2-949f-1916d37df1f1', 'be8c5ea5-50b4-4aeb-b9bb-e604cb7fa916', 'd868ddf4-685e-4119-ada6-905305bd3c70'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:40:19 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-992802a6-6ba2-49d3-a032-52071c4eeadd tempest-TestServerVolumeAttachScenarioOldVersion-631312841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:40:19 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-992802a6-6ba2-49d3-a032-52071c4eeadd tempest-TestServerVolumeAttachScenarioOldVersion-631312841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:40:19 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-992802a6-6ba2-49d3-a032-52071c4eeadd tempest-TestServerVolumeAttachScenarioOldVersion-631312841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:40:19 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-992802a6-6ba2-49d3-a032-52071c4eeadd tempest-TestServerVolumeAttachScenarioOldVersion-631312841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:40:19 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-992802a6-6ba2-49d3-a032-52071c4eeadd tempest-TestServerVolumeAttachScenarioOldVersion-631312841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:40:19 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-992802a6-6ba2-49d3-a032-52071c4eeadd tempest-TestServerVolumeAttachScenarioOldVersion-631312841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:40:19 devstack sudo[98368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:40:19 devstack sudo[98368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:40:19 devstack sudo[98368]: pam_unix(sudo:session): session closed for user root Sep 06 06:40:19 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-992802a6-6ba2-49d3-a032-52071c4eeadd tempest-TestServerVolumeAttachScenarioOldVersion-631312841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.338s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:40:19 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-992802a6-6ba2-49d3-a032-52071c4eeadd tempest-TestServerVolumeAttachScenarioOldVersion-631312841 None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:40:19 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-992802a6-6ba2-49d3-a032-52071c4eeadd tempest-TestServerVolumeAttachScenarioOldVersion-631312841 None] Deleted volume successfully. Sep 06 06:40:20 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-992802a6-6ba2-49d3-a032-52071c4eeadd tempest-TestServerVolumeAttachScenarioOldVersion-631312841 None] Lock "cinder-9b0162fb-263d-4286-a1de-30903afe84d4-delete_volume" released by "delete_volume" :: held 1.374s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:40:24 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-402addfb-9857-4b03-af46-65e0276e533e tempest-VolumesTransfersV355Test-1327350034 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87329) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 06:40:24 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-402addfb-9857-4b03-af46-65e0276e533e tempest-VolumesTransfersV355Test-1327350034 None] Flow 'volume_create_manager' (6f13c8f3-7db0-4e48-9b4f-8c38243d3a42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:40:24 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-402addfb-9857-4b03-af46-65e0276e533e tempest-VolumesTransfersV355Test-1327350034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ae41ec2-07e4-42f1-863e-6aadf51785c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:40:24 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-402addfb-9857-4b03-af46-65e0276e533e tempest-VolumesTransfersV355Test-1327350034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ae41ec2-07e4-42f1-863e-6aadf51785c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:40:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-394982058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=195f64d8-3444-4843-88d9-0e61e7c61f54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18771e4cd33846c484fefece7009d0bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:40:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:40:24Z,use_quota=True,user_id='5ca9cfe336ef496fb8a80ef13d0e61e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:40:24 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-402addfb-9857-4b03-af46-65e0276e533e tempest-VolumesTransfersV355Test-1327350034 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3044e306-5888-4566-bc66-da7cceddf0ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:40:24 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-402addfb-9857-4b03-af46-65e0276e533e tempest-VolumesTransfersV355Test-1327350034 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3044e306-5888-4566-bc66-da7cceddf0ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:40:24 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-402addfb-9857-4b03-af46-65e0276e533e tempest-VolumesTransfersV355Test-1327350034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b05cd3fa-cac4-4de3-a81c-3a30dbf14150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:40:24 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-402addfb-9857-4b03-af46-65e0276e533e tempest-VolumesTransfersV355Test-1327350034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b05cd3fa-cac4-4de3-a81c-3a30dbf14150) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '195f64d8-3444-4843-88d9-0e61e7c61f54', 'volume_name': 'volume-195f64d8-3444-4843-88d9-0e61e7c61f54', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:40:24 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-402addfb-9857-4b03-af46-65e0276e533e tempest-VolumesTransfersV355Test-1327350034 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d96e1d8-a8b3-4e1e-862f-e7ac8fe63f93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:40:24 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-402addfb-9857-4b03-af46-65e0276e533e tempest-VolumesTransfersV355Test-1327350034 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d96e1d8-a8b3-4e1e-862f-e7ac8fe63f93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:40:24 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-402addfb-9857-4b03-af46-65e0276e533e tempest-VolumesTransfersV355Test-1327350034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b793df07-026a-4bd9-b148-6e77d0035322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:40:24 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-402addfb-9857-4b03-af46-65e0276e533e tempest-VolumesTransfersV355Test-1327350034 None] Volume 195f64d8-3444-4843-88d9-0e61e7c61f54: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-195f64d8-3444-4843-88d9-0e61e7c61f54', 'volume_size': 1} Sep 06 06:40:24 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-402addfb-9857-4b03-af46-65e0276e533e tempest-VolumesTransfersV355Test-1327350034 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:40:24 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-402addfb-9857-4b03-af46-65e0276e533e tempest-VolumesTransfersV355Test-1327350034 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:40:24 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-402addfb-9857-4b03-af46-65e0276e533e tempest-VolumesTransfersV355Test-1327350034 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:40:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-394982058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=195f64d8-3444-4843-88d9-0e61e7c61f54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18771e4cd33846c484fefece7009d0bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:40:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:40:24Z,use_quota=True,user_id='5ca9cfe336ef496fb8a80ef13d0e61e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)}" {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 06:40:24 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-402addfb-9857-4b03-af46-65e0276e533e tempest-VolumesTransfersV355Test-1327350034 None] Creating volume 195f64d8-3444-4843-88d9-0e61e7c61f54 {{(pid=87329) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 06:40:24 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-402addfb-9857-4b03-af46-65e0276e533e tempest-VolumesTransfersV355Test-1327350034 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:40:24 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-402addfb-9857-4b03-af46-65e0276e533e tempest-VolumesTransfersV355Test-1327350034 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:40:24 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-402addfb-9857-4b03-af46-65e0276e533e tempest-VolumesTransfersV355Test-1327350034 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:40:24 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-402addfb-9857-4b03-af46-65e0276e533e tempest-VolumesTransfersV355Test-1327350034 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:40:24 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-402addfb-9857-4b03-af46-65e0276e533e tempest-VolumesTransfersV355Test-1327350034 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:40:24 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-402addfb-9857-4b03-af46-65e0276e533e tempest-VolumesTransfersV355Test-1327350034 None] Selected osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 as target Quobyte volume. {{(pid=87329) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 06:40:24 devstack cinder-volume[87329]: INFO cinder.volume.drivers.remotefs [None req-402addfb-9857-4b03-af46-65e0276e533e tempest-VolumesTransfersV355Test-1327350034 None] casted to osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 Sep 06 06:40:24 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-402addfb-9857-4b03-af46-65e0276e533e tempest-VolumesTransfersV355Test-1327350034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-195f64d8-3444-4843-88d9-0e61e7c61f54 1073741824 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:40:24 devstack sudo[98395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-195f64d8-3444-4843-88d9-0e61e7c61f54 1073741824 Sep 06 06:40:24 devstack sudo[98395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:40:24 devstack sudo[98395]: pam_unix(sudo:session): session closed for user root Sep 06 06:40:24 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-402addfb-9857-4b03-af46-65e0276e533e tempest-VolumesTransfersV355Test-1327350034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-195f64d8-3444-4843-88d9-0e61e7c61f54 1073741824" returned: 0 in 0.513s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:40:24 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-402addfb-9857-4b03-af46-65e0276e533e tempest-VolumesTransfersV355Test-1327350034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-195f64d8-3444-4843-88d9-0e61e7c61f54 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:40:24 devstack sudo[98401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-195f64d8-3444-4843-88d9-0e61e7c61f54 Sep 06 06:40:24 devstack sudo[98401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:40:25 devstack sudo[98401]: pam_unix(sudo:session): session closed for user root Sep 06 06:40:25 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-402addfb-9857-4b03-af46-65e0276e533e tempest-VolumesTransfersV355Test-1327350034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-195f64d8-3444-4843-88d9-0e61e7c61f54" returned: 0 in 0.272s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:40:25 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-402addfb-9857-4b03-af46-65e0276e533e tempest-VolumesTransfersV355Test-1327350034 None] <== create_volume: return (834ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'} {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 06:40:25 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-402addfb-9857-4b03-af46-65e0276e533e tempest-VolumesTransfersV355Test-1327350034 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.838s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:40:25 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-402addfb-9857-4b03-af46-65e0276e533e tempest-VolumesTransfersV355Test-1327350034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b793df07-026a-4bd9-b148-6e77d0035322) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-195f64d8-3444-4843-88d9-0e61e7c61f54', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:40:25 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-402addfb-9857-4b03-af46-65e0276e533e tempest-VolumesTransfersV355Test-1327350034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c83efa87-289c-441f-b784-2fe05a57a698) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:40:25 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-402addfb-9857-4b03-af46-65e0276e533e tempest-VolumesTransfersV355Test-1327350034 None] Volume volume-195f64d8-3444-4843-88d9-0e61e7c61f54 (195f64d8-3444-4843-88d9-0e61e7c61f54): created successfully Sep 06 06:40:25 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-402addfb-9857-4b03-af46-65e0276e533e tempest-VolumesTransfersV355Test-1327350034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c83efa87-289c-441f-b784-2fe05a57a698) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:40:25 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-402addfb-9857-4b03-af46-65e0276e533e tempest-VolumesTransfersV355Test-1327350034 None] Flow 'volume_create_manager' (6f13c8f3-7db0-4e48-9b4f-8c38243d3a42) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:40:25 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-402addfb-9857-4b03-af46-65e0276e533e tempest-VolumesTransfersV355Test-1327350034 None] Created volume successfully. Sep 06 06:40:27 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-315d8870-7ef0-4f2f-a9f9-6298c3eca5ca tempest-VolumesTransfersV355Test-787103255 None] Transfer volume completed successfully. Sep 06 06:40:27 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-11f6cdd2-731c-4ca2-94bc-01f98d324ea1 tempest-VolumesTransfersV355Test-1936200090 None] Acquiring lock "cinder-195f64d8-3444-4843-88d9-0e61e7c61f54-delete_volume" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:40:27 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-11f6cdd2-731c-4ca2-94bc-01f98d324ea1 tempest-VolumesTransfersV355Test-1936200090 None] Lock "cinder-195f64d8-3444-4843-88d9-0e61e7c61f54-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:40:27 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-11f6cdd2-731c-4ca2-94bc-01f98d324ea1 tempest-VolumesTransfersV355Test-1936200090 None] Acquiring lock "cinder-quobyte-195f64d8-3444-4843-88d9-0e61e7c61f54" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:40:27 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-11f6cdd2-731c-4ca2-94bc-01f98d324ea1 tempest-VolumesTransfersV355Test-1936200090 None] Lock "cinder-quobyte-195f64d8-3444-4843-88d9-0e61e7c61f54" acquired by "delete_volume" :: waited 0.021s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:40:27 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[45d28d3c-f1f0-49a4-8f58-f97f98684f17]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:40:27 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-11f6cdd2-731c-4ca2-94bc-01f98d324ea1 tempest-VolumesTransfersV355Test-1936200090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-195f64d8-3444-4843-88d9-0e61e7c61f54 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:40:27 devstack sudo[98406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-195f64d8-3444-4843-88d9-0e61e7c61f54 Sep 06 06:40:27 devstack sudo[98406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:40:28 devstack sudo[98406]: pam_unix(sudo:session): session closed for user root Sep 06 06:40:28 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-11f6cdd2-731c-4ca2-94bc-01f98d324ea1 tempest-VolumesTransfersV355Test-1936200090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-195f64d8-3444-4843-88d9-0e61e7c61f54" returned: 0 in 0.438s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:40:28 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-11f6cdd2-731c-4ca2-94bc-01f98d324ea1 tempest-VolumesTransfersV355Test-1936200090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-195f64d8-3444-4843-88d9-0e61e7c61f54 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:40:28 devstack sudo[98411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-195f64d8-3444-4843-88d9-0e61e7c61f54 Sep 06 06:40:28 devstack sudo[98411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:40:28 devstack sudo[98411]: pam_unix(sudo:session): session closed for user root Sep 06 06:40:28 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-11f6cdd2-731c-4ca2-94bc-01f98d324ea1 tempest-VolumesTransfersV355Test-1936200090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-195f64d8-3444-4843-88d9-0e61e7c61f54" returned: 0 in 0.274s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:40:28 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-11f6cdd2-731c-4ca2-94bc-01f98d324ea1 tempest-VolumesTransfersV355Test-1936200090 None] Lock "cinder-quobyte-195f64d8-3444-4843-88d9-0e61e7c61f54" released by "delete_volume" :: held 0.759s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:40:28 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-11f6cdd2-731c-4ca2-94bc-01f98d324ea1 tempest-VolumesTransfersV355Test-1936200090 None] Created reservations ['2ec3c98f-65f7-4ee2-9b6d-e4f323b9eac4', '45e5daf6-55ee-4ab0-bea4-e383c316d7a9', '388e290c-b41a-4942-9bdb-9fec8ebadc23', '9dddfa61-21f4-4eb0-8c1e-41a78e8aa14f'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:40:28 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-11f6cdd2-731c-4ca2-94bc-01f98d324ea1 tempest-VolumesTransfersV355Test-1936200090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:40:28 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-11f6cdd2-731c-4ca2-94bc-01f98d324ea1 tempest-VolumesTransfersV355Test-1936200090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:40:28 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-11f6cdd2-731c-4ca2-94bc-01f98d324ea1 tempest-VolumesTransfersV355Test-1936200090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:40:28 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-11f6cdd2-731c-4ca2-94bc-01f98d324ea1 tempest-VolumesTransfersV355Test-1936200090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:40:28 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-11f6cdd2-731c-4ca2-94bc-01f98d324ea1 tempest-VolumesTransfersV355Test-1936200090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:40:28 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-11f6cdd2-731c-4ca2-94bc-01f98d324ea1 tempest-VolumesTransfersV355Test-1936200090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:40:28 devstack sudo[98414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:40:28 devstack sudo[98414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:40:29 devstack sudo[98414]: pam_unix(sudo:session): session closed for user root Sep 06 06:40:29 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-11f6cdd2-731c-4ca2-94bc-01f98d324ea1 tempest-VolumesTransfersV355Test-1936200090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.370s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:40:29 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-11f6cdd2-731c-4ca2-94bc-01f98d324ea1 tempest-VolumesTransfersV355Test-1936200090 None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:40:29 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-11f6cdd2-731c-4ca2-94bc-01f98d324ea1 tempest-VolumesTransfersV355Test-1936200090 None] Deleted volume successfully. Sep 06 06:40:29 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-11f6cdd2-731c-4ca2-94bc-01f98d324ea1 tempest-VolumesTransfersV355Test-1936200090 None] Lock "cinder-195f64d8-3444-4843-88d9-0e61e7c61f54-delete_volume" released by "delete_volume" :: held 1.384s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:40:29 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab9a1c34-da6e-413c-85ff-25aae195db13 tempest-VolumesTransfersV355Test-1327350034 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87329) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 06:40:29 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-ab9a1c34-da6e-413c-85ff-25aae195db13 tempest-VolumesTransfersV355Test-1327350034 None] Flow 'volume_create_manager' (f49a996e-119b-404b-876a-8f9c2745608e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:40:29 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-ab9a1c34-da6e-413c-85ff-25aae195db13 tempest-VolumesTransfersV355Test-1327350034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b978ebe-9e33-4221-b437-605ea05c507c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:40:29 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-ab9a1c34-da6e-413c-85ff-25aae195db13 tempest-VolumesTransfersV355Test-1327350034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b978ebe-9e33-4221-b437-605ea05c507c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:40:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1651874247',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01d2a5fa-504a-4ed8-a480-0a9feaaff765,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18771e4cd33846c484fefece7009d0bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:40:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:40:30Z,use_quota=True,user_id='5ca9cfe336ef496fb8a80ef13d0e61e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:40:29 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-ab9a1c34-da6e-413c-85ff-25aae195db13 tempest-VolumesTransfersV355Test-1327350034 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c2dde31-cb88-4f70-86f2-690600867a50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:40:29 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-ab9a1c34-da6e-413c-85ff-25aae195db13 tempest-VolumesTransfersV355Test-1327350034 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c2dde31-cb88-4f70-86f2-690600867a50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:40:29 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-ab9a1c34-da6e-413c-85ff-25aae195db13 tempest-VolumesTransfersV355Test-1327350034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11bf736d-884b-447e-9d58-1c1194458134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:40:29 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-ab9a1c34-da6e-413c-85ff-25aae195db13 tempest-VolumesTransfersV355Test-1327350034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11bf736d-884b-447e-9d58-1c1194458134) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01d2a5fa-504a-4ed8-a480-0a9feaaff765', 'volume_name': 'volume-01d2a5fa-504a-4ed8-a480-0a9feaaff765', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:40:29 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-ab9a1c34-da6e-413c-85ff-25aae195db13 tempest-VolumesTransfersV355Test-1327350034 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdc3b02d-eca8-4319-852a-7a2c9c190c3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:40:29 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-ab9a1c34-da6e-413c-85ff-25aae195db13 tempest-VolumesTransfersV355Test-1327350034 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdc3b02d-eca8-4319-852a-7a2c9c190c3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:40:29 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-ab9a1c34-da6e-413c-85ff-25aae195db13 tempest-VolumesTransfersV355Test-1327350034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d151fac-7849-4c55-a0a0-24cb92e41eda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:40:29 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-ab9a1c34-da6e-413c-85ff-25aae195db13 tempest-VolumesTransfersV355Test-1327350034 None] Volume 01d2a5fa-504a-4ed8-a480-0a9feaaff765: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01d2a5fa-504a-4ed8-a480-0a9feaaff765', 'volume_size': 1} Sep 06 06:40:29 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-ab9a1c34-da6e-413c-85ff-25aae195db13 tempest-VolumesTransfersV355Test-1327350034 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:40:29 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-ab9a1c34-da6e-413c-85ff-25aae195db13 tempest-VolumesTransfersV355Test-1327350034 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:40:29 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-ab9a1c34-da6e-413c-85ff-25aae195db13 tempest-VolumesTransfersV355Test-1327350034 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:40:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1651874247',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01d2a5fa-504a-4ed8-a480-0a9feaaff765,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18771e4cd33846c484fefece7009d0bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:40:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:40:30Z,use_quota=True,user_id='5ca9cfe336ef496fb8a80ef13d0e61e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)}" {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 06:40:29 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-ab9a1c34-da6e-413c-85ff-25aae195db13 tempest-VolumesTransfersV355Test-1327350034 None] Creating volume 01d2a5fa-504a-4ed8-a480-0a9feaaff765 {{(pid=87329) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 06:40:29 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-ab9a1c34-da6e-413c-85ff-25aae195db13 tempest-VolumesTransfersV355Test-1327350034 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:40:29 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-ab9a1c34-da6e-413c-85ff-25aae195db13 tempest-VolumesTransfersV355Test-1327350034 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:40:29 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-ab9a1c34-da6e-413c-85ff-25aae195db13 tempest-VolumesTransfersV355Test-1327350034 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:40:29 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-ab9a1c34-da6e-413c-85ff-25aae195db13 tempest-VolumesTransfersV355Test-1327350034 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:40:29 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-ab9a1c34-da6e-413c-85ff-25aae195db13 tempest-VolumesTransfersV355Test-1327350034 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:40:29 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-ab9a1c34-da6e-413c-85ff-25aae195db13 tempest-VolumesTransfersV355Test-1327350034 None] Selected osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 as target Quobyte volume. {{(pid=87329) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 06:40:29 devstack cinder-volume[87329]: INFO cinder.volume.drivers.remotefs [None req-ab9a1c34-da6e-413c-85ff-25aae195db13 tempest-VolumesTransfersV355Test-1327350034 None] casted to osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 Sep 06 06:40:29 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-ab9a1c34-da6e-413c-85ff-25aae195db13 tempest-VolumesTransfersV355Test-1327350034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-01d2a5fa-504a-4ed8-a480-0a9feaaff765 1073741824 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:40:29 devstack sudo[98420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-01d2a5fa-504a-4ed8-a480-0a9feaaff765 1073741824 Sep 06 06:40:29 devstack sudo[98420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:40:30 devstack sudo[98420]: pam_unix(sudo:session): session closed for user root Sep 06 06:40:30 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-ab9a1c34-da6e-413c-85ff-25aae195db13 tempest-VolumesTransfersV355Test-1327350034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-01d2a5fa-504a-4ed8-a480-0a9feaaff765 1073741824" returned: 0 in 0.497s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:40:30 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-ab9a1c34-da6e-413c-85ff-25aae195db13 tempest-VolumesTransfersV355Test-1327350034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-01d2a5fa-504a-4ed8-a480-0a9feaaff765 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:40:30 devstack sudo[98427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-01d2a5fa-504a-4ed8-a480-0a9feaaff765 Sep 06 06:40:30 devstack sudo[98427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:40:30 devstack sudo[98427]: pam_unix(sudo:session): session closed for user root Sep 06 06:40:30 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-ab9a1c34-da6e-413c-85ff-25aae195db13 tempest-VolumesTransfersV355Test-1327350034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-01d2a5fa-504a-4ed8-a480-0a9feaaff765" returned: 0 in 0.306s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:40:30 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-ab9a1c34-da6e-413c-85ff-25aae195db13 tempest-VolumesTransfersV355Test-1327350034 None] <== create_volume: return (848ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'} {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 06:40:30 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-ab9a1c34-da6e-413c-85ff-25aae195db13 tempest-VolumesTransfersV355Test-1327350034 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.851s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:40:30 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-ab9a1c34-da6e-413c-85ff-25aae195db13 tempest-VolumesTransfersV355Test-1327350034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d151fac-7849-4c55-a0a0-24cb92e41eda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01d2a5fa-504a-4ed8-a480-0a9feaaff765', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:40:30 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-ab9a1c34-da6e-413c-85ff-25aae195db13 tempest-VolumesTransfersV355Test-1327350034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46482978-b666-4bad-a4fc-3025b8f6120e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:40:30 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-ab9a1c34-da6e-413c-85ff-25aae195db13 tempest-VolumesTransfersV355Test-1327350034 None] Volume volume-01d2a5fa-504a-4ed8-a480-0a9feaaff765 (01d2a5fa-504a-4ed8-a480-0a9feaaff765): created successfully Sep 06 06:40:30 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-ab9a1c34-da6e-413c-85ff-25aae195db13 tempest-VolumesTransfersV355Test-1327350034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46482978-b666-4bad-a4fc-3025b8f6120e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:40:30 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-ab9a1c34-da6e-413c-85ff-25aae195db13 tempest-VolumesTransfersV355Test-1327350034 None] Flow 'volume_create_manager' (f49a996e-119b-404b-876a-8f9c2745608e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:40:30 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-ab9a1c34-da6e-413c-85ff-25aae195db13 tempest-VolumesTransfersV355Test-1327350034 None] Created volume successfully. Sep 06 06:40:32 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-13e18115-2886-4f75-9f89-61eac385a870 tempest-VolumesTransfersV355Test-1936200090 None] Acquiring lock "cinder-01d2a5fa-504a-4ed8-a480-0a9feaaff765-delete_volume" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:40:32 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-13e18115-2886-4f75-9f89-61eac385a870 tempest-VolumesTransfersV355Test-1936200090 None] Lock "cinder-01d2a5fa-504a-4ed8-a480-0a9feaaff765-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:40:32 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-13e18115-2886-4f75-9f89-61eac385a870 tempest-VolumesTransfersV355Test-1936200090 None] Acquiring lock "cinder-quobyte-01d2a5fa-504a-4ed8-a480-0a9feaaff765" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:40:32 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-13e18115-2886-4f75-9f89-61eac385a870 tempest-VolumesTransfersV355Test-1936200090 None] Lock "cinder-quobyte-01d2a5fa-504a-4ed8-a480-0a9feaaff765" acquired by "delete_volume" :: waited 0.016s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:40:32 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[79857e78-7291-4b15-bf85-ee2994c5c16c]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:40:32 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-13e18115-2886-4f75-9f89-61eac385a870 tempest-VolumesTransfersV355Test-1936200090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-01d2a5fa-504a-4ed8-a480-0a9feaaff765 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:40:32 devstack sudo[98431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-01d2a5fa-504a-4ed8-a480-0a9feaaff765 Sep 06 06:40:32 devstack sudo[98431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:40:32 devstack sudo[98431]: pam_unix(sudo:session): session closed for user root Sep 06 06:40:32 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-13e18115-2886-4f75-9f89-61eac385a870 tempest-VolumesTransfersV355Test-1936200090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-01d2a5fa-504a-4ed8-a480-0a9feaaff765" returned: 0 in 0.415s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:40:32 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-13e18115-2886-4f75-9f89-61eac385a870 tempest-VolumesTransfersV355Test-1936200090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-01d2a5fa-504a-4ed8-a480-0a9feaaff765 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:40:32 devstack sudo[98436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-01d2a5fa-504a-4ed8-a480-0a9feaaff765 Sep 06 06:40:32 devstack sudo[98436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:40:32 devstack sudo[98436]: pam_unix(sudo:session): session closed for user root Sep 06 06:40:32 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-13e18115-2886-4f75-9f89-61eac385a870 tempest-VolumesTransfersV355Test-1936200090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-01d2a5fa-504a-4ed8-a480-0a9feaaff765" returned: 0 in 0.252s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:40:32 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-13e18115-2886-4f75-9f89-61eac385a870 tempest-VolumesTransfersV355Test-1936200090 None] Lock "cinder-quobyte-01d2a5fa-504a-4ed8-a480-0a9feaaff765" released by "delete_volume" :: held 0.710s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:40:32 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-13e18115-2886-4f75-9f89-61eac385a870 tempest-VolumesTransfersV355Test-1936200090 None] Created reservations ['747a6ddb-7e31-49d2-9bad-23bf423d963c', '5aecef74-5840-49bd-be4a-4b18efb8bbf2', '8f8b4f06-f049-4365-95be-0e14f4966672', 'c665cd54-c315-4c96-a7a2-2f4c98f2cf6e'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:40:32 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-13e18115-2886-4f75-9f89-61eac385a870 tempest-VolumesTransfersV355Test-1936200090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:40:32 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-13e18115-2886-4f75-9f89-61eac385a870 tempest-VolumesTransfersV355Test-1936200090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:40:32 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-13e18115-2886-4f75-9f89-61eac385a870 tempest-VolumesTransfersV355Test-1936200090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:40:32 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-13e18115-2886-4f75-9f89-61eac385a870 tempest-VolumesTransfersV355Test-1936200090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:40:32 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-13e18115-2886-4f75-9f89-61eac385a870 tempest-VolumesTransfersV355Test-1936200090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:40:32 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-13e18115-2886-4f75-9f89-61eac385a870 tempest-VolumesTransfersV355Test-1936200090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:40:32 devstack sudo[98439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:40:32 devstack sudo[98439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:40:33 devstack sudo[98439]: pam_unix(sudo:session): session closed for user root Sep 06 06:40:33 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-13e18115-2886-4f75-9f89-61eac385a870 tempest-VolumesTransfersV355Test-1936200090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.256s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:40:33 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-13e18115-2886-4f75-9f89-61eac385a870 tempest-VolumesTransfersV355Test-1936200090 None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:40:33 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-13e18115-2886-4f75-9f89-61eac385a870 tempest-VolumesTransfersV355Test-1936200090 None] Deleted volume successfully. Sep 06 06:40:33 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-13e18115-2886-4f75-9f89-61eac385a870 tempest-VolumesTransfersV355Test-1936200090 None] Lock "cinder-01d2a5fa-504a-4ed8-a480-0a9feaaff765-delete_volume" released by "delete_volume" :: held 1.211s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:40:39 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-831fae3e-bfae-4479-9fe7-fc64a467c934 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87329) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 06:40:40 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-831fae3e-bfae-4479-9fe7-fc64a467c934 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Flow 'volume_create_manager' (9f3e6214-160f-43aa-9305-fde1081929c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:40:40 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-831fae3e-bfae-4479-9fe7-fc64a467c934 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58394006-71c3-4dc3-8ff2-49202365cf1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:40:40 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-831fae3e-bfae-4479-9fe7-fc64a467c934 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58394006-71c3-4dc3-8ff2-49202365cf1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:40:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1454478945',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a0a616d-4117-4b8e-a6a4-b41ff175423c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46f52a8fc2cd40898813ebea168c263a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:40:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:40:40Z,use_quota=True,user_id='63f6570ea0dc4e83854c1b9f1b29a85d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:40:40 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-831fae3e-bfae-4479-9fe7-fc64a467c934 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f3a3e00-7405-406b-882f-fe6a0250a30f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:40:40 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-831fae3e-bfae-4479-9fe7-fc64a467c934 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f3a3e00-7405-406b-882f-fe6a0250a30f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:40:40 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-831fae3e-bfae-4479-9fe7-fc64a467c934 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8a061fd-880e-467c-9418-b8a17cb5e285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:40:40 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-831fae3e-bfae-4479-9fe7-fc64a467c934 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8a061fd-880e-467c-9418-b8a17cb5e285) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a0a616d-4117-4b8e-a6a4-b41ff175423c', 'volume_name': 'volume-2a0a616d-4117-4b8e-a6a4-b41ff175423c', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:40:40 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-831fae3e-bfae-4479-9fe7-fc64a467c934 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7651175-78c4-415b-922a-953a3df2a2cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:40:40 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-831fae3e-bfae-4479-9fe7-fc64a467c934 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7651175-78c4-415b-922a-953a3df2a2cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:40:40 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-831fae3e-bfae-4479-9fe7-fc64a467c934 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e3c14b6-03ed-4b67-a132-389b49441130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:40:40 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-831fae3e-bfae-4479-9fe7-fc64a467c934 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Volume 2a0a616d-4117-4b8e-a6a4-b41ff175423c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a0a616d-4117-4b8e-a6a4-b41ff175423c', 'volume_size': 1} Sep 06 06:40:40 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-831fae3e-bfae-4479-9fe7-fc64a467c934 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:40:40 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-831fae3e-bfae-4479-9fe7-fc64a467c934 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:40:40 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-831fae3e-bfae-4479-9fe7-fc64a467c934 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:40:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1454478945',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a0a616d-4117-4b8e-a6a4-b41ff175423c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46f52a8fc2cd40898813ebea168c263a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:40:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:40:40Z,use_quota=True,user_id='63f6570ea0dc4e83854c1b9f1b29a85d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)}" {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 06:40:40 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-831fae3e-bfae-4479-9fe7-fc64a467c934 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Creating volume 2a0a616d-4117-4b8e-a6a4-b41ff175423c {{(pid=87329) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 06:40:40 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-831fae3e-bfae-4479-9fe7-fc64a467c934 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:40:40 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-831fae3e-bfae-4479-9fe7-fc64a467c934 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:40:40 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-831fae3e-bfae-4479-9fe7-fc64a467c934 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:40:40 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-831fae3e-bfae-4479-9fe7-fc64a467c934 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:40:40 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-831fae3e-bfae-4479-9fe7-fc64a467c934 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:40:40 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-831fae3e-bfae-4479-9fe7-fc64a467c934 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Selected osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 as target Quobyte volume. {{(pid=87329) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 06:40:40 devstack cinder-volume[87329]: INFO cinder.volume.drivers.remotefs [None req-831fae3e-bfae-4479-9fe7-fc64a467c934 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] casted to osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 Sep 06 06:40:40 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-831fae3e-bfae-4479-9fe7-fc64a467c934 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-2a0a616d-4117-4b8e-a6a4-b41ff175423c 1073741824 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:40:40 devstack sudo[98483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-2a0a616d-4117-4b8e-a6a4-b41ff175423c 1073741824 Sep 06 06:40:40 devstack sudo[98483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:40:40 devstack sudo[98483]: pam_unix(sudo:session): session closed for user root Sep 06 06:40:40 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-831fae3e-bfae-4479-9fe7-fc64a467c934 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-2a0a616d-4117-4b8e-a6a4-b41ff175423c 1073741824" returned: 0 in 0.588s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:40:40 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-831fae3e-bfae-4479-9fe7-fc64a467c934 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-2a0a616d-4117-4b8e-a6a4-b41ff175423c {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:40:40 devstack sudo[98489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-2a0a616d-4117-4b8e-a6a4-b41ff175423c Sep 06 06:40:40 devstack sudo[98489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:40:40 devstack sudo[98489]: pam_unix(sudo:session): session closed for user root Sep 06 06:40:40 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-831fae3e-bfae-4479-9fe7-fc64a467c934 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-2a0a616d-4117-4b8e-a6a4-b41ff175423c" returned: 0 in 0.261s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:40:40 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-831fae3e-bfae-4479-9fe7-fc64a467c934 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] <== create_volume: return (914ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'} {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 06:40:40 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-831fae3e-bfae-4479-9fe7-fc64a467c934 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.917s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:40:41 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-831fae3e-bfae-4479-9fe7-fc64a467c934 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e3c14b6-03ed-4b67-a132-389b49441130) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a0a616d-4117-4b8e-a6a4-b41ff175423c', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:40:41 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-831fae3e-bfae-4479-9fe7-fc64a467c934 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (988bdbba-d5ab-45f6-9544-1f07bdffebc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:40:41 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-831fae3e-bfae-4479-9fe7-fc64a467c934 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Volume volume-2a0a616d-4117-4b8e-a6a4-b41ff175423c (2a0a616d-4117-4b8e-a6a4-b41ff175423c): created successfully Sep 06 06:40:41 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-831fae3e-bfae-4479-9fe7-fc64a467c934 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (988bdbba-d5ab-45f6-9544-1f07bdffebc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:40:41 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-831fae3e-bfae-4479-9fe7-fc64a467c934 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Flow 'volume_create_manager' (9f3e6214-160f-43aa-9305-fde1081929c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:40:41 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-831fae3e-bfae-4479-9fe7-fc64a467c934 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Created volume successfully. Sep 06 06:40:41 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-42ac7edb-a616-4e7a-ad3b-a8bbef3c50bc tempest-VolumesCloneTest-741677168 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87329) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 06:40:41 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-42ac7edb-a616-4e7a-ad3b-a8bbef3c50bc tempest-VolumesCloneTest-741677168 None] Flow 'volume_create_manager' (76781848-df1e-4ebb-8304-149256a23722) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:40:41 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-42ac7edb-a616-4e7a-ad3b-a8bbef3c50bc tempest-VolumesCloneTest-741677168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6abe59b-d2ab-4596-9c99-4b34e4aff8b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:40:41 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-42ac7edb-a616-4e7a-ad3b-a8bbef3c50bc tempest-VolumesCloneTest-741677168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6abe59b-d2ab-4596-9c99-4b34e4aff8b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:40:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-727147231',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=071ddf2b-7aaa-438f-8ee9-dfea9065eaf1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='471efa60fd7f4bc89c0426665573cf90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:40:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:40:41Z,use_quota=True,user_id='d8ec2463119247b49f3c47081f75f3ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:40:41 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-42ac7edb-a616-4e7a-ad3b-a8bbef3c50bc tempest-VolumesCloneTest-741677168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f826d64-c8ee-4546-8160-a48bc59021a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:40:41 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-42ac7edb-a616-4e7a-ad3b-a8bbef3c50bc tempest-VolumesCloneTest-741677168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f826d64-c8ee-4546-8160-a48bc59021a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:40:41 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-42ac7edb-a616-4e7a-ad3b-a8bbef3c50bc tempest-VolumesCloneTest-741677168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (257d9df4-a5d2-40a2-ad63-45cb6fe26484) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:40:41 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-42ac7edb-a616-4e7a-ad3b-a8bbef3c50bc tempest-VolumesCloneTest-741677168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (257d9df4-a5d2-40a2-ad63-45cb6fe26484) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '071ddf2b-7aaa-438f-8ee9-dfea9065eaf1', 'volume_name': 'volume-071ddf2b-7aaa-438f-8ee9-dfea9065eaf1', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:40:41 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-42ac7edb-a616-4e7a-ad3b-a8bbef3c50bc tempest-VolumesCloneTest-741677168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bfa4be5-3974-43ab-b354-eba5fcd2e8c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:40:41 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-42ac7edb-a616-4e7a-ad3b-a8bbef3c50bc tempest-VolumesCloneTest-741677168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bfa4be5-3974-43ab-b354-eba5fcd2e8c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:40:41 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-42ac7edb-a616-4e7a-ad3b-a8bbef3c50bc tempest-VolumesCloneTest-741677168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60b8a275-4cdc-4b53-b4e6-182524b59fc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:40:41 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-42ac7edb-a616-4e7a-ad3b-a8bbef3c50bc tempest-VolumesCloneTest-741677168 None] Volume 071ddf2b-7aaa-438f-8ee9-dfea9065eaf1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-071ddf2b-7aaa-438f-8ee9-dfea9065eaf1', 'volume_size': 1} Sep 06 06:40:41 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-42ac7edb-a616-4e7a-ad3b-a8bbef3c50bc tempest-VolumesCloneTest-741677168 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:40:41 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-42ac7edb-a616-4e7a-ad3b-a8bbef3c50bc tempest-VolumesCloneTest-741677168 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:40:41 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-42ac7edb-a616-4e7a-ad3b-a8bbef3c50bc tempest-VolumesCloneTest-741677168 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:40:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-727147231',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=071ddf2b-7aaa-438f-8ee9-dfea9065eaf1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='471efa60fd7f4bc89c0426665573cf90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:40:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:40:41Z,use_quota=True,user_id='d8ec2463119247b49f3c47081f75f3ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)}" {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 06:40:41 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-42ac7edb-a616-4e7a-ad3b-a8bbef3c50bc tempest-VolumesCloneTest-741677168 None] Creating volume 071ddf2b-7aaa-438f-8ee9-dfea9065eaf1 {{(pid=87329) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 06:40:41 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-42ac7edb-a616-4e7a-ad3b-a8bbef3c50bc tempest-VolumesCloneTest-741677168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:40:41 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-42ac7edb-a616-4e7a-ad3b-a8bbef3c50bc tempest-VolumesCloneTest-741677168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:40:41 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-42ac7edb-a616-4e7a-ad3b-a8bbef3c50bc tempest-VolumesCloneTest-741677168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:40:41 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-42ac7edb-a616-4e7a-ad3b-a8bbef3c50bc tempest-VolumesCloneTest-741677168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:40:41 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-42ac7edb-a616-4e7a-ad3b-a8bbef3c50bc tempest-VolumesCloneTest-741677168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:40:41 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-42ac7edb-a616-4e7a-ad3b-a8bbef3c50bc tempest-VolumesCloneTest-741677168 None] Selected osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 as target Quobyte volume. {{(pid=87329) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 06:40:41 devstack cinder-volume[87329]: INFO cinder.volume.drivers.remotefs [None req-42ac7edb-a616-4e7a-ad3b-a8bbef3c50bc tempest-VolumesCloneTest-741677168 None] casted to osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 Sep 06 06:40:41 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-42ac7edb-a616-4e7a-ad3b-a8bbef3c50bc tempest-VolumesCloneTest-741677168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-071ddf2b-7aaa-438f-8ee9-dfea9065eaf1 1073741824 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:40:41 devstack sudo[98502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-071ddf2b-7aaa-438f-8ee9-dfea9065eaf1 1073741824 Sep 06 06:40:41 devstack sudo[98502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:40:42 devstack sudo[98502]: pam_unix(sudo:session): session closed for user root Sep 06 06:40:42 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-42ac7edb-a616-4e7a-ad3b-a8bbef3c50bc tempest-VolumesCloneTest-741677168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-071ddf2b-7aaa-438f-8ee9-dfea9065eaf1 1073741824" returned: 0 in 0.578s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:40:42 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-42ac7edb-a616-4e7a-ad3b-a8bbef3c50bc tempest-VolumesCloneTest-741677168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-071ddf2b-7aaa-438f-8ee9-dfea9065eaf1 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:40:42 devstack sudo[98513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-071ddf2b-7aaa-438f-8ee9-dfea9065eaf1 Sep 06 06:40:42 devstack sudo[98513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:40:42 devstack sudo[98513]: pam_unix(sudo:session): session closed for user root Sep 06 06:40:42 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-42ac7edb-a616-4e7a-ad3b-a8bbef3c50bc tempest-VolumesCloneTest-741677168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-071ddf2b-7aaa-438f-8ee9-dfea9065eaf1" returned: 0 in 0.304s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:40:42 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-42ac7edb-a616-4e7a-ad3b-a8bbef3c50bc tempest-VolumesCloneTest-741677168 None] <== create_volume: return (936ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'} {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 06:40:42 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-42ac7edb-a616-4e7a-ad3b-a8bbef3c50bc tempest-VolumesCloneTest-741677168 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.940s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:40:42 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-42ac7edb-a616-4e7a-ad3b-a8bbef3c50bc tempest-VolumesCloneTest-741677168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60b8a275-4cdc-4b53-b4e6-182524b59fc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-071ddf2b-7aaa-438f-8ee9-dfea9065eaf1', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:40:42 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-42ac7edb-a616-4e7a-ad3b-a8bbef3c50bc tempest-VolumesCloneTest-741677168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0c61149-a728-4c45-aa9a-4917660b1fa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:40:42 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-42ac7edb-a616-4e7a-ad3b-a8bbef3c50bc tempest-VolumesCloneTest-741677168 None] Volume volume-071ddf2b-7aaa-438f-8ee9-dfea9065eaf1 (071ddf2b-7aaa-438f-8ee9-dfea9065eaf1): created successfully Sep 06 06:40:42 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-42ac7edb-a616-4e7a-ad3b-a8bbef3c50bc tempest-VolumesCloneTest-741677168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0c61149-a728-4c45-aa9a-4917660b1fa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:40:42 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-42ac7edb-a616-4e7a-ad3b-a8bbef3c50bc tempest-VolumesCloneTest-741677168 None] Flow 'volume_create_manager' (76781848-df1e-4ebb-8304-149256a23722) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:40:42 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-42ac7edb-a616-4e7a-ad3b-a8bbef3c50bc tempest-VolumesCloneTest-741677168 None] Created volume successfully. Sep 06 06:40:42 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7ad590b-9906-4e95-9c21-749e2127ea24 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87329) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 06:40:42 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-c7ad590b-9906-4e95-9c21-749e2127ea24 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Flow 'volume_create_manager' (6d3f2639-f4e8-492c-aec9-c188d8319a9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:40:42 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-c7ad590b-9906-4e95-9c21-749e2127ea24 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0da525be-257a-493e-a245-f4b8b4907614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:40:42 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-c7ad590b-9906-4e95-9c21-749e2127ea24 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0da525be-257a-493e-a245-f4b8b4907614) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:40:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-989441224',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e466a30a-8c43-4df6-b513-5968bfbe9345,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46f52a8fc2cd40898813ebea168c263a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:40:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:40:43Z,use_quota=True,user_id='63f6570ea0dc4e83854c1b9f1b29a85d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:40:42 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-c7ad590b-9906-4e95-9c21-749e2127ea24 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c3088b1-c623-4f49-8fd0-361b9b6f809b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:40:42 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-c7ad590b-9906-4e95-9c21-749e2127ea24 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c3088b1-c623-4f49-8fd0-361b9b6f809b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:40:42 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-c7ad590b-9906-4e95-9c21-749e2127ea24 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (710f3e54-33c7-43f3-83e1-ebf5e6ceb7ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:40:42 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-c7ad590b-9906-4e95-9c21-749e2127ea24 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (710f3e54-33c7-43f3-83e1-ebf5e6ceb7ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e466a30a-8c43-4df6-b513-5968bfbe9345', 'volume_name': 'volume-e466a30a-8c43-4df6-b513-5968bfbe9345', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:40:42 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-c7ad590b-9906-4e95-9c21-749e2127ea24 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2cbee29-68d7-48f1-849f-2d1a3d858fd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:40:42 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-c7ad590b-9906-4e95-9c21-749e2127ea24 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2cbee29-68d7-48f1-849f-2d1a3d858fd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:40:42 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-c7ad590b-9906-4e95-9c21-749e2127ea24 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02404303-fcb3-4c05-a0f4-7ff157f28bb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:40:42 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-c7ad590b-9906-4e95-9c21-749e2127ea24 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Volume e466a30a-8c43-4df6-b513-5968bfbe9345: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e466a30a-8c43-4df6-b513-5968bfbe9345', 'volume_size': 1} Sep 06 06:40:42 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-c7ad590b-9906-4e95-9c21-749e2127ea24 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:40:42 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-c7ad590b-9906-4e95-9c21-749e2127ea24 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:40:42 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-c7ad590b-9906-4e95-9c21-749e2127ea24 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:40:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-989441224',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e466a30a-8c43-4df6-b513-5968bfbe9345,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46f52a8fc2cd40898813ebea168c263a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:40:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:40:43Z,use_quota=True,user_id='63f6570ea0dc4e83854c1b9f1b29a85d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)}" {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 06:40:42 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-c7ad590b-9906-4e95-9c21-749e2127ea24 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Creating volume e466a30a-8c43-4df6-b513-5968bfbe9345 {{(pid=87329) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 06:40:42 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-c7ad590b-9906-4e95-9c21-749e2127ea24 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:40:42 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-c7ad590b-9906-4e95-9c21-749e2127ea24 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:40:42 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-c7ad590b-9906-4e95-9c21-749e2127ea24 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:40:42 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-c7ad590b-9906-4e95-9c21-749e2127ea24 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:40:42 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-c7ad590b-9906-4e95-9c21-749e2127ea24 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:40:42 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-c7ad590b-9906-4e95-9c21-749e2127ea24 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Selected osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 as target Quobyte volume. {{(pid=87329) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 06:40:42 devstack cinder-volume[87329]: INFO cinder.volume.drivers.remotefs [None req-c7ad590b-9906-4e95-9c21-749e2127ea24 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] casted to osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 Sep 06 06:40:42 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-c7ad590b-9906-4e95-9c21-749e2127ea24 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e466a30a-8c43-4df6-b513-5968bfbe9345 1073741824 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:40:42 devstack sudo[98516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e466a30a-8c43-4df6-b513-5968bfbe9345 1073741824 Sep 06 06:40:42 devstack sudo[98516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:40:43 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-a349d36e-bffb-43b5-a219-2cfe9d391c49 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87329) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 06:40:43 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-a349d36e-bffb-43b5-a219-2cfe9d391c49 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Flow 'volume_create_manager' (fdd0b9e5-f0a7-4d67-9338-e44b9890abcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:40:43 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-a349d36e-bffb-43b5-a219-2cfe9d391c49 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a611cb4-05f0-4ea7-b65e-78bb35b32b08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:40:43 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-a349d36e-bffb-43b5-a219-2cfe9d391c49 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a611cb4-05f0-4ea7-b65e-78bb35b32b08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:40:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-942183794',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d485d5f9-d238-4235-a88b-b69cf72c95da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46f52a8fc2cd40898813ebea168c263a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:40:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:40:43Z,use_quota=True,user_id='63f6570ea0dc4e83854c1b9f1b29a85d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:40:43 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-a349d36e-bffb-43b5-a219-2cfe9d391c49 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdbac9e0-d06e-41ff-8350-293aad0f8043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:40:43 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-a349d36e-bffb-43b5-a219-2cfe9d391c49 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdbac9e0-d06e-41ff-8350-293aad0f8043) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:40:43 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-a349d36e-bffb-43b5-a219-2cfe9d391c49 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d9b810d-242f-478d-b27c-9b6bb1183c18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:40:43 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-a349d36e-bffb-43b5-a219-2cfe9d391c49 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d9b810d-242f-478d-b27c-9b6bb1183c18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd485d5f9-d238-4235-a88b-b69cf72c95da', 'volume_name': 'volume-d485d5f9-d238-4235-a88b-b69cf72c95da', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:40:43 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-a349d36e-bffb-43b5-a219-2cfe9d391c49 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13e11de5-63a7-484a-8a6c-9d594aae5327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:40:43 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-a349d36e-bffb-43b5-a219-2cfe9d391c49 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13e11de5-63a7-484a-8a6c-9d594aae5327) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:40:43 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-a349d36e-bffb-43b5-a219-2cfe9d391c49 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42c8092b-0549-4b2c-b7a2-b733d0670615) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:40:43 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-a349d36e-bffb-43b5-a219-2cfe9d391c49 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Volume d485d5f9-d238-4235-a88b-b69cf72c95da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d485d5f9-d238-4235-a88b-b69cf72c95da', 'volume_size': 1} Sep 06 06:40:43 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-a349d36e-bffb-43b5-a219-2cfe9d391c49 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:40:43 devstack sudo[98516]: pam_unix(sudo:session): session closed for user root Sep 06 06:40:43 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-c7ad590b-9906-4e95-9c21-749e2127ea24 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e466a30a-8c43-4df6-b513-5968bfbe9345 1073741824" returned: 0 in 0.621s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:40:43 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-c7ad590b-9906-4e95-9c21-749e2127ea24 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e466a30a-8c43-4df6-b513-5968bfbe9345 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:40:43 devstack sudo[98523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e466a30a-8c43-4df6-b513-5968bfbe9345 Sep 06 06:40:43 devstack sudo[98523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:40:43 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-5fe54156-0b49-44bd-900c-649e89f626f5 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87329) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 06:40:43 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-5fe54156-0b49-44bd-900c-649e89f626f5 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Flow 'volume_create_manager' (086d7598-b7a4-46af-8ad0-0224657f1f5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:40:43 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-5fe54156-0b49-44bd-900c-649e89f626f5 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd9998a6-ac5f-47fe-bdf4-361f9bff736b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:40:43 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-5fe54156-0b49-44bd-900c-649e89f626f5 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd9998a6-ac5f-47fe-bdf4-361f9bff736b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:40:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1013005244',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59f04e33-e3d2-431e-87d3-9ca7a5361eed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46f52a8fc2cd40898813ebea168c263a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:40:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:40:44Z,use_quota=True,user_id='63f6570ea0dc4e83854c1b9f1b29a85d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:40:43 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-5fe54156-0b49-44bd-900c-649e89f626f5 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cc7659b-b3c3-46af-ab09-fbbad9f2e6e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:40:43 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-5fe54156-0b49-44bd-900c-649e89f626f5 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cc7659b-b3c3-46af-ab09-fbbad9f2e6e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:40:43 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-5fe54156-0b49-44bd-900c-649e89f626f5 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24b733de-794a-4dc9-808f-d8b6a9435172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:40:43 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-5fe54156-0b49-44bd-900c-649e89f626f5 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24b733de-794a-4dc9-808f-d8b6a9435172) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '59f04e33-e3d2-431e-87d3-9ca7a5361eed', 'volume_name': 'volume-59f04e33-e3d2-431e-87d3-9ca7a5361eed', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:40:43 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-5fe54156-0b49-44bd-900c-649e89f626f5 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aebc0309-85a7-4782-840d-e7c99dc62273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:40:43 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-5fe54156-0b49-44bd-900c-649e89f626f5 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aebc0309-85a7-4782-840d-e7c99dc62273) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:40:43 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-5fe54156-0b49-44bd-900c-649e89f626f5 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd6ad9e3-9416-4199-848c-43544764877d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:40:43 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-5fe54156-0b49-44bd-900c-649e89f626f5 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Volume 59f04e33-e3d2-431e-87d3-9ca7a5361eed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-59f04e33-e3d2-431e-87d3-9ca7a5361eed', 'volume_size': 1} Sep 06 06:40:43 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-5fe54156-0b49-44bd-900c-649e89f626f5 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:40:43 devstack sudo[98523]: pam_unix(sudo:session): session closed for user root Sep 06 06:40:43 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-c7ad590b-9906-4e95-9c21-749e2127ea24 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e466a30a-8c43-4df6-b513-5968bfbe9345" returned: 0 in 0.388s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:40:43 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-c7ad590b-9906-4e95-9c21-749e2127ea24 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] <== create_volume: return (1091ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'} {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 06:40:43 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-c7ad590b-9906-4e95-9c21-749e2127ea24 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.094s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:40:43 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-a349d36e-bffb-43b5-a219-2cfe9d391c49 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.518s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:40:43 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-a349d36e-bffb-43b5-a219-2cfe9d391c49 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:40:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-942183794',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d485d5f9-d238-4235-a88b-b69cf72c95da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46f52a8fc2cd40898813ebea168c263a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:40:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:40:43Z,use_quota=True,user_id='63f6570ea0dc4e83854c1b9f1b29a85d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)}" {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 06:40:43 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-a349d36e-bffb-43b5-a219-2cfe9d391c49 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Creating volume d485d5f9-d238-4235-a88b-b69cf72c95da {{(pid=87329) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 06:40:43 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-a349d36e-bffb-43b5-a219-2cfe9d391c49 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:40:43 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-a349d36e-bffb-43b5-a219-2cfe9d391c49 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:40:43 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-a349d36e-bffb-43b5-a219-2cfe9d391c49 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:40:43 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-a349d36e-bffb-43b5-a219-2cfe9d391c49 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:40:43 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-a349d36e-bffb-43b5-a219-2cfe9d391c49 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:40:43 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-a349d36e-bffb-43b5-a219-2cfe9d391c49 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Selected osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 as target Quobyte volume. {{(pid=87329) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 06:40:43 devstack cinder-volume[87329]: INFO cinder.volume.drivers.remotefs [None req-a349d36e-bffb-43b5-a219-2cfe9d391c49 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] casted to osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 Sep 06 06:40:43 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-a349d36e-bffb-43b5-a219-2cfe9d391c49 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-d485d5f9-d238-4235-a88b-b69cf72c95da 1073741824 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:40:43 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-c7ad590b-9906-4e95-9c21-749e2127ea24 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02404303-fcb3-4c05-a0f4-7ff157f28bb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e466a30a-8c43-4df6-b513-5968bfbe9345', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:40:43 devstack sudo[98526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-d485d5f9-d238-4235-a88b-b69cf72c95da 1073741824 Sep 06 06:40:43 devstack sudo[98526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:40:44 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-c7ad590b-9906-4e95-9c21-749e2127ea24 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee07bf81-37ce-4510-a0e7-cdc2db95380b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:40:44 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-c7ad590b-9906-4e95-9c21-749e2127ea24 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Volume volume-e466a30a-8c43-4df6-b513-5968bfbe9345 (e466a30a-8c43-4df6-b513-5968bfbe9345): created successfully Sep 06 06:40:44 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-c7ad590b-9906-4e95-9c21-749e2127ea24 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee07bf81-37ce-4510-a0e7-cdc2db95380b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:40:44 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-c7ad590b-9906-4e95-9c21-749e2127ea24 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Flow 'volume_create_manager' (6d3f2639-f4e8-492c-aec9-c188d8319a9c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:40:44 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-c7ad590b-9906-4e95-9c21-749e2127ea24 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Created volume successfully. Sep 06 06:40:44 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc62e0ce-759e-4f96-bba4-1e858efa12ab tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87329) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 06:40:44 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-dc62e0ce-759e-4f96-bba4-1e858efa12ab tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Flow 'volume_create_manager' (bdf90ad0-44fa-4e44-92ed-0bfeadd8bad9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:40:44 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-dc62e0ce-759e-4f96-bba4-1e858efa12ab tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f126827e-8874-4832-96b4-1dff80f72504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:40:44 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-dc62e0ce-759e-4f96-bba4-1e858efa12ab tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f126827e-8874-4832-96b4-1dff80f72504) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:40:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1024357446',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f583026-4d18-42af-b1be-1fe0a3357c7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46f52a8fc2cd40898813ebea168c263a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:40:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:40:44Z,use_quota=True,user_id='63f6570ea0dc4e83854c1b9f1b29a85d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:40:44 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-dc62e0ce-759e-4f96-bba4-1e858efa12ab tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25ee73b9-65f3-4fcc-8650-f47d1ab231e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:40:44 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-dc62e0ce-759e-4f96-bba4-1e858efa12ab tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25ee73b9-65f3-4fcc-8650-f47d1ab231e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:40:44 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-dc62e0ce-759e-4f96-bba4-1e858efa12ab tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20059c29-2b87-4b58-8252-5f924a674ca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:40:44 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-dc62e0ce-759e-4f96-bba4-1e858efa12ab tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20059c29-2b87-4b58-8252-5f924a674ca7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f583026-4d18-42af-b1be-1fe0a3357c7c', 'volume_name': 'volume-2f583026-4d18-42af-b1be-1fe0a3357c7c', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:40:44 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-dc62e0ce-759e-4f96-bba4-1e858efa12ab tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7dcb8b5a-5076-427e-ac15-2df54229a051) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:40:44 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-dc62e0ce-759e-4f96-bba4-1e858efa12ab tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7dcb8b5a-5076-427e-ac15-2df54229a051) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:40:44 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-dc62e0ce-759e-4f96-bba4-1e858efa12ab tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64b1f580-0256-48a4-8cdf-867824190071) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:40:44 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-dc62e0ce-759e-4f96-bba4-1e858efa12ab tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Volume 2f583026-4d18-42af-b1be-1fe0a3357c7c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f583026-4d18-42af-b1be-1fe0a3357c7c', 'volume_size': 1} Sep 06 06:40:44 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-dc62e0ce-759e-4f96-bba4-1e858efa12ab tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:40:45 devstack sudo[98526]: pam_unix(sudo:session): session closed for user root Sep 06 06:40:45 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-a349d36e-bffb-43b5-a219-2cfe9d391c49 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-d485d5f9-d238-4235-a88b-b69cf72c95da 1073741824" returned: 0 in 1.380s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:40:45 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-a349d36e-bffb-43b5-a219-2cfe9d391c49 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-d485d5f9-d238-4235-a88b-b69cf72c95da {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:40:45 devstack sudo[98597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-d485d5f9-d238-4235-a88b-b69cf72c95da Sep 06 06:40:45 devstack sudo[98597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:40:45 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-dee46c50-82b1-4016-a39f-54b61c309967 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87329) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 06:40:45 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-dee46c50-82b1-4016-a39f-54b61c309967 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Flow 'volume_create_manager' (eea15abf-a923-4941-94dc-12db04352df5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:40:45 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-dee46c50-82b1-4016-a39f-54b61c309967 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59a13f94-8f30-41f5-a41d-f7ebbf0ab518) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:40:45 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c711501-3a89-4599-8fa6-5ad9cc2dd4aa tempest-VolumesCloneTest-741677168 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87329) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 06:40:45 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-dee46c50-82b1-4016-a39f-54b61c309967 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59a13f94-8f30-41f5-a41d-f7ebbf0ab518) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:40:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1937913775',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bb9307d-e3ae-492f-bd4b-a8d9450cfb9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46f52a8fc2cd40898813ebea168c263a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:40:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:40:45Z,use_quota=True,user_id='63f6570ea0dc4e83854c1b9f1b29a85d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:40:45 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-dee46c50-82b1-4016-a39f-54b61c309967 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a51991ce-9fea-4c2a-9c3b-16979839570e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:40:45 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-dee46c50-82b1-4016-a39f-54b61c309967 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a51991ce-9fea-4c2a-9c3b-16979839570e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:40:45 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-dee46c50-82b1-4016-a39f-54b61c309967 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1a5bbca-8d05-48b7-be36-dbb38d12b147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:40:45 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-dee46c50-82b1-4016-a39f-54b61c309967 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1a5bbca-8d05-48b7-be36-dbb38d12b147) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2bb9307d-e3ae-492f-bd4b-a8d9450cfb9d', 'volume_name': 'volume-2bb9307d-e3ae-492f-bd4b-a8d9450cfb9d', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:40:45 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-dee46c50-82b1-4016-a39f-54b61c309967 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e17cc52-0a08-4f7a-99ee-3c79d0a401c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:40:45 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-dee46c50-82b1-4016-a39f-54b61c309967 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e17cc52-0a08-4f7a-99ee-3c79d0a401c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:40:45 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-dee46c50-82b1-4016-a39f-54b61c309967 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2c1234a-23c2-40b7-8e44-81ccfd13abe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:40:45 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-dee46c50-82b1-4016-a39f-54b61c309967 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Volume 2bb9307d-e3ae-492f-bd4b-a8d9450cfb9d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2bb9307d-e3ae-492f-bd4b-a8d9450cfb9d', 'volume_size': 1} Sep 06 06:40:45 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-dee46c50-82b1-4016-a39f-54b61c309967 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:40:45 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-4c711501-3a89-4599-8fa6-5ad9cc2dd4aa tempest-VolumesCloneTest-741677168 None] Flow 'volume_create_manager' (1c973c0d-0077-4f53-b233-9bce3c3c4c99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:40:45 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-4c711501-3a89-4599-8fa6-5ad9cc2dd4aa tempest-VolumesCloneTest-741677168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f16fbfc7-e78b-4da1-9fe6-7422ca201130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:40:45 devstack sudo[98597]: pam_unix(sudo:session): session closed for user root Sep 06 06:40:45 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-a349d36e-bffb-43b5-a219-2cfe9d391c49 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-d485d5f9-d238-4235-a88b-b69cf72c95da" returned: 0 in 0.396s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:40:45 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-a349d36e-bffb-43b5-a219-2cfe9d391c49 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] <== create_volume: return (1850ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'} {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 06:40:45 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-a349d36e-bffb-43b5-a219-2cfe9d391c49 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.858s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:40:45 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-5fe54156-0b49-44bd-900c-649e89f626f5 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.931s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:40:45 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-5fe54156-0b49-44bd-900c-649e89f626f5 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:40:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1013005244',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59f04e33-e3d2-431e-87d3-9ca7a5361eed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46f52a8fc2cd40898813ebea168c263a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:40:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:40:44Z,use_quota=True,user_id='63f6570ea0dc4e83854c1b9f1b29a85d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)}" {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 06:40:45 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-5fe54156-0b49-44bd-900c-649e89f626f5 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Creating volume 59f04e33-e3d2-431e-87d3-9ca7a5361eed {{(pid=87329) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 06:40:45 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-5fe54156-0b49-44bd-900c-649e89f626f5 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:40:45 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-5fe54156-0b49-44bd-900c-649e89f626f5 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:40:45 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-5fe54156-0b49-44bd-900c-649e89f626f5 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:40:45 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-5fe54156-0b49-44bd-900c-649e89f626f5 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:40:45 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-5fe54156-0b49-44bd-900c-649e89f626f5 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:40:45 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-5fe54156-0b49-44bd-900c-649e89f626f5 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Selected osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 as target Quobyte volume. {{(pid=87329) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 06:40:45 devstack cinder-volume[87329]: INFO cinder.volume.drivers.remotefs [None req-5fe54156-0b49-44bd-900c-649e89f626f5 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] casted to osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 Sep 06 06:40:45 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-5fe54156-0b49-44bd-900c-649e89f626f5 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-59f04e33-e3d2-431e-87d3-9ca7a5361eed 1073741824 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:40:45 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-4c711501-3a89-4599-8fa6-5ad9cc2dd4aa tempest-VolumesCloneTest-741677168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f16fbfc7-e78b-4da1-9fe6-7422ca201130) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:40:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-573940866',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3f4220f-a711-47eb-b49f-d31f26e59dd0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='471efa60fd7f4bc89c0426665573cf90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:40:45Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=071ddf2b-7aaa-438f-8ee9-dfea9065eaf1,status='creating',terminated_at=None,updated_at=2026-09-06T04:40:45Z,use_quota=True,user_id='d8ec2463119247b49f3c47081f75f3ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:40:45 devstack sudo[98604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-59f04e33-e3d2-431e-87d3-9ca7a5361eed 1073741824 Sep 06 06:40:45 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-4c711501-3a89-4599-8fa6-5ad9cc2dd4aa tempest-VolumesCloneTest-741677168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5682249a-e8ce-4182-83f9-67cfce0b5c36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:40:45 devstack sudo[98604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:40:45 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-4c711501-3a89-4599-8fa6-5ad9cc2dd4aa tempest-VolumesCloneTest-741677168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5682249a-e8ce-4182-83f9-67cfce0b5c36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:40:45 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-4c711501-3a89-4599-8fa6-5ad9cc2dd4aa tempest-VolumesCloneTest-741677168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee45dad4-038c-4893-a4bf-deaf77bf024d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:40:45 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-a349d36e-bffb-43b5-a219-2cfe9d391c49 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42c8092b-0549-4b2c-b7a2-b733d0670615) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d485d5f9-d238-4235-a88b-b69cf72c95da', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:40:45 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-a349d36e-bffb-43b5-a219-2cfe9d391c49 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be63ea0e-436c-4e57-919d-5adc1b51c12c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:40:45 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-4c711501-3a89-4599-8fa6-5ad9cc2dd4aa tempest-VolumesCloneTest-741677168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee45dad4-038c-4893-a4bf-deaf77bf024d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'c3f4220f-a711-47eb-b49f-d31f26e59dd0', 'volume_name': 'volume-c3f4220f-a711-47eb-b49f-d31f26e59dd0', 'volume_size': 2, 'source_volid': '071ddf2b-7aaa-438f-8ee9-dfea9065eaf1', 'source_volstatus': 'available'}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:40:45 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-4c711501-3a89-4599-8fa6-5ad9cc2dd4aa tempest-VolumesCloneTest-741677168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2373d255-c50f-49dc-81a5-ba812c9b0520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:40:45 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-4c711501-3a89-4599-8fa6-5ad9cc2dd4aa tempest-VolumesCloneTest-741677168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2373d255-c50f-49dc-81a5-ba812c9b0520) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:40:45 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-4c711501-3a89-4599-8fa6-5ad9cc2dd4aa tempest-VolumesCloneTest-741677168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17b249c7-4f0f-450e-ad37-1f2069360bd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:40:45 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-4c711501-3a89-4599-8fa6-5ad9cc2dd4aa tempest-VolumesCloneTest-741677168 None] Volume c3f4220f-a711-47eb-b49f-d31f26e59dd0: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-c3f4220f-a711-47eb-b49f-d31f26e59dd0', 'volume_size': 2, 'source_volid': '071ddf2b-7aaa-438f-8ee9-dfea9065eaf1', 'source_volstatus': 'available'} Sep 06 06:40:45 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-4c711501-3a89-4599-8fa6-5ad9cc2dd4aa tempest-VolumesCloneTest-741677168 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:40:45 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-a349d36e-bffb-43b5-a219-2cfe9d391c49 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Volume volume-d485d5f9-d238-4235-a88b-b69cf72c95da (d485d5f9-d238-4235-a88b-b69cf72c95da): created successfully Sep 06 06:40:45 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-a349d36e-bffb-43b5-a219-2cfe9d391c49 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be63ea0e-436c-4e57-919d-5adc1b51c12c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:40:45 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-a349d36e-bffb-43b5-a219-2cfe9d391c49 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Flow 'volume_create_manager' (fdd0b9e5-f0a7-4d67-9338-e44b9890abcf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:40:45 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-a349d36e-bffb-43b5-a219-2cfe9d391c49 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Created volume successfully. Sep 06 06:40:46 devstack sudo[98604]: pam_unix(sudo:session): session closed for user root Sep 06 06:40:46 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-5fe54156-0b49-44bd-900c-649e89f626f5 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-59f04e33-e3d2-431e-87d3-9ca7a5361eed 1073741824" returned: 0 in 0.511s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:40:46 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-5fe54156-0b49-44bd-900c-649e89f626f5 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-59f04e33-e3d2-431e-87d3-9ca7a5361eed {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:40:46 devstack sudo[98612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-59f04e33-e3d2-431e-87d3-9ca7a5361eed Sep 06 06:40:46 devstack sudo[98612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:40:46 devstack sudo[98612]: pam_unix(sudo:session): session closed for user root Sep 06 06:40:46 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-5fe54156-0b49-44bd-900c-649e89f626f5 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-59f04e33-e3d2-431e-87d3-9ca7a5361eed" returned: 0 in 0.295s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:40:46 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-5fe54156-0b49-44bd-900c-649e89f626f5 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] <== create_volume: return (853ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'} {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 06:40:46 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-5fe54156-0b49-44bd-900c-649e89f626f5 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.857s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:40:46 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-dc62e0ce-759e-4f96-bba4-1e858efa12ab tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.844s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:40:46 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-dc62e0ce-759e-4f96-bba4-1e858efa12ab tempest-CreateVolumesFromSourceVolumeTest-356108605 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:40:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1024357446',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f583026-4d18-42af-b1be-1fe0a3357c7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46f52a8fc2cd40898813ebea168c263a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:40:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:40:44Z,use_quota=True,user_id='63f6570ea0dc4e83854c1b9f1b29a85d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)}" {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 06:40:46 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-dc62e0ce-759e-4f96-bba4-1e858efa12ab tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Creating volume 2f583026-4d18-42af-b1be-1fe0a3357c7c {{(pid=87329) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 06:40:46 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-dc62e0ce-759e-4f96-bba4-1e858efa12ab tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:40:46 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-dc62e0ce-759e-4f96-bba4-1e858efa12ab tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:40:46 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-dc62e0ce-759e-4f96-bba4-1e858efa12ab tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:40:46 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-dc62e0ce-759e-4f96-bba4-1e858efa12ab tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:40:46 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-dc62e0ce-759e-4f96-bba4-1e858efa12ab tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:40:46 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-dc62e0ce-759e-4f96-bba4-1e858efa12ab tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Selected osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 as target Quobyte volume. {{(pid=87329) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 06:40:46 devstack cinder-volume[87329]: INFO cinder.volume.drivers.remotefs [None req-dc62e0ce-759e-4f96-bba4-1e858efa12ab tempest-CreateVolumesFromSourceVolumeTest-356108605 None] casted to osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 Sep 06 06:40:46 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-dc62e0ce-759e-4f96-bba4-1e858efa12ab tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-2f583026-4d18-42af-b1be-1fe0a3357c7c 1073741824 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:40:46 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-5fe54156-0b49-44bd-900c-649e89f626f5 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd6ad9e3-9416-4199-848c-43544764877d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59f04e33-e3d2-431e-87d3-9ca7a5361eed', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:40:46 devstack sudo[98615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-2f583026-4d18-42af-b1be-1fe0a3357c7c 1073741824 Sep 06 06:40:46 devstack sudo[98615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:40:46 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-5fe54156-0b49-44bd-900c-649e89f626f5 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1423962-77b4-418d-abbf-9cd611055bf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:40:46 devstack cinder-volume[87329]: DEBUG dbcounter [-] [87329] Writing DB stats cinder:UPDATE=133,cinder:SELECT=111,cinder:INSERT=33,cinder:DELETE=13 {{(pid=87329) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 06:40:46 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-5fe54156-0b49-44bd-900c-649e89f626f5 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Volume volume-59f04e33-e3d2-431e-87d3-9ca7a5361eed (59f04e33-e3d2-431e-87d3-9ca7a5361eed): created successfully Sep 06 06:40:46 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-5fe54156-0b49-44bd-900c-649e89f626f5 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1423962-77b4-418d-abbf-9cd611055bf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:40:46 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-5fe54156-0b49-44bd-900c-649e89f626f5 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Flow 'volume_create_manager' (086d7598-b7a4-46af-8ad0-0224657f1f5d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:40:46 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-5fe54156-0b49-44bd-900c-649e89f626f5 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Created volume successfully. Sep 06 06:40:47 devstack sudo[98615]: pam_unix(sudo:session): session closed for user root Sep 06 06:40:47 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-dc62e0ce-759e-4f96-bba4-1e858efa12ab tempest-CreateVolumesFromSourceVolumeTest-356108605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-2f583026-4d18-42af-b1be-1fe0a3357c7c 1073741824" returned: 0 in 0.510s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:40:47 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-dc62e0ce-759e-4f96-bba4-1e858efa12ab tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-2f583026-4d18-42af-b1be-1fe0a3357c7c {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:40:47 devstack sudo[98621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-2f583026-4d18-42af-b1be-1fe0a3357c7c Sep 06 06:40:47 devstack sudo[98621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:40:47 devstack sudo[98621]: pam_unix(sudo:session): session closed for user root Sep 06 06:40:47 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-dc62e0ce-759e-4f96-bba4-1e858efa12ab tempest-CreateVolumesFromSourceVolumeTest-356108605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-2f583026-4d18-42af-b1be-1fe0a3357c7c" returned: 0 in 0.290s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:40:47 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-dc62e0ce-759e-4f96-bba4-1e858efa12ab tempest-CreateVolumesFromSourceVolumeTest-356108605 None] <== create_volume: return (848ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'} {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 06:40:47 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-dc62e0ce-759e-4f96-bba4-1e858efa12ab tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.853s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:40:47 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-dee46c50-82b1-4016-a39f-54b61c309967 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.769s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:40:47 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-dee46c50-82b1-4016-a39f-54b61c309967 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:40:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1937913775',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bb9307d-e3ae-492f-bd4b-a8d9450cfb9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46f52a8fc2cd40898813ebea168c263a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:40:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:40:45Z,use_quota=True,user_id='63f6570ea0dc4e83854c1b9f1b29a85d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)}" {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 06:40:47 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-dee46c50-82b1-4016-a39f-54b61c309967 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Creating volume 2bb9307d-e3ae-492f-bd4b-a8d9450cfb9d {{(pid=87329) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 06:40:47 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-dee46c50-82b1-4016-a39f-54b61c309967 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:40:47 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-dee46c50-82b1-4016-a39f-54b61c309967 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:40:47 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-dee46c50-82b1-4016-a39f-54b61c309967 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:40:47 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-dee46c50-82b1-4016-a39f-54b61c309967 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:40:47 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-dee46c50-82b1-4016-a39f-54b61c309967 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:40:47 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-dee46c50-82b1-4016-a39f-54b61c309967 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Selected osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 as target Quobyte volume. {{(pid=87329) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 06:40:47 devstack cinder-volume[87329]: INFO cinder.volume.drivers.remotefs [None req-dee46c50-82b1-4016-a39f-54b61c309967 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] casted to osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 Sep 06 06:40:47 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-dee46c50-82b1-4016-a39f-54b61c309967 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-2bb9307d-e3ae-492f-bd4b-a8d9450cfb9d 1073741824 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:40:47 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-dc62e0ce-759e-4f96-bba4-1e858efa12ab tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64b1f580-0256-48a4-8cdf-867824190071) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f583026-4d18-42af-b1be-1fe0a3357c7c', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:40:47 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-dc62e0ce-759e-4f96-bba4-1e858efa12ab tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40e0263a-973c-4a0a-ba72-9985fb5e610e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:40:47 devstack sudo[98624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-2bb9307d-e3ae-492f-bd4b-a8d9450cfb9d 1073741824 Sep 06 06:40:47 devstack sudo[98624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:40:47 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-dc62e0ce-759e-4f96-bba4-1e858efa12ab tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Volume volume-2f583026-4d18-42af-b1be-1fe0a3357c7c (2f583026-4d18-42af-b1be-1fe0a3357c7c): created successfully Sep 06 06:40:47 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-dc62e0ce-759e-4f96-bba4-1e858efa12ab tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40e0263a-973c-4a0a-ba72-9985fb5e610e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:40:47 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-dc62e0ce-759e-4f96-bba4-1e858efa12ab tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Flow 'volume_create_manager' (bdf90ad0-44fa-4e44-92ed-0bfeadd8bad9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:40:47 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-dc62e0ce-759e-4f96-bba4-1e858efa12ab tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Created volume successfully. Sep 06 06:40:47 devstack sudo[98624]: pam_unix(sudo:session): session closed for user root Sep 06 06:40:47 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-dee46c50-82b1-4016-a39f-54b61c309967 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-2bb9307d-e3ae-492f-bd4b-a8d9450cfb9d 1073741824" returned: 0 in 0.530s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:40:48 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-dee46c50-82b1-4016-a39f-54b61c309967 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-2bb9307d-e3ae-492f-bd4b-a8d9450cfb9d {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:40:48 devstack sudo[98632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-2bb9307d-e3ae-492f-bd4b-a8d9450cfb9d Sep 06 06:40:48 devstack sudo[98632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:40:48 devstack sudo[98632]: pam_unix(sudo:session): session closed for user root Sep 06 06:40:48 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-dee46c50-82b1-4016-a39f-54b61c309967 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-2bb9307d-e3ae-492f-bd4b-a8d9450cfb9d" returned: 0 in 0.269s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:40:48 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-dee46c50-82b1-4016-a39f-54b61c309967 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] <== create_volume: return (865ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'} {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 06:40:48 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-dee46c50-82b1-4016-a39f-54b61c309967 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.869s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:40:48 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-4c711501-3a89-4599-8fa6-5ad9cc2dd4aa tempest-VolumesCloneTest-741677168 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 2.424s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:40:48 devstack cinder-volume[87329]: INFO cinder.volume.drivers.remotefs [None req-4c711501-3a89-4599-8fa6-5ad9cc2dd4aa tempest-VolumesCloneTest-741677168 None] Cloning volume 071ddf2b-7aaa-438f-8ee9-dfea9065eaf1 to volume c3f4220f-a711-47eb-b49f-d31f26e59dd0 Sep 06 06:40:48 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-dee46c50-82b1-4016-a39f-54b61c309967 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2c1234a-23c2-40b7-8e44-81ccfd13abe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2bb9307d-e3ae-492f-bd4b-a8d9450cfb9d', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:40:48 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-dee46c50-82b1-4016-a39f-54b61c309967 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7869bf39-7cb3-4d52-a074-e8017bdc6d33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:40:48 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-dee46c50-82b1-4016-a39f-54b61c309967 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Volume volume-2bb9307d-e3ae-492f-bd4b-a8d9450cfb9d (2bb9307d-e3ae-492f-bd4b-a8d9450cfb9d): created successfully Sep 06 06:40:48 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-dee46c50-82b1-4016-a39f-54b61c309967 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7869bf39-7cb3-4d52-a074-e8017bdc6d33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:40:48 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-dee46c50-82b1-4016-a39f-54b61c309967 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Flow 'volume_create_manager' (eea15abf-a923-4941-94dc-12db04352df5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:40:48 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-4c711501-3a89-4599-8fa6-5ad9cc2dd4aa tempest-VolumesCloneTest-741677168 None] Creating offline snapshot 5c6b4819-a34a-4c49-9067-8443cd7e7e0e of volume 071ddf2b-7aaa-438f-8ee9-dfea9065eaf1 {{(pid=87329) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 06 06:40:48 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-dee46c50-82b1-4016-a39f-54b61c309967 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Created volume successfully. Sep 06 06:40:48 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[44c5be5a-3ba1-4b90-a411-bb2c1a4b4359]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:40:48 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-4c711501-3a89-4599-8fa6-5ad9cc2dd4aa tempest-VolumesCloneTest-741677168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-071ddf2b-7aaa-438f-8ee9-dfea9065eaf1 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:40:48 devstack cinder-volume[87329]: DEBUG oslo_service.periodic_task [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87329) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 06 06:40:48 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:40:48 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:40:48 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:40:48 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:40:48 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:40:48 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:40:48 devstack sudo[98636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:40:48 devstack sudo[98636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:40:48 devstack sudo[98635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-071ddf2b-7aaa-438f-8ee9-dfea9065eaf1 Sep 06 06:40:48 devstack sudo[98635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:40:48 devstack sudo[98636]: pam_unix(sudo:session): session closed for user root Sep 06 06:40:48 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.258s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:40:48 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:40:48 devstack cinder-volume[87329]: DEBUG oslo_service.periodic_task [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Running periodic task VolumeManager._thread_info {{(pid=87329) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 06 06:40:48 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] thread count: 28 {{(pid=87329) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 06 06:40:48 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] thread info: [<_MainThread(MainThread, started 126855043821696)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87329) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 06 06:40:48 devstack sudo[98635]: pam_unix(sudo:session): session closed for user root Sep 06 06:40:48 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-4c711501-3a89-4599-8fa6-5ad9cc2dd4aa tempest-VolumesCloneTest-741677168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-071ddf2b-7aaa-438f-8ee9-dfea9065eaf1" returned: 0 in 0.395s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:40:48 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-4c711501-3a89-4599-8fa6-5ad9cc2dd4aa tempest-VolumesCloneTest-741677168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-071ddf2b-7aaa-438f-8ee9-dfea9065eaf1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-071ddf2b-7aaa-438f-8ee9-dfea9065eaf1.5c6b4819-a34a-4c49-9067-8443cd7e7e0e 1G {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:40:48 devstack sudo[98643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-071ddf2b-7aaa-438f-8ee9-dfea9065eaf1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-071ddf2b-7aaa-438f-8ee9-dfea9065eaf1.5c6b4819-a34a-4c49-9067-8443cd7e7e0e 1G Sep 06 06:40:48 devstack sudo[98643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:40:48 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-8c0cb467-494f-49d1-824e-8f9ac8efb421 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Acquiring lock "cinder-2bb9307d-e3ae-492f-bd4b-a8d9450cfb9d-delete_volume" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:40:48 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-8c0cb467-494f-49d1-824e-8f9ac8efb421 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Lock "cinder-2bb9307d-e3ae-492f-bd4b-a8d9450cfb9d-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:40:48 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-8c0cb467-494f-49d1-824e-8f9ac8efb421 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Acquiring lock "cinder-quobyte-2bb9307d-e3ae-492f-bd4b-a8d9450cfb9d" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:40:48 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-8c0cb467-494f-49d1-824e-8f9ac8efb421 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Lock "cinder-quobyte-2bb9307d-e3ae-492f-bd4b-a8d9450cfb9d" acquired by "delete_volume" :: waited 0.020s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:40:49 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[51315414-61e0-4ef9-b7fd-7727dad2d484]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:40:49 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-8c0cb467-494f-49d1-824e-8f9ac8efb421 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-2bb9307d-e3ae-492f-bd4b-a8d9450cfb9d {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:40:49 devstack sudo[98645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-2bb9307d-e3ae-492f-bd4b-a8d9450cfb9d Sep 06 06:40:49 devstack sudo[98645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:40:49 devstack sudo[98643]: pam_unix(sudo:session): session closed for user root Sep 06 06:40:49 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-4c711501-3a89-4599-8fa6-5ad9cc2dd4aa tempest-VolumesCloneTest-741677168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-071ddf2b-7aaa-438f-8ee9-dfea9065eaf1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-071ddf2b-7aaa-438f-8ee9-dfea9065eaf1.5c6b4819-a34a-4c49-9067-8443cd7e7e0e 1G" returned: 0 in 0.427s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:40:49 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-4c711501-3a89-4599-8fa6-5ad9cc2dd4aa tempest-VolumesCloneTest-741677168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-071ddf2b-7aaa-438f-8ee9-dfea9065eaf1 -F qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-071ddf2b-7aaa-438f-8ee9-dfea9065eaf1.5c6b4819-a34a-4c49-9067-8443cd7e7e0e {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:40:49 devstack sudo[98650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-071ddf2b-7aaa-438f-8ee9-dfea9065eaf1 -F qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-071ddf2b-7aaa-438f-8ee9-dfea9065eaf1.5c6b4819-a34a-4c49-9067-8443cd7e7e0e Sep 06 06:40:49 devstack sudo[98650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:40:49 devstack sudo[98645]: pam_unix(sudo:session): session closed for user root Sep 06 06:40:49 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-8c0cb467-494f-49d1-824e-8f9ac8efb421 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-2bb9307d-e3ae-492f-bd4b-a8d9450cfb9d" returned: 0 in 0.447s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:40:49 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-8c0cb467-494f-49d1-824e-8f9ac8efb421 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-2bb9307d-e3ae-492f-bd4b-a8d9450cfb9d {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:40:49 devstack sudo[98655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-2bb9307d-e3ae-492f-bd4b-a8d9450cfb9d Sep 06 06:40:49 devstack sudo[98655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:40:49 devstack sudo[98650]: pam_unix(sudo:session): session closed for user root Sep 06 06:40:49 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-4c711501-3a89-4599-8fa6-5ad9cc2dd4aa tempest-VolumesCloneTest-741677168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-071ddf2b-7aaa-438f-8ee9-dfea9065eaf1 -F qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-071ddf2b-7aaa-438f-8ee9-dfea9065eaf1.5c6b4819-a34a-4c49-9067-8443cd7e7e0e" returned: 0 in 0.363s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:40:49 devstack cinder-volume[87329]: WARNING cinder.volume.drivers.remotefs [None req-4c711501-3a89-4599-8fa6-5ad9cc2dd4aa tempest-VolumesCloneTest-741677168 None] /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-071ddf2b-7aaa-438f-8ee9-dfea9065eaf1.5c6b4819-a34a-4c49-9067-8443cd7e7e0e is being set with open permissions: ugo+rw Sep 06 06:40:49 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-4c711501-3a89-4599-8fa6-5ad9cc2dd4aa tempest-VolumesCloneTest-741677168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-071ddf2b-7aaa-438f-8ee9-dfea9065eaf1.5c6b4819-a34a-4c49-9067-8443cd7e7e0e {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:40:49 devstack sudo[98662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-071ddf2b-7aaa-438f-8ee9-dfea9065eaf1.5c6b4819-a34a-4c49-9067-8443cd7e7e0e Sep 06 06:40:49 devstack sudo[98662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:40:49 devstack sudo[98655]: pam_unix(sudo:session): session closed for user root Sep 06 06:40:49 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-8c0cb467-494f-49d1-824e-8f9ac8efb421 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-2bb9307d-e3ae-492f-bd4b-a8d9450cfb9d" returned: 0 in 0.293s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:40:49 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-8c0cb467-494f-49d1-824e-8f9ac8efb421 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Lock "cinder-quobyte-2bb9307d-e3ae-492f-bd4b-a8d9450cfb9d" released by "delete_volume" :: held 0.791s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:40:49 devstack cinder-volume[87329]: DEBUG dbcounter [-] [87329] Writing DB stats cinder:UPDATE=141,cinder:SELECT=111,cinder:DELETE=10,cinder:INSERT=32 {{(pid=87329) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 06:40:49 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-8c0cb467-494f-49d1-824e-8f9ac8efb421 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Created reservations ['5c6174e3-8936-408f-a258-fc70c9fdc2d5', 'ed2642de-513b-4c0b-aa47-d1cf479a0627', '282fea16-a116-4f67-b21d-17e1eb1ccda3', '5ba75492-4a9a-4b92-b558-fd8704f59e55'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:40:49 devstack sudo[98662]: pam_unix(sudo:session): session closed for user root Sep 06 06:40:49 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-8c0cb467-494f-49d1-824e-8f9ac8efb421 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:40:49 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-8c0cb467-494f-49d1-824e-8f9ac8efb421 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:40:49 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-8c0cb467-494f-49d1-824e-8f9ac8efb421 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:40:49 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-8c0cb467-494f-49d1-824e-8f9ac8efb421 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:40:49 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-8c0cb467-494f-49d1-824e-8f9ac8efb421 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:40:49 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-8c0cb467-494f-49d1-824e-8f9ac8efb421 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:40:49 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-4c711501-3a89-4599-8fa6-5ad9cc2dd4aa tempest-VolumesCloneTest-741677168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-071ddf2b-7aaa-438f-8ee9-dfea9065eaf1.5c6b4819-a34a-4c49-9067-8443cd7e7e0e" returned: 0 in 0.356s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:40:49 devstack sudo[98666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:40:49 devstack sudo[98666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:40:49 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-4c711501-3a89-4599-8fa6-5ad9cc2dd4aa tempest-VolumesCloneTest-741677168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-071ddf2b-7aaa-438f-8ee9-dfea9065eaf1.info {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:40:50 devstack sudo[98668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-071ddf2b-7aaa-438f-8ee9-dfea9065eaf1.info Sep 06 06:40:50 devstack sudo[98668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:40:50 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-9f22d020-ba28-4fe3-b3fa-5b6e801909f8 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Acquiring lock "cinder-2f583026-4d18-42af-b1be-1fe0a3357c7c-delete_volume" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:40:50 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-9f22d020-ba28-4fe3-b3fa-5b6e801909f8 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Lock "cinder-2f583026-4d18-42af-b1be-1fe0a3357c7c-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:40:50 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-9f22d020-ba28-4fe3-b3fa-5b6e801909f8 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Acquiring lock "cinder-quobyte-2f583026-4d18-42af-b1be-1fe0a3357c7c" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:40:50 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-9f22d020-ba28-4fe3-b3fa-5b6e801909f8 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Lock "cinder-quobyte-2f583026-4d18-42af-b1be-1fe0a3357c7c" acquired by "delete_volume" :: waited 0.025s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:40:50 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[824946f0-d772-48ca-bc0c-419b1d432658]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:40:50 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-9f22d020-ba28-4fe3-b3fa-5b6e801909f8 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-2f583026-4d18-42af-b1be-1fe0a3357c7c {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:40:50 devstack sudo[98666]: pam_unix(sudo:session): session closed for user root Sep 06 06:40:50 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-8c0cb467-494f-49d1-824e-8f9ac8efb421 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.378s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:40:50 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-8c0cb467-494f-49d1-824e-8f9ac8efb421 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:40:50 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-8c0cb467-494f-49d1-824e-8f9ac8efb421 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Deleted volume successfully. Sep 06 06:40:50 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-8c0cb467-494f-49d1-824e-8f9ac8efb421 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Lock "cinder-2bb9307d-e3ae-492f-bd4b-a8d9450cfb9d-delete_volume" released by "delete_volume" :: held 1.477s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:40:50 devstack sudo[98668]: pam_unix(sudo:session): session closed for user root Sep 06 06:40:50 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-4c711501-3a89-4599-8fa6-5ad9cc2dd4aa tempest-VolumesCloneTest-741677168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-071ddf2b-7aaa-438f-8ee9-dfea9065eaf1.info" returned: 0 in 0.458s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:40:50 devstack cinder-volume[87329]: WARNING cinder.volume.drivers.remotefs [None req-4c711501-3a89-4599-8fa6-5ad9cc2dd4aa tempest-VolumesCloneTest-741677168 None] /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-071ddf2b-7aaa-438f-8ee9-dfea9065eaf1.info is being set with open permissions: ugo+rw Sep 06 06:40:50 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-4c711501-3a89-4599-8fa6-5ad9cc2dd4aa tempest-VolumesCloneTest-741677168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-071ddf2b-7aaa-438f-8ee9-dfea9065eaf1.info {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:40:50 devstack sudo[98671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-2f583026-4d18-42af-b1be-1fe0a3357c7c Sep 06 06:40:50 devstack sudo[98671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:40:50 devstack sudo[98673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-071ddf2b-7aaa-438f-8ee9-dfea9065eaf1.info Sep 06 06:40:50 devstack sudo[98673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:40:50 devstack sudo[98673]: pam_unix(sudo:session): session closed for user root Sep 06 06:40:50 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-4c711501-3a89-4599-8fa6-5ad9cc2dd4aa tempest-VolumesCloneTest-741677168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-071ddf2b-7aaa-438f-8ee9-dfea9065eaf1.info" returned: 0 in 0.255s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:40:50 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-4c711501-3a89-4599-8fa6-5ad9cc2dd4aa tempest-VolumesCloneTest-741677168 None] Acquiring lock "cinder-quobyte-c3f4220f-a711-47eb-b49f-d31f26e59dd0" by "_copy_volume_from_snapshot" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:40:50 devstack sudo[98671]: pam_unix(sudo:session): session closed for user root Sep 06 06:40:50 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-9f22d020-ba28-4fe3-b3fa-5b6e801909f8 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-2f583026-4d18-42af-b1be-1fe0a3357c7c" returned: 0 in 0.467s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:40:50 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-9f22d020-ba28-4fe3-b3fa-5b6e801909f8 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-2f583026-4d18-42af-b1be-1fe0a3357c7c {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:40:50 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-4c711501-3a89-4599-8fa6-5ad9cc2dd4aa tempest-VolumesCloneTest-741677168 None] Lock "cinder-quobyte-c3f4220f-a711-47eb-b49f-d31f26e59dd0" acquired by "_copy_volume_from_snapshot" :: waited 0.041s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:40:50 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-4c711501-3a89-4599-8fa6-5ad9cc2dd4aa tempest-VolumesCloneTest-741677168 None] snapshot: 5c6b4819-a34a-4c49-9067-8443cd7e7e0e, volume: c3f4220f-a711-47eb-b49f-d31f26e59dd0, {{(pid=87329) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 06 06:40:50 devstack sudo[98680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-2f583026-4d18-42af-b1be-1fe0a3357c7c Sep 06 06:40:50 devstack sudo[98680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:40:50 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-4c711501-3a89-4599-8fa6-5ad9cc2dd4aa tempest-VolumesCloneTest-741677168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:40:50 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-4c711501-3a89-4599-8fa6-5ad9cc2dd4aa tempest-VolumesCloneTest-741677168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:40:50 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-4c711501-3a89-4599-8fa6-5ad9cc2dd4aa tempest-VolumesCloneTest-741677168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:40:50 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-4c711501-3a89-4599-8fa6-5ad9cc2dd4aa tempest-VolumesCloneTest-741677168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:40:50 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-4c711501-3a89-4599-8fa6-5ad9cc2dd4aa tempest-VolumesCloneTest-741677168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:40:50 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[b61fe1bb-ea3b-4a09-b08b-924dec35761e]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:40:50 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-4c711501-3a89-4599-8fa6-5ad9cc2dd4aa tempest-VolumesCloneTest-741677168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-071ddf2b-7aaa-438f-8ee9-dfea9065eaf1.5c6b4819-a34a-4c49-9067-8443cd7e7e0e {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:40:50 devstack sudo[98682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-071ddf2b-7aaa-438f-8ee9-dfea9065eaf1.5c6b4819-a34a-4c49-9067-8443cd7e7e0e Sep 06 06:40:50 devstack sudo[98682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:40:50 devstack sudo[98680]: pam_unix(sudo:session): session closed for user root Sep 06 06:40:51 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-9f22d020-ba28-4fe3-b3fa-5b6e801909f8 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-2f583026-4d18-42af-b1be-1fe0a3357c7c" returned: 0 in 0.267s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:40:51 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-9f22d020-ba28-4fe3-b3fa-5b6e801909f8 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Lock "cinder-quobyte-2f583026-4d18-42af-b1be-1fe0a3357c7c" released by "delete_volume" :: held 0.779s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:40:51 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-9f22d020-ba28-4fe3-b3fa-5b6e801909f8 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Created reservations ['97355a3b-fde9-4c23-aec9-bd272b7affd6', '649679bb-80e7-4b0e-ace4-ef76b9814174', 'd565f05b-0c94-4d13-8e97-c28ea705b81a', '8d318693-7320-476d-b599-3f1cab75a9a2'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:40:51 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-9f22d020-ba28-4fe3-b3fa-5b6e801909f8 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:40:51 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-9f22d020-ba28-4fe3-b3fa-5b6e801909f8 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:40:51 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-9f22d020-ba28-4fe3-b3fa-5b6e801909f8 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:40:51 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-9f22d020-ba28-4fe3-b3fa-5b6e801909f8 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:40:51 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-9f22d020-ba28-4fe3-b3fa-5b6e801909f8 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:40:51 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-9f22d020-ba28-4fe3-b3fa-5b6e801909f8 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:40:51 devstack sudo[98687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:40:51 devstack sudo[98687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:40:51 devstack sudo[98682]: pam_unix(sudo:session): session closed for user root Sep 06 06:40:51 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-4c711501-3a89-4599-8fa6-5ad9cc2dd4aa tempest-VolumesCloneTest-741677168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-071ddf2b-7aaa-438f-8ee9-dfea9065eaf1.5c6b4819-a34a-4c49-9067-8443cd7e7e0e" returned: 0 in 0.431s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:40:51 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-4c711501-3a89-4599-8fa6-5ad9cc2dd4aa tempest-VolumesCloneTest-741677168 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-071ddf2b-7aaa-438f-8ee9-dfea9065eaf1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87329) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 06:40:51 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e50c45f-e5b1-47e7-985c-b52feb33825e]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:40:51 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-4c711501-3a89-4599-8fa6-5ad9cc2dd4aa tempest-VolumesCloneTest-741677168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-071ddf2b-7aaa-438f-8ee9-dfea9065eaf1 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:40:51 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-96cef5bd-a5d7-4157-a9a3-361967792a5a tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Acquiring lock "cinder-59f04e33-e3d2-431e-87d3-9ca7a5361eed-delete_volume" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:40:51 devstack sudo[98690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-071ddf2b-7aaa-438f-8ee9-dfea9065eaf1 Sep 06 06:40:51 devstack sudo[98690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:40:51 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-96cef5bd-a5d7-4157-a9a3-361967792a5a tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Lock "cinder-59f04e33-e3d2-431e-87d3-9ca7a5361eed-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:40:51 devstack sudo[98687]: pam_unix(sudo:session): session closed for user root Sep 06 06:40:51 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-9f22d020-ba28-4fe3-b3fa-5b6e801909f8 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.321s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:40:51 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-9f22d020-ba28-4fe3-b3fa-5b6e801909f8 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:40:51 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-96cef5bd-a5d7-4157-a9a3-361967792a5a tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Acquiring lock "cinder-quobyte-59f04e33-e3d2-431e-87d3-9ca7a5361eed" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:40:51 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-9f22d020-ba28-4fe3-b3fa-5b6e801909f8 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Deleted volume successfully. Sep 06 06:40:51 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-96cef5bd-a5d7-4157-a9a3-361967792a5a tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Lock "cinder-quobyte-59f04e33-e3d2-431e-87d3-9ca7a5361eed" acquired by "delete_volume" :: waited 0.034s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:40:51 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-9f22d020-ba28-4fe3-b3fa-5b6e801909f8 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Lock "cinder-2f583026-4d18-42af-b1be-1fe0a3357c7c-delete_volume" released by "delete_volume" :: held 1.355s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:40:51 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[156943e8-fccf-4010-8432-3858f806dd5c]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:40:51 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-96cef5bd-a5d7-4157-a9a3-361967792a5a tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-59f04e33-e3d2-431e-87d3-9ca7a5361eed {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:40:51 devstack sudo[98693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-59f04e33-e3d2-431e-87d3-9ca7a5361eed Sep 06 06:40:51 devstack sudo[98693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:40:51 devstack sudo[98690]: pam_unix(sudo:session): session closed for user root Sep 06 06:40:51 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-4c711501-3a89-4599-8fa6-5ad9cc2dd4aa tempest-VolumesCloneTest-741677168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-071ddf2b-7aaa-438f-8ee9-dfea9065eaf1" returned: 0 in 0.435s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:40:51 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-4c711501-3a89-4599-8fa6-5ad9cc2dd4aa tempest-VolumesCloneTest-741677168 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-071ddf2b-7aaa-438f-8ee9-dfea9065eaf1 {{(pid=87329) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 06 06:40:51 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-4c711501-3a89-4599-8fa6-5ad9cc2dd4aa tempest-VolumesCloneTest-741677168 None] Creating direct copy from snapshot {{(pid=87329) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 06 06:40:51 devstack cinder-volume[87329]: DEBUG cinder.utils [None req-4c711501-3a89-4599-8fa6-5ad9cc2dd4aa tempest-VolumesCloneTest-741677168 None] Path /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-c3f4220f-a711-47eb-b49f-d31f26e59dd0 not found in is_blk_device check {{(pid=87329) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 06 06:40:51 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-4c711501-3a89-4599-8fa6-5ad9cc2dd4aa tempest-VolumesCloneTest-741677168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-071ddf2b-7aaa-438f-8ee9-dfea9065eaf1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-c3f4220f-a711-47eb-b49f-d31f26e59dd0 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:40:51 devstack sudo[98698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-071ddf2b-7aaa-438f-8ee9-dfea9065eaf1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-c3f4220f-a711-47eb-b49f-d31f26e59dd0 Sep 06 06:40:51 devstack sudo[98698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:40:51 devstack sudo[98693]: pam_unix(sudo:session): session closed for user root Sep 06 06:40:51 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-96cef5bd-a5d7-4157-a9a3-361967792a5a tempest-CreateVolumesFromSourceVolumeTest-356108605 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-59f04e33-e3d2-431e-87d3-9ca7a5361eed" returned: 0 in 0.410s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:40:51 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-96cef5bd-a5d7-4157-a9a3-361967792a5a tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-59f04e33-e3d2-431e-87d3-9ca7a5361eed {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:40:51 devstack sudo[98706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-59f04e33-e3d2-431e-87d3-9ca7a5361eed Sep 06 06:40:51 devstack sudo[98706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:40:52 devstack sudo[98706]: pam_unix(sudo:session): session closed for user root Sep 06 06:40:52 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-96cef5bd-a5d7-4157-a9a3-361967792a5a tempest-CreateVolumesFromSourceVolumeTest-356108605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-59f04e33-e3d2-431e-87d3-9ca7a5361eed" returned: 0 in 0.369s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:40:52 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-96cef5bd-a5d7-4157-a9a3-361967792a5a tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Lock "cinder-quobyte-59f04e33-e3d2-431e-87d3-9ca7a5361eed" released by "delete_volume" :: held 0.857s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:40:52 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-96cef5bd-a5d7-4157-a9a3-361967792a5a tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Created reservations ['af334598-1955-4119-969a-718ad08c86dd', 'da7330df-837d-4829-afe7-9e356eafa237', '17bb50fe-7acf-4138-a831-bcce2267839a', '55282a55-5e6a-46db-b6bf-1208ad898813'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:40:52 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-96cef5bd-a5d7-4157-a9a3-361967792a5a tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:40:52 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-96cef5bd-a5d7-4157-a9a3-361967792a5a tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:40:52 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-96cef5bd-a5d7-4157-a9a3-361967792a5a tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:40:52 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-96cef5bd-a5d7-4157-a9a3-361967792a5a tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:40:52 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-96cef5bd-a5d7-4157-a9a3-361967792a5a tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:40:52 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-96cef5bd-a5d7-4157-a9a3-361967792a5a tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:40:52 devstack sudo[98716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:40:52 devstack sudo[98716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:40:53 devstack sudo[98716]: pam_unix(sudo:session): session closed for user root Sep 06 06:40:53 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-96cef5bd-a5d7-4157-a9a3-361967792a5a tempest-CreateVolumesFromSourceVolumeTest-356108605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.794s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:40:53 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-96cef5bd-a5d7-4157-a9a3-361967792a5a tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:40:53 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-96cef5bd-a5d7-4157-a9a3-361967792a5a tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Deleted volume successfully. Sep 06 06:40:53 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-96cef5bd-a5d7-4157-a9a3-361967792a5a tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Lock "cinder-59f04e33-e3d2-431e-87d3-9ca7a5361eed-delete_volume" released by "delete_volume" :: held 2.282s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:40:53 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-e9fed5ed-5282-48e4-9b80-7cc7050309fc tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Acquiring lock "cinder-d485d5f9-d238-4235-a88b-b69cf72c95da-delete_volume" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:40:54 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-e9fed5ed-5282-48e4-9b80-7cc7050309fc tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Lock "cinder-d485d5f9-d238-4235-a88b-b69cf72c95da-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:40:54 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-e9fed5ed-5282-48e4-9b80-7cc7050309fc tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Acquiring lock "cinder-quobyte-d485d5f9-d238-4235-a88b-b69cf72c95da" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:40:54 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-e9fed5ed-5282-48e4-9b80-7cc7050309fc tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Lock "cinder-quobyte-d485d5f9-d238-4235-a88b-b69cf72c95da" acquired by "delete_volume" :: waited 0.044s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:40:54 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a40c555-45a1-4361-97c6-84e0c443e287]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:40:54 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-e9fed5ed-5282-48e4-9b80-7cc7050309fc tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-d485d5f9-d238-4235-a88b-b69cf72c95da {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:40:54 devstack sudo[98720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-d485d5f9-d238-4235-a88b-b69cf72c95da Sep 06 06:40:54 devstack sudo[98720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:40:55 devstack sudo[98720]: pam_unix(sudo:session): session closed for user root Sep 06 06:40:55 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-e9fed5ed-5282-48e4-9b80-7cc7050309fc tempest-CreateVolumesFromSourceVolumeTest-356108605 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-d485d5f9-d238-4235-a88b-b69cf72c95da" returned: 0 in 0.961s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:40:55 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-e9fed5ed-5282-48e4-9b80-7cc7050309fc tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-d485d5f9-d238-4235-a88b-b69cf72c95da {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:40:55 devstack sudo[98725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-d485d5f9-d238-4235-a88b-b69cf72c95da Sep 06 06:40:55 devstack sudo[98725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:40:56 devstack sudo[98725]: pam_unix(sudo:session): session closed for user root Sep 06 06:40:56 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-e9fed5ed-5282-48e4-9b80-7cc7050309fc tempest-CreateVolumesFromSourceVolumeTest-356108605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-d485d5f9-d238-4235-a88b-b69cf72c95da" returned: 0 in 0.811s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:40:56 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-e9fed5ed-5282-48e4-9b80-7cc7050309fc tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Lock "cinder-quobyte-d485d5f9-d238-4235-a88b-b69cf72c95da" released by "delete_volume" :: held 1.890s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:40:56 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-e9fed5ed-5282-48e4-9b80-7cc7050309fc tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Created reservations ['4226f3f4-56dc-4d90-a21d-00868332e989', '2680a378-e8b6-41ee-866b-42f57774ea18', '9c2b4643-7850-4242-90fa-e2e25a349f79', '09b34efc-4a8c-4aa6-ad9d-b837704c6070'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:40:56 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-e9fed5ed-5282-48e4-9b80-7cc7050309fc tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:40:56 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-e9fed5ed-5282-48e4-9b80-7cc7050309fc tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:40:56 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-e9fed5ed-5282-48e4-9b80-7cc7050309fc tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:40:56 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-e9fed5ed-5282-48e4-9b80-7cc7050309fc tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:40:56 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-e9fed5ed-5282-48e4-9b80-7cc7050309fc tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:40:56 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-e9fed5ed-5282-48e4-9b80-7cc7050309fc tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:40:56 devstack sudo[98728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:40:56 devstack sudo[98728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:40:56 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-543f7c8f-8f84-4199-b938-beb446e4699d tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Acquiring lock "cinder-e466a30a-8c43-4df6-b513-5968bfbe9345-delete_volume" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:40:56 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-543f7c8f-8f84-4199-b938-beb446e4699d tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Lock "cinder-e466a30a-8c43-4df6-b513-5968bfbe9345-delete_volume" acquired by "delete_volume" :: waited 0.079s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:40:56 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-543f7c8f-8f84-4199-b938-beb446e4699d tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Acquiring lock "cinder-quobyte-e466a30a-8c43-4df6-b513-5968bfbe9345" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:40:57 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-543f7c8f-8f84-4199-b938-beb446e4699d tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Lock "cinder-quobyte-e466a30a-8c43-4df6-b513-5968bfbe9345" acquired by "delete_volume" :: waited 0.079s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:40:57 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[440ce662-8f60-4b4c-b749-7f5a09fcc176]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:40:57 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-543f7c8f-8f84-4199-b938-beb446e4699d tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e466a30a-8c43-4df6-b513-5968bfbe9345 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:40:57 devstack sudo[98728]: pam_unix(sudo:session): session closed for user root Sep 06 06:40:57 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-e9fed5ed-5282-48e4-9b80-7cc7050309fc tempest-CreateVolumesFromSourceVolumeTest-356108605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.952s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:40:57 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-e9fed5ed-5282-48e4-9b80-7cc7050309fc tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:40:57 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-e9fed5ed-5282-48e4-9b80-7cc7050309fc tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Deleted volume successfully. Sep 06 06:40:57 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-e9fed5ed-5282-48e4-9b80-7cc7050309fc tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Lock "cinder-d485d5f9-d238-4235-a88b-b69cf72c95da-delete_volume" released by "delete_volume" :: held 3.518s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:40:57 devstack sudo[98730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e466a30a-8c43-4df6-b513-5968bfbe9345 Sep 06 06:40:57 devstack sudo[98730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:40:57 devstack sudo[98698]: pam_unix(sudo:session): session closed for user root Sep 06 06:40:57 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-4c711501-3a89-4599-8fa6-5ad9cc2dd4aa tempest-VolumesCloneTest-741677168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-071ddf2b-7aaa-438f-8ee9-dfea9065eaf1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-c3f4220f-a711-47eb-b49f-d31f26e59dd0" returned: 0 in 5.912s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:40:57 devstack cinder-volume[87329]: DEBUG cinder.image.image_utils [None req-4c711501-3a89-4599-8fa6-5ad9cc2dd4aa tempest-VolumesCloneTest-741677168 None] Image conversion details: src /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-071ddf2b-7aaa-438f-8ee9-dfea9065eaf1, size 1024.00 MB, duration 5.91 sec, destination /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-c3f4220f-a711-47eb-b49f-d31f26e59dd0 {{(pid=87329) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 06 06:40:57 devstack cinder-volume[87329]: INFO cinder.image.image_utils [None req-4c711501-3a89-4599-8fa6-5ad9cc2dd4aa tempest-VolumesCloneTest-741677168 None] Converted 1024.00 MB image at 173.18 MB/s Sep 06 06:40:57 devstack cinder-volume[87329]: WARNING cinder.volume.drivers.remotefs [None req-4c711501-3a89-4599-8fa6-5ad9cc2dd4aa tempest-VolumesCloneTest-741677168 None] /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-c3f4220f-a711-47eb-b49f-d31f26e59dd0 is being set with open permissions: ugo+rw Sep 06 06:40:57 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-4c711501-3a89-4599-8fa6-5ad9cc2dd4aa tempest-VolumesCloneTest-741677168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-c3f4220f-a711-47eb-b49f-d31f26e59dd0 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:40:57 devstack sudo[98739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-c3f4220f-a711-47eb-b49f-d31f26e59dd0 Sep 06 06:40:57 devstack sudo[98739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:40:57 devstack sudo[98730]: pam_unix(sudo:session): session closed for user root Sep 06 06:40:57 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-543f7c8f-8f84-4199-b938-beb446e4699d tempest-CreateVolumesFromSourceVolumeTest-356108605 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e466a30a-8c43-4df6-b513-5968bfbe9345" returned: 0 in 0.676s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:40:57 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-543f7c8f-8f84-4199-b938-beb446e4699d tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e466a30a-8c43-4df6-b513-5968bfbe9345 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:40:57 devstack sudo[98745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e466a30a-8c43-4df6-b513-5968bfbe9345 Sep 06 06:40:57 devstack sudo[98745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:40:57 devstack sudo[98739]: pam_unix(sudo:session): session closed for user root Sep 06 06:40:57 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-4c711501-3a89-4599-8fa6-5ad9cc2dd4aa tempest-VolumesCloneTest-741677168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-c3f4220f-a711-47eb-b49f-d31f26e59dd0" returned: 0 in 0.272s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:40:57 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-4c711501-3a89-4599-8fa6-5ad9cc2dd4aa tempest-VolumesCloneTest-741677168 None] Lock "cinder-quobyte-c3f4220f-a711-47eb-b49f-d31f26e59dd0" released by "_copy_volume_from_snapshot" :: held 7.136s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:40:57 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-4c711501-3a89-4599-8fa6-5ad9cc2dd4aa tempest-VolumesCloneTest-741677168 None] Acquiring lock "cinder-quobyte-5c6b4819-a34a-4c49-9067-8443cd7e7e0e" by "_delete_snapshot" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:40:57 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-4c711501-3a89-4599-8fa6-5ad9cc2dd4aa tempest-VolumesCloneTest-741677168 None] Lock "cinder-quobyte-5c6b4819-a34a-4c49-9067-8443cd7e7e0e" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:40:57 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-4c711501-3a89-4599-8fa6-5ad9cc2dd4aa tempest-VolumesCloneTest-741677168 None] Deleting offline snapshot 5c6b4819-a34a-4c49-9067-8443cd7e7e0e of volume 071ddf2b-7aaa-438f-8ee9-dfea9065eaf1 {{(pid=87329) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 06 06:40:57 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-4c711501-3a89-4599-8fa6-5ad9cc2dd4aa tempest-VolumesCloneTest-741677168 None] snapshot_file for this snap is: volume-071ddf2b-7aaa-438f-8ee9-dfea9065eaf1.5c6b4819-a34a-4c49-9067-8443cd7e7e0e {{(pid=87329) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 06 06:40:57 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[4163ae5e-c463-4379-a6a0-6374bb4fc551]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:40:57 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-4c711501-3a89-4599-8fa6-5ad9cc2dd4aa tempest-VolumesCloneTest-741677168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-071ddf2b-7aaa-438f-8ee9-dfea9065eaf1.5c6b4819-a34a-4c49-9067-8443cd7e7e0e {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:40:58 devstack sudo[98747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-071ddf2b-7aaa-438f-8ee9-dfea9065eaf1.5c6b4819-a34a-4c49-9067-8443cd7e7e0e Sep 06 06:40:58 devstack sudo[98747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:40:58 devstack sudo[98745]: pam_unix(sudo:session): session closed for user root Sep 06 06:40:58 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-543f7c8f-8f84-4199-b938-beb446e4699d tempest-CreateVolumesFromSourceVolumeTest-356108605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e466a30a-8c43-4df6-b513-5968bfbe9345" returned: 0 in 0.268s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:40:58 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-543f7c8f-8f84-4199-b938-beb446e4699d tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Lock "cinder-quobyte-e466a30a-8c43-4df6-b513-5968bfbe9345" released by "delete_volume" :: held 1.070s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:40:58 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-543f7c8f-8f84-4199-b938-beb446e4699d tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Created reservations ['6a67aa23-cfa7-4944-bb72-71ea3cc0a67f', '17c0f74b-b78c-4cae-b783-95fec58ed36b', 'dda117ae-2d33-460c-90e5-c3feb2676fd0', 'b7321189-bcd3-4d20-8bc9-61e4348c17c4'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:40:58 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-543f7c8f-8f84-4199-b938-beb446e4699d tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:40:58 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-543f7c8f-8f84-4199-b938-beb446e4699d tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:40:58 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-543f7c8f-8f84-4199-b938-beb446e4699d tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:40:58 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-543f7c8f-8f84-4199-b938-beb446e4699d tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:40:58 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-543f7c8f-8f84-4199-b938-beb446e4699d tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:40:58 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-543f7c8f-8f84-4199-b938-beb446e4699d tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:40:58 devstack sudo[98750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:40:58 devstack sudo[98750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:40:58 devstack sudo[98747]: pam_unix(sudo:session): session closed for user root Sep 06 06:40:58 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-4c711501-3a89-4599-8fa6-5ad9cc2dd4aa tempest-VolumesCloneTest-741677168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-071ddf2b-7aaa-438f-8ee9-dfea9065eaf1.5c6b4819-a34a-4c49-9067-8443cd7e7e0e" returned: 0 in 0.420s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:40:58 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-4c711501-3a89-4599-8fa6-5ad9cc2dd4aa tempest-VolumesCloneTest-741677168 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-071ddf2b-7aaa-438f-8ee9-dfea9065eaf1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87329) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 06:40:58 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba7658ee-136c-4d28-bc12-6b3b664089fa]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:40:58 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-4c711501-3a89-4599-8fa6-5ad9cc2dd4aa tempest-VolumesCloneTest-741677168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-071ddf2b-7aaa-438f-8ee9-dfea9065eaf1 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:40:58 devstack sudo[98755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-071ddf2b-7aaa-438f-8ee9-dfea9065eaf1 Sep 06 06:40:58 devstack sudo[98755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:40:58 devstack sudo[98750]: pam_unix(sudo:session): session closed for user root Sep 06 06:40:58 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-543f7c8f-8f84-4199-b938-beb446e4699d tempest-CreateVolumesFromSourceVolumeTest-356108605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.272s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:40:58 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-543f7c8f-8f84-4199-b938-beb446e4699d tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:40:58 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-543f7c8f-8f84-4199-b938-beb446e4699d tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Deleted volume successfully. Sep 06 06:40:58 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-543f7c8f-8f84-4199-b938-beb446e4699d tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Lock "cinder-e466a30a-8c43-4df6-b513-5968bfbe9345-delete_volume" released by "delete_volume" :: held 1.767s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:40:58 devstack sudo[98755]: pam_unix(sudo:session): session closed for user root Sep 06 06:40:58 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-4c711501-3a89-4599-8fa6-5ad9cc2dd4aa tempest-VolumesCloneTest-741677168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-071ddf2b-7aaa-438f-8ee9-dfea9065eaf1" returned: 0 in 0.535s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:40:58 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-4c711501-3a89-4599-8fa6-5ad9cc2dd4aa tempest-VolumesCloneTest-741677168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-071ddf2b-7aaa-438f-8ee9-dfea9065eaf1.5c6b4819-a34a-4c49-9067-8443cd7e7e0e {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:40:58 devstack sudo[98773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-071ddf2b-7aaa-438f-8ee9-dfea9065eaf1.5c6b4819-a34a-4c49-9067-8443cd7e7e0e Sep 06 06:40:58 devstack sudo[98773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:40:59 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-0547a04f-ab32-4243-8944-5fe3839ef2e9 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Acquiring lock "cinder-2a0a616d-4117-4b8e-a6a4-b41ff175423c-delete_volume" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:40:59 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-0547a04f-ab32-4243-8944-5fe3839ef2e9 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Lock "cinder-2a0a616d-4117-4b8e-a6a4-b41ff175423c-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:40:59 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-0547a04f-ab32-4243-8944-5fe3839ef2e9 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Acquiring lock "cinder-quobyte-2a0a616d-4117-4b8e-a6a4-b41ff175423c" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:40:59 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-0547a04f-ab32-4243-8944-5fe3839ef2e9 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Lock "cinder-quobyte-2a0a616d-4117-4b8e-a6a4-b41ff175423c" acquired by "delete_volume" :: waited 0.019s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:40:59 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c49ad92-d6e2-427f-91d3-e8a5d0f83394]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:40:59 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-0547a04f-ab32-4243-8944-5fe3839ef2e9 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-2a0a616d-4117-4b8e-a6a4-b41ff175423c {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:40:59 devstack sudo[98773]: pam_unix(sudo:session): session closed for user root Sep 06 06:40:59 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-4c711501-3a89-4599-8fa6-5ad9cc2dd4aa tempest-VolumesCloneTest-741677168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-071ddf2b-7aaa-438f-8ee9-dfea9065eaf1.5c6b4819-a34a-4c49-9067-8443cd7e7e0e" returned: 0 in 0.378s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:40:59 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-4c711501-3a89-4599-8fa6-5ad9cc2dd4aa tempest-VolumesCloneTest-741677168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-071ddf2b-7aaa-438f-8ee9-dfea9065eaf1.5c6b4819-a34a-4c49-9067-8443cd7e7e0e {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:40:59 devstack sudo[98779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-071ddf2b-7aaa-438f-8ee9-dfea9065eaf1.5c6b4819-a34a-4c49-9067-8443cd7e7e0e Sep 06 06:40:59 devstack sudo[98779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:40:59 devstack sudo[98778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-2a0a616d-4117-4b8e-a6a4-b41ff175423c Sep 06 06:40:59 devstack sudo[98778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:40:59 devstack sudo[98779]: pam_unix(sudo:session): session closed for user root Sep 06 06:40:59 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-4c711501-3a89-4599-8fa6-5ad9cc2dd4aa tempest-VolumesCloneTest-741677168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-071ddf2b-7aaa-438f-8ee9-dfea9065eaf1.5c6b4819-a34a-4c49-9067-8443cd7e7e0e" returned: 0 in 0.251s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:40:59 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-4c711501-3a89-4599-8fa6-5ad9cc2dd4aa tempest-VolumesCloneTest-741677168 None] Lock "cinder-quobyte-5c6b4819-a34a-4c49-9067-8443cd7e7e0e" released by "_delete_snapshot" :: held 1.661s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:40:59 devstack sudo[98778]: pam_unix(sudo:session): session closed for user root Sep 06 06:40:59 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-0547a04f-ab32-4243-8944-5fe3839ef2e9 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-2a0a616d-4117-4b8e-a6a4-b41ff175423c" returned: 0 in 0.384s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:40:59 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-0547a04f-ab32-4243-8944-5fe3839ef2e9 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-2a0a616d-4117-4b8e-a6a4-b41ff175423c {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:40:59 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-4c711501-3a89-4599-8fa6-5ad9cc2dd4aa tempest-VolumesCloneTest-741677168 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.335s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:40:59 devstack sudo[98787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-2a0a616d-4117-4b8e-a6a4-b41ff175423c Sep 06 06:40:59 devstack sudo[98787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:40:59 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-4c711501-3a89-4599-8fa6-5ad9cc2dd4aa tempest-VolumesCloneTest-741677168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17b249c7-4f0f-450e-ad37-1f2069360bd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3f4220f-a711-47eb-b49f-d31f26e59dd0', 'volume_size': 2, 'source_volid': '071ddf2b-7aaa-438f-8ee9-dfea9065eaf1', 'source_volstatus': 'available'}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:40:59 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-4c711501-3a89-4599-8fa6-5ad9cc2dd4aa tempest-VolumesCloneTest-741677168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24d68d31-dca6-4f6a-b01c-90d5bd51092e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:40:59 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-4c711501-3a89-4599-8fa6-5ad9cc2dd4aa tempest-VolumesCloneTest-741677168 None] Volume volume-c3f4220f-a711-47eb-b49f-d31f26e59dd0 (c3f4220f-a711-47eb-b49f-d31f26e59dd0): created successfully Sep 06 06:40:59 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-4c711501-3a89-4599-8fa6-5ad9cc2dd4aa tempest-VolumesCloneTest-741677168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24d68d31-dca6-4f6a-b01c-90d5bd51092e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:40:59 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-4c711501-3a89-4599-8fa6-5ad9cc2dd4aa tempest-VolumesCloneTest-741677168 None] Flow 'volume_create_manager' (1c973c0d-0077-4f53-b233-9bce3c3c4c99) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:40:59 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-4c711501-3a89-4599-8fa6-5ad9cc2dd4aa tempest-VolumesCloneTest-741677168 None] Created volume successfully. Sep 06 06:40:59 devstack sudo[98787]: pam_unix(sudo:session): session closed for user root Sep 06 06:40:59 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-0547a04f-ab32-4243-8944-5fe3839ef2e9 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-2a0a616d-4117-4b8e-a6a4-b41ff175423c" returned: 0 in 0.253s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:40:59 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-0547a04f-ab32-4243-8944-5fe3839ef2e9 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Lock "cinder-quobyte-2a0a616d-4117-4b8e-a6a4-b41ff175423c" released by "delete_volume" :: held 0.683s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:40:59 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-0547a04f-ab32-4243-8944-5fe3839ef2e9 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Created reservations ['23c542f8-2fd3-49de-921a-d9604139e985', '505b286f-273c-49b1-8cf3-91be99568448', '2053af9d-65fe-43c2-897e-2522e7c35130', '55a8753e-7fe3-4722-943b-3b7aa0fa6f59'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:40:59 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-0547a04f-ab32-4243-8944-5fe3839ef2e9 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:40:59 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-0547a04f-ab32-4243-8944-5fe3839ef2e9 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:40:59 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-0547a04f-ab32-4243-8944-5fe3839ef2e9 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:40:59 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-0547a04f-ab32-4243-8944-5fe3839ef2e9 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:40:59 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-0547a04f-ab32-4243-8944-5fe3839ef2e9 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:40:59 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-0547a04f-ab32-4243-8944-5fe3839ef2e9 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:41:00 devstack sudo[98790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:41:00 devstack sudo[98790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:41:00 devstack sudo[98790]: pam_unix(sudo:session): session closed for user root Sep 06 06:41:00 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-0547a04f-ab32-4243-8944-5fe3839ef2e9 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.238s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:41:00 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-0547a04f-ab32-4243-8944-5fe3839ef2e9 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:41:00 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-0547a04f-ab32-4243-8944-5fe3839ef2e9 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Deleted volume successfully. Sep 06 06:41:00 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-0547a04f-ab32-4243-8944-5fe3839ef2e9 tempest-CreateVolumesFromSourceVolumeTest-356108605 None] Lock "cinder-2a0a616d-4117-4b8e-a6a4-b41ff175423c-delete_volume" released by "delete_volume" :: held 1.111s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:41:00 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-04589da2-fd75-4a52-9d6a-e0db91369abd tempest-VolumesCloneTest-741677168 None] Acquiring lock "cinder-c3f4220f-a711-47eb-b49f-d31f26e59dd0-delete_volume" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:41:00 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-04589da2-fd75-4a52-9d6a-e0db91369abd tempest-VolumesCloneTest-741677168 None] Lock "cinder-c3f4220f-a711-47eb-b49f-d31f26e59dd0-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:41:00 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-04589da2-fd75-4a52-9d6a-e0db91369abd tempest-VolumesCloneTest-741677168 None] Acquiring lock "cinder-quobyte-c3f4220f-a711-47eb-b49f-d31f26e59dd0" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:41:00 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-04589da2-fd75-4a52-9d6a-e0db91369abd tempest-VolumesCloneTest-741677168 None] Lock "cinder-quobyte-c3f4220f-a711-47eb-b49f-d31f26e59dd0" acquired by "delete_volume" :: waited 0.015s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:41:00 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[4458601d-35a4-4517-9e05-6783686160f6]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:41:00 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-04589da2-fd75-4a52-9d6a-e0db91369abd tempest-VolumesCloneTest-741677168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-c3f4220f-a711-47eb-b49f-d31f26e59dd0 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:41:00 devstack sudo[98793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-c3f4220f-a711-47eb-b49f-d31f26e59dd0 Sep 06 06:41:00 devstack sudo[98793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:41:01 devstack sudo[98793]: pam_unix(sudo:session): session closed for user root Sep 06 06:41:01 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-04589da2-fd75-4a52-9d6a-e0db91369abd tempest-VolumesCloneTest-741677168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-c3f4220f-a711-47eb-b49f-d31f26e59dd0" returned: 0 in 0.364s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:41:01 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-04589da2-fd75-4a52-9d6a-e0db91369abd tempest-VolumesCloneTest-741677168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-c3f4220f-a711-47eb-b49f-d31f26e59dd0 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:41:01 devstack sudo[98798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-c3f4220f-a711-47eb-b49f-d31f26e59dd0 Sep 06 06:41:01 devstack sudo[98798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:41:01 devstack sudo[98798]: pam_unix(sudo:session): session closed for user root Sep 06 06:41:01 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-04589da2-fd75-4a52-9d6a-e0db91369abd tempest-VolumesCloneTest-741677168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-c3f4220f-a711-47eb-b49f-d31f26e59dd0" returned: 0 in 0.251s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:41:01 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-04589da2-fd75-4a52-9d6a-e0db91369abd tempest-VolumesCloneTest-741677168 None] Lock "cinder-quobyte-c3f4220f-a711-47eb-b49f-d31f26e59dd0" released by "delete_volume" :: held 0.651s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:41:01 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-04589da2-fd75-4a52-9d6a-e0db91369abd tempest-VolumesCloneTest-741677168 None] Created reservations ['8bbc539f-12a5-4866-a608-0f2039bbf523', 'fae6b314-3697-4d5f-b8a1-9e7e3eb3d79b', 'a973d0a6-abfc-41ab-b6c5-054db527e529', 'aebc74a3-f476-49b2-b3cb-4c8b4b33110d'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:41:01 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-04589da2-fd75-4a52-9d6a-e0db91369abd tempest-VolumesCloneTest-741677168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:41:01 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-04589da2-fd75-4a52-9d6a-e0db91369abd tempest-VolumesCloneTest-741677168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:41:01 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-04589da2-fd75-4a52-9d6a-e0db91369abd tempest-VolumesCloneTest-741677168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:41:01 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-04589da2-fd75-4a52-9d6a-e0db91369abd tempest-VolumesCloneTest-741677168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:41:01 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-04589da2-fd75-4a52-9d6a-e0db91369abd tempest-VolumesCloneTest-741677168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:41:01 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-04589da2-fd75-4a52-9d6a-e0db91369abd tempest-VolumesCloneTest-741677168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:41:01 devstack sudo[98801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:41:01 devstack sudo[98801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:41:01 devstack sudo[98801]: pam_unix(sudo:session): session closed for user root Sep 06 06:41:01 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-04589da2-fd75-4a52-9d6a-e0db91369abd tempest-VolumesCloneTest-741677168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.275s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:41:01 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-04589da2-fd75-4a52-9d6a-e0db91369abd tempest-VolumesCloneTest-741677168 None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:41:01 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-04589da2-fd75-4a52-9d6a-e0db91369abd tempest-VolumesCloneTest-741677168 None] Deleted volume successfully. Sep 06 06:41:01 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-04589da2-fd75-4a52-9d6a-e0db91369abd tempest-VolumesCloneTest-741677168 None] Lock "cinder-c3f4220f-a711-47eb-b49f-d31f26e59dd0-delete_volume" released by "delete_volume" :: held 1.179s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:41:01 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-e23cf1f5-6f77-4b4a-b513-0ecbfbc1ccd4 tempest-VolumesCloneTest-741677168 None] Acquiring lock "cinder-071ddf2b-7aaa-438f-8ee9-dfea9065eaf1-delete_volume" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:41:01 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-e23cf1f5-6f77-4b4a-b513-0ecbfbc1ccd4 tempest-VolumesCloneTest-741677168 None] Lock "cinder-071ddf2b-7aaa-438f-8ee9-dfea9065eaf1-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:41:01 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-e23cf1f5-6f77-4b4a-b513-0ecbfbc1ccd4 tempest-VolumesCloneTest-741677168 None] Acquiring lock "cinder-quobyte-071ddf2b-7aaa-438f-8ee9-dfea9065eaf1" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:41:01 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-e23cf1f5-6f77-4b4a-b513-0ecbfbc1ccd4 tempest-VolumesCloneTest-741677168 None] Lock "cinder-quobyte-071ddf2b-7aaa-438f-8ee9-dfea9065eaf1" acquired by "delete_volume" :: waited 0.016s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:41:01 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2a6bfc1-28d9-4972-979c-d79f5d51238f]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:41:01 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-e23cf1f5-6f77-4b4a-b513-0ecbfbc1ccd4 tempest-VolumesCloneTest-741677168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-071ddf2b-7aaa-438f-8ee9-dfea9065eaf1 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:41:02 devstack sudo[98804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-071ddf2b-7aaa-438f-8ee9-dfea9065eaf1 Sep 06 06:41:02 devstack sudo[98804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:41:02 devstack sudo[98804]: pam_unix(sudo:session): session closed for user root Sep 06 06:41:02 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-e23cf1f5-6f77-4b4a-b513-0ecbfbc1ccd4 tempest-VolumesCloneTest-741677168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-071ddf2b-7aaa-438f-8ee9-dfea9065eaf1" returned: 0 in 0.375s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:41:02 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-e23cf1f5-6f77-4b4a-b513-0ecbfbc1ccd4 tempest-VolumesCloneTest-741677168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-071ddf2b-7aaa-438f-8ee9-dfea9065eaf1 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:41:02 devstack sudo[98810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-071ddf2b-7aaa-438f-8ee9-dfea9065eaf1 Sep 06 06:41:02 devstack sudo[98810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:41:02 devstack sudo[98810]: pam_unix(sudo:session): session closed for user root Sep 06 06:41:02 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-e23cf1f5-6f77-4b4a-b513-0ecbfbc1ccd4 tempest-VolumesCloneTest-741677168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-071ddf2b-7aaa-438f-8ee9-dfea9065eaf1" returned: 0 in 0.248s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:41:02 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-e23cf1f5-6f77-4b4a-b513-0ecbfbc1ccd4 tempest-VolumesCloneTest-741677168 None] Lock "cinder-quobyte-071ddf2b-7aaa-438f-8ee9-dfea9065eaf1" released by "delete_volume" :: held 0.681s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:41:02 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-e23cf1f5-6f77-4b4a-b513-0ecbfbc1ccd4 tempest-VolumesCloneTest-741677168 None] Created reservations ['43703630-3643-49f1-ae64-76f216b4be68', 'b8fde3dc-5ca2-4ef5-8815-dffc7b40bdd2', 'fbb861d2-b042-4d0f-87ed-f0a6be17d9d5', 'fef4b61c-b5fe-4b30-9424-74eb858df37a'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:41:02 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-e23cf1f5-6f77-4b4a-b513-0ecbfbc1ccd4 tempest-VolumesCloneTest-741677168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:41:02 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-e23cf1f5-6f77-4b4a-b513-0ecbfbc1ccd4 tempest-VolumesCloneTest-741677168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:41:02 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-e23cf1f5-6f77-4b4a-b513-0ecbfbc1ccd4 tempest-VolumesCloneTest-741677168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:41:02 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-e23cf1f5-6f77-4b4a-b513-0ecbfbc1ccd4 tempest-VolumesCloneTest-741677168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:41:02 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-e23cf1f5-6f77-4b4a-b513-0ecbfbc1ccd4 tempest-VolumesCloneTest-741677168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:41:02 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-e23cf1f5-6f77-4b4a-b513-0ecbfbc1ccd4 tempest-VolumesCloneTest-741677168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:41:02 devstack sudo[98813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:41:02 devstack sudo[98813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:41:02 devstack sudo[98813]: pam_unix(sudo:session): session closed for user root Sep 06 06:41:02 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-e23cf1f5-6f77-4b4a-b513-0ecbfbc1ccd4 tempest-VolumesCloneTest-741677168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.274s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:41:02 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-e23cf1f5-6f77-4b4a-b513-0ecbfbc1ccd4 tempest-VolumesCloneTest-741677168 None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:41:03 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-e23cf1f5-6f77-4b4a-b513-0ecbfbc1ccd4 tempest-VolumesCloneTest-741677168 None] Deleted volume successfully. Sep 06 06:41:03 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-e23cf1f5-6f77-4b4a-b513-0ecbfbc1ccd4 tempest-VolumesCloneTest-741677168 None] Lock "cinder-071ddf2b-7aaa-438f-8ee9-dfea9065eaf1-delete_volume" released by "delete_volume" :: held 1.162s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:41:03 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-cbf27c47-7483-442c-94d8-0c3688adbf99 tempest-VolumeDependencyTests-1326358127 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87329) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 06:41:03 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-cbf27c47-7483-442c-94d8-0c3688adbf99 tempest-VolumeDependencyTests-1326358127 None] Flow 'volume_create_manager' (b6658110-6afb-4b20-b72b-5d1b70ec5c2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:41:03 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-cbf27c47-7483-442c-94d8-0c3688adbf99 tempest-VolumeDependencyTests-1326358127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09a515c8-0f69-42af-b7ad-9977666a3ff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:41:03 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-cbf27c47-7483-442c-94d8-0c3688adbf99 tempest-VolumeDependencyTests-1326358127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09a515c8-0f69-42af-b7ad-9977666a3ff5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:41:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1298916404',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8cead335-b15e-4c1e-85b3-c8b1cf1ef742,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10953d61cb12481c98ecb4dad19a09e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:41:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:41:03Z,use_quota=True,user_id='06222c309f854392831c5e0f6129469a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:41:03 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-cbf27c47-7483-442c-94d8-0c3688adbf99 tempest-VolumeDependencyTests-1326358127 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b381f06f-5ec0-455e-88fb-5d28cda838ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:41:03 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-cbf27c47-7483-442c-94d8-0c3688adbf99 tempest-VolumeDependencyTests-1326358127 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b381f06f-5ec0-455e-88fb-5d28cda838ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:41:03 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-cbf27c47-7483-442c-94d8-0c3688adbf99 tempest-VolumeDependencyTests-1326358127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (187d01b0-3950-4ad1-9575-d74b48ffa3a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:41:03 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-cbf27c47-7483-442c-94d8-0c3688adbf99 tempest-VolumeDependencyTests-1326358127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (187d01b0-3950-4ad1-9575-d74b48ffa3a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8cead335-b15e-4c1e-85b3-c8b1cf1ef742', 'volume_name': 'volume-8cead335-b15e-4c1e-85b3-c8b1cf1ef742', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:41:03 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-cbf27c47-7483-442c-94d8-0c3688adbf99 tempest-VolumeDependencyTests-1326358127 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f886b12e-fa72-497d-aebc-b0bd0e7ec66e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:41:03 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-cbf27c47-7483-442c-94d8-0c3688adbf99 tempest-VolumeDependencyTests-1326358127 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f886b12e-fa72-497d-aebc-b0bd0e7ec66e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:41:03 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-cbf27c47-7483-442c-94d8-0c3688adbf99 tempest-VolumeDependencyTests-1326358127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (696e719a-5674-4c7b-8e94-4dba18cc49fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:41:03 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-cbf27c47-7483-442c-94d8-0c3688adbf99 tempest-VolumeDependencyTests-1326358127 None] Volume 8cead335-b15e-4c1e-85b3-c8b1cf1ef742: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8cead335-b15e-4c1e-85b3-c8b1cf1ef742', 'volume_size': 1} Sep 06 06:41:03 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-cbf27c47-7483-442c-94d8-0c3688adbf99 tempest-VolumeDependencyTests-1326358127 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:41:03 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-cbf27c47-7483-442c-94d8-0c3688adbf99 tempest-VolumeDependencyTests-1326358127 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:41:03 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-cbf27c47-7483-442c-94d8-0c3688adbf99 tempest-VolumeDependencyTests-1326358127 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:41:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1298916404',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8cead335-b15e-4c1e-85b3-c8b1cf1ef742,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10953d61cb12481c98ecb4dad19a09e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:41:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:41:03Z,use_quota=True,user_id='06222c309f854392831c5e0f6129469a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)}" {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 06:41:03 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-cbf27c47-7483-442c-94d8-0c3688adbf99 tempest-VolumeDependencyTests-1326358127 None] Creating volume 8cead335-b15e-4c1e-85b3-c8b1cf1ef742 {{(pid=87329) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 06:41:03 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-cbf27c47-7483-442c-94d8-0c3688adbf99 tempest-VolumeDependencyTests-1326358127 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:41:03 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-cbf27c47-7483-442c-94d8-0c3688adbf99 tempest-VolumeDependencyTests-1326358127 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:41:03 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-cbf27c47-7483-442c-94d8-0c3688adbf99 tempest-VolumeDependencyTests-1326358127 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:41:03 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-cbf27c47-7483-442c-94d8-0c3688adbf99 tempest-VolumeDependencyTests-1326358127 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:41:03 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-cbf27c47-7483-442c-94d8-0c3688adbf99 tempest-VolumeDependencyTests-1326358127 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:41:03 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-cbf27c47-7483-442c-94d8-0c3688adbf99 tempest-VolumeDependencyTests-1326358127 None] Selected osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 as target Quobyte volume. {{(pid=87329) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 06:41:03 devstack cinder-volume[87329]: INFO cinder.volume.drivers.remotefs [None req-cbf27c47-7483-442c-94d8-0c3688adbf99 tempest-VolumeDependencyTests-1326358127 None] casted to osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 Sep 06 06:41:03 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-cbf27c47-7483-442c-94d8-0c3688adbf99 tempest-VolumeDependencyTests-1326358127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-8cead335-b15e-4c1e-85b3-c8b1cf1ef742 1073741824 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:41:03 devstack sudo[98816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-8cead335-b15e-4c1e-85b3-c8b1cf1ef742 1073741824 Sep 06 06:41:03 devstack sudo[98816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:41:03 devstack sudo[98816]: pam_unix(sudo:session): session closed for user root Sep 06 06:41:03 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-cbf27c47-7483-442c-94d8-0c3688adbf99 tempest-VolumeDependencyTests-1326358127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-8cead335-b15e-4c1e-85b3-c8b1cf1ef742 1073741824" returned: 0 in 0.425s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:41:03 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-cbf27c47-7483-442c-94d8-0c3688adbf99 tempest-VolumeDependencyTests-1326358127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-8cead335-b15e-4c1e-85b3-c8b1cf1ef742 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:41:03 devstack sudo[98822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-8cead335-b15e-4c1e-85b3-c8b1cf1ef742 Sep 06 06:41:03 devstack sudo[98822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:41:04 devstack sudo[98822]: pam_unix(sudo:session): session closed for user root Sep 06 06:41:04 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-cbf27c47-7483-442c-94d8-0c3688adbf99 tempest-VolumeDependencyTests-1326358127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-8cead335-b15e-4c1e-85b3-c8b1cf1ef742" returned: 0 in 0.255s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:41:04 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-cbf27c47-7483-442c-94d8-0c3688adbf99 tempest-VolumeDependencyTests-1326358127 None] <== create_volume: return (722ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'} {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 06:41:04 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-cbf27c47-7483-442c-94d8-0c3688adbf99 tempest-VolumeDependencyTests-1326358127 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.725s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:41:04 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-cbf27c47-7483-442c-94d8-0c3688adbf99 tempest-VolumeDependencyTests-1326358127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (696e719a-5674-4c7b-8e94-4dba18cc49fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8cead335-b15e-4c1e-85b3-c8b1cf1ef742', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:41:04 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-cbf27c47-7483-442c-94d8-0c3688adbf99 tempest-VolumeDependencyTests-1326358127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (843df35c-c79e-4f3c-b583-427b6bd7cfc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:41:04 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-cbf27c47-7483-442c-94d8-0c3688adbf99 tempest-VolumeDependencyTests-1326358127 None] Volume volume-8cead335-b15e-4c1e-85b3-c8b1cf1ef742 (8cead335-b15e-4c1e-85b3-c8b1cf1ef742): created successfully Sep 06 06:41:04 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-cbf27c47-7483-442c-94d8-0c3688adbf99 tempest-VolumeDependencyTests-1326358127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (843df35c-c79e-4f3c-b583-427b6bd7cfc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:41:04 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-cbf27c47-7483-442c-94d8-0c3688adbf99 tempest-VolumeDependencyTests-1326358127 None] Flow 'volume_create_manager' (b6658110-6afb-4b20-b72b-5d1b70ec5c2b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:41:04 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-cbf27c47-7483-442c-94d8-0c3688adbf99 tempest-VolumeDependencyTests-1326358127 None] Created volume successfully. Sep 06 06:41:04 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-51167c97-e61a-4cda-bd17-035c0cb9d54f tempest-VolumeDependencyTests-1326358127 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:41:04 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-51167c97-e61a-4cda-bd17-035c0cb9d54f tempest-VolumeDependencyTests-1326358127 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:41:04 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-51167c97-e61a-4cda-bd17-035c0cb9d54f tempest-VolumeDependencyTests-1326358127 None] Creating offline snapshot 44907dec-fa79-4e63-916a-21423470cbf2 of volume 8cead335-b15e-4c1e-85b3-c8b1cf1ef742 {{(pid=87329) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 06 06:41:04 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[473e7bf6-d7d4-428a-8158-7ef416114b94]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:41:04 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-51167c97-e61a-4cda-bd17-035c0cb9d54f tempest-VolumeDependencyTests-1326358127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-8cead335-b15e-4c1e-85b3-c8b1cf1ef742 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:41:04 devstack sudo[98825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-8cead335-b15e-4c1e-85b3-c8b1cf1ef742 Sep 06 06:41:04 devstack sudo[98825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:41:04 devstack sudo[98825]: pam_unix(sudo:session): session closed for user root Sep 06 06:41:04 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-51167c97-e61a-4cda-bd17-035c0cb9d54f tempest-VolumeDependencyTests-1326358127 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-8cead335-b15e-4c1e-85b3-c8b1cf1ef742" returned: 0 in 0.366s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:41:04 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-51167c97-e61a-4cda-bd17-035c0cb9d54f tempest-VolumeDependencyTests-1326358127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-8cead335-b15e-4c1e-85b3-c8b1cf1ef742,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-8cead335-b15e-4c1e-85b3-c8b1cf1ef742.44907dec-fa79-4e63-916a-21423470cbf2 1G {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:41:04 devstack sudo[98832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-8cead335-b15e-4c1e-85b3-c8b1cf1ef742,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-8cead335-b15e-4c1e-85b3-c8b1cf1ef742.44907dec-fa79-4e63-916a-21423470cbf2 1G Sep 06 06:41:04 devstack sudo[98832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:41:05 devstack sudo[98832]: pam_unix(sudo:session): session closed for user root Sep 06 06:41:05 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-51167c97-e61a-4cda-bd17-035c0cb9d54f tempest-VolumeDependencyTests-1326358127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-8cead335-b15e-4c1e-85b3-c8b1cf1ef742,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-8cead335-b15e-4c1e-85b3-c8b1cf1ef742.44907dec-fa79-4e63-916a-21423470cbf2 1G" returned: 0 in 0.427s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:41:05 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-51167c97-e61a-4cda-bd17-035c0cb9d54f tempest-VolumeDependencyTests-1326358127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8cead335-b15e-4c1e-85b3-c8b1cf1ef742 -F qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-8cead335-b15e-4c1e-85b3-c8b1cf1ef742.44907dec-fa79-4e63-916a-21423470cbf2 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:41:05 devstack sudo[98837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8cead335-b15e-4c1e-85b3-c8b1cf1ef742 -F qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-8cead335-b15e-4c1e-85b3-c8b1cf1ef742.44907dec-fa79-4e63-916a-21423470cbf2 Sep 06 06:41:05 devstack sudo[98837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:41:05 devstack sudo[98837]: pam_unix(sudo:session): session closed for user root Sep 06 06:41:05 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-51167c97-e61a-4cda-bd17-035c0cb9d54f tempest-VolumeDependencyTests-1326358127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8cead335-b15e-4c1e-85b3-c8b1cf1ef742 -F qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-8cead335-b15e-4c1e-85b3-c8b1cf1ef742.44907dec-fa79-4e63-916a-21423470cbf2" returned: 0 in 0.346s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:41:05 devstack cinder-volume[87329]: WARNING cinder.volume.drivers.remotefs [None req-51167c97-e61a-4cda-bd17-035c0cb9d54f tempest-VolumeDependencyTests-1326358127 None] /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-8cead335-b15e-4c1e-85b3-c8b1cf1ef742.44907dec-fa79-4e63-916a-21423470cbf2 is being set with open permissions: ugo+rw Sep 06 06:41:05 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-51167c97-e61a-4cda-bd17-035c0cb9d54f tempest-VolumeDependencyTests-1326358127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-8cead335-b15e-4c1e-85b3-c8b1cf1ef742.44907dec-fa79-4e63-916a-21423470cbf2 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:41:05 devstack sudo[98842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-8cead335-b15e-4c1e-85b3-c8b1cf1ef742.44907dec-fa79-4e63-916a-21423470cbf2 Sep 06 06:41:05 devstack sudo[98842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:41:05 devstack sudo[98842]: pam_unix(sudo:session): session closed for user root Sep 06 06:41:05 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-51167c97-e61a-4cda-bd17-035c0cb9d54f tempest-VolumeDependencyTests-1326358127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-8cead335-b15e-4c1e-85b3-c8b1cf1ef742.44907dec-fa79-4e63-916a-21423470cbf2" returned: 0 in 0.291s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:41:05 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-51167c97-e61a-4cda-bd17-035c0cb9d54f tempest-VolumeDependencyTests-1326358127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-8cead335-b15e-4c1e-85b3-c8b1cf1ef742.info {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:41:05 devstack sudo[98845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-8cead335-b15e-4c1e-85b3-c8b1cf1ef742.info Sep 06 06:41:05 devstack sudo[98845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:41:06 devstack sudo[98845]: pam_unix(sudo:session): session closed for user root Sep 06 06:41:06 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-51167c97-e61a-4cda-bd17-035c0cb9d54f tempest-VolumeDependencyTests-1326358127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-8cead335-b15e-4c1e-85b3-c8b1cf1ef742.info" returned: 0 in 0.289s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:41:06 devstack cinder-volume[87329]: WARNING cinder.volume.drivers.remotefs [None req-51167c97-e61a-4cda-bd17-035c0cb9d54f tempest-VolumeDependencyTests-1326358127 None] /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-8cead335-b15e-4c1e-85b3-c8b1cf1ef742.info is being set with open permissions: ugo+rw Sep 06 06:41:06 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-51167c97-e61a-4cda-bd17-035c0cb9d54f tempest-VolumeDependencyTests-1326358127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-8cead335-b15e-4c1e-85b3-c8b1cf1ef742.info {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:41:06 devstack sudo[98850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-8cead335-b15e-4c1e-85b3-c8b1cf1ef742.info Sep 06 06:41:06 devstack sudo[98850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:41:06 devstack sudo[98850]: pam_unix(sudo:session): session closed for user root Sep 06 06:41:06 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-51167c97-e61a-4cda-bd17-035c0cb9d54f tempest-VolumeDependencyTests-1326358127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-8cead335-b15e-4c1e-85b3-c8b1cf1ef742.info" returned: 0 in 0.268s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:41:06 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-51167c97-e61a-4cda-bd17-035c0cb9d54f tempest-VolumeDependencyTests-1326358127 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.099s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:41:06 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-51167c97-e61a-4cda-bd17-035c0cb9d54f tempest-VolumeDependencyTests-1326358127 None] Create snapshot completed successfully Sep 06 06:41:07 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a9b7ae3-5422-48b4-8c2e-42aa838520fc tempest-VolumesExtendTest-2006658009 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87329) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 06:41:07 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-6a9b7ae3-5422-48b4-8c2e-42aa838520fc tempest-VolumesExtendTest-2006658009 None] Flow 'volume_create_manager' (c5c098d5-3584-490c-ae1e-f79a8f78339d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:41:07 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-6a9b7ae3-5422-48b4-8c2e-42aa838520fc tempest-VolumesExtendTest-2006658009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f3edfb4-0f78-48e3-aa89-0f26a558733a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:41:07 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-6a9b7ae3-5422-48b4-8c2e-42aa838520fc tempest-VolumesExtendTest-2006658009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f3edfb4-0f78-48e3-aa89-0f26a558733a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:41:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-234567190',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2116a3dc-938c-4819-8330-b815a8d9d41d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c49313d5ba74cc0a3146268e6d81af1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:41:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:41:07Z,use_quota=True,user_id='f0d331e312fc4c7fb9384dca06e6135a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:41:07 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-6a9b7ae3-5422-48b4-8c2e-42aa838520fc tempest-VolumesExtendTest-2006658009 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05e75e89-2408-4959-9b14-5ecf8fed0f61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:41:07 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-6a9b7ae3-5422-48b4-8c2e-42aa838520fc tempest-VolumesExtendTest-2006658009 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05e75e89-2408-4959-9b14-5ecf8fed0f61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:41:07 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-6a9b7ae3-5422-48b4-8c2e-42aa838520fc tempest-VolumesExtendTest-2006658009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e32ff314-1993-40d8-90fa-8a697202e859) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:41:07 devstack cinder-volume[87329]: DEBUG cinder.image.glance [None req-6a9b7ae3-5422-48b4-8c2e-42aa838520fc tempest-VolumesExtendTest-2006658009 None] Creating Keystone auth plugin from conf {{(pid=87329) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 06 06:41:07 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-6a9b7ae3-5422-48b4-8c2e-42aa838520fc tempest-VolumesExtendTest-2006658009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e32ff314-1993-40d8-90fa-8a697202e859) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2116a3dc-938c-4819-8330-b815a8d9d41d', 'volume_name': 'volume-2116a3dc-938c-4819-8330-b815a8d9d41d', 'volume_size': 1, 'image_id': '7005ba32-ec39-44a3-88d9-ca6af0b34ea0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7005ba32-ec39-44a3-88d9-ca6af0b34ea0', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '65b0d6d605b2427d8db787d4220dbeb4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7005ba32-ec39-44a3-88d9-ca6af0b34ea0', 'created_at': datetime.datetime(2026, 9, 6, 4, 25, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 6, 4, 25, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7005ba32-ec39-44a3-88d9-ca6af0b34ea0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:41:07 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-6a9b7ae3-5422-48b4-8c2e-42aa838520fc tempest-VolumesExtendTest-2006658009 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9128e5e8-0f55-451c-bb9c-cea0343c1bd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:41:07 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-6a9b7ae3-5422-48b4-8c2e-42aa838520fc tempest-VolumesExtendTest-2006658009 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9128e5e8-0f55-451c-bb9c-cea0343c1bd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:41:07 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-6a9b7ae3-5422-48b4-8c2e-42aa838520fc tempest-VolumesExtendTest-2006658009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93e1a400-d68a-41d4-8d1d-6b22a015be1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:41:07 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-6a9b7ae3-5422-48b4-8c2e-42aa838520fc tempest-VolumesExtendTest-2006658009 None] Volume 2116a3dc-938c-4819-8330-b815a8d9d41d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2116a3dc-938c-4819-8330-b815a8d9d41d', 'volume_size': 1, 'image_id': '7005ba32-ec39-44a3-88d9-ca6af0b34ea0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7005ba32-ec39-44a3-88d9-ca6af0b34ea0', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '65b0d6d605b2427d8db787d4220dbeb4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7005ba32-ec39-44a3-88d9-ca6af0b34ea0', 'created_at': datetime.datetime(2026, 9, 6, 4, 25, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 6, 4, 25, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7005ba32-ec39-44a3-88d9-ca6af0b34ea0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 06 06:41:07 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a9b7ae3-5422-48b4-8c2e-42aa838520fc tempest-VolumesExtendTest-2006658009 None] Trying to clone 2116a3dc-938c-4819-8330-b815a8d9d41d from image 7005ba32-ec39-44a3-88d9-ca6af0b34ea0 at location (None, [{'url': 'file:///opt/stack/data/glance/images/7005ba32-ec39-44a3-88d9-ca6af0b34ea0', 'metadata': {}}]). {{(pid=87329) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 06 06:41:08 devstack cinder-volume[87329]: DEBUG cinder.image.image_utils [None req-6a9b7ae3-5422-48b4-8c2e-42aa838520fc tempest-VolumesExtendTest-2006658009 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_7005ba32-ec39-44a3-88d9-ca6af0b34ea0_ajhevdp5devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87329) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 06 06:41:08 devstack cinder-volume[87329]: INFO cinder.image.image_utils [None req-6a9b7ae3-5422-48b4-8c2e-42aa838520fc tempest-VolumesExtendTest-2006658009 None] Image download 20.69 MB at 20.69 MB/s Sep 06 06:41:08 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ec2f805-dced-4ec1-9cc0-5649b4b09c76]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:41:08 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-6a9b7ae3-5422-48b4-8c2e-42aa838520fc tempest-VolumesExtendTest-2006658009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7005ba32-ec39-44a3-88d9-ca6af0b34ea0_ajhevdp5devstack@QuobyteHD {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:41:08 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b23fefc-3dfa-44a9-ac92-62c458264d84 tempest-VolumeDependencyTests-1326358127 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87329) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 06:41:08 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-5b23fefc-3dfa-44a9-ac92-62c458264d84 tempest-VolumeDependencyTests-1326358127 None] Flow 'volume_create_manager' (b01e4a77-f63b-49ec-86f5-bd915b314833) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:41:08 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-5b23fefc-3dfa-44a9-ac92-62c458264d84 tempest-VolumeDependencyTests-1326358127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49ef7666-ab2c-4f64-8156-6cb516e4a51a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:41:08 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-5b23fefc-3dfa-44a9-ac92-62c458264d84 tempest-VolumeDependencyTests-1326358127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49ef7666-ab2c-4f64-8156-6cb516e4a51a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:41:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1158934687',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a254542-d95e-4699-a37c-4bfb8a08d277,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10953d61cb12481c98ecb4dad19a09e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:41:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=44907dec-fa79-4e63-916a-21423470cbf2,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:41:08Z,use_quota=True,user_id='06222c309f854392831c5e0f6129469a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:41:08 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-5b23fefc-3dfa-44a9-ac92-62c458264d84 tempest-VolumeDependencyTests-1326358127 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59bc85de-9438-4802-98a9-b495e9b7fb53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:41:08 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-5b23fefc-3dfa-44a9-ac92-62c458264d84 tempest-VolumeDependencyTests-1326358127 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59bc85de-9438-4802-98a9-b495e9b7fb53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:41:08 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-5b23fefc-3dfa-44a9-ac92-62c458264d84 tempest-VolumeDependencyTests-1326358127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc4de438-ce71-4b77-8d89-a36b20423698) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:41:08 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-5b23fefc-3dfa-44a9-ac92-62c458264d84 tempest-VolumeDependencyTests-1326358127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc4de438-ce71-4b77-8d89-a36b20423698) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '1a254542-d95e-4699-a37c-4bfb8a08d277', 'volume_name': 'volume-1a254542-d95e-4699-a37c-4bfb8a08d277', 'volume_size': 1, 'snapshot_id': '44907dec-fa79-4e63-916a-21423470cbf2'}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:41:08 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-5b23fefc-3dfa-44a9-ac92-62c458264d84 tempest-VolumeDependencyTests-1326358127 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d92226f2-4315-4321-92ef-f43472277ddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:41:08 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-5b23fefc-3dfa-44a9-ac92-62c458264d84 tempest-VolumeDependencyTests-1326358127 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d92226f2-4315-4321-92ef-f43472277ddc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:41:08 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-5b23fefc-3dfa-44a9-ac92-62c458264d84 tempest-VolumeDependencyTests-1326358127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f831d8b6-0196-4d21-91f0-565a8af651b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:41:08 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-5b23fefc-3dfa-44a9-ac92-62c458264d84 tempest-VolumeDependencyTests-1326358127 None] Volume 1a254542-d95e-4699-a37c-4bfb8a08d277: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-1a254542-d95e-4699-a37c-4bfb8a08d277', 'volume_size': 1, 'snapshot_id': '44907dec-fa79-4e63-916a-21423470cbf2'} Sep 06 06:41:08 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-5b23fefc-3dfa-44a9-ac92-62c458264d84 tempest-VolumeDependencyTests-1326358127 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:41:08 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-5b23fefc-3dfa-44a9-ac92-62c458264d84 tempest-VolumeDependencyTests-1326358127 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:41:08 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-5b23fefc-3dfa-44a9-ac92-62c458264d84 tempest-VolumeDependencyTests-1326358127 None] Acquiring lock "cinder-quobyte-44907dec-fa79-4e63-916a-21423470cbf2-1a254542-d95e-4699-a37c-4bfb8a08d277" by "_create_volume_from_snapshot" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:41:08 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-5b23fefc-3dfa-44a9-ac92-62c458264d84 tempest-VolumeDependencyTests-1326358127 None] Lock "cinder-quobyte-44907dec-fa79-4e63-916a-21423470cbf2-1a254542-d95e-4699-a37c-4bfb8a08d277" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:41:08 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-5b23fefc-3dfa-44a9-ac92-62c458264d84 tempest-VolumeDependencyTests-1326358127 None] Creating volume 1a254542-d95e-4699-a37c-4bfb8a08d277 from snapshot 44907dec-fa79-4e63-916a-21423470cbf2 {{(pid=87329) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 06 06:41:08 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-5b23fefc-3dfa-44a9-ac92-62c458264d84 tempest-VolumeDependencyTests-1326358127 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:41:08 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-5b23fefc-3dfa-44a9-ac92-62c458264d84 tempest-VolumeDependencyTests-1326358127 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:41:08 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-5b23fefc-3dfa-44a9-ac92-62c458264d84 tempest-VolumeDependencyTests-1326358127 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:41:08 devstack sudo[98867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7005ba32-ec39-44a3-88d9-ca6af0b34ea0_ajhevdp5devstack@QuobyteHD Sep 06 06:41:08 devstack sudo[98867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:41:08 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-5b23fefc-3dfa-44a9-ac92-62c458264d84 tempest-VolumeDependencyTests-1326358127 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:41:08 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-5b23fefc-3dfa-44a9-ac92-62c458264d84 tempest-VolumeDependencyTests-1326358127 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:41:08 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-5b23fefc-3dfa-44a9-ac92-62c458264d84 tempest-VolumeDependencyTests-1326358127 None] Selected osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 as target Quobyte volume. {{(pid=87329) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 06:41:08 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-5b23fefc-3dfa-44a9-ac92-62c458264d84 tempest-VolumeDependencyTests-1326358127 None] Acquiring lock "cinder-quobyte-1a254542-d95e-4699-a37c-4bfb8a08d277" by "_copy_volume_from_snapshot" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:41:08 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-5b23fefc-3dfa-44a9-ac92-62c458264d84 tempest-VolumeDependencyTests-1326358127 None] Lock "cinder-quobyte-1a254542-d95e-4699-a37c-4bfb8a08d277" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:41:08 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-5b23fefc-3dfa-44a9-ac92-62c458264d84 tempest-VolumeDependencyTests-1326358127 None] snapshot: 44907dec-fa79-4e63-916a-21423470cbf2, volume: 1a254542-d95e-4699-a37c-4bfb8a08d277, {{(pid=87329) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 06 06:41:08 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-5b23fefc-3dfa-44a9-ac92-62c458264d84 tempest-VolumeDependencyTests-1326358127 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:41:08 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-5b23fefc-3dfa-44a9-ac92-62c458264d84 tempest-VolumeDependencyTests-1326358127 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:41:08 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-5b23fefc-3dfa-44a9-ac92-62c458264d84 tempest-VolumeDependencyTests-1326358127 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:41:08 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-5b23fefc-3dfa-44a9-ac92-62c458264d84 tempest-VolumeDependencyTests-1326358127 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:41:08 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-5b23fefc-3dfa-44a9-ac92-62c458264d84 tempest-VolumeDependencyTests-1326358127 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:41:08 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[184536e5-0272-40ca-a7f0-2e68b565da21]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:41:08 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-5b23fefc-3dfa-44a9-ac92-62c458264d84 tempest-VolumeDependencyTests-1326358127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-8cead335-b15e-4c1e-85b3-c8b1cf1ef742.44907dec-fa79-4e63-916a-21423470cbf2 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:41:08 devstack sudo[98869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-8cead335-b15e-4c1e-85b3-c8b1cf1ef742.44907dec-fa79-4e63-916a-21423470cbf2 Sep 06 06:41:08 devstack sudo[98869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:41:08 devstack sudo[98867]: pam_unix(sudo:session): session closed for user root Sep 06 06:41:08 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-6a9b7ae3-5422-48b4-8c2e-42aa838520fc tempest-VolumesExtendTest-2006658009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7005ba32-ec39-44a3-88d9-ca6af0b34ea0_ajhevdp5devstack@QuobyteHD" returned: 0 in 0.396s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:41:08 devstack cinder-volume[87329]: DEBUG cinder.image.image_utils [None req-6a9b7ae3-5422-48b4-8c2e-42aa838520fc tempest-VolumesExtendTest-2006658009 None] Temporary image 7005ba32-ec39-44a3-88d9-ca6af0b34ea0 is fetched for user f0d331e312fc4c7fb9384dca06e6135a. {{(pid=87329) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 06 06:41:08 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[886aff9e-6630-429f-b738-bc1e5f117224]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:41:08 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-6a9b7ae3-5422-48b4-8c2e-42aa838520fc tempest-VolumesExtendTest-2006658009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7005ba32-ec39-44a3-88d9-ca6af0b34ea0_ajhevdp5devstack@QuobyteHD {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:41:08 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b47e192-fde8-46d9-9321-60e66583974b tempest-AttachVolumeTestJSON-1525867077 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87329) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 06:41:08 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-0b47e192-fde8-46d9-9321-60e66583974b tempest-AttachVolumeTestJSON-1525867077 None] Flow 'volume_create_manager' (c6e9b53f-08be-4272-bd86-0135257f8550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:41:08 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-0b47e192-fde8-46d9-9321-60e66583974b tempest-AttachVolumeTestJSON-1525867077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb2bd7a2-040a-47fd-bd3b-c09779f65cda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:41:08 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-0b47e192-fde8-46d9-9321-60e66583974b tempest-AttachVolumeTestJSON-1525867077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb2bd7a2-040a-47fd-bd3b-c09779f65cda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:41:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1918421195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=285d28b3-ee74-43a2-9ffc-15959096b0a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0963cc134ebb4365b128ea7e41f4469c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:41:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:41:09Z,use_quota=True,user_id='e1bdadfacfaf4b9394e7ded7f4848d7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:41:08 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-0b47e192-fde8-46d9-9321-60e66583974b tempest-AttachVolumeTestJSON-1525867077 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca0f1519-ba96-40cb-b547-8de7e612a55e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:41:08 devstack sudo[98874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7005ba32-ec39-44a3-88d9-ca6af0b34ea0_ajhevdp5devstack@QuobyteHD Sep 06 06:41:08 devstack sudo[98874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:41:08 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-0b47e192-fde8-46d9-9321-60e66583974b tempest-AttachVolumeTestJSON-1525867077 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca0f1519-ba96-40cb-b547-8de7e612a55e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:41:08 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-0b47e192-fde8-46d9-9321-60e66583974b tempest-AttachVolumeTestJSON-1525867077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea408bbd-5c29-47e9-a8aa-6af01d0e049e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:41:08 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-0b47e192-fde8-46d9-9321-60e66583974b tempest-AttachVolumeTestJSON-1525867077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea408bbd-5c29-47e9-a8aa-6af01d0e049e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '285d28b3-ee74-43a2-9ffc-15959096b0a9', 'volume_name': 'volume-285d28b3-ee74-43a2-9ffc-15959096b0a9', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:41:08 devstack sudo[98869]: pam_unix(sudo:session): session closed for user root Sep 06 06:41:08 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-0b47e192-fde8-46d9-9321-60e66583974b tempest-AttachVolumeTestJSON-1525867077 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8dd8c8ea-495b-47c4-8d2c-5fcd6d8b8ece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:41:08 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-0b47e192-fde8-46d9-9321-60e66583974b tempest-AttachVolumeTestJSON-1525867077 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8dd8c8ea-495b-47c4-8d2c-5fcd6d8b8ece) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:41:08 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-0b47e192-fde8-46d9-9321-60e66583974b tempest-AttachVolumeTestJSON-1525867077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (690c5156-6f08-425e-afd2-bae14a49c979) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:41:08 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-0b47e192-fde8-46d9-9321-60e66583974b tempest-AttachVolumeTestJSON-1525867077 None] Volume 285d28b3-ee74-43a2-9ffc-15959096b0a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-285d28b3-ee74-43a2-9ffc-15959096b0a9', 'volume_size': 1} Sep 06 06:41:08 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-0b47e192-fde8-46d9-9321-60e66583974b tempest-AttachVolumeTestJSON-1525867077 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:41:08 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-5b23fefc-3dfa-44a9-ac92-62c458264d84 tempest-VolumeDependencyTests-1326358127 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-8cead335-b15e-4c1e-85b3-c8b1cf1ef742.44907dec-fa79-4e63-916a-21423470cbf2" returned: 0 in 0.421s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:41:08 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-5b23fefc-3dfa-44a9-ac92-62c458264d84 tempest-VolumeDependencyTests-1326358127 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8cead335-b15e-4c1e-85b3-c8b1cf1ef742(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87329) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 06:41:08 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[d926e909-24a2-43c9-b6ea-5bdf56f0e495]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:41:08 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-5b23fefc-3dfa-44a9-ac92-62c458264d84 tempest-VolumeDependencyTests-1326358127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-8cead335-b15e-4c1e-85b3-c8b1cf1ef742 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:41:08 devstack sudo[98879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-8cead335-b15e-4c1e-85b3-c8b1cf1ef742 Sep 06 06:41:08 devstack sudo[98879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:41:09 devstack sudo[98874]: pam_unix(sudo:session): session closed for user root Sep 06 06:41:09 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-6a9b7ae3-5422-48b4-8c2e-42aa838520fc tempest-VolumesExtendTest-2006658009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7005ba32-ec39-44a3-88d9-ca6af0b34ea0_ajhevdp5devstack@QuobyteHD" returned: 0 in 0.364s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:41:09 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-6a9b7ae3-5422-48b4-8c2e-42aa838520fc tempest-VolumesExtendTest-2006658009 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:41:09 devstack sudo[98879]: pam_unix(sudo:session): session closed for user root Sep 06 06:41:09 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-5b23fefc-3dfa-44a9-ac92-62c458264d84 tempest-VolumeDependencyTests-1326358127 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-8cead335-b15e-4c1e-85b3-c8b1cf1ef742" returned: 0 in 0.344s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:41:09 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-5b23fefc-3dfa-44a9-ac92-62c458264d84 tempest-VolumeDependencyTests-1326358127 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-8cead335-b15e-4c1e-85b3-c8b1cf1ef742 {{(pid=87329) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 06 06:41:09 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-5b23fefc-3dfa-44a9-ac92-62c458264d84 tempest-VolumeDependencyTests-1326358127 None] Creating direct copy from snapshot {{(pid=87329) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 06 06:41:09 devstack cinder-volume[87329]: DEBUG cinder.utils [None req-5b23fefc-3dfa-44a9-ac92-62c458264d84 tempest-VolumeDependencyTests-1326358127 None] Path /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-1a254542-d95e-4699-a37c-4bfb8a08d277 not found in is_blk_device check {{(pid=87329) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 06 06:41:09 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-5b23fefc-3dfa-44a9-ac92-62c458264d84 tempest-VolumeDependencyTests-1326358127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-8cead335-b15e-4c1e-85b3-c8b1cf1ef742 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-1a254542-d95e-4699-a37c-4bfb8a08d277 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:41:09 devstack sudo[98887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-8cead335-b15e-4c1e-85b3-c8b1cf1ef742 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-1a254542-d95e-4699-a37c-4bfb8a08d277 Sep 06 06:41:09 devstack sudo[98887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:41:13 devstack sudo[98887]: pam_unix(sudo:session): session closed for user root Sep 06 06:41:13 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-5b23fefc-3dfa-44a9-ac92-62c458264d84 tempest-VolumeDependencyTests-1326358127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-8cead335-b15e-4c1e-85b3-c8b1cf1ef742 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-1a254542-d95e-4699-a37c-4bfb8a08d277" returned: 0 in 4.001s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:41:13 devstack cinder-volume[87329]: DEBUG cinder.image.image_utils [None req-5b23fefc-3dfa-44a9-ac92-62c458264d84 tempest-VolumeDependencyTests-1326358127 None] Image conversion details: src /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-8cead335-b15e-4c1e-85b3-c8b1cf1ef742, size 1024.00 MB, duration 4.00 sec, destination /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-1a254542-d95e-4699-a37c-4bfb8a08d277 {{(pid=87329) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 06 06:41:13 devstack cinder-volume[87329]: INFO cinder.image.image_utils [None req-5b23fefc-3dfa-44a9-ac92-62c458264d84 tempest-VolumeDependencyTests-1326358127 None] Converted 1024.00 MB image at 255.87 MB/s Sep 06 06:41:13 devstack cinder-volume[87329]: WARNING cinder.volume.drivers.remotefs [None req-5b23fefc-3dfa-44a9-ac92-62c458264d84 tempest-VolumeDependencyTests-1326358127 None] /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-1a254542-d95e-4699-a37c-4bfb8a08d277 is being set with open permissions: ugo+rw Sep 06 06:41:13 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-5b23fefc-3dfa-44a9-ac92-62c458264d84 tempest-VolumeDependencyTests-1326358127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-1a254542-d95e-4699-a37c-4bfb8a08d277 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:41:13 devstack sudo[98901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-1a254542-d95e-4699-a37c-4bfb8a08d277 Sep 06 06:41:13 devstack sudo[98901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:41:13 devstack sudo[98901]: pam_unix(sudo:session): session closed for user root Sep 06 06:41:13 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-5b23fefc-3dfa-44a9-ac92-62c458264d84 tempest-VolumeDependencyTests-1326358127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-1a254542-d95e-4699-a37c-4bfb8a08d277" returned: 0 in 0.237s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:41:13 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-5b23fefc-3dfa-44a9-ac92-62c458264d84 tempest-VolumeDependencyTests-1326358127 None] Lock "cinder-quobyte-1a254542-d95e-4699-a37c-4bfb8a08d277" released by "_copy_volume_from_snapshot" :: held 5.085s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:41:13 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-5b23fefc-3dfa-44a9-ac92-62c458264d84 tempest-VolumeDependencyTests-1326358127 None] Lock "cinder-quobyte-44907dec-fa79-4e63-916a-21423470cbf2-1a254542-d95e-4699-a37c-4bfb8a08d277" released by "_create_volume_from_snapshot" :: held 5.152s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:41:13 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-5b23fefc-3dfa-44a9-ac92-62c458264d84 tempest-VolumeDependencyTests-1326358127 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.166s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:41:13 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-0b47e192-fde8-46d9-9321-60e66583974b tempest-AttachVolumeTestJSON-1525867077 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.654s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:41:13 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-0b47e192-fde8-46d9-9321-60e66583974b tempest-AttachVolumeTestJSON-1525867077 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:41:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1918421195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=285d28b3-ee74-43a2-9ffc-15959096b0a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0963cc134ebb4365b128ea7e41f4469c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:41:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:41:09Z,use_quota=True,user_id='e1bdadfacfaf4b9394e7ded7f4848d7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)}" {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 06:41:13 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-0b47e192-fde8-46d9-9321-60e66583974b tempest-AttachVolumeTestJSON-1525867077 None] Creating volume 285d28b3-ee74-43a2-9ffc-15959096b0a9 {{(pid=87329) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 06:41:13 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-0b47e192-fde8-46d9-9321-60e66583974b tempest-AttachVolumeTestJSON-1525867077 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:41:13 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-0b47e192-fde8-46d9-9321-60e66583974b tempest-AttachVolumeTestJSON-1525867077 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:41:13 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-0b47e192-fde8-46d9-9321-60e66583974b tempest-AttachVolumeTestJSON-1525867077 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:41:13 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-0b47e192-fde8-46d9-9321-60e66583974b tempest-AttachVolumeTestJSON-1525867077 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:41:13 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-0b47e192-fde8-46d9-9321-60e66583974b tempest-AttachVolumeTestJSON-1525867077 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:41:13 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-0b47e192-fde8-46d9-9321-60e66583974b tempest-AttachVolumeTestJSON-1525867077 None] Selected osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 as target Quobyte volume. {{(pid=87329) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 06:41:13 devstack cinder-volume[87329]: INFO cinder.volume.drivers.remotefs [None req-0b47e192-fde8-46d9-9321-60e66583974b tempest-AttachVolumeTestJSON-1525867077 None] casted to osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 Sep 06 06:41:13 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-0b47e192-fde8-46d9-9321-60e66583974b tempest-AttachVolumeTestJSON-1525867077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-285d28b3-ee74-43a2-9ffc-15959096b0a9 1073741824 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:41:13 devstack sudo[98904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-285d28b3-ee74-43a2-9ffc-15959096b0a9 1073741824 Sep 06 06:41:13 devstack sudo[98904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:41:13 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-5b23fefc-3dfa-44a9-ac92-62c458264d84 tempest-VolumeDependencyTests-1326358127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f831d8b6-0196-4d21-91f0-565a8af651b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a254542-d95e-4699-a37c-4bfb8a08d277', 'volume_size': 1, 'snapshot_id': '44907dec-fa79-4e63-916a-21423470cbf2'}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:41:13 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-5b23fefc-3dfa-44a9-ac92-62c458264d84 tempest-VolumeDependencyTests-1326358127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0430ea72-11fb-44b2-a5d9-551856425047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:41:13 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-5b23fefc-3dfa-44a9-ac92-62c458264d84 tempest-VolumeDependencyTests-1326358127 None] Volume volume-1a254542-d95e-4699-a37c-4bfb8a08d277 (1a254542-d95e-4699-a37c-4bfb8a08d277): created successfully Sep 06 06:41:13 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-5b23fefc-3dfa-44a9-ac92-62c458264d84 tempest-VolumeDependencyTests-1326358127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0430ea72-11fb-44b2-a5d9-551856425047) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:41:13 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-5b23fefc-3dfa-44a9-ac92-62c458264d84 tempest-VolumeDependencyTests-1326358127 None] Flow 'volume_create_manager' (b01e4a77-f63b-49ec-86f5-bd915b314833) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:41:13 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-5b23fefc-3dfa-44a9-ac92-62c458264d84 tempest-VolumeDependencyTests-1326358127 None] Created volume successfully. Sep 06 06:41:13 devstack sudo[98904]: pam_unix(sudo:session): session closed for user root Sep 06 06:41:13 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-0b47e192-fde8-46d9-9321-60e66583974b tempest-AttachVolumeTestJSON-1525867077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-285d28b3-ee74-43a2-9ffc-15959096b0a9 1073741824" returned: 0 in 0.423s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:41:13 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-0b47e192-fde8-46d9-9321-60e66583974b tempest-AttachVolumeTestJSON-1525867077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-285d28b3-ee74-43a2-9ffc-15959096b0a9 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:41:13 devstack sudo[98910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-285d28b3-ee74-43a2-9ffc-15959096b0a9 Sep 06 06:41:13 devstack sudo[98910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:41:14 devstack sudo[98910]: pam_unix(sudo:session): session closed for user root Sep 06 06:41:14 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-0b47e192-fde8-46d9-9321-60e66583974b tempest-AttachVolumeTestJSON-1525867077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-285d28b3-ee74-43a2-9ffc-15959096b0a9" returned: 0 in 0.236s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:41:14 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-0b47e192-fde8-46d9-9321-60e66583974b tempest-AttachVolumeTestJSON-1525867077 None] <== create_volume: return (695ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'} {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 06:41:14 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-0b47e192-fde8-46d9-9321-60e66583974b tempest-AttachVolumeTestJSON-1525867077 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.697s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:41:14 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-6a9b7ae3-5422-48b4-8c2e-42aa838520fc tempest-VolumesExtendTest-2006658009 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.168s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:41:14 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-6a9b7ae3-5422-48b4-8c2e-42aa838520fc tempest-VolumesExtendTest-2006658009 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:41:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-234567190',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2116a3dc-938c-4819-8330-b815a8d9d41d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c49313d5ba74cc0a3146268e6d81af1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:41:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:41:07Z,use_quota=True,user_id='f0d331e312fc4c7fb9384dca06e6135a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)}" {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 06:41:14 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-6a9b7ae3-5422-48b4-8c2e-42aa838520fc tempest-VolumesExtendTest-2006658009 None] Creating volume 2116a3dc-938c-4819-8330-b815a8d9d41d {{(pid=87329) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 06:41:14 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-6a9b7ae3-5422-48b4-8c2e-42aa838520fc tempest-VolumesExtendTest-2006658009 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:41:14 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-6a9b7ae3-5422-48b4-8c2e-42aa838520fc tempest-VolumesExtendTest-2006658009 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:41:14 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-6a9b7ae3-5422-48b4-8c2e-42aa838520fc tempest-VolumesExtendTest-2006658009 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:41:14 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-6a9b7ae3-5422-48b4-8c2e-42aa838520fc tempest-VolumesExtendTest-2006658009 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:41:14 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-6a9b7ae3-5422-48b4-8c2e-42aa838520fc tempest-VolumesExtendTest-2006658009 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:41:14 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-6a9b7ae3-5422-48b4-8c2e-42aa838520fc tempest-VolumesExtendTest-2006658009 None] Selected osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 as target Quobyte volume. {{(pid=87329) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 06:41:14 devstack cinder-volume[87329]: INFO cinder.volume.drivers.remotefs [None req-6a9b7ae3-5422-48b4-8c2e-42aa838520fc tempest-VolumesExtendTest-2006658009 None] casted to osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 Sep 06 06:41:14 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-6a9b7ae3-5422-48b4-8c2e-42aa838520fc tempest-VolumesExtendTest-2006658009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-2116a3dc-938c-4819-8330-b815a8d9d41d 1073741824 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:41:14 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-0b47e192-fde8-46d9-9321-60e66583974b tempest-AttachVolumeTestJSON-1525867077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (690c5156-6f08-425e-afd2-bae14a49c979) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-285d28b3-ee74-43a2-9ffc-15959096b0a9', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:41:14 devstack sudo[98913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-2116a3dc-938c-4819-8330-b815a8d9d41d 1073741824 Sep 06 06:41:14 devstack sudo[98913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:41:14 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-0b47e192-fde8-46d9-9321-60e66583974b tempest-AttachVolumeTestJSON-1525867077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8c799e3-abe5-4265-a30e-d231350a1dd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:41:14 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-0b47e192-fde8-46d9-9321-60e66583974b tempest-AttachVolumeTestJSON-1525867077 None] Volume volume-285d28b3-ee74-43a2-9ffc-15959096b0a9 (285d28b3-ee74-43a2-9ffc-15959096b0a9): created successfully Sep 06 06:41:14 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-0b47e192-fde8-46d9-9321-60e66583974b tempest-AttachVolumeTestJSON-1525867077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8c799e3-abe5-4265-a30e-d231350a1dd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:41:14 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-0b47e192-fde8-46d9-9321-60e66583974b tempest-AttachVolumeTestJSON-1525867077 None] Flow 'volume_create_manager' (c6e9b53f-08be-4272-bd86-0135257f8550) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:41:14 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-0b47e192-fde8-46d9-9321-60e66583974b tempest-AttachVolumeTestJSON-1525867077 None] Created volume successfully. Sep 06 06:41:14 devstack sudo[98913]: pam_unix(sudo:session): session closed for user root Sep 06 06:41:14 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-6a9b7ae3-5422-48b4-8c2e-42aa838520fc tempest-VolumesExtendTest-2006658009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-2116a3dc-938c-4819-8330-b815a8d9d41d 1073741824" returned: 0 in 0.431s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:41:14 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-6a9b7ae3-5422-48b4-8c2e-42aa838520fc tempest-VolumesExtendTest-2006658009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-2116a3dc-938c-4819-8330-b815a8d9d41d {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:41:14 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-3062a50c-798c-4485-baf1-07b4b5d14cdb tempest-VolumeDependencyTests-1326358127 None] Acquiring lock "cinder-44907dec-fa79-4e63-916a-21423470cbf2-delete_snapshot" by "delete_snapshot" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:41:14 devstack sudo[98919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-2116a3dc-938c-4819-8330-b815a8d9d41d Sep 06 06:41:14 devstack sudo[98919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:41:14 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-3062a50c-798c-4485-baf1-07b4b5d14cdb tempest-VolumeDependencyTests-1326358127 None] Lock "cinder-44907dec-fa79-4e63-916a-21423470cbf2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:41:14 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-3062a50c-798c-4485-baf1-07b4b5d14cdb tempest-VolumeDependencyTests-1326358127 None] Acquiring lock "cinder-quobyte-8cead335-b15e-4c1e-85b3-c8b1cf1ef742" by "delete_snapshot" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:41:14 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-3062a50c-798c-4485-baf1-07b4b5d14cdb tempest-VolumeDependencyTests-1326358127 None] Lock "cinder-quobyte-8cead335-b15e-4c1e-85b3-c8b1cf1ef742" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:41:14 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-3062a50c-798c-4485-baf1-07b4b5d14cdb tempest-VolumeDependencyTests-1326358127 None] Acquiring lock "cinder-quobyte-44907dec-fa79-4e63-916a-21423470cbf2" by "_delete_snapshot" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:41:14 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-3062a50c-798c-4485-baf1-07b4b5d14cdb tempest-VolumeDependencyTests-1326358127 None] Lock "cinder-quobyte-44907dec-fa79-4e63-916a-21423470cbf2" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:41:14 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-3062a50c-798c-4485-baf1-07b4b5d14cdb tempest-VolumeDependencyTests-1326358127 None] Deleting offline snapshot 44907dec-fa79-4e63-916a-21423470cbf2 of volume 8cead335-b15e-4c1e-85b3-c8b1cf1ef742 {{(pid=87329) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 06 06:41:14 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-3062a50c-798c-4485-baf1-07b4b5d14cdb tempest-VolumeDependencyTests-1326358127 None] snapshot_file for this snap is: volume-8cead335-b15e-4c1e-85b3-c8b1cf1ef742.44907dec-fa79-4e63-916a-21423470cbf2 {{(pid=87329) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 06 06:41:14 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[70699acf-d4f3-49b4-84c2-a46f6fa9892c]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:41:14 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-3062a50c-798c-4485-baf1-07b4b5d14cdb tempest-VolumeDependencyTests-1326358127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-8cead335-b15e-4c1e-85b3-c8b1cf1ef742.44907dec-fa79-4e63-916a-21423470cbf2 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:41:14 devstack sudo[98921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-8cead335-b15e-4c1e-85b3-c8b1cf1ef742.44907dec-fa79-4e63-916a-21423470cbf2 Sep 06 06:41:14 devstack sudo[98921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:41:14 devstack sudo[98919]: pam_unix(sudo:session): session closed for user root Sep 06 06:41:14 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-6a9b7ae3-5422-48b4-8c2e-42aa838520fc tempest-VolumesExtendTest-2006658009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-2116a3dc-938c-4819-8330-b815a8d9d41d" returned: 0 in 0.258s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:41:14 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-6a9b7ae3-5422-48b4-8c2e-42aa838520fc tempest-VolumesExtendTest-2006658009 None] <== create_volume: return (730ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'} {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 06:41:14 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-6a9b7ae3-5422-48b4-8c2e-42aa838520fc tempest-VolumesExtendTest-2006658009 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.733s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:41:14 devstack cinder-volume[87329]: DEBUG cinder.volume.volume_utils [None req-6a9b7ae3-5422-48b4-8c2e-42aa838520fc tempest-VolumesExtendTest-2006658009 None] Attempting download of 7005ba32-ec39-44a3-88d9-ca6af0b34ea0 ((None, [{'url': 'file:///opt/stack/data/glance/images/7005ba32-ec39-44a3-88d9-ca6af0b34ea0', 'metadata': {}}])) to volume 2116a3dc-938c-4819-8330-b815a8d9d41d. {{(pid=87329) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 06 06:41:15 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bbd14ce-82e7-4445-8c4d-fbae494d68ed]: (4, 'raw') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:41:15 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-6a9b7ae3-5422-48b4-8c2e-42aa838520fc tempest-VolumesExtendTest-2006658009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7005ba32-ec39-44a3-88d9-ca6af0b34ea0_kqkckoy3 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:41:15 devstack sudo[98924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7005ba32-ec39-44a3-88d9-ca6af0b34ea0_kqkckoy3 Sep 06 06:41:15 devstack sudo[98924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:41:15 devstack sudo[98921]: pam_unix(sudo:session): session closed for user root Sep 06 06:41:15 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-3062a50c-798c-4485-baf1-07b4b5d14cdb tempest-VolumeDependencyTests-1326358127 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-8cead335-b15e-4c1e-85b3-c8b1cf1ef742.44907dec-fa79-4e63-916a-21423470cbf2" returned: 0 in 0.359s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:41:15 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-3062a50c-798c-4485-baf1-07b4b5d14cdb tempest-VolumeDependencyTests-1326358127 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8cead335-b15e-4c1e-85b3-c8b1cf1ef742(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87329) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 06:41:15 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[407f08db-5709-4f20-836f-72cdfb207dda]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:41:15 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-3062a50c-798c-4485-baf1-07b4b5d14cdb tempest-VolumeDependencyTests-1326358127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-8cead335-b15e-4c1e-85b3-c8b1cf1ef742 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:41:15 devstack sudo[98929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-8cead335-b15e-4c1e-85b3-c8b1cf1ef742 Sep 06 06:41:15 devstack sudo[98929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:41:15 devstack sudo[98924]: pam_unix(sudo:session): session closed for user root Sep 06 06:41:15 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-6a9b7ae3-5422-48b4-8c2e-42aa838520fc tempest-VolumesExtendTest-2006658009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7005ba32-ec39-44a3-88d9-ca6af0b34ea0_kqkckoy3" returned: 0 in 0.336s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:41:15 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-6a9b7ae3-5422-48b4-8c2e-42aa838520fc tempest-VolumesExtendTest-2006658009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7005ba32-ec39-44a3-88d9-ca6af0b34ea0_kqkckoy3 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:41:15 devstack sudo[98933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7005ba32-ec39-44a3-88d9-ca6af0b34ea0_kqkckoy3 Sep 06 06:41:15 devstack sudo[98933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:41:15 devstack sudo[98929]: pam_unix(sudo:session): session closed for user root Sep 06 06:41:15 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-3062a50c-798c-4485-baf1-07b4b5d14cdb tempest-VolumeDependencyTests-1326358127 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-8cead335-b15e-4c1e-85b3-c8b1cf1ef742" returned: 0 in 0.539s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:41:15 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-3062a50c-798c-4485-baf1-07b4b5d14cdb tempest-VolumeDependencyTests-1326358127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-8cead335-b15e-4c1e-85b3-c8b1cf1ef742.44907dec-fa79-4e63-916a-21423470cbf2 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:41:15 devstack sudo[98933]: pam_unix(sudo:session): session closed for user root Sep 06 06:41:15 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-6a9b7ae3-5422-48b4-8c2e-42aa838520fc tempest-VolumesExtendTest-2006658009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7005ba32-ec39-44a3-88d9-ca6af0b34ea0_kqkckoy3" returned: 1 in 0.370s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:41:15 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-6a9b7ae3-5422-48b4-8c2e-42aa838520fc tempest-VolumesExtendTest-2006658009 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7005ba32-ec39-44a3-88d9-ca6af0b34ea0_kqkckoy3' failed. Not Retrying. {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 06 06:41:15 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ad41b8e-7597-429b-aa7f-58bb26ffdd0a]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:41:15 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-6a9b7ae3-5422-48b4-8c2e-42aa838520fc tempest-VolumesExtendTest-2006658009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7005ba32-ec39-44a3-88d9-ca6af0b34ea0_ajhevdp5devstack@QuobyteHD {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:41:15 devstack sudo[98943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-8cead335-b15e-4c1e-85b3-c8b1cf1ef742.44907dec-fa79-4e63-916a-21423470cbf2 Sep 06 06:41:15 devstack sudo[98943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:41:15 devstack sudo[98944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7005ba32-ec39-44a3-88d9-ca6af0b34ea0_ajhevdp5devstack@QuobyteHD Sep 06 06:41:15 devstack sudo[98944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:41:16 devstack sudo[98944]: pam_unix(sudo:session): session closed for user root Sep 06 06:41:16 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-6a9b7ae3-5422-48b4-8c2e-42aa838520fc tempest-VolumesExtendTest-2006658009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7005ba32-ec39-44a3-88d9-ca6af0b34ea0_ajhevdp5devstack@QuobyteHD" returned: 0 in 0.361s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:41:16 devstack cinder-volume[87329]: DEBUG cinder.image.image_utils [None req-6a9b7ae3-5422-48b4-8c2e-42aa838520fc tempest-VolumesExtendTest-2006658009 None] 7005ba32-ec39-44a3-88d9-ca6af0b34ea0 was qcow2, converting to qcow2 {{(pid=87329) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 06 06:41:16 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-6a9b7ae3-5422-48b4-8c2e-42aa838520fc tempest-VolumesExtendTest-2006658009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7005ba32-ec39-44a3-88d9-ca6af0b34ea0_ajhevdp5devstack@QuobyteHD /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-2116a3dc-938c-4819-8330-b815a8d9d41d {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:41:16 devstack sudo[98943]: pam_unix(sudo:session): session closed for user root Sep 06 06:41:16 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-3062a50c-798c-4485-baf1-07b4b5d14cdb tempest-VolumeDependencyTests-1326358127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-8cead335-b15e-4c1e-85b3-c8b1cf1ef742.44907dec-fa79-4e63-916a-21423470cbf2" returned: 0 in 0.404s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:41:16 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-3062a50c-798c-4485-baf1-07b4b5d14cdb tempest-VolumeDependencyTests-1326358127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-8cead335-b15e-4c1e-85b3-c8b1cf1ef742.44907dec-fa79-4e63-916a-21423470cbf2 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:41:16 devstack sudo[98954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7005ba32-ec39-44a3-88d9-ca6af0b34ea0_ajhevdp5devstack@QuobyteHD /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-2116a3dc-938c-4819-8330-b815a8d9d41d Sep 06 06:41:16 devstack sudo[98954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:41:16 devstack sudo[98956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-8cead335-b15e-4c1e-85b3-c8b1cf1ef742.44907dec-fa79-4e63-916a-21423470cbf2 Sep 06 06:41:16 devstack sudo[98956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:41:16 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [req-c6f04664-dcc0-45da-9fd2-d0e693d7facc req-21f57fec-8989-4bbf-8def-b26668fc5e12 tempest-AttachVolumeTestJSON-1525867077 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:41:16 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [req-c6f04664-dcc0-45da-9fd2-d0e693d7facc req-21f57fec-8989-4bbf-8def-b26668fc5e12 tempest-AttachVolumeTestJSON-1525867077 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:41:16 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [req-c6f04664-dcc0-45da-9fd2-d0e693d7facc req-21f57fec-8989-4bbf-8def-b26668fc5e12 tempest-AttachVolumeTestJSON-1525867077 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:41:16 devstack sudo[98956]: pam_unix(sudo:session): session closed for user root Sep 06 06:41:16 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-3062a50c-798c-4485-baf1-07b4b5d14cdb tempest-VolumeDependencyTests-1326358127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-8cead335-b15e-4c1e-85b3-c8b1cf1ef742.44907dec-fa79-4e63-916a-21423470cbf2" returned: 0 in 0.256s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:41:16 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [req-c6f04664-dcc0-45da-9fd2-d0e693d7facc req-21f57fec-8989-4bbf-8def-b26668fc5e12 tempest-AttachVolumeTestJSON-1525867077 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6', 'name': 'volume-285d28b3-ee74-43a2-9ffc-15959096b0a9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3c546323-3332-42ae-b29e-ad90e9865c25', 'enforce_multipath': True} {{(pid=87329) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 06 06:41:16 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-3062a50c-798c-4485-baf1-07b4b5d14cdb tempest-VolumeDependencyTests-1326358127 None] Lock "cinder-quobyte-44907dec-fa79-4e63-916a-21423470cbf2" released by "_delete_snapshot" :: held 1.673s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:41:16 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-3062a50c-798c-4485-baf1-07b4b5d14cdb tempest-VolumeDependencyTests-1326358127 None] Lock "cinder-quobyte-8cead335-b15e-4c1e-85b3-c8b1cf1ef742" released by "delete_snapshot" :: held 1.703s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:41:16 devstack cinder-volume[87329]: INFO cinder.volume.manager [req-c6f04664-dcc0-45da-9fd2-d0e693d7facc req-21f57fec-8989-4bbf-8def-b26668fc5e12 tempest-AttachVolumeTestJSON-1525867077 None] attachment_update completed successfully. Sep 06 06:41:16 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-3062a50c-798c-4485-baf1-07b4b5d14cdb tempest-VolumeDependencyTests-1326358127 None] Created reservations ['29bb84cd-5c72-472a-8736-fb6bbedc7042', 'b6b43a9c-0d73-4d36-9e39-d847a2597e92', 'e9a02a60-f8af-493f-8be8-dc0aeae59e5c', '3ec7207a-8525-4171-832c-fb8dc7785bd7'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:41:16 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-3062a50c-798c-4485-baf1-07b4b5d14cdb tempest-VolumeDependencyTests-1326358127 None] Delete snapshot completed successfully. Sep 06 06:41:16 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-3062a50c-798c-4485-baf1-07b4b5d14cdb tempest-VolumeDependencyTests-1326358127 None] Lock "cinder-44907dec-fa79-4e63-916a-21423470cbf2-delete_snapshot" released by "delete_snapshot" :: held 1.863s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:41:16 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-060e658b-99e8-46a5-9220-0266f841b13d tempest-VolumeDependencyTests-1326358127 None] Acquiring lock "cinder-8cead335-b15e-4c1e-85b3-c8b1cf1ef742-delete_volume" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:41:16 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-060e658b-99e8-46a5-9220-0266f841b13d tempest-VolumeDependencyTests-1326358127 None] Lock "cinder-8cead335-b15e-4c1e-85b3-c8b1cf1ef742-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:41:16 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-060e658b-99e8-46a5-9220-0266f841b13d tempest-VolumeDependencyTests-1326358127 None] Acquiring lock "cinder-quobyte-8cead335-b15e-4c1e-85b3-c8b1cf1ef742" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:41:16 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-060e658b-99e8-46a5-9220-0266f841b13d tempest-VolumeDependencyTests-1326358127 None] Lock "cinder-quobyte-8cead335-b15e-4c1e-85b3-c8b1cf1ef742" acquired by "delete_volume" :: waited 0.022s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:41:17 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[76d035c1-5a46-45e8-a8ba-4d5bef01d0e3]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:41:17 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-060e658b-99e8-46a5-9220-0266f841b13d tempest-VolumeDependencyTests-1326358127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-8cead335-b15e-4c1e-85b3-c8b1cf1ef742 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:41:17 devstack sudo[99355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-8cead335-b15e-4c1e-85b3-c8b1cf1ef742 Sep 06 06:41:17 devstack sudo[99355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:41:17 devstack sudo[99355]: pam_unix(sudo:session): session closed for user root Sep 06 06:41:17 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-060e658b-99e8-46a5-9220-0266f841b13d tempest-VolumeDependencyTests-1326358127 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-8cead335-b15e-4c1e-85b3-c8b1cf1ef742" returned: 0 in 0.468s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:41:17 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-060e658b-99e8-46a5-9220-0266f841b13d tempest-VolumeDependencyTests-1326358127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-8cead335-b15e-4c1e-85b3-c8b1cf1ef742 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:41:17 devstack sudo[99360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-8cead335-b15e-4c1e-85b3-c8b1cf1ef742 Sep 06 06:41:17 devstack sudo[99360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:41:17 devstack sudo[99360]: pam_unix(sudo:session): session closed for user root Sep 06 06:41:17 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-060e658b-99e8-46a5-9220-0266f841b13d tempest-VolumeDependencyTests-1326358127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-8cead335-b15e-4c1e-85b3-c8b1cf1ef742" returned: 0 in 0.252s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:41:17 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-060e658b-99e8-46a5-9220-0266f841b13d tempest-VolumeDependencyTests-1326358127 None] Lock "cinder-quobyte-8cead335-b15e-4c1e-85b3-c8b1cf1ef742" released by "delete_volume" :: held 0.819s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:41:17 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-060e658b-99e8-46a5-9220-0266f841b13d tempest-VolumeDependencyTests-1326358127 None] Created reservations ['4de6b696-3988-4b68-ac7c-0fd63ff6d1a1', 'b25f9ea7-a967-479c-9dab-db48ddedb685', '00b805bb-1d44-4ebe-a096-6364a3695495', 'e114afe9-8250-4b01-b26c-b477db28d0b3'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:41:17 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-060e658b-99e8-46a5-9220-0266f841b13d tempest-VolumeDependencyTests-1326358127 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:41:17 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-060e658b-99e8-46a5-9220-0266f841b13d tempest-VolumeDependencyTests-1326358127 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:41:17 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-060e658b-99e8-46a5-9220-0266f841b13d tempest-VolumeDependencyTests-1326358127 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:41:17 devstack sudo[98954]: pam_unix(sudo:session): session closed for user root Sep 06 06:41:17 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-060e658b-99e8-46a5-9220-0266f841b13d tempest-VolumeDependencyTests-1326358127 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:41:17 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-060e658b-99e8-46a5-9220-0266f841b13d tempest-VolumeDependencyTests-1326358127 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:41:17 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-060e658b-99e8-46a5-9220-0266f841b13d tempest-VolumeDependencyTests-1326358127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:41:17 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-6a9b7ae3-5422-48b4-8c2e-42aa838520fc tempest-VolumesExtendTest-2006658009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7005ba32-ec39-44a3-88d9-ca6af0b34ea0_ajhevdp5devstack@QuobyteHD /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-2116a3dc-938c-4819-8330-b815a8d9d41d" returned: 0 in 1.817s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:41:17 devstack cinder-volume[87329]: DEBUG cinder.image.image_utils [None req-6a9b7ae3-5422-48b4-8c2e-42aa838520fc tempest-VolumesExtendTest-2006658009 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_7005ba32-ec39-44a3-88d9-ca6af0b34ea0_ajhevdp5devstack@QuobyteHD, size 112.00 MB, duration 1.82 sec, destination /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-2116a3dc-938c-4819-8330-b815a8d9d41d {{(pid=87329) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 06 06:41:17 devstack cinder-volume[87329]: INFO cinder.image.image_utils [None req-6a9b7ae3-5422-48b4-8c2e-42aa838520fc tempest-VolumesExtendTest-2006658009 None] Converted 112.00 MB image at 61.57 MB/s Sep 06 06:41:17 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-6a9b7ae3-5422-48b4-8c2e-42aa838520fc tempest-VolumesExtendTest-2006658009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-2116a3dc-938c-4819-8330-b815a8d9d41d 1G {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:41:17 devstack sudo[99363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:41:17 devstack sudo[99363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:41:17 devstack sudo[99364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-2116a3dc-938c-4819-8330-b815a8d9d41d 1G Sep 06 06:41:17 devstack sudo[99364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:41:18 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-1ad43a90-8b2d-4f34-8255-010b83b57031 tempest-VolumeDependencyTests-1326358127 None] Acquiring lock "cinder-1a254542-d95e-4699-a37c-4bfb8a08d277-delete_volume" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:41:18 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-1ad43a90-8b2d-4f34-8255-010b83b57031 tempest-VolumeDependencyTests-1326358127 None] Lock "cinder-1a254542-d95e-4699-a37c-4bfb8a08d277-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:41:18 devstack sudo[99363]: pam_unix(sudo:session): session closed for user root Sep 06 06:41:18 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-060e658b-99e8-46a5-9220-0266f841b13d tempest-VolumeDependencyTests-1326358127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.255s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:41:18 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-1ad43a90-8b2d-4f34-8255-010b83b57031 tempest-VolumeDependencyTests-1326358127 None] Acquiring lock "cinder-quobyte-1a254542-d95e-4699-a37c-4bfb8a08d277" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:41:18 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-060e658b-99e8-46a5-9220-0266f841b13d tempest-VolumeDependencyTests-1326358127 None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:41:18 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-060e658b-99e8-46a5-9220-0266f841b13d tempest-VolumeDependencyTests-1326358127 None] Deleted volume successfully. Sep 06 06:41:18 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-1ad43a90-8b2d-4f34-8255-010b83b57031 tempest-VolumeDependencyTests-1326358127 None] Lock "cinder-quobyte-1a254542-d95e-4699-a37c-4bfb8a08d277" acquired by "delete_volume" :: waited 0.028s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:41:18 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-060e658b-99e8-46a5-9220-0266f841b13d tempest-VolumeDependencyTests-1326358127 None] Lock "cinder-8cead335-b15e-4c1e-85b3-c8b1cf1ef742-delete_volume" released by "delete_volume" :: held 1.336s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:41:18 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[34cd58e2-dff7-4fae-b5d8-b36369e0844d]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:41:18 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-1ad43a90-8b2d-4f34-8255-010b83b57031 tempest-VolumeDependencyTests-1326358127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-1a254542-d95e-4699-a37c-4bfb8a08d277 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:41:18 devstack sudo[99364]: pam_unix(sudo:session): session closed for user root Sep 06 06:41:18 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-6a9b7ae3-5422-48b4-8c2e-42aa838520fc tempest-VolumesExtendTest-2006658009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-2116a3dc-938c-4819-8330-b815a8d9d41d 1G" returned: 0 in 0.424s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:41:18 devstack cinder-volume[87329]: DEBUG cinder.volume.volume_utils [None req-6a9b7ae3-5422-48b4-8c2e-42aa838520fc tempest-VolumesExtendTest-2006658009 None] Downloaded image 7005ba32-ec39-44a3-88d9-ca6af0b34ea0 ((None, [{'url': 'file:///opt/stack/data/glance/images/7005ba32-ec39-44a3-88d9-ca6af0b34ea0', 'metadata': {}}])) to volume 2116a3dc-938c-4819-8330-b815a8d9d41d successfully. {{(pid=87329) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 06 06:41:18 devstack cinder-volume[87329]: DEBUG cinder.image.image_utils [None req-6a9b7ae3-5422-48b4-8c2e-42aa838520fc tempest-VolumesExtendTest-2006658009 None] Temporary image 7005ba32-ec39-44a3-88d9-ca6af0b34ea0 for user f0d331e312fc4c7fb9384dca06e6135a is deleted. {{(pid=87329) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 06 06:41:18 devstack cinder-volume[87329]: DEBUG cinder.volume.volume_utils [None req-6a9b7ae3-5422-48b4-8c2e-42aa838520fc tempest-VolumesExtendTest-2006658009 None] Marking volume 2116a3dc-938c-4819-8330-b815a8d9d41d as bootable. {{(pid=87329) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 06 06:41:18 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a9b7ae3-5422-48b4-8c2e-42aa838520fc tempest-VolumesExtendTest-2006658009 None] Copying metadata from image 7005ba32-ec39-44a3-88d9-ca6af0b34ea0 to 2116a3dc-938c-4819-8330-b815a8d9d41d. {{(pid=87329) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 06 06:41:18 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a9b7ae3-5422-48b4-8c2e-42aa838520fc tempest-VolumesExtendTest-2006658009 None] Creating volume glance metadata for volume 2116a3dc-938c-4819-8330-b815a8d9d41d backed by image 7005ba32-ec39-44a3-88d9-ca6af0b34ea0 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '7005ba32-ec39-44a3-88d9-ca6af0b34ea0', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87329) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 06 06:41:18 devstack sudo[99370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-1a254542-d95e-4699-a37c-4bfb8a08d277 Sep 06 06:41:18 devstack sudo[99370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:41:18 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-6a9b7ae3-5422-48b4-8c2e-42aa838520fc tempest-VolumesExtendTest-2006658009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93e1a400-d68a-41d4-8d1d-6b22a015be1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2116a3dc-938c-4819-8330-b815a8d9d41d', 'volume_size': 1, 'image_id': '7005ba32-ec39-44a3-88d9-ca6af0b34ea0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7005ba32-ec39-44a3-88d9-ca6af0b34ea0', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '65b0d6d605b2427d8db787d4220dbeb4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7005ba32-ec39-44a3-88d9-ca6af0b34ea0', 'created_at': datetime.datetime(2026, 9, 6, 4, 25, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 6, 4, 25, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7005ba32-ec39-44a3-88d9-ca6af0b34ea0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:41:18 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-6a9b7ae3-5422-48b4-8c2e-42aa838520fc tempest-VolumesExtendTest-2006658009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13acc4ee-c6c8-4ca5-97c1-26e25b7ba660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:41:18 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-6a9b7ae3-5422-48b4-8c2e-42aa838520fc tempest-VolumesExtendTest-2006658009 None] Volume volume-2116a3dc-938c-4819-8330-b815a8d9d41d (2116a3dc-938c-4819-8330-b815a8d9d41d): created successfully Sep 06 06:41:18 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-6a9b7ae3-5422-48b4-8c2e-42aa838520fc tempest-VolumesExtendTest-2006658009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13acc4ee-c6c8-4ca5-97c1-26e25b7ba660) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:41:18 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-6a9b7ae3-5422-48b4-8c2e-42aa838520fc tempest-VolumesExtendTest-2006658009 None] Flow 'volume_create_manager' (c5c098d5-3584-490c-ae1e-f79a8f78339d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:41:18 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-6a9b7ae3-5422-48b4-8c2e-42aa838520fc tempest-VolumesExtendTest-2006658009 None] Created volume successfully. Sep 06 06:41:18 devstack sudo[99370]: pam_unix(sudo:session): session closed for user root Sep 06 06:41:18 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-1ad43a90-8b2d-4f34-8255-010b83b57031 tempest-VolumeDependencyTests-1326358127 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-1a254542-d95e-4699-a37c-4bfb8a08d277" returned: 0 in 0.443s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:41:18 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-1ad43a90-8b2d-4f34-8255-010b83b57031 tempest-VolumeDependencyTests-1326358127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-1a254542-d95e-4699-a37c-4bfb8a08d277 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:41:18 devstack sudo[99380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-1a254542-d95e-4699-a37c-4bfb8a08d277 Sep 06 06:41:18 devstack sudo[99380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:41:18 devstack sudo[99380]: pam_unix(sudo:session): session closed for user root Sep 06 06:41:18 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-1ad43a90-8b2d-4f34-8255-010b83b57031 tempest-VolumeDependencyTests-1326358127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-1a254542-d95e-4699-a37c-4bfb8a08d277" returned: 0 in 0.261s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:41:18 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-1ad43a90-8b2d-4f34-8255-010b83b57031 tempest-VolumeDependencyTests-1326358127 None] Lock "cinder-quobyte-1a254542-d95e-4699-a37c-4bfb8a08d277" released by "delete_volume" :: held 0.769s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:41:19 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-1ad43a90-8b2d-4f34-8255-010b83b57031 tempest-VolumeDependencyTests-1326358127 None] Created reservations ['7b32890c-81de-4873-8198-f5641798bdc1', 'afd7b224-39b3-4a26-919f-e2644dceb605', '3f0c0f3a-5402-453a-9a6a-b463ab69045f', 'ed1e73e3-11a4-4e41-8ac1-738f71512588'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:41:19 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-1ad43a90-8b2d-4f34-8255-010b83b57031 tempest-VolumeDependencyTests-1326358127 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:41:19 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-1ad43a90-8b2d-4f34-8255-010b83b57031 tempest-VolumeDependencyTests-1326358127 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:41:19 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-1ad43a90-8b2d-4f34-8255-010b83b57031 tempest-VolumeDependencyTests-1326358127 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:41:19 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-1ad43a90-8b2d-4f34-8255-010b83b57031 tempest-VolumeDependencyTests-1326358127 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:41:19 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-1ad43a90-8b2d-4f34-8255-010b83b57031 tempest-VolumeDependencyTests-1326358127 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:41:19 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-1ad43a90-8b2d-4f34-8255-010b83b57031 tempest-VolumeDependencyTests-1326358127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:41:19 devstack sudo[99388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:41:19 devstack sudo[99388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:41:19 devstack sudo[99388]: pam_unix(sudo:session): session closed for user root Sep 06 06:41:19 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-1ad43a90-8b2d-4f34-8255-010b83b57031 tempest-VolumeDependencyTests-1326358127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.255s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:41:19 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-1ad43a90-8b2d-4f34-8255-010b83b57031 tempest-VolumeDependencyTests-1326358127 None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:41:19 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-1ad43a90-8b2d-4f34-8255-010b83b57031 tempest-VolumeDependencyTests-1326358127 None] Deleted volume successfully. Sep 06 06:41:19 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-1ad43a90-8b2d-4f34-8255-010b83b57031 tempest-VolumeDependencyTests-1326358127 None] Lock "cinder-1a254542-d95e-4699-a37c-4bfb8a08d277-delete_volume" released by "delete_volume" :: held 1.253s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:41:19 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-a106ffe6-d88a-48c8-8242-ca20c7ad7486 tempest-VolumesExtendTest-2006658009 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:41:19 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-a106ffe6-d88a-48c8-8242-ca20c7ad7486 tempest-VolumesExtendTest-2006658009 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:41:19 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f2e956b-f59a-4034-878a-7d7fb00bf6ea]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:41:19 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-a106ffe6-d88a-48c8-8242-ca20c7ad7486 tempest-VolumesExtendTest-2006658009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-2116a3dc-938c-4819-8330-b815a8d9d41d {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:41:19 devstack sudo[99391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-2116a3dc-938c-4819-8330-b815a8d9d41d Sep 06 06:41:19 devstack sudo[99391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:41:19 devstack sudo[99391]: pam_unix(sudo:session): session closed for user root Sep 06 06:41:19 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-a106ffe6-d88a-48c8-8242-ca20c7ad7486 tempest-VolumesExtendTest-2006658009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-2116a3dc-938c-4819-8330-b815a8d9d41d" returned: 0 in 0.388s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:41:19 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-a106ffe6-d88a-48c8-8242-ca20c7ad7486 tempest-VolumesExtendTest-2006658009 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-2116a3dc-938c-4819-8330-b815a8d9d41d 2G {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:41:19 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-a106ffe6-d88a-48c8-8242-ca20c7ad7486 tempest-VolumesExtendTest-2006658009 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-2116a3dc-938c-4819-8330-b815a8d9d41d 2G" returned: 0 in 0.117s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:41:19 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-a106ffe6-d88a-48c8-8242-ca20c7ad7486 tempest-VolumesExtendTest-2006658009 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.535s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:41:20 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-a106ffe6-d88a-48c8-8242-ca20c7ad7486 tempest-VolumesExtendTest-2006658009 None] Extend volume completed successfully. Sep 06 06:41:21 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-1a36054f-77dc-441c-b119-77a6d951041e tempest-VolumesExtendTest-2006658009 None] Acquiring lock "cinder-2116a3dc-938c-4819-8330-b815a8d9d41d-delete_volume" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:41:21 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-1a36054f-77dc-441c-b119-77a6d951041e tempest-VolumesExtendTest-2006658009 None] Lock "cinder-2116a3dc-938c-4819-8330-b815a8d9d41d-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:41:21 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-1a36054f-77dc-441c-b119-77a6d951041e tempest-VolumesExtendTest-2006658009 None] Acquiring lock "cinder-quobyte-2116a3dc-938c-4819-8330-b815a8d9d41d" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:41:21 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-1a36054f-77dc-441c-b119-77a6d951041e tempest-VolumesExtendTest-2006658009 None] Lock "cinder-quobyte-2116a3dc-938c-4819-8330-b815a8d9d41d" acquired by "delete_volume" :: waited 0.016s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:41:21 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[11af7aeb-d87b-4553-8da8-7f6685fe3657]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:41:21 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-1a36054f-77dc-441c-b119-77a6d951041e tempest-VolumesExtendTest-2006658009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-2116a3dc-938c-4819-8330-b815a8d9d41d {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:41:21 devstack sudo[99400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-2116a3dc-938c-4819-8330-b815a8d9d41d Sep 06 06:41:21 devstack sudo[99400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:41:21 devstack sudo[99400]: pam_unix(sudo:session): session closed for user root Sep 06 06:41:21 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-1a36054f-77dc-441c-b119-77a6d951041e tempest-VolumesExtendTest-2006658009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-2116a3dc-938c-4819-8330-b815a8d9d41d" returned: 0 in 0.603s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:41:21 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-1a36054f-77dc-441c-b119-77a6d951041e tempest-VolumesExtendTest-2006658009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-2116a3dc-938c-4819-8330-b815a8d9d41d {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:41:21 devstack sudo[99469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-2116a3dc-938c-4819-8330-b815a8d9d41d Sep 06 06:41:21 devstack sudo[99469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:41:22 devstack sudo[99469]: pam_unix(sudo:session): session closed for user root Sep 06 06:41:22 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-1a36054f-77dc-441c-b119-77a6d951041e tempest-VolumesExtendTest-2006658009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-2116a3dc-938c-4819-8330-b815a8d9d41d" returned: 0 in 0.455s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:41:22 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-1a36054f-77dc-441c-b119-77a6d951041e tempest-VolumesExtendTest-2006658009 None] Lock "cinder-quobyte-2116a3dc-938c-4819-8330-b815a8d9d41d" released by "delete_volume" :: held 1.112s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:41:22 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-1a36054f-77dc-441c-b119-77a6d951041e tempest-VolumesExtendTest-2006658009 None] Created reservations ['260cfd38-e454-4b32-822f-999219d39f5a', '4b06a1ed-efe7-4332-95ab-c4d332e528f5', 'a0d1fa5b-ef48-4a2d-8ef5-bd4cc1d11064', 'e35edce3-0168-4c78-ab39-ee1e426a6dce'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:41:22 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-1a36054f-77dc-441c-b119-77a6d951041e tempest-VolumesExtendTest-2006658009 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:41:22 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-1a36054f-77dc-441c-b119-77a6d951041e tempest-VolumesExtendTest-2006658009 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:41:22 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-1a36054f-77dc-441c-b119-77a6d951041e tempest-VolumesExtendTest-2006658009 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:41:22 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-1a36054f-77dc-441c-b119-77a6d951041e tempest-VolumesExtendTest-2006658009 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:41:22 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-1a36054f-77dc-441c-b119-77a6d951041e tempest-VolumesExtendTest-2006658009 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:41:22 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-1a36054f-77dc-441c-b119-77a6d951041e tempest-VolumesExtendTest-2006658009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:41:22 devstack sudo[99524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:41:22 devstack sudo[99524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:41:22 devstack sudo[99524]: pam_unix(sudo:session): session closed for user root Sep 06 06:41:22 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-1a36054f-77dc-441c-b119-77a6d951041e tempest-VolumesExtendTest-2006658009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.261s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:41:22 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-1a36054f-77dc-441c-b119-77a6d951041e tempest-VolumesExtendTest-2006658009 None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:41:22 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-1a36054f-77dc-441c-b119-77a6d951041e tempest-VolumesExtendTest-2006658009 None] Deleted volume successfully. Sep 06 06:41:22 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-1a36054f-77dc-441c-b119-77a6d951041e tempest-VolumesExtendTest-2006658009 None] Lock "cinder-2116a3dc-938c-4819-8330-b815a8d9d41d-delete_volume" released by "delete_volume" :: held 1.689s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:41:24 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b660863-f071-4b5a-a163-3e2f33f29644 tempest-VolumesExtendTest-2006658009 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87329) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 06:41:24 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-4b660863-f071-4b5a-a163-3e2f33f29644 tempest-VolumesExtendTest-2006658009 None] Flow 'volume_create_manager' (11427a89-4240-4d62-9de5-2c5408ab501b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:41:24 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-4b660863-f071-4b5a-a163-3e2f33f29644 tempest-VolumesExtendTest-2006658009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe3d7e65-4c63-433a-bea9-1195d3cb99de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:41:24 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-4b660863-f071-4b5a-a163-3e2f33f29644 tempest-VolumesExtendTest-2006658009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe3d7e65-4c63-433a-bea9-1195d3cb99de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:41:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-457112254',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ad3750f-abeb-49c7-bd97-609cbf3fd1d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c49313d5ba74cc0a3146268e6d81af1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:41:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:41:24Z,use_quota=True,user_id='f0d331e312fc4c7fb9384dca06e6135a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:41:24 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-4b660863-f071-4b5a-a163-3e2f33f29644 tempest-VolumesExtendTest-2006658009 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd6fba6e-85e8-4486-bf65-15d409f70e5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:41:24 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-4b660863-f071-4b5a-a163-3e2f33f29644 tempest-VolumesExtendTest-2006658009 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd6fba6e-85e8-4486-bf65-15d409f70e5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:41:24 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-4b660863-f071-4b5a-a163-3e2f33f29644 tempest-VolumesExtendTest-2006658009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2624d67-4036-4df6-a2b3-2c747af7fb89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:41:24 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-4b660863-f071-4b5a-a163-3e2f33f29644 tempest-VolumesExtendTest-2006658009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2624d67-4036-4df6-a2b3-2c747af7fb89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ad3750f-abeb-49c7-bd97-609cbf3fd1d3', 'volume_name': 'volume-7ad3750f-abeb-49c7-bd97-609cbf3fd1d3', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:41:24 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-4b660863-f071-4b5a-a163-3e2f33f29644 tempest-VolumesExtendTest-2006658009 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c94c73a4-210d-4264-bdd7-6b4c9384e3c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:41:24 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-4b660863-f071-4b5a-a163-3e2f33f29644 tempest-VolumesExtendTest-2006658009 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c94c73a4-210d-4264-bdd7-6b4c9384e3c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:41:24 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-4b660863-f071-4b5a-a163-3e2f33f29644 tempest-VolumesExtendTest-2006658009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f5525ba-1007-424d-84e9-bff95c7058fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:41:24 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-4b660863-f071-4b5a-a163-3e2f33f29644 tempest-VolumesExtendTest-2006658009 None] Volume 7ad3750f-abeb-49c7-bd97-609cbf3fd1d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ad3750f-abeb-49c7-bd97-609cbf3fd1d3', 'volume_size': 1} Sep 06 06:41:24 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-4b660863-f071-4b5a-a163-3e2f33f29644 tempest-VolumesExtendTest-2006658009 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:41:24 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-4b660863-f071-4b5a-a163-3e2f33f29644 tempest-VolumesExtendTest-2006658009 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:41:24 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-4b660863-f071-4b5a-a163-3e2f33f29644 tempest-VolumesExtendTest-2006658009 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:41:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-457112254',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ad3750f-abeb-49c7-bd97-609cbf3fd1d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c49313d5ba74cc0a3146268e6d81af1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:41:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:41:24Z,use_quota=True,user_id='f0d331e312fc4c7fb9384dca06e6135a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)}" {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 06:41:24 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-4b660863-f071-4b5a-a163-3e2f33f29644 tempest-VolumesExtendTest-2006658009 None] Creating volume 7ad3750f-abeb-49c7-bd97-609cbf3fd1d3 {{(pid=87329) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 06:41:24 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-4b660863-f071-4b5a-a163-3e2f33f29644 tempest-VolumesExtendTest-2006658009 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:41:24 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-4b660863-f071-4b5a-a163-3e2f33f29644 tempest-VolumesExtendTest-2006658009 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:41:24 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-4b660863-f071-4b5a-a163-3e2f33f29644 tempest-VolumesExtendTest-2006658009 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:41:24 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-4b660863-f071-4b5a-a163-3e2f33f29644 tempest-VolumesExtendTest-2006658009 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:41:24 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-4b660863-f071-4b5a-a163-3e2f33f29644 tempest-VolumesExtendTest-2006658009 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:41:24 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-4b660863-f071-4b5a-a163-3e2f33f29644 tempest-VolumesExtendTest-2006658009 None] Selected osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 as target Quobyte volume. {{(pid=87329) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 06:41:24 devstack cinder-volume[87329]: INFO cinder.volume.drivers.remotefs [None req-4b660863-f071-4b5a-a163-3e2f33f29644 tempest-VolumesExtendTest-2006658009 None] casted to osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 Sep 06 06:41:24 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-4b660863-f071-4b5a-a163-3e2f33f29644 tempest-VolumesExtendTest-2006658009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-7ad3750f-abeb-49c7-bd97-609cbf3fd1d3 1073741824 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:41:24 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-190d7bca-2bc3-4a16-ab90-006b56b675cf tempest-ProjectReaderTests-565185984 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87329) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 06:41:24 devstack sudo[99911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-7ad3750f-abeb-49c7-bd97-609cbf3fd1d3 1073741824 Sep 06 06:41:24 devstack sudo[99911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:41:24 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-190d7bca-2bc3-4a16-ab90-006b56b675cf tempest-ProjectReaderTests-565185984 None] Flow 'volume_create_manager' (239fb090-8b61-4f56-8748-815d6f532c1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:41:24 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-190d7bca-2bc3-4a16-ab90-006b56b675cf tempest-ProjectReaderTests-565185984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a083a783-35cc-46c3-8726-d8ac1bfb9810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:41:24 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-190d7bca-2bc3-4a16-ab90-006b56b675cf tempest-ProjectReaderTests-565185984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a083a783-35cc-46c3-8726-d8ac1bfb9810) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:41:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-849480879',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e54a74da-b0ba-4cd9-8e23-0553fcfb4d8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='490360e70ad741fcb278afde72a8d371',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:41:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:41:24Z,use_quota=True,user_id='783d3bcc349d4a8781de139829550158',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:41:24 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-190d7bca-2bc3-4a16-ab90-006b56b675cf tempest-ProjectReaderTests-565185984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f243dc3-b9de-487b-93e5-deb03801db11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:41:24 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-190d7bca-2bc3-4a16-ab90-006b56b675cf tempest-ProjectReaderTests-565185984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f243dc3-b9de-487b-93e5-deb03801db11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:41:24 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-190d7bca-2bc3-4a16-ab90-006b56b675cf tempest-ProjectReaderTests-565185984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8c4ac85-48df-4af5-9197-4e49d43c26ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:41:24 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-190d7bca-2bc3-4a16-ab90-006b56b675cf tempest-ProjectReaderTests-565185984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8c4ac85-48df-4af5-9197-4e49d43c26ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e54a74da-b0ba-4cd9-8e23-0553fcfb4d8a', 'volume_name': 'volume-e54a74da-b0ba-4cd9-8e23-0553fcfb4d8a', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:41:24 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-190d7bca-2bc3-4a16-ab90-006b56b675cf tempest-ProjectReaderTests-565185984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c64c9c9-218f-4fa1-b7d4-f1ab6986ee60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:41:24 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-190d7bca-2bc3-4a16-ab90-006b56b675cf tempest-ProjectReaderTests-565185984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c64c9c9-218f-4fa1-b7d4-f1ab6986ee60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:41:24 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-190d7bca-2bc3-4a16-ab90-006b56b675cf tempest-ProjectReaderTests-565185984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdb3a0a8-6d0f-4f16-83f0-f221ef632ff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:41:24 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-190d7bca-2bc3-4a16-ab90-006b56b675cf tempest-ProjectReaderTests-565185984 None] Volume e54a74da-b0ba-4cd9-8e23-0553fcfb4d8a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e54a74da-b0ba-4cd9-8e23-0553fcfb4d8a', 'volume_size': 1} Sep 06 06:41:24 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-190d7bca-2bc3-4a16-ab90-006b56b675cf tempest-ProjectReaderTests-565185984 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:41:24 devstack sudo[99911]: pam_unix(sudo:session): session closed for user root Sep 06 06:41:24 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-4b660863-f071-4b5a-a163-3e2f33f29644 tempest-VolumesExtendTest-2006658009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-7ad3750f-abeb-49c7-bd97-609cbf3fd1d3 1073741824" returned: 0 in 0.591s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:41:24 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-4b660863-f071-4b5a-a163-3e2f33f29644 tempest-VolumesExtendTest-2006658009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-7ad3750f-abeb-49c7-bd97-609cbf3fd1d3 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:41:24 devstack sudo[99918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-7ad3750f-abeb-49c7-bd97-609cbf3fd1d3 Sep 06 06:41:24 devstack sudo[99918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:41:25 devstack sudo[99918]: pam_unix(sudo:session): session closed for user root Sep 06 06:41:25 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-4b660863-f071-4b5a-a163-3e2f33f29644 tempest-VolumesExtendTest-2006658009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-7ad3750f-abeb-49c7-bd97-609cbf3fd1d3" returned: 0 in 0.259s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:41:25 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-4b660863-f071-4b5a-a163-3e2f33f29644 tempest-VolumesExtendTest-2006658009 None] <== create_volume: return (895ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'} {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 06:41:25 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-4b660863-f071-4b5a-a163-3e2f33f29644 tempest-VolumesExtendTest-2006658009 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.897s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:41:25 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-190d7bca-2bc3-4a16-ab90-006b56b675cf tempest-ProjectReaderTests-565185984 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.786s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:41:25 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-190d7bca-2bc3-4a16-ab90-006b56b675cf tempest-ProjectReaderTests-565185984 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:41:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-849480879',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e54a74da-b0ba-4cd9-8e23-0553fcfb4d8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='490360e70ad741fcb278afde72a8d371',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:41:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:41:24Z,use_quota=True,user_id='783d3bcc349d4a8781de139829550158',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)}" {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 06:41:25 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-190d7bca-2bc3-4a16-ab90-006b56b675cf tempest-ProjectReaderTests-565185984 None] Creating volume e54a74da-b0ba-4cd9-8e23-0553fcfb4d8a {{(pid=87329) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 06:41:25 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-190d7bca-2bc3-4a16-ab90-006b56b675cf tempest-ProjectReaderTests-565185984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:41:25 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-190d7bca-2bc3-4a16-ab90-006b56b675cf tempest-ProjectReaderTests-565185984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:41:25 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-190d7bca-2bc3-4a16-ab90-006b56b675cf tempest-ProjectReaderTests-565185984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:41:25 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-190d7bca-2bc3-4a16-ab90-006b56b675cf tempest-ProjectReaderTests-565185984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:41:25 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-190d7bca-2bc3-4a16-ab90-006b56b675cf tempest-ProjectReaderTests-565185984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:41:25 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-190d7bca-2bc3-4a16-ab90-006b56b675cf tempest-ProjectReaderTests-565185984 None] Selected osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 as target Quobyte volume. {{(pid=87329) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 06:41:25 devstack cinder-volume[87329]: INFO cinder.volume.drivers.remotefs [None req-190d7bca-2bc3-4a16-ab90-006b56b675cf tempest-ProjectReaderTests-565185984 None] casted to osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 Sep 06 06:41:25 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-190d7bca-2bc3-4a16-ab90-006b56b675cf tempest-ProjectReaderTests-565185984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e54a74da-b0ba-4cd9-8e23-0553fcfb4d8a 1073741824 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:41:25 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-4b660863-f071-4b5a-a163-3e2f33f29644 tempest-VolumesExtendTest-2006658009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f5525ba-1007-424d-84e9-bff95c7058fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ad3750f-abeb-49c7-bd97-609cbf3fd1d3', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:41:25 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-4b660863-f071-4b5a-a163-3e2f33f29644 tempest-VolumesExtendTest-2006658009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7582011e-8fdd-486e-aa2e-00646a312287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:41:25 devstack sudo[99921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e54a74da-b0ba-4cd9-8e23-0553fcfb4d8a 1073741824 Sep 06 06:41:25 devstack sudo[99921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:41:25 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-4b660863-f071-4b5a-a163-3e2f33f29644 tempest-VolumesExtendTest-2006658009 None] Volume volume-7ad3750f-abeb-49c7-bd97-609cbf3fd1d3 (7ad3750f-abeb-49c7-bd97-609cbf3fd1d3): created successfully Sep 06 06:41:25 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-4b660863-f071-4b5a-a163-3e2f33f29644 tempest-VolumesExtendTest-2006658009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7582011e-8fdd-486e-aa2e-00646a312287) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:41:25 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-4b660863-f071-4b5a-a163-3e2f33f29644 tempest-VolumesExtendTest-2006658009 None] Flow 'volume_create_manager' (11427a89-4240-4d62-9de5-2c5408ab501b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:41:25 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-4b660863-f071-4b5a-a163-3e2f33f29644 tempest-VolumesExtendTest-2006658009 None] Created volume successfully. Sep 06 06:41:25 devstack sudo[99921]: pam_unix(sudo:session): session closed for user root Sep 06 06:41:25 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-190d7bca-2bc3-4a16-ab90-006b56b675cf tempest-ProjectReaderTests-565185984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e54a74da-b0ba-4cd9-8e23-0553fcfb4d8a 1073741824" returned: 0 in 0.447s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:41:25 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-190d7bca-2bc3-4a16-ab90-006b56b675cf tempest-ProjectReaderTests-565185984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e54a74da-b0ba-4cd9-8e23-0553fcfb4d8a {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:41:25 devstack sudo[99927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e54a74da-b0ba-4cd9-8e23-0553fcfb4d8a Sep 06 06:41:25 devstack sudo[99927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:41:25 devstack sudo[99927]: pam_unix(sudo:session): session closed for user root Sep 06 06:41:25 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-190d7bca-2bc3-4a16-ab90-006b56b675cf tempest-ProjectReaderTests-565185984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e54a74da-b0ba-4cd9-8e23-0553fcfb4d8a" returned: 0 in 0.260s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:41:25 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-190d7bca-2bc3-4a16-ab90-006b56b675cf tempest-ProjectReaderTests-565185984 None] <== create_volume: return (752ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'} {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 06:41:25 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-190d7bca-2bc3-4a16-ab90-006b56b675cf tempest-ProjectReaderTests-565185984 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.755s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:41:25 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-190d7bca-2bc3-4a16-ab90-006b56b675cf tempest-ProjectReaderTests-565185984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdb3a0a8-6d0f-4f16-83f0-f221ef632ff0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e54a74da-b0ba-4cd9-8e23-0553fcfb4d8a', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:41:25 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-190d7bca-2bc3-4a16-ab90-006b56b675cf tempest-ProjectReaderTests-565185984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0befc879-fed2-4936-bd0a-6031f96212cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:41:25 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-190d7bca-2bc3-4a16-ab90-006b56b675cf tempest-ProjectReaderTests-565185984 None] Volume volume-e54a74da-b0ba-4cd9-8e23-0553fcfb4d8a (e54a74da-b0ba-4cd9-8e23-0553fcfb4d8a): created successfully Sep 06 06:41:25 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-190d7bca-2bc3-4a16-ab90-006b56b675cf tempest-ProjectReaderTests-565185984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0befc879-fed2-4936-bd0a-6031f96212cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:41:25 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-190d7bca-2bc3-4a16-ab90-006b56b675cf tempest-ProjectReaderTests-565185984 None] Flow 'volume_create_manager' (239fb090-8b61-4f56-8748-815d6f532c1e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:41:25 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-190d7bca-2bc3-4a16-ab90-006b56b675cf tempest-ProjectReaderTests-565185984 None] Created volume successfully. Sep 06 06:41:26 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-36545cb0-0050-4c57-8a06-9dfbb2fcd3a8 tempest-VolumesExtendTest-2006658009 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:41:26 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-36545cb0-0050-4c57-8a06-9dfbb2fcd3a8 tempest-VolumesExtendTest-2006658009 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:41:26 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-36545cb0-0050-4c57-8a06-9dfbb2fcd3a8 tempest-VolumesExtendTest-2006658009 None] Creating offline snapshot 15535945-5405-4da5-80c7-9488e3fb4bd8 of volume 7ad3750f-abeb-49c7-bd97-609cbf3fd1d3 {{(pid=87329) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 06 06:41:26 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[0867da1e-8fef-41c2-846a-0ce614088c1d]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:41:26 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-36545cb0-0050-4c57-8a06-9dfbb2fcd3a8 tempest-VolumesExtendTest-2006658009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-7ad3750f-abeb-49c7-bd97-609cbf3fd1d3 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:41:26 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-e8aa5856-2e2b-4f48-af66-5b366251a61b tempest-ProjectReaderTests-565185984 None] Acquiring lock "cinder-e54a74da-b0ba-4cd9-8e23-0553fcfb4d8a-delete_volume" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:41:26 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-e8aa5856-2e2b-4f48-af66-5b366251a61b tempest-ProjectReaderTests-565185984 None] Lock "cinder-e54a74da-b0ba-4cd9-8e23-0553fcfb4d8a-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:41:26 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-e8aa5856-2e2b-4f48-af66-5b366251a61b tempest-ProjectReaderTests-565185984 None] Acquiring lock "cinder-quobyte-e54a74da-b0ba-4cd9-8e23-0553fcfb4d8a" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:41:26 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-e8aa5856-2e2b-4f48-af66-5b366251a61b tempest-ProjectReaderTests-565185984 None] Lock "cinder-quobyte-e54a74da-b0ba-4cd9-8e23-0553fcfb4d8a" acquired by "delete_volume" :: waited 0.027s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:41:26 devstack sudo[99930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-7ad3750f-abeb-49c7-bd97-609cbf3fd1d3 Sep 06 06:41:26 devstack sudo[99930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:41:26 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb3db9e5-6947-485d-a4b4-e395219b7ed7]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:41:26 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-e8aa5856-2e2b-4f48-af66-5b366251a61b tempest-ProjectReaderTests-565185984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e54a74da-b0ba-4cd9-8e23-0553fcfb4d8a {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:41:26 devstack sudo[99932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e54a74da-b0ba-4cd9-8e23-0553fcfb4d8a Sep 06 06:41:26 devstack sudo[99932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:41:26 devstack sudo[99930]: pam_unix(sudo:session): session closed for user root Sep 06 06:41:26 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-36545cb0-0050-4c57-8a06-9dfbb2fcd3a8 tempest-VolumesExtendTest-2006658009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-7ad3750f-abeb-49c7-bd97-609cbf3fd1d3" returned: 0 in 0.433s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:41:26 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-36545cb0-0050-4c57-8a06-9dfbb2fcd3a8 tempest-VolumesExtendTest-2006658009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-7ad3750f-abeb-49c7-bd97-609cbf3fd1d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-7ad3750f-abeb-49c7-bd97-609cbf3fd1d3.15535945-5405-4da5-80c7-9488e3fb4bd8 1G {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:41:26 devstack sudo[99937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-7ad3750f-abeb-49c7-bd97-609cbf3fd1d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-7ad3750f-abeb-49c7-bd97-609cbf3fd1d3.15535945-5405-4da5-80c7-9488e3fb4bd8 1G Sep 06 06:41:26 devstack sudo[99937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:41:26 devstack sudo[99932]: pam_unix(sudo:session): session closed for user root Sep 06 06:41:26 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-e8aa5856-2e2b-4f48-af66-5b366251a61b tempest-ProjectReaderTests-565185984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e54a74da-b0ba-4cd9-8e23-0553fcfb4d8a" returned: 0 in 0.396s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:41:26 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-e8aa5856-2e2b-4f48-af66-5b366251a61b tempest-ProjectReaderTests-565185984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e54a74da-b0ba-4cd9-8e23-0553fcfb4d8a {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:41:26 devstack sudo[99942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e54a74da-b0ba-4cd9-8e23-0553fcfb4d8a Sep 06 06:41:26 devstack sudo[99942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:41:27 devstack sudo[99937]: pam_unix(sudo:session): session closed for user root Sep 06 06:41:27 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-36545cb0-0050-4c57-8a06-9dfbb2fcd3a8 tempest-VolumesExtendTest-2006658009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-7ad3750f-abeb-49c7-bd97-609cbf3fd1d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-7ad3750f-abeb-49c7-bd97-609cbf3fd1d3.15535945-5405-4da5-80c7-9488e3fb4bd8 1G" returned: 0 in 0.412s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:41:27 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-36545cb0-0050-4c57-8a06-9dfbb2fcd3a8 tempest-VolumesExtendTest-2006658009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ad3750f-abeb-49c7-bd97-609cbf3fd1d3 -F qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-7ad3750f-abeb-49c7-bd97-609cbf3fd1d3.15535945-5405-4da5-80c7-9488e3fb4bd8 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:41:27 devstack sudo[99942]: pam_unix(sudo:session): session closed for user root Sep 06 06:41:27 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-e8aa5856-2e2b-4f48-af66-5b366251a61b tempest-ProjectReaderTests-565185984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e54a74da-b0ba-4cd9-8e23-0553fcfb4d8a" returned: 0 in 0.296s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:41:27 devstack sudo[99949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ad3750f-abeb-49c7-bd97-609cbf3fd1d3 -F qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-7ad3750f-abeb-49c7-bd97-609cbf3fd1d3.15535945-5405-4da5-80c7-9488e3fb4bd8 Sep 06 06:41:27 devstack sudo[99949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:41:27 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-e8aa5856-2e2b-4f48-af66-5b366251a61b tempest-ProjectReaderTests-565185984 None] Lock "cinder-quobyte-e54a74da-b0ba-4cd9-8e23-0553fcfb4d8a" released by "delete_volume" :: held 0.752s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:41:27 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-e8aa5856-2e2b-4f48-af66-5b366251a61b tempest-ProjectReaderTests-565185984 None] Created reservations ['9b9dfe4d-59d4-4c48-b385-c564bd0ee9b8', '3da465eb-eaf2-4b0e-a628-38f771710bc7', 'bfa1d890-e37e-4843-9c2a-575b96d05797', 'd1c5d88b-765f-40cb-994a-6a1b3a0c83e0'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:41:27 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-e8aa5856-2e2b-4f48-af66-5b366251a61b tempest-ProjectReaderTests-565185984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:41:27 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-e8aa5856-2e2b-4f48-af66-5b366251a61b tempest-ProjectReaderTests-565185984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:41:27 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-e8aa5856-2e2b-4f48-af66-5b366251a61b tempest-ProjectReaderTests-565185984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:41:27 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-e8aa5856-2e2b-4f48-af66-5b366251a61b tempest-ProjectReaderTests-565185984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:41:27 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-e8aa5856-2e2b-4f48-af66-5b366251a61b tempest-ProjectReaderTests-565185984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:41:27 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-e8aa5856-2e2b-4f48-af66-5b366251a61b tempest-ProjectReaderTests-565185984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:41:27 devstack sudo[99951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:41:27 devstack sudo[99951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:41:27 devstack sudo[99949]: pam_unix(sudo:session): session closed for user root Sep 06 06:41:27 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-36545cb0-0050-4c57-8a06-9dfbb2fcd3a8 tempest-VolumesExtendTest-2006658009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ad3750f-abeb-49c7-bd97-609cbf3fd1d3 -F qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-7ad3750f-abeb-49c7-bd97-609cbf3fd1d3.15535945-5405-4da5-80c7-9488e3fb4bd8" returned: 0 in 0.331s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:41:27 devstack cinder-volume[87329]: WARNING cinder.volume.drivers.remotefs [None req-36545cb0-0050-4c57-8a06-9dfbb2fcd3a8 tempest-VolumesExtendTest-2006658009 None] /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-7ad3750f-abeb-49c7-bd97-609cbf3fd1d3.15535945-5405-4da5-80c7-9488e3fb4bd8 is being set with open permissions: ugo+rw Sep 06 06:41:27 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-36545cb0-0050-4c57-8a06-9dfbb2fcd3a8 tempest-VolumesExtendTest-2006658009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-7ad3750f-abeb-49c7-bd97-609cbf3fd1d3.15535945-5405-4da5-80c7-9488e3fb4bd8 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:41:27 devstack sudo[99956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-7ad3750f-abeb-49c7-bd97-609cbf3fd1d3.15535945-5405-4da5-80c7-9488e3fb4bd8 Sep 06 06:41:27 devstack sudo[99956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:41:27 devstack sudo[99951]: pam_unix(sudo:session): session closed for user root Sep 06 06:41:27 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-e8aa5856-2e2b-4f48-af66-5b366251a61b tempest-ProjectReaderTests-565185984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.298s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:41:27 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-e8aa5856-2e2b-4f48-af66-5b366251a61b tempest-ProjectReaderTests-565185984 None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:41:27 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-e8aa5856-2e2b-4f48-af66-5b366251a61b tempest-ProjectReaderTests-565185984 None] Deleted volume successfully. Sep 06 06:41:27 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-e8aa5856-2e2b-4f48-af66-5b366251a61b tempest-ProjectReaderTests-565185984 None] Lock "cinder-e54a74da-b0ba-4cd9-8e23-0553fcfb4d8a-delete_volume" released by "delete_volume" :: held 1.306s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:41:27 devstack sudo[99956]: pam_unix(sudo:session): session closed for user root Sep 06 06:41:27 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-36545cb0-0050-4c57-8a06-9dfbb2fcd3a8 tempest-VolumesExtendTest-2006658009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-7ad3750f-abeb-49c7-bd97-609cbf3fd1d3.15535945-5405-4da5-80c7-9488e3fb4bd8" returned: 0 in 0.309s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:41:27 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-36545cb0-0050-4c57-8a06-9dfbb2fcd3a8 tempest-VolumesExtendTest-2006658009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-7ad3750f-abeb-49c7-bd97-609cbf3fd1d3.info {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:41:27 devstack sudo[99960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-7ad3750f-abeb-49c7-bd97-609cbf3fd1d3.info Sep 06 06:41:27 devstack sudo[99960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:41:28 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-f663fd7c-cfac-4cc1-8438-34a74376c684 tempest-ProjectReaderTests-565185984 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87329) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 06:41:28 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-f663fd7c-cfac-4cc1-8438-34a74376c684 tempest-ProjectReaderTests-565185984 None] Flow 'volume_create_manager' (ae62f870-a298-46a5-82d9-8ae659e5e80a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:41:28 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-f663fd7c-cfac-4cc1-8438-34a74376c684 tempest-ProjectReaderTests-565185984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e575baca-6abe-4678-9142-962c029c9e38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:41:28 devstack sudo[99960]: pam_unix(sudo:session): session closed for user root Sep 06 06:41:28 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-36545cb0-0050-4c57-8a06-9dfbb2fcd3a8 tempest-VolumesExtendTest-2006658009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-7ad3750f-abeb-49c7-bd97-609cbf3fd1d3.info" returned: 0 in 0.282s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:41:28 devstack cinder-volume[87329]: WARNING cinder.volume.drivers.remotefs [None req-36545cb0-0050-4c57-8a06-9dfbb2fcd3a8 tempest-VolumesExtendTest-2006658009 None] /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-7ad3750f-abeb-49c7-bd97-609cbf3fd1d3.info is being set with open permissions: ugo+rw Sep 06 06:41:28 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-36545cb0-0050-4c57-8a06-9dfbb2fcd3a8 tempest-VolumesExtendTest-2006658009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-7ad3750f-abeb-49c7-bd97-609cbf3fd1d3.info {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:41:28 devstack sudo[99963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-7ad3750f-abeb-49c7-bd97-609cbf3fd1d3.info Sep 06 06:41:28 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-f663fd7c-cfac-4cc1-8438-34a74376c684 tempest-ProjectReaderTests-565185984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e575baca-6abe-4678-9142-962c029c9e38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:41:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-321507170',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d588615a-2226-46a8-85cb-011118849442,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='490360e70ad741fcb278afde72a8d371',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:41:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:41:28Z,use_quota=True,user_id='783d3bcc349d4a8781de139829550158',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:41:28 devstack sudo[99963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:41:28 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-f663fd7c-cfac-4cc1-8438-34a74376c684 tempest-ProjectReaderTests-565185984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc2af86a-6915-4652-bf3b-313d4c0f8552) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:41:28 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-f663fd7c-cfac-4cc1-8438-34a74376c684 tempest-ProjectReaderTests-565185984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc2af86a-6915-4652-bf3b-313d4c0f8552) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:41:28 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-f663fd7c-cfac-4cc1-8438-34a74376c684 tempest-ProjectReaderTests-565185984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (101bcac6-dba9-4455-b884-eab21fbdfab9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:41:28 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-f663fd7c-cfac-4cc1-8438-34a74376c684 tempest-ProjectReaderTests-565185984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (101bcac6-dba9-4455-b884-eab21fbdfab9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd588615a-2226-46a8-85cb-011118849442', 'volume_name': 'volume-d588615a-2226-46a8-85cb-011118849442', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:41:28 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-f663fd7c-cfac-4cc1-8438-34a74376c684 tempest-ProjectReaderTests-565185984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3ffec43-4f60-4cf9-ac68-09792fef50fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:41:28 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-f663fd7c-cfac-4cc1-8438-34a74376c684 tempest-ProjectReaderTests-565185984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3ffec43-4f60-4cf9-ac68-09792fef50fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:41:28 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-f663fd7c-cfac-4cc1-8438-34a74376c684 tempest-ProjectReaderTests-565185984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f92a26b4-46f9-464e-9612-10f21a12994e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:41:28 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-f663fd7c-cfac-4cc1-8438-34a74376c684 tempest-ProjectReaderTests-565185984 None] Volume d588615a-2226-46a8-85cb-011118849442: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d588615a-2226-46a8-85cb-011118849442', 'volume_size': 1} Sep 06 06:41:28 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-f663fd7c-cfac-4cc1-8438-34a74376c684 tempest-ProjectReaderTests-565185984 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:41:28 devstack sudo[99963]: pam_unix(sudo:session): session closed for user root Sep 06 06:41:28 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-36545cb0-0050-4c57-8a06-9dfbb2fcd3a8 tempest-VolumesExtendTest-2006658009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-7ad3750f-abeb-49c7-bd97-609cbf3fd1d3.info" returned: 0 in 0.244s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:41:28 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-36545cb0-0050-4c57-8a06-9dfbb2fcd3a8 tempest-VolumesExtendTest-2006658009 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.119s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:41:28 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-f663fd7c-cfac-4cc1-8438-34a74376c684 tempest-ProjectReaderTests-565185984 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.201s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:41:28 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-f663fd7c-cfac-4cc1-8438-34a74376c684 tempest-ProjectReaderTests-565185984 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:41:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-321507170',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d588615a-2226-46a8-85cb-011118849442,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='490360e70ad741fcb278afde72a8d371',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:41:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:41:28Z,use_quota=True,user_id='783d3bcc349d4a8781de139829550158',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)}" {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 06:41:28 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-f663fd7c-cfac-4cc1-8438-34a74376c684 tempest-ProjectReaderTests-565185984 None] Creating volume d588615a-2226-46a8-85cb-011118849442 {{(pid=87329) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 06:41:28 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-f663fd7c-cfac-4cc1-8438-34a74376c684 tempest-ProjectReaderTests-565185984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:41:28 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-f663fd7c-cfac-4cc1-8438-34a74376c684 tempest-ProjectReaderTests-565185984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:41:28 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-f663fd7c-cfac-4cc1-8438-34a74376c684 tempest-ProjectReaderTests-565185984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:41:28 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-f663fd7c-cfac-4cc1-8438-34a74376c684 tempest-ProjectReaderTests-565185984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:41:28 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-f663fd7c-cfac-4cc1-8438-34a74376c684 tempest-ProjectReaderTests-565185984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:41:28 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-f663fd7c-cfac-4cc1-8438-34a74376c684 tempest-ProjectReaderTests-565185984 None] Selected osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 as target Quobyte volume. {{(pid=87329) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 06:41:28 devstack cinder-volume[87329]: INFO cinder.volume.drivers.remotefs [None req-f663fd7c-cfac-4cc1-8438-34a74376c684 tempest-ProjectReaderTests-565185984 None] casted to osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 Sep 06 06:41:28 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-f663fd7c-cfac-4cc1-8438-34a74376c684 tempest-ProjectReaderTests-565185984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-d588615a-2226-46a8-85cb-011118849442 1073741824 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:41:28 devstack sudo[99966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-d588615a-2226-46a8-85cb-011118849442 1073741824 Sep 06 06:41:28 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-36545cb0-0050-4c57-8a06-9dfbb2fcd3a8 tempest-VolumesExtendTest-2006658009 None] Create snapshot completed successfully Sep 06 06:41:28 devstack sudo[99966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:41:28 devstack sudo[99966]: pam_unix(sudo:session): session closed for user root Sep 06 06:41:28 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-f663fd7c-cfac-4cc1-8438-34a74376c684 tempest-ProjectReaderTests-565185984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-d588615a-2226-46a8-85cb-011118849442 1073741824" returned: 0 in 0.416s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:41:28 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-f663fd7c-cfac-4cc1-8438-34a74376c684 tempest-ProjectReaderTests-565185984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-d588615a-2226-46a8-85cb-011118849442 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:41:28 devstack sudo[99971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-d588615a-2226-46a8-85cb-011118849442 Sep 06 06:41:28 devstack sudo[99971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:41:29 devstack sudo[99971]: pam_unix(sudo:session): session closed for user root Sep 06 06:41:29 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-f663fd7c-cfac-4cc1-8438-34a74376c684 tempest-ProjectReaderTests-565185984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-d588615a-2226-46a8-85cb-011118849442" returned: 0 in 0.244s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:41:29 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-f663fd7c-cfac-4cc1-8438-34a74376c684 tempest-ProjectReaderTests-565185984 None] <== create_volume: return (698ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'} {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 06:41:29 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-f663fd7c-cfac-4cc1-8438-34a74376c684 tempest-ProjectReaderTests-565185984 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.704s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:41:29 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-f663fd7c-cfac-4cc1-8438-34a74376c684 tempest-ProjectReaderTests-565185984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f92a26b4-46f9-464e-9612-10f21a12994e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d588615a-2226-46a8-85cb-011118849442', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:41:29 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-f663fd7c-cfac-4cc1-8438-34a74376c684 tempest-ProjectReaderTests-565185984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee0ef38b-5fac-4e56-a942-94d02fd035e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:41:29 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-f663fd7c-cfac-4cc1-8438-34a74376c684 tempest-ProjectReaderTests-565185984 None] Volume volume-d588615a-2226-46a8-85cb-011118849442 (d588615a-2226-46a8-85cb-011118849442): created successfully Sep 06 06:41:29 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-f663fd7c-cfac-4cc1-8438-34a74376c684 tempest-ProjectReaderTests-565185984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee0ef38b-5fac-4e56-a942-94d02fd035e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:41:29 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-f663fd7c-cfac-4cc1-8438-34a74376c684 tempest-ProjectReaderTests-565185984 None] Flow 'volume_create_manager' (ae62f870-a298-46a5-82d9-8ae659e5e80a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:41:29 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-f663fd7c-cfac-4cc1-8438-34a74376c684 tempest-ProjectReaderTests-565185984 None] Created volume successfully. Sep 06 06:41:29 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-17c9183a-2bab-43bf-b64f-d16b69a5a155 tempest-VolumesExtendTest-2006658009 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:41:29 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-17c9183a-2bab-43bf-b64f-d16b69a5a155 tempest-VolumesExtendTest-2006658009 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:41:29 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce0489e7-0814-44c2-bd2d-117943c2e361]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:41:29 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-17c9183a-2bab-43bf-b64f-d16b69a5a155 tempest-VolumesExtendTest-2006658009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-7ad3750f-abeb-49c7-bd97-609cbf3fd1d3 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:41:29 devstack sudo[99976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-7ad3750f-abeb-49c7-bd97-609cbf3fd1d3 Sep 06 06:41:29 devstack sudo[99976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:41:29 devstack sudo[99976]: pam_unix(sudo:session): session closed for user root Sep 06 06:41:29 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-17c9183a-2bab-43bf-b64f-d16b69a5a155 tempest-VolumesExtendTest-2006658009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-7ad3750f-abeb-49c7-bd97-609cbf3fd1d3" returned: 0 in 0.344s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:41:29 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-17c9183a-2bab-43bf-b64f-d16b69a5a155 tempest-VolumesExtendTest-2006658009 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-7ad3750f-abeb-49c7-bd97-609cbf3fd1d3.15535945-5405-4da5-80c7-9488e3fb4bd8 2G {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:41:30 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-17c9183a-2bab-43bf-b64f-d16b69a5a155 tempest-VolumesExtendTest-2006658009 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-7ad3750f-abeb-49c7-bd97-609cbf3fd1d3.15535945-5405-4da5-80c7-9488e3fb4bd8 2G" returned: 0 in 0.115s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:41:30 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-17c9183a-2bab-43bf-b64f-d16b69a5a155 tempest-VolumesExtendTest-2006658009 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.490s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:41:30 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-17c9183a-2bab-43bf-b64f-d16b69a5a155 tempest-VolumesExtendTest-2006658009 None] Extend volume completed successfully. Sep 06 06:41:30 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-923d1656-a4a3-4e53-8917-93ec8d82b682 tempest-ProjectReaderTests-565185984 None] Acquiring lock "cinder-d588615a-2226-46a8-85cb-011118849442-delete_volume" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:41:30 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-923d1656-a4a3-4e53-8917-93ec8d82b682 tempest-ProjectReaderTests-565185984 None] Lock "cinder-d588615a-2226-46a8-85cb-011118849442-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:41:30 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-923d1656-a4a3-4e53-8917-93ec8d82b682 tempest-ProjectReaderTests-565185984 None] Acquiring lock "cinder-quobyte-d588615a-2226-46a8-85cb-011118849442" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:41:30 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-923d1656-a4a3-4e53-8917-93ec8d82b682 tempest-ProjectReaderTests-565185984 None] Lock "cinder-quobyte-d588615a-2226-46a8-85cb-011118849442" acquired by "delete_volume" :: waited 0.015s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:41:30 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[46fa83fb-d2ac-4785-bbc1-74259da5dd5c]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:41:30 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-923d1656-a4a3-4e53-8917-93ec8d82b682 tempest-ProjectReaderTests-565185984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-d588615a-2226-46a8-85cb-011118849442 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:41:30 devstack sudo[99985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-d588615a-2226-46a8-85cb-011118849442 Sep 06 06:41:30 devstack sudo[99985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:41:30 devstack sudo[99985]: pam_unix(sudo:session): session closed for user root Sep 06 06:41:30 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-923d1656-a4a3-4e53-8917-93ec8d82b682 tempest-ProjectReaderTests-565185984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-d588615a-2226-46a8-85cb-011118849442" returned: 0 in 0.373s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:41:30 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-923d1656-a4a3-4e53-8917-93ec8d82b682 tempest-ProjectReaderTests-565185984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-d588615a-2226-46a8-85cb-011118849442 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:41:30 devstack sudo[99990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-d588615a-2226-46a8-85cb-011118849442 Sep 06 06:41:30 devstack sudo[99990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:41:30 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-471c0452-17ba-4056-aac8-b9fb8c43c158 tempest-VolumesExtendTest-2006658009 None] Acquiring lock "cinder-15535945-5405-4da5-80c7-9488e3fb4bd8-delete_snapshot" by "delete_snapshot" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:41:30 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-471c0452-17ba-4056-aac8-b9fb8c43c158 tempest-VolumesExtendTest-2006658009 None] Lock "cinder-15535945-5405-4da5-80c7-9488e3fb4bd8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:41:30 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-471c0452-17ba-4056-aac8-b9fb8c43c158 tempest-VolumesExtendTest-2006658009 None] Acquiring lock "cinder-quobyte-7ad3750f-abeb-49c7-bd97-609cbf3fd1d3" by "delete_snapshot" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:41:30 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-471c0452-17ba-4056-aac8-b9fb8c43c158 tempest-VolumesExtendTest-2006658009 None] Lock "cinder-quobyte-7ad3750f-abeb-49c7-bd97-609cbf3fd1d3" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:41:30 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-471c0452-17ba-4056-aac8-b9fb8c43c158 tempest-VolumesExtendTest-2006658009 None] Acquiring lock "cinder-quobyte-15535945-5405-4da5-80c7-9488e3fb4bd8" by "_delete_snapshot" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:41:30 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-471c0452-17ba-4056-aac8-b9fb8c43c158 tempest-VolumesExtendTest-2006658009 None] Lock "cinder-quobyte-15535945-5405-4da5-80c7-9488e3fb4bd8" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:41:30 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-471c0452-17ba-4056-aac8-b9fb8c43c158 tempest-VolumesExtendTest-2006658009 None] Deleting offline snapshot 15535945-5405-4da5-80c7-9488e3fb4bd8 of volume 7ad3750f-abeb-49c7-bd97-609cbf3fd1d3 {{(pid=87329) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 06 06:41:30 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-471c0452-17ba-4056-aac8-b9fb8c43c158 tempest-VolumesExtendTest-2006658009 None] snapshot_file for this snap is: volume-7ad3750f-abeb-49c7-bd97-609cbf3fd1d3.15535945-5405-4da5-80c7-9488e3fb4bd8 {{(pid=87329) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 06 06:41:30 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[940325b3-7948-496b-9b89-67990f5814e0]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:41:30 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-471c0452-17ba-4056-aac8-b9fb8c43c158 tempest-VolumesExtendTest-2006658009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-7ad3750f-abeb-49c7-bd97-609cbf3fd1d3.15535945-5405-4da5-80c7-9488e3fb4bd8 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:41:31 devstack sudo[99990]: pam_unix(sudo:session): session closed for user root Sep 06 06:41:31 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-923d1656-a4a3-4e53-8917-93ec8d82b682 tempest-ProjectReaderTests-565185984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-d588615a-2226-46a8-85cb-011118849442" returned: 0 in 0.287s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:41:31 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-923d1656-a4a3-4e53-8917-93ec8d82b682 tempest-ProjectReaderTests-565185984 None] Lock "cinder-quobyte-d588615a-2226-46a8-85cb-011118849442" released by "delete_volume" :: held 0.702s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:41:31 devstack sudo[99992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-7ad3750f-abeb-49c7-bd97-609cbf3fd1d3.15535945-5405-4da5-80c7-9488e3fb4bd8 Sep 06 06:41:31 devstack sudo[99992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:41:31 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-923d1656-a4a3-4e53-8917-93ec8d82b682 tempest-ProjectReaderTests-565185984 None] Created reservations ['f3cf9034-d7d1-4e0c-af76-982f361808b3', '75259076-f5e3-4b85-af25-c33fdd709ebc', '09491bcb-3c81-448f-aa85-eb7d7312bb11', '46e1996f-a134-4b42-b74b-f932fa88d8a3'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:41:31 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-923d1656-a4a3-4e53-8917-93ec8d82b682 tempest-ProjectReaderTests-565185984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:41:31 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-923d1656-a4a3-4e53-8917-93ec8d82b682 tempest-ProjectReaderTests-565185984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:41:31 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-923d1656-a4a3-4e53-8917-93ec8d82b682 tempest-ProjectReaderTests-565185984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:41:31 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-923d1656-a4a3-4e53-8917-93ec8d82b682 tempest-ProjectReaderTests-565185984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:41:31 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-923d1656-a4a3-4e53-8917-93ec8d82b682 tempest-ProjectReaderTests-565185984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:41:31 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-923d1656-a4a3-4e53-8917-93ec8d82b682 tempest-ProjectReaderTests-565185984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:41:31 devstack sudo[99995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:41:31 devstack sudo[99995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:41:31 devstack sudo[99992]: pam_unix(sudo:session): session closed for user root Sep 06 06:41:31 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-471c0452-17ba-4056-aac8-b9fb8c43c158 tempest-VolumesExtendTest-2006658009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-7ad3750f-abeb-49c7-bd97-609cbf3fd1d3.15535945-5405-4da5-80c7-9488e3fb4bd8" returned: 0 in 0.424s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:41:31 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-471c0452-17ba-4056-aac8-b9fb8c43c158 tempest-VolumesExtendTest-2006658009 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ad3750f-abeb-49c7-bd97-609cbf3fd1d3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87329) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 06:41:31 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[c80fe2c4-6aba-449c-bfdd-8ab0682fd0bc]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:41:31 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-471c0452-17ba-4056-aac8-b9fb8c43c158 tempest-VolumesExtendTest-2006658009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-7ad3750f-abeb-49c7-bd97-609cbf3fd1d3 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:41:31 devstack sudo[99995]: pam_unix(sudo:session): session closed for user root Sep 06 06:41:31 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-923d1656-a4a3-4e53-8917-93ec8d82b682 tempest-ProjectReaderTests-565185984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.275s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:41:31 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-923d1656-a4a3-4e53-8917-93ec8d82b682 tempest-ProjectReaderTests-565185984 None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:41:31 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-923d1656-a4a3-4e53-8917-93ec8d82b682 tempest-ProjectReaderTests-565185984 None] Deleted volume successfully. Sep 06 06:41:31 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-923d1656-a4a3-4e53-8917-93ec8d82b682 tempest-ProjectReaderTests-565185984 None] Lock "cinder-d588615a-2226-46a8-85cb-011118849442-delete_volume" released by "delete_volume" :: held 1.232s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:41:31 devstack sudo[100001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-7ad3750f-abeb-49c7-bd97-609cbf3fd1d3 Sep 06 06:41:31 devstack sudo[100001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:41:31 devstack sudo[100001]: pam_unix(sudo:session): session closed for user root Sep 06 06:41:31 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-471c0452-17ba-4056-aac8-b9fb8c43c158 tempest-VolumesExtendTest-2006658009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-7ad3750f-abeb-49c7-bd97-609cbf3fd1d3" returned: 0 in 0.391s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:41:31 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-471c0452-17ba-4056-aac8-b9fb8c43c158 tempest-VolumesExtendTest-2006658009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-7ad3750f-abeb-49c7-bd97-609cbf3fd1d3.15535945-5405-4da5-80c7-9488e3fb4bd8 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:41:31 devstack sudo[100006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-7ad3750f-abeb-49c7-bd97-609cbf3fd1d3.15535945-5405-4da5-80c7-9488e3fb4bd8 Sep 06 06:41:31 devstack sudo[100006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:41:32 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc537d13-0fe7-4667-aeae-7250c193d298 tempest-ProjectReaderTests-565185984 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87329) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 06:41:32 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-bc537d13-0fe7-4667-aeae-7250c193d298 tempest-ProjectReaderTests-565185984 None] Flow 'volume_create_manager' (651de60d-ba7b-4a94-bca7-ba1c748f5115) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:41:32 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-bc537d13-0fe7-4667-aeae-7250c193d298 tempest-ProjectReaderTests-565185984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6f449af-d39a-4338-9912-371b7601d24b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:41:32 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-bc537d13-0fe7-4667-aeae-7250c193d298 tempest-ProjectReaderTests-565185984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6f449af-d39a-4338-9912-371b7601d24b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:41:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-913374280',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa1fd2d8-2d47-40f9-9146-42a74143aa86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='490360e70ad741fcb278afde72a8d371',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:41:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:41:32Z,use_quota=True,user_id='783d3bcc349d4a8781de139829550158',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:41:32 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-bc537d13-0fe7-4667-aeae-7250c193d298 tempest-ProjectReaderTests-565185984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc4a392e-23cf-4386-9db7-7f151cf0c7e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:41:32 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-bc537d13-0fe7-4667-aeae-7250c193d298 tempest-ProjectReaderTests-565185984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc4a392e-23cf-4386-9db7-7f151cf0c7e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:41:32 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-bc537d13-0fe7-4667-aeae-7250c193d298 tempest-ProjectReaderTests-565185984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7da9bcac-b433-44ac-b6bd-119547016541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:41:32 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-bc537d13-0fe7-4667-aeae-7250c193d298 tempest-ProjectReaderTests-565185984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7da9bcac-b433-44ac-b6bd-119547016541) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa1fd2d8-2d47-40f9-9146-42a74143aa86', 'volume_name': 'volume-aa1fd2d8-2d47-40f9-9146-42a74143aa86', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:41:32 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-bc537d13-0fe7-4667-aeae-7250c193d298 tempest-ProjectReaderTests-565185984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3dc56260-26aa-40d8-ad33-0eba895375ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:41:32 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-bc537d13-0fe7-4667-aeae-7250c193d298 tempest-ProjectReaderTests-565185984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3dc56260-26aa-40d8-ad33-0eba895375ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:41:32 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-bc537d13-0fe7-4667-aeae-7250c193d298 tempest-ProjectReaderTests-565185984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b085b4a-7ffa-4002-90d4-8a684e996fec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:41:32 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-bc537d13-0fe7-4667-aeae-7250c193d298 tempest-ProjectReaderTests-565185984 None] Volume aa1fd2d8-2d47-40f9-9146-42a74143aa86: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa1fd2d8-2d47-40f9-9146-42a74143aa86', 'volume_size': 1} Sep 06 06:41:32 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-bc537d13-0fe7-4667-aeae-7250c193d298 tempest-ProjectReaderTests-565185984 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:41:32 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-bc537d13-0fe7-4667-aeae-7250c193d298 tempest-ProjectReaderTests-565185984 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:41:32 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-bc537d13-0fe7-4667-aeae-7250c193d298 tempest-ProjectReaderTests-565185984 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:41:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-913374280',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa1fd2d8-2d47-40f9-9146-42a74143aa86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='490360e70ad741fcb278afde72a8d371',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:41:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:41:32Z,use_quota=True,user_id='783d3bcc349d4a8781de139829550158',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)}" {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 06:41:32 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-bc537d13-0fe7-4667-aeae-7250c193d298 tempest-ProjectReaderTests-565185984 None] Creating volume aa1fd2d8-2d47-40f9-9146-42a74143aa86 {{(pid=87329) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 06:41:32 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-bc537d13-0fe7-4667-aeae-7250c193d298 tempest-ProjectReaderTests-565185984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:41:32 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-bc537d13-0fe7-4667-aeae-7250c193d298 tempest-ProjectReaderTests-565185984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:41:32 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-bc537d13-0fe7-4667-aeae-7250c193d298 tempest-ProjectReaderTests-565185984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:41:32 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-bc537d13-0fe7-4667-aeae-7250c193d298 tempest-ProjectReaderTests-565185984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:41:32 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-bc537d13-0fe7-4667-aeae-7250c193d298 tempest-ProjectReaderTests-565185984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:41:32 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-bc537d13-0fe7-4667-aeae-7250c193d298 tempest-ProjectReaderTests-565185984 None] Selected osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 as target Quobyte volume. {{(pid=87329) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 06:41:32 devstack cinder-volume[87329]: INFO cinder.volume.drivers.remotefs [None req-bc537d13-0fe7-4667-aeae-7250c193d298 tempest-ProjectReaderTests-565185984 None] casted to osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 Sep 06 06:41:32 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-bc537d13-0fe7-4667-aeae-7250c193d298 tempest-ProjectReaderTests-565185984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-aa1fd2d8-2d47-40f9-9146-42a74143aa86 1073741824 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:41:32 devstack sudo[100011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-aa1fd2d8-2d47-40f9-9146-42a74143aa86 1073741824 Sep 06 06:41:32 devstack sudo[100011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:41:32 devstack sudo[100006]: pam_unix(sudo:session): session closed for user root Sep 06 06:41:32 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-471c0452-17ba-4056-aac8-b9fb8c43c158 tempest-VolumesExtendTest-2006658009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-7ad3750f-abeb-49c7-bd97-609cbf3fd1d3.15535945-5405-4da5-80c7-9488e3fb4bd8" returned: 0 in 0.434s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:41:32 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-471c0452-17ba-4056-aac8-b9fb8c43c158 tempest-VolumesExtendTest-2006658009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-7ad3750f-abeb-49c7-bd97-609cbf3fd1d3.15535945-5405-4da5-80c7-9488e3fb4bd8 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:41:32 devstack sudo[100013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-7ad3750f-abeb-49c7-bd97-609cbf3fd1d3.15535945-5405-4da5-80c7-9488e3fb4bd8 Sep 06 06:41:32 devstack sudo[100013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:41:32 devstack sudo[100013]: pam_unix(sudo:session): session closed for user root Sep 06 06:41:32 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-471c0452-17ba-4056-aac8-b9fb8c43c158 tempest-VolumesExtendTest-2006658009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-7ad3750f-abeb-49c7-bd97-609cbf3fd1d3.15535945-5405-4da5-80c7-9488e3fb4bd8" returned: 0 in 0.298s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:41:32 devstack sudo[100011]: pam_unix(sudo:session): session closed for user root Sep 06 06:41:32 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-bc537d13-0fe7-4667-aeae-7250c193d298 tempest-ProjectReaderTests-565185984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-aa1fd2d8-2d47-40f9-9146-42a74143aa86 1073741824" returned: 0 in 0.466s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:41:32 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-471c0452-17ba-4056-aac8-b9fb8c43c158 tempest-VolumesExtendTest-2006658009 None] Lock "cinder-quobyte-15535945-5405-4da5-80c7-9488e3fb4bd8" released by "_delete_snapshot" :: held 1.677s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:41:32 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-471c0452-17ba-4056-aac8-b9fb8c43c158 tempest-VolumesExtendTest-2006658009 None] Lock "cinder-quobyte-7ad3750f-abeb-49c7-bd97-609cbf3fd1d3" released by "delete_snapshot" :: held 1.706s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:41:32 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-bc537d13-0fe7-4667-aeae-7250c193d298 tempest-ProjectReaderTests-565185984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-aa1fd2d8-2d47-40f9-9146-42a74143aa86 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:41:32 devstack sudo[100019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-aa1fd2d8-2d47-40f9-9146-42a74143aa86 Sep 06 06:41:32 devstack sudo[100019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:41:32 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-471c0452-17ba-4056-aac8-b9fb8c43c158 tempest-VolumesExtendTest-2006658009 None] Created reservations ['976a45a0-8292-48b4-beb7-d2996d340d97', 'b7782ac4-716a-4e24-b0b4-4ff2e468e290', '6abc6947-550f-466b-88eb-db864c2d8972', 'bd870d39-663f-4f69-b5ba-22db16fbf4dd'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:41:32 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-471c0452-17ba-4056-aac8-b9fb8c43c158 tempest-VolumesExtendTest-2006658009 None] Delete snapshot completed successfully. Sep 06 06:41:32 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-471c0452-17ba-4056-aac8-b9fb8c43c158 tempest-VolumesExtendTest-2006658009 None] Lock "cinder-15535945-5405-4da5-80c7-9488e3fb4bd8-delete_snapshot" released by "delete_snapshot" :: held 1.899s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:41:32 devstack sudo[100019]: pam_unix(sudo:session): session closed for user root Sep 06 06:41:32 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-bc537d13-0fe7-4667-aeae-7250c193d298 tempest-ProjectReaderTests-565185984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-aa1fd2d8-2d47-40f9-9146-42a74143aa86" returned: 0 in 0.277s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:41:32 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-bc537d13-0fe7-4667-aeae-7250c193d298 tempest-ProjectReaderTests-565185984 None] <== create_volume: return (800ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'} {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 06:41:32 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-bc537d13-0fe7-4667-aeae-7250c193d298 tempest-ProjectReaderTests-565185984 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.804s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:41:32 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-bc537d13-0fe7-4667-aeae-7250c193d298 tempest-ProjectReaderTests-565185984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b085b4a-7ffa-4002-90d4-8a684e996fec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa1fd2d8-2d47-40f9-9146-42a74143aa86', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:41:32 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-bc537d13-0fe7-4667-aeae-7250c193d298 tempest-ProjectReaderTests-565185984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3895395-4204-415f-bfa3-442c2e21b904) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:41:32 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-bc537d13-0fe7-4667-aeae-7250c193d298 tempest-ProjectReaderTests-565185984 None] Volume volume-aa1fd2d8-2d47-40f9-9146-42a74143aa86 (aa1fd2d8-2d47-40f9-9146-42a74143aa86): created successfully Sep 06 06:41:32 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-bc537d13-0fe7-4667-aeae-7250c193d298 tempest-ProjectReaderTests-565185984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3895395-4204-415f-bfa3-442c2e21b904) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:41:32 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-bc537d13-0fe7-4667-aeae-7250c193d298 tempest-ProjectReaderTests-565185984 None] Flow 'volume_create_manager' (651de60d-ba7b-4a94-bca7-ba1c748f5115) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:41:32 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-bc537d13-0fe7-4667-aeae-7250c193d298 tempest-ProjectReaderTests-565185984 None] Created volume successfully. Sep 06 06:41:33 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-fe283627-08f9-418a-b304-3674ef6d93a5 tempest-VolumesExtendTest-2006658009 None] Acquiring lock "cinder-7ad3750f-abeb-49c7-bd97-609cbf3fd1d3-delete_volume" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:41:33 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-fe283627-08f9-418a-b304-3674ef6d93a5 tempest-VolumesExtendTest-2006658009 None] Lock "cinder-7ad3750f-abeb-49c7-bd97-609cbf3fd1d3-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:41:33 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-fe283627-08f9-418a-b304-3674ef6d93a5 tempest-VolumesExtendTest-2006658009 None] Acquiring lock "cinder-quobyte-7ad3750f-abeb-49c7-bd97-609cbf3fd1d3" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:41:33 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-fe283627-08f9-418a-b304-3674ef6d93a5 tempest-VolumesExtendTest-2006658009 None] Lock "cinder-quobyte-7ad3750f-abeb-49c7-bd97-609cbf3fd1d3" acquired by "delete_volume" :: waited 0.021s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:41:33 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[41c94b2b-25f1-4a81-bdb1-dd1b190c0fc9]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:41:33 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-fe283627-08f9-418a-b304-3674ef6d93a5 tempest-VolumesExtendTest-2006658009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-7ad3750f-abeb-49c7-bd97-609cbf3fd1d3 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:41:33 devstack sudo[100022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-7ad3750f-abeb-49c7-bd97-609cbf3fd1d3 Sep 06 06:41:33 devstack sudo[100022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:41:33 devstack sudo[100022]: pam_unix(sudo:session): session closed for user root Sep 06 06:41:33 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-fe283627-08f9-418a-b304-3674ef6d93a5 tempest-VolumesExtendTest-2006658009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-7ad3750f-abeb-49c7-bd97-609cbf3fd1d3" returned: 0 in 0.373s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:41:33 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-fe283627-08f9-418a-b304-3674ef6d93a5 tempest-VolumesExtendTest-2006658009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-7ad3750f-abeb-49c7-bd97-609cbf3fd1d3 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:41:33 devstack sudo[100027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-7ad3750f-abeb-49c7-bd97-609cbf3fd1d3 Sep 06 06:41:33 devstack sudo[100027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:41:33 devstack sudo[100027]: pam_unix(sudo:session): session closed for user root Sep 06 06:41:33 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-fe283627-08f9-418a-b304-3674ef6d93a5 tempest-VolumesExtendTest-2006658009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-7ad3750f-abeb-49c7-bd97-609cbf3fd1d3" returned: 0 in 0.243s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:41:33 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-fe283627-08f9-418a-b304-3674ef6d93a5 tempest-VolumesExtendTest-2006658009 None] Lock "cinder-quobyte-7ad3750f-abeb-49c7-bd97-609cbf3fd1d3" released by "delete_volume" :: held 0.669s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:41:33 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-fe283627-08f9-418a-b304-3674ef6d93a5 tempest-VolumesExtendTest-2006658009 None] Created reservations ['9a574d42-5803-4380-a003-cb3931128923', 'c49d666d-678a-4246-9d78-1e6ad17708eb', '97a1c55c-1398-4df6-850b-4e718dc4c549', '313a742f-3372-4460-8524-5aada6082659'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:41:33 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-fe283627-08f9-418a-b304-3674ef6d93a5 tempest-VolumesExtendTest-2006658009 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:41:33 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-fe283627-08f9-418a-b304-3674ef6d93a5 tempest-VolumesExtendTest-2006658009 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:41:33 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-fe283627-08f9-418a-b304-3674ef6d93a5 tempest-VolumesExtendTest-2006658009 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:41:33 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-fe283627-08f9-418a-b304-3674ef6d93a5 tempest-VolumesExtendTest-2006658009 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:41:33 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-fe283627-08f9-418a-b304-3674ef6d93a5 tempest-VolumesExtendTest-2006658009 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:41:33 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-fe283627-08f9-418a-b304-3674ef6d93a5 tempest-VolumesExtendTest-2006658009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:41:33 devstack sudo[100030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:41:33 devstack sudo[100030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:41:34 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-50f3c858-74ec-4202-b9bc-c3d34482d12d tempest-ProjectReaderTests-565185984 None] Acquiring lock "cinder-aa1fd2d8-2d47-40f9-9146-42a74143aa86-delete_volume" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:41:34 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-50f3c858-74ec-4202-b9bc-c3d34482d12d tempest-ProjectReaderTests-565185984 None] Lock "cinder-aa1fd2d8-2d47-40f9-9146-42a74143aa86-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:41:34 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-50f3c858-74ec-4202-b9bc-c3d34482d12d tempest-ProjectReaderTests-565185984 None] Acquiring lock "cinder-quobyte-aa1fd2d8-2d47-40f9-9146-42a74143aa86" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:41:34 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-50f3c858-74ec-4202-b9bc-c3d34482d12d tempest-ProjectReaderTests-565185984 None] Lock "cinder-quobyte-aa1fd2d8-2d47-40f9-9146-42a74143aa86" acquired by "delete_volume" :: waited 0.037s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:41:34 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4d852b7-d0a9-43f1-a43a-c9bc3b6b6202]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:41:34 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-50f3c858-74ec-4202-b9bc-c3d34482d12d tempest-ProjectReaderTests-565185984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-aa1fd2d8-2d47-40f9-9146-42a74143aa86 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:41:34 devstack sudo[100030]: pam_unix(sudo:session): session closed for user root Sep 06 06:41:34 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-fe283627-08f9-418a-b304-3674ef6d93a5 tempest-VolumesExtendTest-2006658009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.342s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:41:34 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-fe283627-08f9-418a-b304-3674ef6d93a5 tempest-VolumesExtendTest-2006658009 None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:41:34 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-fe283627-08f9-418a-b304-3674ef6d93a5 tempest-VolumesExtendTest-2006658009 None] Deleted volume successfully. Sep 06 06:41:34 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-fe283627-08f9-418a-b304-3674ef6d93a5 tempest-VolumesExtendTest-2006658009 None] Lock "cinder-7ad3750f-abeb-49c7-bd97-609cbf3fd1d3-delete_volume" released by "delete_volume" :: held 1.229s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:41:34 devstack sudo[100033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-aa1fd2d8-2d47-40f9-9146-42a74143aa86 Sep 06 06:41:34 devstack sudo[100033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:41:34 devstack sudo[100033]: pam_unix(sudo:session): session closed for user root Sep 06 06:41:34 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-50f3c858-74ec-4202-b9bc-c3d34482d12d tempest-ProjectReaderTests-565185984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-aa1fd2d8-2d47-40f9-9146-42a74143aa86" returned: 0 in 0.414s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:41:34 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-50f3c858-74ec-4202-b9bc-c3d34482d12d tempest-ProjectReaderTests-565185984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-aa1fd2d8-2d47-40f9-9146-42a74143aa86 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:41:34 devstack sudo[100038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-aa1fd2d8-2d47-40f9-9146-42a74143aa86 Sep 06 06:41:34 devstack sudo[100038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:41:34 devstack sudo[100038]: pam_unix(sudo:session): session closed for user root Sep 06 06:41:34 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-50f3c858-74ec-4202-b9bc-c3d34482d12d tempest-ProjectReaderTests-565185984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-aa1fd2d8-2d47-40f9-9146-42a74143aa86" returned: 0 in 0.280s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:41:34 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-50f3c858-74ec-4202-b9bc-c3d34482d12d tempest-ProjectReaderTests-565185984 None] Lock "cinder-quobyte-aa1fd2d8-2d47-40f9-9146-42a74143aa86" released by "delete_volume" :: held 0.748s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:41:35 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-50f3c858-74ec-4202-b9bc-c3d34482d12d tempest-ProjectReaderTests-565185984 None] Created reservations ['630e3226-c926-487f-aec3-c2d40ad2b740', '780d9d8f-2c37-4a73-bff5-6887dc4422bb', '705dde01-7c79-42e9-add7-593d305836cd', 'edea2034-1daf-4b59-9de9-0e6c88d99c54'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:41:35 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-50f3c858-74ec-4202-b9bc-c3d34482d12d tempest-ProjectReaderTests-565185984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:41:35 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-50f3c858-74ec-4202-b9bc-c3d34482d12d tempest-ProjectReaderTests-565185984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:41:35 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-50f3c858-74ec-4202-b9bc-c3d34482d12d tempest-ProjectReaderTests-565185984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:41:35 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-50f3c858-74ec-4202-b9bc-c3d34482d12d tempest-ProjectReaderTests-565185984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:41:35 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-50f3c858-74ec-4202-b9bc-c3d34482d12d tempest-ProjectReaderTests-565185984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:41:35 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-50f3c858-74ec-4202-b9bc-c3d34482d12d tempest-ProjectReaderTests-565185984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:41:35 devstack sudo[100041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:41:35 devstack sudo[100041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:41:35 devstack sudo[100041]: pam_unix(sudo:session): session closed for user root Sep 06 06:41:35 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-50f3c858-74ec-4202-b9bc-c3d34482d12d tempest-ProjectReaderTests-565185984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.328s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:41:35 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-50f3c858-74ec-4202-b9bc-c3d34482d12d tempest-ProjectReaderTests-565185984 None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:41:35 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-50f3c858-74ec-4202-b9bc-c3d34482d12d tempest-ProjectReaderTests-565185984 None] Deleted volume successfully. Sep 06 06:41:35 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-50f3c858-74ec-4202-b9bc-c3d34482d12d tempest-ProjectReaderTests-565185984 None] Lock "cinder-aa1fd2d8-2d47-40f9-9146-42a74143aa86-delete_volume" released by "delete_volume" :: held 1.355s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:41:35 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-09c82e96-c143-4509-abe8-b76479ca14ae tempest-ProjectReaderTests-565185984 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87329) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 06:41:36 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-09c82e96-c143-4509-abe8-b76479ca14ae tempest-ProjectReaderTests-565185984 None] Flow 'volume_create_manager' (08064213-0318-4fbf-b676-4580d7ff7dba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:41:36 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-09c82e96-c143-4509-abe8-b76479ca14ae tempest-ProjectReaderTests-565185984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4017456b-adad-473e-b0b2-b570a65fa522) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:41:36 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-09c82e96-c143-4509-abe8-b76479ca14ae tempest-ProjectReaderTests-565185984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4017456b-adad-473e-b0b2-b570a65fa522) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:41:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-139934239',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb2f4436-114c-435c-ae77-f6d13b113703,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='490360e70ad741fcb278afde72a8d371',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:41:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:41:36Z,use_quota=True,user_id='783d3bcc349d4a8781de139829550158',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:41:36 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-09c82e96-c143-4509-abe8-b76479ca14ae tempest-ProjectReaderTests-565185984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc7a2df7-7969-4a87-8253-8f07e148b4de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:41:36 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-09c82e96-c143-4509-abe8-b76479ca14ae tempest-ProjectReaderTests-565185984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc7a2df7-7969-4a87-8253-8f07e148b4de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:41:36 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-09c82e96-c143-4509-abe8-b76479ca14ae tempest-ProjectReaderTests-565185984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01c92601-1778-4362-94b4-57758de65979) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:41:36 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-09c82e96-c143-4509-abe8-b76479ca14ae tempest-ProjectReaderTests-565185984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01c92601-1778-4362-94b4-57758de65979) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb2f4436-114c-435c-ae77-f6d13b113703', 'volume_name': 'volume-bb2f4436-114c-435c-ae77-f6d13b113703', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:41:36 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-09c82e96-c143-4509-abe8-b76479ca14ae tempest-ProjectReaderTests-565185984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (677ee70a-4f08-4f12-b475-047b4668f185) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:41:36 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-09c82e96-c143-4509-abe8-b76479ca14ae tempest-ProjectReaderTests-565185984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (677ee70a-4f08-4f12-b475-047b4668f185) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:41:36 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-09c82e96-c143-4509-abe8-b76479ca14ae tempest-ProjectReaderTests-565185984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aba9c508-0498-401b-b1a1-cf965e0907fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:41:36 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-09c82e96-c143-4509-abe8-b76479ca14ae tempest-ProjectReaderTests-565185984 None] Volume bb2f4436-114c-435c-ae77-f6d13b113703: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb2f4436-114c-435c-ae77-f6d13b113703', 'volume_size': 1} Sep 06 06:41:36 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-09c82e96-c143-4509-abe8-b76479ca14ae tempest-ProjectReaderTests-565185984 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:41:36 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-09c82e96-c143-4509-abe8-b76479ca14ae tempest-ProjectReaderTests-565185984 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:41:36 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-09c82e96-c143-4509-abe8-b76479ca14ae tempest-ProjectReaderTests-565185984 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:41:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-139934239',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb2f4436-114c-435c-ae77-f6d13b113703,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='490360e70ad741fcb278afde72a8d371',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:41:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:41:36Z,use_quota=True,user_id='783d3bcc349d4a8781de139829550158',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)}" {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 06:41:36 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-09c82e96-c143-4509-abe8-b76479ca14ae tempest-ProjectReaderTests-565185984 None] Creating volume bb2f4436-114c-435c-ae77-f6d13b113703 {{(pid=87329) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 06:41:36 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-09c82e96-c143-4509-abe8-b76479ca14ae tempest-ProjectReaderTests-565185984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:41:36 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-09c82e96-c143-4509-abe8-b76479ca14ae tempest-ProjectReaderTests-565185984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:41:36 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-09c82e96-c143-4509-abe8-b76479ca14ae tempest-ProjectReaderTests-565185984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:41:36 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-09c82e96-c143-4509-abe8-b76479ca14ae tempest-ProjectReaderTests-565185984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:41:36 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-09c82e96-c143-4509-abe8-b76479ca14ae tempest-ProjectReaderTests-565185984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:41:36 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-09c82e96-c143-4509-abe8-b76479ca14ae tempest-ProjectReaderTests-565185984 None] Selected osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 as target Quobyte volume. {{(pid=87329) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 06:41:36 devstack cinder-volume[87329]: INFO cinder.volume.drivers.remotefs [None req-09c82e96-c143-4509-abe8-b76479ca14ae tempest-ProjectReaderTests-565185984 None] casted to osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 Sep 06 06:41:36 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-09c82e96-c143-4509-abe8-b76479ca14ae tempest-ProjectReaderTests-565185984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bb2f4436-114c-435c-ae77-f6d13b113703 1073741824 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:41:36 devstack sudo[100045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bb2f4436-114c-435c-ae77-f6d13b113703 1073741824 Sep 06 06:41:36 devstack sudo[100045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:41:36 devstack sudo[100045]: pam_unix(sudo:session): session closed for user root Sep 06 06:41:36 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-09c82e96-c143-4509-abe8-b76479ca14ae tempest-ProjectReaderTests-565185984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bb2f4436-114c-435c-ae77-f6d13b113703 1073741824" returned: 0 in 0.494s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:41:36 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-09c82e96-c143-4509-abe8-b76479ca14ae tempest-ProjectReaderTests-565185984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bb2f4436-114c-435c-ae77-f6d13b113703 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:41:36 devstack sudo[100051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bb2f4436-114c-435c-ae77-f6d13b113703 Sep 06 06:41:36 devstack sudo[100051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:41:36 devstack sudo[100051]: pam_unix(sudo:session): session closed for user root Sep 06 06:41:36 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-09c82e96-c143-4509-abe8-b76479ca14ae tempest-ProjectReaderTests-565185984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bb2f4436-114c-435c-ae77-f6d13b113703" returned: 0 in 0.276s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:41:36 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-09c82e96-c143-4509-abe8-b76479ca14ae tempest-ProjectReaderTests-565185984 None] <== create_volume: return (824ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'} {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 06:41:36 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-09c82e96-c143-4509-abe8-b76479ca14ae tempest-ProjectReaderTests-565185984 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.828s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:41:36 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-09c82e96-c143-4509-abe8-b76479ca14ae tempest-ProjectReaderTests-565185984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aba9c508-0498-401b-b1a1-cf965e0907fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb2f4436-114c-435c-ae77-f6d13b113703', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:41:36 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-09c82e96-c143-4509-abe8-b76479ca14ae tempest-ProjectReaderTests-565185984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b54aa9c-d586-41fa-8904-87ceeafa0296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:41:36 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-09c82e96-c143-4509-abe8-b76479ca14ae tempest-ProjectReaderTests-565185984 None] Volume volume-bb2f4436-114c-435c-ae77-f6d13b113703 (bb2f4436-114c-435c-ae77-f6d13b113703): created successfully Sep 06 06:41:36 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-09c82e96-c143-4509-abe8-b76479ca14ae tempest-ProjectReaderTests-565185984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b54aa9c-d586-41fa-8904-87ceeafa0296) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:41:36 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-09c82e96-c143-4509-abe8-b76479ca14ae tempest-ProjectReaderTests-565185984 None] Flow 'volume_create_manager' (08064213-0318-4fbf-b676-4580d7ff7dba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:41:36 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-09c82e96-c143-4509-abe8-b76479ca14ae tempest-ProjectReaderTests-565185984 None] Created volume successfully. Sep 06 06:41:38 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-11a2b546-2c3d-42d7-8c7c-de37157943f1 tempest-ProjectReaderTests-565185984 None] Acquiring lock "cinder-bb2f4436-114c-435c-ae77-f6d13b113703-delete_volume" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:41:38 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-11a2b546-2c3d-42d7-8c7c-de37157943f1 tempest-ProjectReaderTests-565185984 None] Lock "cinder-bb2f4436-114c-435c-ae77-f6d13b113703-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:41:38 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-11a2b546-2c3d-42d7-8c7c-de37157943f1 tempest-ProjectReaderTests-565185984 None] Acquiring lock "cinder-quobyte-bb2f4436-114c-435c-ae77-f6d13b113703" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:41:38 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-11a2b546-2c3d-42d7-8c7c-de37157943f1 tempest-ProjectReaderTests-565185984 None] Lock "cinder-quobyte-bb2f4436-114c-435c-ae77-f6d13b113703" acquired by "delete_volume" :: waited 0.019s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:41:38 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[c30da5c5-1b0c-4549-867f-be6d5f065b25]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:41:38 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-11a2b546-2c3d-42d7-8c7c-de37157943f1 tempest-ProjectReaderTests-565185984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bb2f4436-114c-435c-ae77-f6d13b113703 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:41:38 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac8b1866-54a2-49b0-8071-806d8df358ca tempest-VolumesGetTest-752433910 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87329) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 06:41:38 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-ac8b1866-54a2-49b0-8071-806d8df358ca tempest-VolumesGetTest-752433910 None] Flow 'volume_create_manager' (991fc381-027b-440e-a039-5b69c031ca96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:41:38 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-ac8b1866-54a2-49b0-8071-806d8df358ca tempest-VolumesGetTest-752433910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b17d8133-6224-48f7-b9f8-d8698ba7df9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:41:38 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-ac8b1866-54a2-49b0-8071-806d8df358ca tempest-VolumesGetTest-752433910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b17d8133-6224-48f7-b9f8-d8698ba7df9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:41:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2062524047',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=164873a1-6c12-40a9-b7de-38e669bb78c0,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='c90d8f93af0e4316b970f01878855707',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:41:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:41:38Z,use_quota=True,user_id='b403002bde0446738f1c0ea9206318e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:41:38 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-ac8b1866-54a2-49b0-8071-806d8df358ca tempest-VolumesGetTest-752433910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (611e9584-aa69-4ea2-aa22-ab4fa2c231be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:41:38 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-ac8b1866-54a2-49b0-8071-806d8df358ca tempest-VolumesGetTest-752433910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (611e9584-aa69-4ea2-aa22-ab4fa2c231be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:41:38 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-ac8b1866-54a2-49b0-8071-806d8df358ca tempest-VolumesGetTest-752433910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a5d4972-ac66-4e03-89c1-03333eaba1db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:41:38 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-ac8b1866-54a2-49b0-8071-806d8df358ca tempest-VolumesGetTest-752433910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a5d4972-ac66-4e03-89c1-03333eaba1db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '164873a1-6c12-40a9-b7de-38e669bb78c0', 'volume_name': 'volume-164873a1-6c12-40a9-b7de-38e669bb78c0', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:41:38 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-ac8b1866-54a2-49b0-8071-806d8df358ca tempest-VolumesGetTest-752433910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ca35121-130f-47de-94e1-b07428217dfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:41:38 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-ac8b1866-54a2-49b0-8071-806d8df358ca tempest-VolumesGetTest-752433910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ca35121-130f-47de-94e1-b07428217dfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:41:38 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-ac8b1866-54a2-49b0-8071-806d8df358ca tempest-VolumesGetTest-752433910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f5ed0c8-614c-4427-a3c9-4e5e00a80cf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:41:38 devstack sudo[100064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bb2f4436-114c-435c-ae77-f6d13b113703 Sep 06 06:41:38 devstack sudo[100064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:41:38 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-ac8b1866-54a2-49b0-8071-806d8df358ca tempest-VolumesGetTest-752433910 None] Volume 164873a1-6c12-40a9-b7de-38e669bb78c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-164873a1-6c12-40a9-b7de-38e669bb78c0', 'volume_size': 1} Sep 06 06:41:38 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-ac8b1866-54a2-49b0-8071-806d8df358ca tempest-VolumesGetTest-752433910 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:41:38 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-ac8b1866-54a2-49b0-8071-806d8df358ca tempest-VolumesGetTest-752433910 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:41:38 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-ac8b1866-54a2-49b0-8071-806d8df358ca tempest-VolumesGetTest-752433910 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:41:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2062524047',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=164873a1-6c12-40a9-b7de-38e669bb78c0,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='c90d8f93af0e4316b970f01878855707',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:41:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:41:38Z,use_quota=True,user_id='b403002bde0446738f1c0ea9206318e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)}" {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 06:41:38 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-ac8b1866-54a2-49b0-8071-806d8df358ca tempest-VolumesGetTest-752433910 None] Creating volume 164873a1-6c12-40a9-b7de-38e669bb78c0 {{(pid=87329) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 06:41:38 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-ac8b1866-54a2-49b0-8071-806d8df358ca tempest-VolumesGetTest-752433910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:41:38 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-ac8b1866-54a2-49b0-8071-806d8df358ca tempest-VolumesGetTest-752433910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:41:38 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-ac8b1866-54a2-49b0-8071-806d8df358ca tempest-VolumesGetTest-752433910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:41:38 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-ac8b1866-54a2-49b0-8071-806d8df358ca tempest-VolumesGetTest-752433910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:41:38 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-ac8b1866-54a2-49b0-8071-806d8df358ca tempest-VolumesGetTest-752433910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:41:38 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-ac8b1866-54a2-49b0-8071-806d8df358ca tempest-VolumesGetTest-752433910 None] Selected osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 as target Quobyte volume. {{(pid=87329) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 06:41:38 devstack cinder-volume[87329]: INFO cinder.volume.drivers.remotefs [None req-ac8b1866-54a2-49b0-8071-806d8df358ca tempest-VolumesGetTest-752433910 None] casted to osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 Sep 06 06:41:38 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-ac8b1866-54a2-49b0-8071-806d8df358ca tempest-VolumesGetTest-752433910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-164873a1-6c12-40a9-b7de-38e669bb78c0 1073741824 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:41:38 devstack sudo[100066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-164873a1-6c12-40a9-b7de-38e669bb78c0 1073741824 Sep 06 06:41:38 devstack sudo[100066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:41:38 devstack sudo[100064]: pam_unix(sudo:session): session closed for user root Sep 06 06:41:38 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-11a2b546-2c3d-42d7-8c7c-de37157943f1 tempest-ProjectReaderTests-565185984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bb2f4436-114c-435c-ae77-f6d13b113703" returned: 0 in 0.388s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:41:38 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-11a2b546-2c3d-42d7-8c7c-de37157943f1 tempest-ProjectReaderTests-565185984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bb2f4436-114c-435c-ae77-f6d13b113703 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:41:38 devstack sudo[100074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bb2f4436-114c-435c-ae77-f6d13b113703 Sep 06 06:41:38 devstack sudo[100074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:41:38 devstack sudo[100066]: pam_unix(sudo:session): session closed for user root Sep 06 06:41:38 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-ac8b1866-54a2-49b0-8071-806d8df358ca tempest-VolumesGetTest-752433910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-164873a1-6c12-40a9-b7de-38e669bb78c0 1073741824" returned: 0 in 0.423s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:41:38 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-ac8b1866-54a2-49b0-8071-806d8df358ca tempest-VolumesGetTest-752433910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-164873a1-6c12-40a9-b7de-38e669bb78c0 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:41:38 devstack sudo[100076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-164873a1-6c12-40a9-b7de-38e669bb78c0 Sep 06 06:41:38 devstack sudo[100076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:41:38 devstack sudo[100074]: pam_unix(sudo:session): session closed for user root Sep 06 06:41:38 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-11a2b546-2c3d-42d7-8c7c-de37157943f1 tempest-ProjectReaderTests-565185984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bb2f4436-114c-435c-ae77-f6d13b113703" returned: 0 in 0.259s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:41:38 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-11a2b546-2c3d-42d7-8c7c-de37157943f1 tempest-ProjectReaderTests-565185984 None] Lock "cinder-quobyte-bb2f4436-114c-435c-ae77-f6d13b113703" released by "delete_volume" :: held 0.686s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:41:38 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-11a2b546-2c3d-42d7-8c7c-de37157943f1 tempest-ProjectReaderTests-565185984 None] Created reservations ['cddf166e-bae7-4a6b-933f-26d14007ff44', 'f151f112-2f52-436b-8bb5-6aaf399ea2c4', '479b0140-73d5-4423-bfa4-dc8607091540', '3a236150-a1f6-479a-93ba-b4cf84e8f5dc'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:41:38 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-11a2b546-2c3d-42d7-8c7c-de37157943f1 tempest-ProjectReaderTests-565185984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:41:38 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-11a2b546-2c3d-42d7-8c7c-de37157943f1 tempest-ProjectReaderTests-565185984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:41:38 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-11a2b546-2c3d-42d7-8c7c-de37157943f1 tempest-ProjectReaderTests-565185984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:41:39 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-11a2b546-2c3d-42d7-8c7c-de37157943f1 tempest-ProjectReaderTests-565185984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:41:39 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-11a2b546-2c3d-42d7-8c7c-de37157943f1 tempest-ProjectReaderTests-565185984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:41:39 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-11a2b546-2c3d-42d7-8c7c-de37157943f1 tempest-ProjectReaderTests-565185984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:41:39 devstack sudo[100114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:41:39 devstack sudo[100114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:41:39 devstack sudo[100076]: pam_unix(sudo:session): session closed for user root Sep 06 06:41:39 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-ac8b1866-54a2-49b0-8071-806d8df358ca tempest-VolumesGetTest-752433910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-164873a1-6c12-40a9-b7de-38e669bb78c0" returned: 0 in 0.247s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:41:39 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-ac8b1866-54a2-49b0-8071-806d8df358ca tempest-VolumesGetTest-752433910 None] <== create_volume: return (712ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'} {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 06:41:39 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-ac8b1866-54a2-49b0-8071-806d8df358ca tempest-VolumesGetTest-752433910 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.714s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:41:39 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-ac8b1866-54a2-49b0-8071-806d8df358ca tempest-VolumesGetTest-752433910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f5ed0c8-614c-4427-a3c9-4e5e00a80cf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-164873a1-6c12-40a9-b7de-38e669bb78c0', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:41:39 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-ac8b1866-54a2-49b0-8071-806d8df358ca tempest-VolumesGetTest-752433910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38d889fd-a33b-41a4-a89b-2360aa9a3e81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:41:39 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-ac8b1866-54a2-49b0-8071-806d8df358ca tempest-VolumesGetTest-752433910 None] Volume volume-164873a1-6c12-40a9-b7de-38e669bb78c0 (164873a1-6c12-40a9-b7de-38e669bb78c0): created successfully Sep 06 06:41:39 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-ac8b1866-54a2-49b0-8071-806d8df358ca tempest-VolumesGetTest-752433910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38d889fd-a33b-41a4-a89b-2360aa9a3e81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:41:39 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-ac8b1866-54a2-49b0-8071-806d8df358ca tempest-VolumesGetTest-752433910 None] Flow 'volume_create_manager' (991fc381-027b-440e-a039-5b69c031ca96) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:41:39 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-ac8b1866-54a2-49b0-8071-806d8df358ca tempest-VolumesGetTest-752433910 None] Created volume successfully. Sep 06 06:41:39 devstack sudo[100114]: pam_unix(sudo:session): session closed for user root Sep 06 06:41:39 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-11a2b546-2c3d-42d7-8c7c-de37157943f1 tempest-ProjectReaderTests-565185984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.284s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:41:39 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-11a2b546-2c3d-42d7-8c7c-de37157943f1 tempest-ProjectReaderTests-565185984 None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:41:39 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-11a2b546-2c3d-42d7-8c7c-de37157943f1 tempest-ProjectReaderTests-565185984 None] Deleted volume successfully. Sep 06 06:41:39 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-11a2b546-2c3d-42d7-8c7c-de37157943f1 tempest-ProjectReaderTests-565185984 None] Lock "cinder-bb2f4436-114c-435c-ae77-f6d13b113703-delete_volume" released by "delete_volume" :: held 1.211s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:41:40 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d9bfcb7-f150-4af5-bdba-d48beafe5297 tempest-VolumesGetTest-752433910 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87329) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 06:41:40 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-6d9bfcb7-f150-4af5-bdba-d48beafe5297 tempest-VolumesGetTest-752433910 None] Flow 'volume_create_manager' (76a7be48-bb8e-453e-b49c-e478e04e0c5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:41:40 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-6d9bfcb7-f150-4af5-bdba-d48beafe5297 tempest-VolumesGetTest-752433910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a43ed415-11dc-46cf-b813-d0dd890a2f88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:41:40 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-6d9bfcb7-f150-4af5-bdba-d48beafe5297 tempest-VolumesGetTest-752433910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a43ed415-11dc-46cf-b813-d0dd890a2f88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:41:40Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1653720080',display_name='tempest-VolumesGetTest-Volume-46395612',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=daf8904d-f96f-45e9-a7ff-6e7c4169b54c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c90d8f93af0e4316b970f01878855707',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:41:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:41:40Z,use_quota=True,user_id='b403002bde0446738f1c0ea9206318e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:41:40 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-6d9bfcb7-f150-4af5-bdba-d48beafe5297 tempest-VolumesGetTest-752433910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de5ccb33-9b5f-4bf4-b7d4-58b1b22cbed1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:41:40 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-6d9bfcb7-f150-4af5-bdba-d48beafe5297 tempest-VolumesGetTest-752433910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de5ccb33-9b5f-4bf4-b7d4-58b1b22cbed1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:41:40 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-6d9bfcb7-f150-4af5-bdba-d48beafe5297 tempest-VolumesGetTest-752433910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4d49e78-1df6-488b-b096-c930a71e5ab2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:41:40 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-6d9bfcb7-f150-4af5-bdba-d48beafe5297 tempest-VolumesGetTest-752433910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4d49e78-1df6-488b-b096-c930a71e5ab2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'daf8904d-f96f-45e9-a7ff-6e7c4169b54c', 'volume_name': 'volume-daf8904d-f96f-45e9-a7ff-6e7c4169b54c', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:41:40 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-6d9bfcb7-f150-4af5-bdba-d48beafe5297 tempest-VolumesGetTest-752433910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ed990fa-f79c-4171-bfc6-1ee59815daa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:41:40 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-6d9bfcb7-f150-4af5-bdba-d48beafe5297 tempest-VolumesGetTest-752433910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ed990fa-f79c-4171-bfc6-1ee59815daa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:41:40 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-6d9bfcb7-f150-4af5-bdba-d48beafe5297 tempest-VolumesGetTest-752433910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b9ea965-ccee-4590-9353-d18b037b1930) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:41:40 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-6d9bfcb7-f150-4af5-bdba-d48beafe5297 tempest-VolumesGetTest-752433910 None] Volume daf8904d-f96f-45e9-a7ff-6e7c4169b54c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-daf8904d-f96f-45e9-a7ff-6e7c4169b54c', 'volume_size': 1} Sep 06 06:41:40 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-6d9bfcb7-f150-4af5-bdba-d48beafe5297 tempest-VolumesGetTest-752433910 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:41:40 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-6d9bfcb7-f150-4af5-bdba-d48beafe5297 tempest-VolumesGetTest-752433910 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:41:40 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-6d9bfcb7-f150-4af5-bdba-d48beafe5297 tempest-VolumesGetTest-752433910 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:41:40Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1653720080',display_name='tempest-VolumesGetTest-Volume-46395612',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=daf8904d-f96f-45e9-a7ff-6e7c4169b54c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c90d8f93af0e4316b970f01878855707',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:41:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:41:40Z,use_quota=True,user_id='b403002bde0446738f1c0ea9206318e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)}" {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 06:41:40 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-6d9bfcb7-f150-4af5-bdba-d48beafe5297 tempest-VolumesGetTest-752433910 None] Creating volume daf8904d-f96f-45e9-a7ff-6e7c4169b54c {{(pid=87329) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 06:41:40 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-6d9bfcb7-f150-4af5-bdba-d48beafe5297 tempest-VolumesGetTest-752433910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:41:40 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-6d9bfcb7-f150-4af5-bdba-d48beafe5297 tempest-VolumesGetTest-752433910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:41:40 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-6d9bfcb7-f150-4af5-bdba-d48beafe5297 tempest-VolumesGetTest-752433910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:41:40 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-6d9bfcb7-f150-4af5-bdba-d48beafe5297 tempest-VolumesGetTest-752433910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:41:40 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-6d9bfcb7-f150-4af5-bdba-d48beafe5297 tempest-VolumesGetTest-752433910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:41:40 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-6d9bfcb7-f150-4af5-bdba-d48beafe5297 tempest-VolumesGetTest-752433910 None] Selected osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 as target Quobyte volume. {{(pid=87329) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 06:41:40 devstack cinder-volume[87329]: INFO cinder.volume.drivers.remotefs [None req-6d9bfcb7-f150-4af5-bdba-d48beafe5297 tempest-VolumesGetTest-752433910 None] casted to osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 Sep 06 06:41:40 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-6d9bfcb7-f150-4af5-bdba-d48beafe5297 tempest-VolumesGetTest-752433910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-daf8904d-f96f-45e9-a7ff-6e7c4169b54c 1073741824 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:41:40 devstack sudo[100120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-daf8904d-f96f-45e9-a7ff-6e7c4169b54c 1073741824 Sep 06 06:41:40 devstack sudo[100120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:41:40 devstack sudo[100120]: pam_unix(sudo:session): session closed for user root Sep 06 06:41:40 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-6d9bfcb7-f150-4af5-bdba-d48beafe5297 tempest-VolumesGetTest-752433910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-daf8904d-f96f-45e9-a7ff-6e7c4169b54c 1073741824" returned: 0 in 0.442s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:41:40 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-6d9bfcb7-f150-4af5-bdba-d48beafe5297 tempest-VolumesGetTest-752433910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-daf8904d-f96f-45e9-a7ff-6e7c4169b54c {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:41:40 devstack sudo[100126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-daf8904d-f96f-45e9-a7ff-6e7c4169b54c Sep 06 06:41:40 devstack sudo[100126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:41:40 devstack sudo[100126]: pam_unix(sudo:session): session closed for user root Sep 06 06:41:40 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-6d9bfcb7-f150-4af5-bdba-d48beafe5297 tempest-VolumesGetTest-752433910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-daf8904d-f96f-45e9-a7ff-6e7c4169b54c" returned: 0 in 0.276s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:41:40 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-6d9bfcb7-f150-4af5-bdba-d48beafe5297 tempest-VolumesGetTest-752433910 None] <== create_volume: return (762ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'} {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 06:41:40 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-6d9bfcb7-f150-4af5-bdba-d48beafe5297 tempest-VolumesGetTest-752433910 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.764s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:41:40 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-6d9bfcb7-f150-4af5-bdba-d48beafe5297 tempest-VolumesGetTest-752433910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b9ea965-ccee-4590-9353-d18b037b1930) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-daf8904d-f96f-45e9-a7ff-6e7c4169b54c', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:41:40 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-6d9bfcb7-f150-4af5-bdba-d48beafe5297 tempest-VolumesGetTest-752433910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (680475a8-7b68-426e-8be5-ef2910b3e64f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:41:40 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-6d9bfcb7-f150-4af5-bdba-d48beafe5297 tempest-VolumesGetTest-752433910 None] Volume volume-daf8904d-f96f-45e9-a7ff-6e7c4169b54c (daf8904d-f96f-45e9-a7ff-6e7c4169b54c): created successfully Sep 06 06:41:40 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-6d9bfcb7-f150-4af5-bdba-d48beafe5297 tempest-VolumesGetTest-752433910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (680475a8-7b68-426e-8be5-ef2910b3e64f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:41:40 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-6d9bfcb7-f150-4af5-bdba-d48beafe5297 tempest-VolumesGetTest-752433910 None] Flow 'volume_create_manager' (76a7be48-bb8e-453e-b49c-e478e04e0c5b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:41:40 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-6d9bfcb7-f150-4af5-bdba-d48beafe5297 tempest-VolumesGetTest-752433910 None] Created volume successfully. Sep 06 06:41:41 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-c4e84dca-5617-4f2a-bbb9-668f203df9e8 tempest-VolumesGetTest-752433910 None] Acquiring lock "cinder-daf8904d-f96f-45e9-a7ff-6e7c4169b54c-delete_volume" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:41:41 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-c4e84dca-5617-4f2a-bbb9-668f203df9e8 tempest-VolumesGetTest-752433910 None] Lock "cinder-daf8904d-f96f-45e9-a7ff-6e7c4169b54c-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:41:41 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-c4e84dca-5617-4f2a-bbb9-668f203df9e8 tempest-VolumesGetTest-752433910 None] Acquiring lock "cinder-quobyte-daf8904d-f96f-45e9-a7ff-6e7c4169b54c" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:41:41 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-c4e84dca-5617-4f2a-bbb9-668f203df9e8 tempest-VolumesGetTest-752433910 None] Lock "cinder-quobyte-daf8904d-f96f-45e9-a7ff-6e7c4169b54c" acquired by "delete_volume" :: waited 0.015s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:41:41 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[33cbc366-9116-477a-896e-5fa8a79895ab]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:41:41 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-c4e84dca-5617-4f2a-bbb9-668f203df9e8 tempest-VolumesGetTest-752433910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-daf8904d-f96f-45e9-a7ff-6e7c4169b54c {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:41:41 devstack sudo[100129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-daf8904d-f96f-45e9-a7ff-6e7c4169b54c Sep 06 06:41:41 devstack sudo[100129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:41:41 devstack sudo[100129]: pam_unix(sudo:session): session closed for user root Sep 06 06:41:41 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-c4e84dca-5617-4f2a-bbb9-668f203df9e8 tempest-VolumesGetTest-752433910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-daf8904d-f96f-45e9-a7ff-6e7c4169b54c" returned: 0 in 0.361s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:41:41 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-c4e84dca-5617-4f2a-bbb9-668f203df9e8 tempest-VolumesGetTest-752433910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-daf8904d-f96f-45e9-a7ff-6e7c4169b54c {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:41:41 devstack sudo[100134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-daf8904d-f96f-45e9-a7ff-6e7c4169b54c Sep 06 06:41:41 devstack sudo[100134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:41:41 devstack sudo[100134]: pam_unix(sudo:session): session closed for user root Sep 06 06:41:41 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-c4e84dca-5617-4f2a-bbb9-668f203df9e8 tempest-VolumesGetTest-752433910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-daf8904d-f96f-45e9-a7ff-6e7c4169b54c" returned: 0 in 0.245s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:41:41 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-c4e84dca-5617-4f2a-bbb9-668f203df9e8 tempest-VolumesGetTest-752433910 None] Lock "cinder-quobyte-daf8904d-f96f-45e9-a7ff-6e7c4169b54c" released by "delete_volume" :: held 0.643s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:41:41 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-c4e84dca-5617-4f2a-bbb9-668f203df9e8 tempest-VolumesGetTest-752433910 None] Created reservations ['a87280ef-ec4d-4ac5-b4ec-e1c478426791', '730f335b-a02c-441f-abe2-2d9f9b3a0c1a', 'dc6a4a7b-21e9-4bf2-8a81-323c15d5c8de', '97077929-8864-4026-a1b8-7d26524fe002'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:41:42 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-c4e84dca-5617-4f2a-bbb9-668f203df9e8 tempest-VolumesGetTest-752433910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:41:42 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-c4e84dca-5617-4f2a-bbb9-668f203df9e8 tempest-VolumesGetTest-752433910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:41:42 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-c4e84dca-5617-4f2a-bbb9-668f203df9e8 tempest-VolumesGetTest-752433910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:41:42 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-c4e84dca-5617-4f2a-bbb9-668f203df9e8 tempest-VolumesGetTest-752433910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:41:42 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-c4e84dca-5617-4f2a-bbb9-668f203df9e8 tempest-VolumesGetTest-752433910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:41:42 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-c4e84dca-5617-4f2a-bbb9-668f203df9e8 tempest-VolumesGetTest-752433910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:41:42 devstack sudo[100161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:41:42 devstack sudo[100161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:41:42 devstack sudo[100161]: pam_unix(sudo:session): session closed for user root Sep 06 06:41:42 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-c4e84dca-5617-4f2a-bbb9-668f203df9e8 tempest-VolumesGetTest-752433910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.248s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:41:42 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-c4e84dca-5617-4f2a-bbb9-668f203df9e8 tempest-VolumesGetTest-752433910 None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:41:42 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-c4e84dca-5617-4f2a-bbb9-668f203df9e8 tempest-VolumesGetTest-752433910 None] Deleted volume successfully. Sep 06 06:41:42 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-c4e84dca-5617-4f2a-bbb9-668f203df9e8 tempest-VolumesGetTest-752433910 None] Lock "cinder-daf8904d-f96f-45e9-a7ff-6e7c4169b54c-delete_volume" released by "delete_volume" :: held 1.105s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:41:42 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-56bb84e0-84bd-4ccc-abc9-538f86443f38 tempest-VolumesGetTest-752433910 None] Acquiring lock "cinder-164873a1-6c12-40a9-b7de-38e669bb78c0-delete_volume" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:41:42 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-56bb84e0-84bd-4ccc-abc9-538f86443f38 tempest-VolumesGetTest-752433910 None] Lock "cinder-164873a1-6c12-40a9-b7de-38e669bb78c0-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:41:42 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-56bb84e0-84bd-4ccc-abc9-538f86443f38 tempest-VolumesGetTest-752433910 None] Acquiring lock "cinder-quobyte-164873a1-6c12-40a9-b7de-38e669bb78c0" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:41:42 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-56bb84e0-84bd-4ccc-abc9-538f86443f38 tempest-VolumesGetTest-752433910 None] Lock "cinder-quobyte-164873a1-6c12-40a9-b7de-38e669bb78c0" acquired by "delete_volume" :: waited 0.022s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:41:42 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6d3366f-47bb-46a2-a50e-afef3a8c7f87]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:41:42 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-56bb84e0-84bd-4ccc-abc9-538f86443f38 tempest-VolumesGetTest-752433910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-164873a1-6c12-40a9-b7de-38e669bb78c0 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:41:42 devstack sudo[100164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-164873a1-6c12-40a9-b7de-38e669bb78c0 Sep 06 06:41:42 devstack sudo[100164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:41:42 devstack sudo[100164]: pam_unix(sudo:session): session closed for user root Sep 06 06:41:42 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-56bb84e0-84bd-4ccc-abc9-538f86443f38 tempest-VolumesGetTest-752433910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-164873a1-6c12-40a9-b7de-38e669bb78c0" returned: 0 in 0.410s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:41:42 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-56bb84e0-84bd-4ccc-abc9-538f86443f38 tempest-VolumesGetTest-752433910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-164873a1-6c12-40a9-b7de-38e669bb78c0 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:41:42 devstack sudo[100169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-164873a1-6c12-40a9-b7de-38e669bb78c0 Sep 06 06:41:42 devstack sudo[100169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:41:43 devstack sudo[100169]: pam_unix(sudo:session): session closed for user root Sep 06 06:41:43 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-56bb84e0-84bd-4ccc-abc9-538f86443f38 tempest-VolumesGetTest-752433910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-164873a1-6c12-40a9-b7de-38e669bb78c0" returned: 0 in 0.248s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:41:43 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-56bb84e0-84bd-4ccc-abc9-538f86443f38 tempest-VolumesGetTest-752433910 None] Lock "cinder-quobyte-164873a1-6c12-40a9-b7de-38e669bb78c0" released by "delete_volume" :: held 0.697s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:41:43 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-56bb84e0-84bd-4ccc-abc9-538f86443f38 tempest-VolumesGetTest-752433910 None] Created reservations ['e644d38d-7e0a-40b0-a863-6c4f1f95dbfe', '31f8da46-eb3b-4deb-a77a-28108db2e4af', '81996057-5bf9-4bcb-ab53-34e70eaa2bbc', 'a4117705-55fc-4554-8e75-a8c69ea718be'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:41:43 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-56bb84e0-84bd-4ccc-abc9-538f86443f38 tempest-VolumesGetTest-752433910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:41:43 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-56bb84e0-84bd-4ccc-abc9-538f86443f38 tempest-VolumesGetTest-752433910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:41:43 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-56bb84e0-84bd-4ccc-abc9-538f86443f38 tempest-VolumesGetTest-752433910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:41:43 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-56bb84e0-84bd-4ccc-abc9-538f86443f38 tempest-VolumesGetTest-752433910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:41:43 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-56bb84e0-84bd-4ccc-abc9-538f86443f38 tempest-VolumesGetTest-752433910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:41:43 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-56bb84e0-84bd-4ccc-abc9-538f86443f38 tempest-VolumesGetTest-752433910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:41:43 devstack sudo[100172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:41:43 devstack sudo[100172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:41:43 devstack sudo[100172]: pam_unix(sudo:session): session closed for user root Sep 06 06:41:43 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-56bb84e0-84bd-4ccc-abc9-538f86443f38 tempest-VolumesGetTest-752433910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.315s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:41:43 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-56bb84e0-84bd-4ccc-abc9-538f86443f38 tempest-VolumesGetTest-752433910 None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:41:43 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-56bb84e0-84bd-4ccc-abc9-538f86443f38 tempest-VolumesGetTest-752433910 None] Deleted volume successfully. Sep 06 06:41:43 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-56bb84e0-84bd-4ccc-abc9-538f86443f38 tempest-VolumesGetTest-752433910 None] Lock "cinder-164873a1-6c12-40a9-b7de-38e669bb78c0-delete_volume" released by "delete_volume" :: held 1.233s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:41:44 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-5077b0de-1fd5-44a5-b5fd-5b776aeb3ac8 tempest-VolumesGetTest-752433910 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87329) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 06:41:44 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-5077b0de-1fd5-44a5-b5fd-5b776aeb3ac8 tempest-VolumesGetTest-752433910 None] Flow 'volume_create_manager' (e3266b77-e05e-404a-9fc3-28028548a03e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:41:44 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-5077b0de-1fd5-44a5-b5fd-5b776aeb3ac8 tempest-VolumesGetTest-752433910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09451619-6aed-4fc9-a82c-9c41287266b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:41:44 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-5077b0de-1fd5-44a5-b5fd-5b776aeb3ac8 tempest-VolumesGetTest-752433910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09451619-6aed-4fc9-a82c-9c41287266b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:41:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1416763855',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2a5e452-c82c-442d-9b78-f4b2aab1cf45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c90d8f93af0e4316b970f01878855707',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:41:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:41:44Z,use_quota=True,user_id='b403002bde0446738f1c0ea9206318e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:41:44 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-5077b0de-1fd5-44a5-b5fd-5b776aeb3ac8 tempest-VolumesGetTest-752433910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16080cf1-0533-4ed4-b945-35a975cb5b37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:41:44 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-5077b0de-1fd5-44a5-b5fd-5b776aeb3ac8 tempest-VolumesGetTest-752433910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16080cf1-0533-4ed4-b945-35a975cb5b37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:41:44 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-5077b0de-1fd5-44a5-b5fd-5b776aeb3ac8 tempest-VolumesGetTest-752433910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63bbb11a-4129-4648-ad6e-1b9f1806a3d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:41:44 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-5077b0de-1fd5-44a5-b5fd-5b776aeb3ac8 tempest-VolumesGetTest-752433910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63bbb11a-4129-4648-ad6e-1b9f1806a3d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2a5e452-c82c-442d-9b78-f4b2aab1cf45', 'volume_name': 'volume-b2a5e452-c82c-442d-9b78-f4b2aab1cf45', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:41:44 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-5077b0de-1fd5-44a5-b5fd-5b776aeb3ac8 tempest-VolumesGetTest-752433910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a93ba0d1-8087-4306-9f53-70cdc54c1dce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:41:44 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-5077b0de-1fd5-44a5-b5fd-5b776aeb3ac8 tempest-VolumesGetTest-752433910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a93ba0d1-8087-4306-9f53-70cdc54c1dce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:41:44 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-5077b0de-1fd5-44a5-b5fd-5b776aeb3ac8 tempest-VolumesGetTest-752433910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e0eb96c-cf60-4ecc-b8c7-4e90bbc8fd23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:41:44 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-5077b0de-1fd5-44a5-b5fd-5b776aeb3ac8 tempest-VolumesGetTest-752433910 None] Volume b2a5e452-c82c-442d-9b78-f4b2aab1cf45: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2a5e452-c82c-442d-9b78-f4b2aab1cf45', 'volume_size': 1} Sep 06 06:41:44 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-5077b0de-1fd5-44a5-b5fd-5b776aeb3ac8 tempest-VolumesGetTest-752433910 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:41:44 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-5077b0de-1fd5-44a5-b5fd-5b776aeb3ac8 tempest-VolumesGetTest-752433910 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:41:44 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-5077b0de-1fd5-44a5-b5fd-5b776aeb3ac8 tempest-VolumesGetTest-752433910 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:41:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1416763855',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2a5e452-c82c-442d-9b78-f4b2aab1cf45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c90d8f93af0e4316b970f01878855707',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:41:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:41:44Z,use_quota=True,user_id='b403002bde0446738f1c0ea9206318e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)}" {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 06:41:44 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-5077b0de-1fd5-44a5-b5fd-5b776aeb3ac8 tempest-VolumesGetTest-752433910 None] Creating volume b2a5e452-c82c-442d-9b78-f4b2aab1cf45 {{(pid=87329) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 06:41:44 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-5077b0de-1fd5-44a5-b5fd-5b776aeb3ac8 tempest-VolumesGetTest-752433910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:41:44 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-5077b0de-1fd5-44a5-b5fd-5b776aeb3ac8 tempest-VolumesGetTest-752433910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:41:44 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-5077b0de-1fd5-44a5-b5fd-5b776aeb3ac8 tempest-VolumesGetTest-752433910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:41:44 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-5077b0de-1fd5-44a5-b5fd-5b776aeb3ac8 tempest-VolumesGetTest-752433910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:41:44 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-5077b0de-1fd5-44a5-b5fd-5b776aeb3ac8 tempest-VolumesGetTest-752433910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:41:44 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-5077b0de-1fd5-44a5-b5fd-5b776aeb3ac8 tempest-VolumesGetTest-752433910 None] Selected osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 as target Quobyte volume. {{(pid=87329) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 06:41:44 devstack cinder-volume[87329]: INFO cinder.volume.drivers.remotefs [None req-5077b0de-1fd5-44a5-b5fd-5b776aeb3ac8 tempest-VolumesGetTest-752433910 None] casted to osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 Sep 06 06:41:44 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-5077b0de-1fd5-44a5-b5fd-5b776aeb3ac8 tempest-VolumesGetTest-752433910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b2a5e452-c82c-442d-9b78-f4b2aab1cf45 1073741824 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:41:44 devstack sudo[100175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b2a5e452-c82c-442d-9b78-f4b2aab1cf45 1073741824 Sep 06 06:41:44 devstack sudo[100175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:41:44 devstack sudo[100175]: pam_unix(sudo:session): session closed for user root Sep 06 06:41:44 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-5077b0de-1fd5-44a5-b5fd-5b776aeb3ac8 tempest-VolumesGetTest-752433910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b2a5e452-c82c-442d-9b78-f4b2aab1cf45 1073741824" returned: 0 in 0.491s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:41:44 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-5077b0de-1fd5-44a5-b5fd-5b776aeb3ac8 tempest-VolumesGetTest-752433910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b2a5e452-c82c-442d-9b78-f4b2aab1cf45 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:41:44 devstack sudo[100180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b2a5e452-c82c-442d-9b78-f4b2aab1cf45 Sep 06 06:41:44 devstack sudo[100180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:41:45 devstack sudo[100180]: pam_unix(sudo:session): session closed for user root Sep 06 06:41:45 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-5077b0de-1fd5-44a5-b5fd-5b776aeb3ac8 tempest-VolumesGetTest-752433910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b2a5e452-c82c-442d-9b78-f4b2aab1cf45" returned: 0 in 0.262s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:41:45 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-5077b0de-1fd5-44a5-b5fd-5b776aeb3ac8 tempest-VolumesGetTest-752433910 None] <== create_volume: return (808ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'} {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 06:41:45 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-5077b0de-1fd5-44a5-b5fd-5b776aeb3ac8 tempest-VolumesGetTest-752433910 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.811s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:41:45 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-5077b0de-1fd5-44a5-b5fd-5b776aeb3ac8 tempest-VolumesGetTest-752433910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e0eb96c-cf60-4ecc-b8c7-4e90bbc8fd23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2a5e452-c82c-442d-9b78-f4b2aab1cf45', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:41:45 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-5077b0de-1fd5-44a5-b5fd-5b776aeb3ac8 tempest-VolumesGetTest-752433910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d8999e4-5e5e-48f7-887a-ad3bc2894aac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:41:45 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-5077b0de-1fd5-44a5-b5fd-5b776aeb3ac8 tempest-VolumesGetTest-752433910 None] Volume volume-b2a5e452-c82c-442d-9b78-f4b2aab1cf45 (b2a5e452-c82c-442d-9b78-f4b2aab1cf45): created successfully Sep 06 06:41:45 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-5077b0de-1fd5-44a5-b5fd-5b776aeb3ac8 tempest-VolumesGetTest-752433910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d8999e4-5e5e-48f7-887a-ad3bc2894aac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:41:45 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-5077b0de-1fd5-44a5-b5fd-5b776aeb3ac8 tempest-VolumesGetTest-752433910 None] Flow 'volume_create_manager' (e3266b77-e05e-404a-9fc3-28028548a03e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:41:45 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-5077b0de-1fd5-44a5-b5fd-5b776aeb3ac8 tempest-VolumesGetTest-752433910 None] Created volume successfully. Sep 06 06:41:46 devstack cinder-volume[87329]: INFO cinder.volume.manager [req-4ae23d7d-0250-4a87-ba72-3899bd9040d9 req-4cb6851f-0923-413d-a293-bc4c92839c79 tempest-AttachVolumeTestJSON-1525867077 None] Terminate volume connection completed successfully. Sep 06 06:41:46 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [req-4ae23d7d-0250-4a87-ba72-3899bd9040d9 req-4cb6851f-0923-413d-a293-bc4c92839c79 tempest-AttachVolumeTestJSON-1525867077 None] Deleting attachment 3c546323-3332-42ae-b29e-ad90e9865c25. {{(pid=87329) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 06 06:41:46 devstack cinder-volume[87329]: DEBUG dbcounter [-] [87329] Writing DB stats cinder:INSERT=61,cinder:UPDATE=211,cinder:SELECT=162,cinder:DELETE=13 {{(pid=87329) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 06:41:46 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-7391baa3-d3e9-4a34-b3bc-f3b01c08602a tempest-VolumesGetTest-752433910 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87329) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 06:41:46 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-7391baa3-d3e9-4a34-b3bc-f3b01c08602a tempest-VolumesGetTest-752433910 None] Flow 'volume_create_manager' (2ca618da-a9c1-4235-b89e-72b7e99a28cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:41:46 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-7391baa3-d3e9-4a34-b3bc-f3b01c08602a tempest-VolumesGetTest-752433910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29f39a28-0bfc-4502-97bd-f1fc374b1293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:41:47 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-7391baa3-d3e9-4a34-b3bc-f3b01c08602a tempest-VolumesGetTest-752433910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29f39a28-0bfc-4502-97bd-f1fc374b1293) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:41:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2086792852',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=727aad21-5552-4cf8-bad5-b86990a91821,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='c90d8f93af0e4316b970f01878855707',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:41:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=b2a5e452-c82c-442d-9b78-f4b2aab1cf45,status='creating',terminated_at=None,updated_at=2026-09-06T04:41:47Z,use_quota=True,user_id='b403002bde0446738f1c0ea9206318e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:41:47 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-7391baa3-d3e9-4a34-b3bc-f3b01c08602a tempest-VolumesGetTest-752433910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2985f572-c84e-4566-84ff-fa781686f62b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:41:47 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-7391baa3-d3e9-4a34-b3bc-f3b01c08602a tempest-VolumesGetTest-752433910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2985f572-c84e-4566-84ff-fa781686f62b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:41:47 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-7391baa3-d3e9-4a34-b3bc-f3b01c08602a tempest-VolumesGetTest-752433910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (332bb5eb-24e6-44d0-9d3f-03ffc6b97d97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:41:47 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-7391baa3-d3e9-4a34-b3bc-f3b01c08602a tempest-VolumesGetTest-752433910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (332bb5eb-24e6-44d0-9d3f-03ffc6b97d97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '727aad21-5552-4cf8-bad5-b86990a91821', 'volume_name': 'volume-727aad21-5552-4cf8-bad5-b86990a91821', 'volume_size': 1, 'source_volid': 'b2a5e452-c82c-442d-9b78-f4b2aab1cf45', 'source_volstatus': 'available'}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:41:47 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-7391baa3-d3e9-4a34-b3bc-f3b01c08602a tempest-VolumesGetTest-752433910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fe0fcc7-9be4-4396-a30c-785670efac93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:41:47 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-7391baa3-d3e9-4a34-b3bc-f3b01c08602a tempest-VolumesGetTest-752433910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fe0fcc7-9be4-4396-a30c-785670efac93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:41:47 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-7391baa3-d3e9-4a34-b3bc-f3b01c08602a tempest-VolumesGetTest-752433910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc2c87b5-bfe9-4ea7-a602-74a1861e54d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:41:47 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-7391baa3-d3e9-4a34-b3bc-f3b01c08602a tempest-VolumesGetTest-752433910 None] Volume 727aad21-5552-4cf8-bad5-b86990a91821: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-727aad21-5552-4cf8-bad5-b86990a91821', 'volume_size': 1, 'source_volid': 'b2a5e452-c82c-442d-9b78-f4b2aab1cf45', 'source_volstatus': 'available'} Sep 06 06:41:47 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-7391baa3-d3e9-4a34-b3bc-f3b01c08602a tempest-VolumesGetTest-752433910 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:41:47 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-7391baa3-d3e9-4a34-b3bc-f3b01c08602a tempest-VolumesGetTest-752433910 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:41:47 devstack cinder-volume[87329]: INFO cinder.volume.drivers.remotefs [None req-7391baa3-d3e9-4a34-b3bc-f3b01c08602a tempest-VolumesGetTest-752433910 None] Cloning volume b2a5e452-c82c-442d-9b78-f4b2aab1cf45 to volume 727aad21-5552-4cf8-bad5-b86990a91821 Sep 06 06:41:47 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-7391baa3-d3e9-4a34-b3bc-f3b01c08602a tempest-VolumesGetTest-752433910 None] Creating offline snapshot b4954bd1-42d5-409d-8a47-02fc37506590 of volume b2a5e452-c82c-442d-9b78-f4b2aab1cf45 {{(pid=87329) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 06 06:41:47 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[d73a4872-8c09-424f-90b0-1ec5dff1a4d8]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:41:47 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-7391baa3-d3e9-4a34-b3bc-f3b01c08602a tempest-VolumesGetTest-752433910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b2a5e452-c82c-442d-9b78-f4b2aab1cf45 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:41:47 devstack sudo[100188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b2a5e452-c82c-442d-9b78-f4b2aab1cf45 Sep 06 06:41:47 devstack sudo[100188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:41:47 devstack sudo[100188]: pam_unix(sudo:session): session closed for user root Sep 06 06:41:47 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-7391baa3-d3e9-4a34-b3bc-f3b01c08602a tempest-VolumesGetTest-752433910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b2a5e452-c82c-442d-9b78-f4b2aab1cf45" returned: 0 in 0.505s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:41:47 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-7391baa3-d3e9-4a34-b3bc-f3b01c08602a tempest-VolumesGetTest-752433910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b2a5e452-c82c-442d-9b78-f4b2aab1cf45,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b2a5e452-c82c-442d-9b78-f4b2aab1cf45.b4954bd1-42d5-409d-8a47-02fc37506590 1G {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:41:47 devstack sudo[100197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b2a5e452-c82c-442d-9b78-f4b2aab1cf45,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b2a5e452-c82c-442d-9b78-f4b2aab1cf45.b4954bd1-42d5-409d-8a47-02fc37506590 1G Sep 06 06:41:47 devstack sudo[100197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:41:48 devstack sudo[100197]: pam_unix(sudo:session): session closed for user root Sep 06 06:41:48 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-7391baa3-d3e9-4a34-b3bc-f3b01c08602a tempest-VolumesGetTest-752433910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b2a5e452-c82c-442d-9b78-f4b2aab1cf45,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b2a5e452-c82c-442d-9b78-f4b2aab1cf45.b4954bd1-42d5-409d-8a47-02fc37506590 1G" returned: 0 in 0.500s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:41:48 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-7391baa3-d3e9-4a34-b3bc-f3b01c08602a tempest-VolumesGetTest-752433910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b2a5e452-c82c-442d-9b78-f4b2aab1cf45 -F qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b2a5e452-c82c-442d-9b78-f4b2aab1cf45.b4954bd1-42d5-409d-8a47-02fc37506590 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:41:48 devstack sudo[100203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b2a5e452-c82c-442d-9b78-f4b2aab1cf45 -F qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b2a5e452-c82c-442d-9b78-f4b2aab1cf45.b4954bd1-42d5-409d-8a47-02fc37506590 Sep 06 06:41:48 devstack sudo[100203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:41:48 devstack cinder-volume[87329]: DEBUG oslo_service.periodic_task [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87329) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 06 06:41:48 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:41:48 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:41:48 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:41:48 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:41:48 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:41:48 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:41:48 devstack sudo[100209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:41:48 devstack sudo[100209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:41:48 devstack sudo[100203]: pam_unix(sudo:session): session closed for user root Sep 06 06:41:48 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-7391baa3-d3e9-4a34-b3bc-f3b01c08602a tempest-VolumesGetTest-752433910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b2a5e452-c82c-442d-9b78-f4b2aab1cf45 -F qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b2a5e452-c82c-442d-9b78-f4b2aab1cf45.b4954bd1-42d5-409d-8a47-02fc37506590" returned: 0 in 0.410s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:41:48 devstack cinder-volume[87329]: WARNING cinder.volume.drivers.remotefs [None req-7391baa3-d3e9-4a34-b3bc-f3b01c08602a tempest-VolumesGetTest-752433910 None] /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b2a5e452-c82c-442d-9b78-f4b2aab1cf45.b4954bd1-42d5-409d-8a47-02fc37506590 is being set with open permissions: ugo+rw Sep 06 06:41:48 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-7391baa3-d3e9-4a34-b3bc-f3b01c08602a tempest-VolumesGetTest-752433910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b2a5e452-c82c-442d-9b78-f4b2aab1cf45.b4954bd1-42d5-409d-8a47-02fc37506590 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:41:48 devstack sudo[100211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b2a5e452-c82c-442d-9b78-f4b2aab1cf45.b4954bd1-42d5-409d-8a47-02fc37506590 Sep 06 06:41:48 devstack sudo[100211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:41:48 devstack sudo[100209]: pam_unix(sudo:session): session closed for user root Sep 06 06:41:48 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.304s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:41:48 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:41:48 devstack cinder-volume[87329]: DEBUG oslo_service.periodic_task [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Running periodic task VolumeManager._thread_info {{(pid=87329) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 06 06:41:48 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] thread count: 28 {{(pid=87329) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 06 06:41:48 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] thread info: [<_MainThread(MainThread, started 126855043821696)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87329) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 06 06:41:48 devstack sudo[100211]: pam_unix(sudo:session): session closed for user root Sep 06 06:41:48 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-7391baa3-d3e9-4a34-b3bc-f3b01c08602a tempest-VolumesGetTest-752433910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b2a5e452-c82c-442d-9b78-f4b2aab1cf45.b4954bd1-42d5-409d-8a47-02fc37506590" returned: 0 in 0.325s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:41:48 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-7391baa3-d3e9-4a34-b3bc-f3b01c08602a tempest-VolumesGetTest-752433910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b2a5e452-c82c-442d-9b78-f4b2aab1cf45.info {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:41:48 devstack sudo[100215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b2a5e452-c82c-442d-9b78-f4b2aab1cf45.info Sep 06 06:41:48 devstack sudo[100215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:41:49 devstack sudo[100215]: pam_unix(sudo:session): session closed for user root Sep 06 06:41:49 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-7391baa3-d3e9-4a34-b3bc-f3b01c08602a tempest-VolumesGetTest-752433910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b2a5e452-c82c-442d-9b78-f4b2aab1cf45.info" returned: 0 in 0.275s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:41:49 devstack cinder-volume[87329]: WARNING cinder.volume.drivers.remotefs [None req-7391baa3-d3e9-4a34-b3bc-f3b01c08602a tempest-VolumesGetTest-752433910 None] /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b2a5e452-c82c-442d-9b78-f4b2aab1cf45.info is being set with open permissions: ugo+rw Sep 06 06:41:49 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-7391baa3-d3e9-4a34-b3bc-f3b01c08602a tempest-VolumesGetTest-752433910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b2a5e452-c82c-442d-9b78-f4b2aab1cf45.info {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:41:49 devstack sudo[100218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b2a5e452-c82c-442d-9b78-f4b2aab1cf45.info Sep 06 06:41:49 devstack sudo[100218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:41:49 devstack sudo[100218]: pam_unix(sudo:session): session closed for user root Sep 06 06:41:49 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-7391baa3-d3e9-4a34-b3bc-f3b01c08602a tempest-VolumesGetTest-752433910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b2a5e452-c82c-442d-9b78-f4b2aab1cf45.info" returned: 0 in 0.313s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:41:49 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-7391baa3-d3e9-4a34-b3bc-f3b01c08602a tempest-VolumesGetTest-752433910 None] Acquiring lock "cinder-quobyte-727aad21-5552-4cf8-bad5-b86990a91821" by "_copy_volume_from_snapshot" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:41:49 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-7391baa3-d3e9-4a34-b3bc-f3b01c08602a tempest-VolumesGetTest-752433910 None] Lock "cinder-quobyte-727aad21-5552-4cf8-bad5-b86990a91821" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:41:49 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-7391baa3-d3e9-4a34-b3bc-f3b01c08602a tempest-VolumesGetTest-752433910 None] snapshot: b4954bd1-42d5-409d-8a47-02fc37506590, volume: 727aad21-5552-4cf8-bad5-b86990a91821, {{(pid=87329) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 06 06:41:49 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-7391baa3-d3e9-4a34-b3bc-f3b01c08602a tempest-VolumesGetTest-752433910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:41:49 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-7391baa3-d3e9-4a34-b3bc-f3b01c08602a tempest-VolumesGetTest-752433910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:41:49 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-7391baa3-d3e9-4a34-b3bc-f3b01c08602a tempest-VolumesGetTest-752433910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:41:49 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-7391baa3-d3e9-4a34-b3bc-f3b01c08602a tempest-VolumesGetTest-752433910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:41:49 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-7391baa3-d3e9-4a34-b3bc-f3b01c08602a tempest-VolumesGetTest-752433910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:41:49 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[54847434-d939-4b4e-8536-636b4dcb8d15]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:41:49 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-7391baa3-d3e9-4a34-b3bc-f3b01c08602a tempest-VolumesGetTest-752433910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b2a5e452-c82c-442d-9b78-f4b2aab1cf45.b4954bd1-42d5-409d-8a47-02fc37506590 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:41:49 devstack sudo[100222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b2a5e452-c82c-442d-9b78-f4b2aab1cf45.b4954bd1-42d5-409d-8a47-02fc37506590 Sep 06 06:41:49 devstack sudo[100222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:41:50 devstack sudo[100222]: pam_unix(sudo:session): session closed for user root Sep 06 06:41:50 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-7391baa3-d3e9-4a34-b3bc-f3b01c08602a tempest-VolumesGetTest-752433910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b2a5e452-c82c-442d-9b78-f4b2aab1cf45.b4954bd1-42d5-409d-8a47-02fc37506590" returned: 0 in 0.439s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:41:50 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-7391baa3-d3e9-4a34-b3bc-f3b01c08602a tempest-VolumesGetTest-752433910 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b2a5e452-c82c-442d-9b78-f4b2aab1cf45(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87329) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 06:41:50 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[657edd5b-fced-456d-8b76-8223b3c6d2c7]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:41:50 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-7391baa3-d3e9-4a34-b3bc-f3b01c08602a tempest-VolumesGetTest-752433910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b2a5e452-c82c-442d-9b78-f4b2aab1cf45 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:41:50 devstack sudo[100227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b2a5e452-c82c-442d-9b78-f4b2aab1cf45 Sep 06 06:41:50 devstack sudo[100227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:41:50 devstack sudo[100227]: pam_unix(sudo:session): session closed for user root Sep 06 06:41:50 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-7391baa3-d3e9-4a34-b3bc-f3b01c08602a tempest-VolumesGetTest-752433910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b2a5e452-c82c-442d-9b78-f4b2aab1cf45" returned: 0 in 0.389s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:41:50 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-7391baa3-d3e9-4a34-b3bc-f3b01c08602a tempest-VolumesGetTest-752433910 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b2a5e452-c82c-442d-9b78-f4b2aab1cf45 {{(pid=87329) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 06 06:41:50 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-7391baa3-d3e9-4a34-b3bc-f3b01c08602a tempest-VolumesGetTest-752433910 None] Creating direct copy from snapshot {{(pid=87329) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 06 06:41:50 devstack cinder-volume[87329]: DEBUG cinder.utils [None req-7391baa3-d3e9-4a34-b3bc-f3b01c08602a tempest-VolumesGetTest-752433910 None] Path /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-727aad21-5552-4cf8-bad5-b86990a91821 not found in is_blk_device check {{(pid=87329) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 06 06:41:50 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-7391baa3-d3e9-4a34-b3bc-f3b01c08602a tempest-VolumesGetTest-752433910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b2a5e452-c82c-442d-9b78-f4b2aab1cf45 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-727aad21-5552-4cf8-bad5-b86990a91821 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:41:50 devstack sudo[100240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b2a5e452-c82c-442d-9b78-f4b2aab1cf45 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-727aad21-5552-4cf8-bad5-b86990a91821 Sep 06 06:41:50 devstack sudo[100240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:41:57 devstack sudo[100240]: pam_unix(sudo:session): session closed for user root Sep 06 06:41:57 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-7391baa3-d3e9-4a34-b3bc-f3b01c08602a tempest-VolumesGetTest-752433910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b2a5e452-c82c-442d-9b78-f4b2aab1cf45 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-727aad21-5552-4cf8-bad5-b86990a91821" returned: 0 in 7.341s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:41:57 devstack cinder-volume[87329]: DEBUG cinder.image.image_utils [None req-7391baa3-d3e9-4a34-b3bc-f3b01c08602a tempest-VolumesGetTest-752433910 None] Image conversion details: src /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b2a5e452-c82c-442d-9b78-f4b2aab1cf45, size 1024.00 MB, duration 7.34 sec, destination /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-727aad21-5552-4cf8-bad5-b86990a91821 {{(pid=87329) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 06 06:41:57 devstack cinder-volume[87329]: INFO cinder.image.image_utils [None req-7391baa3-d3e9-4a34-b3bc-f3b01c08602a tempest-VolumesGetTest-752433910 None] Converted 1024.00 MB image at 139.44 MB/s Sep 06 06:41:57 devstack cinder-volume[87329]: WARNING cinder.volume.drivers.remotefs [None req-7391baa3-d3e9-4a34-b3bc-f3b01c08602a tempest-VolumesGetTest-752433910 None] /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-727aad21-5552-4cf8-bad5-b86990a91821 is being set with open permissions: ugo+rw Sep 06 06:41:57 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-7391baa3-d3e9-4a34-b3bc-f3b01c08602a tempest-VolumesGetTest-752433910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-727aad21-5552-4cf8-bad5-b86990a91821 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:41:57 devstack sudo[100352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-727aad21-5552-4cf8-bad5-b86990a91821 Sep 06 06:41:57 devstack sudo[100352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:41:58 devstack sudo[100352]: pam_unix(sudo:session): session closed for user root Sep 06 06:41:58 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-7391baa3-d3e9-4a34-b3bc-f3b01c08602a tempest-VolumesGetTest-752433910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-727aad21-5552-4cf8-bad5-b86990a91821" returned: 0 in 0.256s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:41:58 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-7391baa3-d3e9-4a34-b3bc-f3b01c08602a tempest-VolumesGetTest-752433910 None] Lock "cinder-quobyte-727aad21-5552-4cf8-bad5-b86990a91821" released by "_copy_volume_from_snapshot" :: held 8.545s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:41:58 devstack cinder-volume[87329]: DEBUG dbcounter [-] [87329] Writing DB stats cinder:INSERT=50,cinder:UPDATE=206,cinder:SELECT=151,cinder:DELETE=20 {{(pid=87329) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 06:41:58 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-7391baa3-d3e9-4a34-b3bc-f3b01c08602a tempest-VolumesGetTest-752433910 None] Acquiring lock "cinder-quobyte-b4954bd1-42d5-409d-8a47-02fc37506590" by "_delete_snapshot" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:41:58 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-7391baa3-d3e9-4a34-b3bc-f3b01c08602a tempest-VolumesGetTest-752433910 None] Lock "cinder-quobyte-b4954bd1-42d5-409d-8a47-02fc37506590" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:41:58 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-7391baa3-d3e9-4a34-b3bc-f3b01c08602a tempest-VolumesGetTest-752433910 None] Deleting offline snapshot b4954bd1-42d5-409d-8a47-02fc37506590 of volume b2a5e452-c82c-442d-9b78-f4b2aab1cf45 {{(pid=87329) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 06 06:41:58 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-7391baa3-d3e9-4a34-b3bc-f3b01c08602a tempest-VolumesGetTest-752433910 None] snapshot_file for this snap is: volume-b2a5e452-c82c-442d-9b78-f4b2aab1cf45.b4954bd1-42d5-409d-8a47-02fc37506590 {{(pid=87329) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 06 06:41:58 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[689922f5-41b5-494d-8d71-8032991e6134]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:41:58 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-7391baa3-d3e9-4a34-b3bc-f3b01c08602a tempest-VolumesGetTest-752433910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b2a5e452-c82c-442d-9b78-f4b2aab1cf45.b4954bd1-42d5-409d-8a47-02fc37506590 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:41:58 devstack sudo[100355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b2a5e452-c82c-442d-9b78-f4b2aab1cf45.b4954bd1-42d5-409d-8a47-02fc37506590 Sep 06 06:41:58 devstack sudo[100355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:41:58 devstack sudo[100355]: pam_unix(sudo:session): session closed for user root Sep 06 06:41:58 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-7391baa3-d3e9-4a34-b3bc-f3b01c08602a tempest-VolumesGetTest-752433910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b2a5e452-c82c-442d-9b78-f4b2aab1cf45.b4954bd1-42d5-409d-8a47-02fc37506590" returned: 0 in 0.437s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:41:58 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-7391baa3-d3e9-4a34-b3bc-f3b01c08602a tempest-VolumesGetTest-752433910 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b2a5e452-c82c-442d-9b78-f4b2aab1cf45(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87329) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 06:41:58 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[b828364d-3783-4891-a171-05a80092062a]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:41:58 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-7391baa3-d3e9-4a34-b3bc-f3b01c08602a tempest-VolumesGetTest-752433910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b2a5e452-c82c-442d-9b78-f4b2aab1cf45 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:41:58 devstack sudo[100360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b2a5e452-c82c-442d-9b78-f4b2aab1cf45 Sep 06 06:41:58 devstack sudo[100360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:41:58 devstack cinder-volume[87329]: DEBUG dbcounter [-] [87329] Writing DB stats cinder:INSERT=2,cinder:SELECT=2,cinder:UPDATE=1 {{(pid=87329) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 06:41:59 devstack sudo[100360]: pam_unix(sudo:session): session closed for user root Sep 06 06:41:59 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-7391baa3-d3e9-4a34-b3bc-f3b01c08602a tempest-VolumesGetTest-752433910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b2a5e452-c82c-442d-9b78-f4b2aab1cf45" returned: 0 in 0.506s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:41:59 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-7391baa3-d3e9-4a34-b3bc-f3b01c08602a tempest-VolumesGetTest-752433910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b2a5e452-c82c-442d-9b78-f4b2aab1cf45.b4954bd1-42d5-409d-8a47-02fc37506590 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:41:59 devstack sudo[100365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b2a5e452-c82c-442d-9b78-f4b2aab1cf45.b4954bd1-42d5-409d-8a47-02fc37506590 Sep 06 06:41:59 devstack sudo[100365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:41:59 devstack sudo[100365]: pam_unix(sudo:session): session closed for user root Sep 06 06:41:59 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-7391baa3-d3e9-4a34-b3bc-f3b01c08602a tempest-VolumesGetTest-752433910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b2a5e452-c82c-442d-9b78-f4b2aab1cf45.b4954bd1-42d5-409d-8a47-02fc37506590" returned: 0 in 0.376s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:41:59 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-7391baa3-d3e9-4a34-b3bc-f3b01c08602a tempest-VolumesGetTest-752433910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b2a5e452-c82c-442d-9b78-f4b2aab1cf45.b4954bd1-42d5-409d-8a47-02fc37506590 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:41:59 devstack sudo[100371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b2a5e452-c82c-442d-9b78-f4b2aab1cf45.b4954bd1-42d5-409d-8a47-02fc37506590 Sep 06 06:41:59 devstack sudo[100371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:41:59 devstack sudo[100371]: pam_unix(sudo:session): session closed for user root Sep 06 06:41:59 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-7391baa3-d3e9-4a34-b3bc-f3b01c08602a tempest-VolumesGetTest-752433910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b2a5e452-c82c-442d-9b78-f4b2aab1cf45.b4954bd1-42d5-409d-8a47-02fc37506590" returned: 0 in 0.282s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:41:59 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-7391baa3-d3e9-4a34-b3bc-f3b01c08602a tempest-VolumesGetTest-752433910 None] Lock "cinder-quobyte-b4954bd1-42d5-409d-8a47-02fc37506590" released by "_delete_snapshot" :: held 1.701s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:41:59 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-7391baa3-d3e9-4a34-b3bc-f3b01c08602a tempest-VolumesGetTest-752433910 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.802s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:41:59 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-7391baa3-d3e9-4a34-b3bc-f3b01c08602a tempest-VolumesGetTest-752433910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc2c87b5-bfe9-4ea7-a602-74a1861e54d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-727aad21-5552-4cf8-bad5-b86990a91821', 'volume_size': 1, 'source_volid': 'b2a5e452-c82c-442d-9b78-f4b2aab1cf45', 'source_volstatus': 'available'}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:41:59 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-7391baa3-d3e9-4a34-b3bc-f3b01c08602a tempest-VolumesGetTest-752433910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61addeba-145d-4eec-8d6f-3bf1816b5a7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:41:59 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-7391baa3-d3e9-4a34-b3bc-f3b01c08602a tempest-VolumesGetTest-752433910 None] Volume volume-727aad21-5552-4cf8-bad5-b86990a91821 (727aad21-5552-4cf8-bad5-b86990a91821): created successfully Sep 06 06:41:59 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-7391baa3-d3e9-4a34-b3bc-f3b01c08602a tempest-VolumesGetTest-752433910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61addeba-145d-4eec-8d6f-3bf1816b5a7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:41:59 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-7391baa3-d3e9-4a34-b3bc-f3b01c08602a tempest-VolumesGetTest-752433910 None] Flow 'volume_create_manager' (2ca618da-a9c1-4235-b89e-72b7e99a28cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:41:59 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-7391baa3-d3e9-4a34-b3bc-f3b01c08602a tempest-VolumesGetTest-752433910 None] Created volume successfully. Sep 06 06:42:01 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3b0d632-47c5-442c-8194-6adea706218a tempest-VolumesGetTest-752433910 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87329) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 06:42:01 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-f3b0d632-47c5-442c-8194-6adea706218a tempest-VolumesGetTest-752433910 None] Flow 'volume_create_manager' (5593af97-570c-4418-b464-a9aac2b8bf4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:42:01 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-f3b0d632-47c5-442c-8194-6adea706218a tempest-VolumesGetTest-752433910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95a2219f-3908-4f3a-b713-5a2214d8a7fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:42:01 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-f3b0d632-47c5-442c-8194-6adea706218a tempest-VolumesGetTest-752433910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95a2219f-3908-4f3a-b713-5a2214d8a7fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:42:01Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1398836017',display_name='tempest-VolumesGetTest-Volume-472995959',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4303c6e-6554-4450-b32e-450aa3b44252,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c90d8f93af0e4316b970f01878855707',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:42:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:42:01Z,use_quota=True,user_id='b403002bde0446738f1c0ea9206318e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:42:01 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-f3b0d632-47c5-442c-8194-6adea706218a tempest-VolumesGetTest-752433910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c47e413-0fe1-4d2b-bbff-10b5aeb26de0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:42:01 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-f3b0d632-47c5-442c-8194-6adea706218a tempest-VolumesGetTest-752433910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c47e413-0fe1-4d2b-bbff-10b5aeb26de0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:42:01 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-f3b0d632-47c5-442c-8194-6adea706218a tempest-VolumesGetTest-752433910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dee4d282-e4d3-4d25-9330-97da0a2f94e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:42:01 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-f3b0d632-47c5-442c-8194-6adea706218a tempest-VolumesGetTest-752433910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dee4d282-e4d3-4d25-9330-97da0a2f94e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4303c6e-6554-4450-b32e-450aa3b44252', 'volume_name': 'volume-e4303c6e-6554-4450-b32e-450aa3b44252', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:42:01 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-f3b0d632-47c5-442c-8194-6adea706218a tempest-VolumesGetTest-752433910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf389fea-1742-46af-a977-658ef1b17169) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:42:01 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-f3b0d632-47c5-442c-8194-6adea706218a tempest-VolumesGetTest-752433910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf389fea-1742-46af-a977-658ef1b17169) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:42:01 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-f3b0d632-47c5-442c-8194-6adea706218a tempest-VolumesGetTest-752433910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56cfb571-03e1-4328-a68b-4f2a722068ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:42:01 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-f3b0d632-47c5-442c-8194-6adea706218a tempest-VolumesGetTest-752433910 None] Volume e4303c6e-6554-4450-b32e-450aa3b44252: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4303c6e-6554-4450-b32e-450aa3b44252', 'volume_size': 1} Sep 06 06:42:01 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-f3b0d632-47c5-442c-8194-6adea706218a tempest-VolumesGetTest-752433910 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:42:01 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-f3b0d632-47c5-442c-8194-6adea706218a tempest-VolumesGetTest-752433910 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:42:01 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-f3b0d632-47c5-442c-8194-6adea706218a tempest-VolumesGetTest-752433910 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:42:01Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1398836017',display_name='tempest-VolumesGetTest-Volume-472995959',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4303c6e-6554-4450-b32e-450aa3b44252,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c90d8f93af0e4316b970f01878855707',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:42:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:42:01Z,use_quota=True,user_id='b403002bde0446738f1c0ea9206318e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)}" {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 06:42:01 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-f3b0d632-47c5-442c-8194-6adea706218a tempest-VolumesGetTest-752433910 None] Creating volume e4303c6e-6554-4450-b32e-450aa3b44252 {{(pid=87329) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 06:42:01 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-f3b0d632-47c5-442c-8194-6adea706218a tempest-VolumesGetTest-752433910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:42:01 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-f3b0d632-47c5-442c-8194-6adea706218a tempest-VolumesGetTest-752433910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:42:01 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-f3b0d632-47c5-442c-8194-6adea706218a tempest-VolumesGetTest-752433910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:42:01 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-f3b0d632-47c5-442c-8194-6adea706218a tempest-VolumesGetTest-752433910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:42:01 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-f3b0d632-47c5-442c-8194-6adea706218a tempest-VolumesGetTest-752433910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:42:01 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-f3b0d632-47c5-442c-8194-6adea706218a tempest-VolumesGetTest-752433910 None] Selected osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 as target Quobyte volume. {{(pid=87329) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 06:42:01 devstack cinder-volume[87329]: INFO cinder.volume.drivers.remotefs [None req-f3b0d632-47c5-442c-8194-6adea706218a tempest-VolumesGetTest-752433910 None] casted to osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 Sep 06 06:42:01 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-f3b0d632-47c5-442c-8194-6adea706218a tempest-VolumesGetTest-752433910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e4303c6e-6554-4450-b32e-450aa3b44252 1073741824 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:42:01 devstack sudo[100375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e4303c6e-6554-4450-b32e-450aa3b44252 1073741824 Sep 06 06:42:01 devstack sudo[100375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:42:02 devstack sudo[100375]: pam_unix(sudo:session): session closed for user root Sep 06 06:42:02 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-f3b0d632-47c5-442c-8194-6adea706218a tempest-VolumesGetTest-752433910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e4303c6e-6554-4450-b32e-450aa3b44252 1073741824" returned: 0 in 0.734s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:42:02 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-f3b0d632-47c5-442c-8194-6adea706218a tempest-VolumesGetTest-752433910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e4303c6e-6554-4450-b32e-450aa3b44252 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:42:02 devstack sudo[100382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e4303c6e-6554-4450-b32e-450aa3b44252 Sep 06 06:42:02 devstack sudo[100382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:42:02 devstack sudo[100382]: pam_unix(sudo:session): session closed for user root Sep 06 06:42:02 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-f3b0d632-47c5-442c-8194-6adea706218a tempest-VolumesGetTest-752433910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e4303c6e-6554-4450-b32e-450aa3b44252" returned: 0 in 0.306s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:42:02 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-f3b0d632-47c5-442c-8194-6adea706218a tempest-VolumesGetTest-752433910 None] <== create_volume: return (1105ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'} {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 06:42:02 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-f3b0d632-47c5-442c-8194-6adea706218a tempest-VolumesGetTest-752433910 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.110s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:42:02 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-f3b0d632-47c5-442c-8194-6adea706218a tempest-VolumesGetTest-752433910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56cfb571-03e1-4328-a68b-4f2a722068ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4303c6e-6554-4450-b32e-450aa3b44252', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:42:02 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-f3b0d632-47c5-442c-8194-6adea706218a tempest-VolumesGetTest-752433910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5563e8e5-2f10-454a-951b-97e603d9f9ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:42:02 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-f3b0d632-47c5-442c-8194-6adea706218a tempest-VolumesGetTest-752433910 None] Volume volume-e4303c6e-6554-4450-b32e-450aa3b44252 (e4303c6e-6554-4450-b32e-450aa3b44252): created successfully Sep 06 06:42:02 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-f3b0d632-47c5-442c-8194-6adea706218a tempest-VolumesGetTest-752433910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5563e8e5-2f10-454a-951b-97e603d9f9ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:42:02 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-f3b0d632-47c5-442c-8194-6adea706218a tempest-VolumesGetTest-752433910 None] Flow 'volume_create_manager' (5593af97-570c-4418-b464-a9aac2b8bf4d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:42:02 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-f3b0d632-47c5-442c-8194-6adea706218a tempest-VolumesGetTest-752433910 None] Created volume successfully. Sep 06 06:42:03 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-db30f179-72f3-474e-a25d-572cd0a7e13b tempest-VolumesGetTest-752433910 None] Acquiring lock "cinder-e4303c6e-6554-4450-b32e-450aa3b44252-delete_volume" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:42:03 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-db30f179-72f3-474e-a25d-572cd0a7e13b tempest-VolumesGetTest-752433910 None] Lock "cinder-e4303c6e-6554-4450-b32e-450aa3b44252-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:42:03 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-db30f179-72f3-474e-a25d-572cd0a7e13b tempest-VolumesGetTest-752433910 None] Acquiring lock "cinder-quobyte-e4303c6e-6554-4450-b32e-450aa3b44252" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:42:03 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-db30f179-72f3-474e-a25d-572cd0a7e13b tempest-VolumesGetTest-752433910 None] Lock "cinder-quobyte-e4303c6e-6554-4450-b32e-450aa3b44252" acquired by "delete_volume" :: waited 0.023s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:42:03 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1df568b-c793-4a95-8788-27d683ad6f5e]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:42:03 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-db30f179-72f3-474e-a25d-572cd0a7e13b tempest-VolumesGetTest-752433910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e4303c6e-6554-4450-b32e-450aa3b44252 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:42:03 devstack sudo[100385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e4303c6e-6554-4450-b32e-450aa3b44252 Sep 06 06:42:03 devstack sudo[100385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:42:04 devstack sudo[100385]: pam_unix(sudo:session): session closed for user root Sep 06 06:42:04 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-db30f179-72f3-474e-a25d-572cd0a7e13b tempest-VolumesGetTest-752433910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e4303c6e-6554-4450-b32e-450aa3b44252" returned: 0 in 0.431s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:42:04 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-db30f179-72f3-474e-a25d-572cd0a7e13b tempest-VolumesGetTest-752433910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e4303c6e-6554-4450-b32e-450aa3b44252 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:42:04 devstack sudo[100390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e4303c6e-6554-4450-b32e-450aa3b44252 Sep 06 06:42:04 devstack sudo[100390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:42:04 devstack sudo[100390]: pam_unix(sudo:session): session closed for user root Sep 06 06:42:04 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-db30f179-72f3-474e-a25d-572cd0a7e13b tempest-VolumesGetTest-752433910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e4303c6e-6554-4450-b32e-450aa3b44252" returned: 0 in 0.294s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:42:04 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-db30f179-72f3-474e-a25d-572cd0a7e13b tempest-VolumesGetTest-752433910 None] Lock "cinder-quobyte-e4303c6e-6554-4450-b32e-450aa3b44252" released by "delete_volume" :: held 0.782s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:42:04 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-db30f179-72f3-474e-a25d-572cd0a7e13b tempest-VolumesGetTest-752433910 None] Created reservations ['141df701-2135-4ecf-b18d-0fd6848f9846', '8d019bbe-0eeb-46d5-94a6-116eba1509ab', 'ae20d4f7-6238-45ee-bfbc-f9923c5cfb26', '3ec53178-cf8e-4103-ab3c-f07238bde71b'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:42:04 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-db30f179-72f3-474e-a25d-572cd0a7e13b tempest-VolumesGetTest-752433910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:42:04 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-db30f179-72f3-474e-a25d-572cd0a7e13b tempest-VolumesGetTest-752433910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:42:04 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-db30f179-72f3-474e-a25d-572cd0a7e13b tempest-VolumesGetTest-752433910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:42:04 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-db30f179-72f3-474e-a25d-572cd0a7e13b tempest-VolumesGetTest-752433910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:42:04 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-db30f179-72f3-474e-a25d-572cd0a7e13b tempest-VolumesGetTest-752433910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:42:04 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-db30f179-72f3-474e-a25d-572cd0a7e13b tempest-VolumesGetTest-752433910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:42:04 devstack sudo[100395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:42:04 devstack sudo[100395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:42:05 devstack sudo[100395]: pam_unix(sudo:session): session closed for user root Sep 06 06:42:05 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-db30f179-72f3-474e-a25d-572cd0a7e13b tempest-VolumesGetTest-752433910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.295s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:42:05 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-db30f179-72f3-474e-a25d-572cd0a7e13b tempest-VolumesGetTest-752433910 None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:42:05 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-db30f179-72f3-474e-a25d-572cd0a7e13b tempest-VolumesGetTest-752433910 None] Deleted volume successfully. Sep 06 06:42:05 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-b0217b65-008a-458a-84ed-459ba2b5c48c tempest-VolumesGetTest-752433910 None] Acquiring lock "cinder-727aad21-5552-4cf8-bad5-b86990a91821-delete_volume" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:42:05 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-db30f179-72f3-474e-a25d-572cd0a7e13b tempest-VolumesGetTest-752433910 None] Lock "cinder-e4303c6e-6554-4450-b32e-450aa3b44252-delete_volume" released by "delete_volume" :: held 1.376s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:42:05 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-b0217b65-008a-458a-84ed-459ba2b5c48c tempest-VolumesGetTest-752433910 None] Lock "cinder-727aad21-5552-4cf8-bad5-b86990a91821-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:42:05 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-b0217b65-008a-458a-84ed-459ba2b5c48c tempest-VolumesGetTest-752433910 None] Acquiring lock "cinder-quobyte-727aad21-5552-4cf8-bad5-b86990a91821" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:42:05 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-b0217b65-008a-458a-84ed-459ba2b5c48c tempest-VolumesGetTest-752433910 None] Lock "cinder-quobyte-727aad21-5552-4cf8-bad5-b86990a91821" acquired by "delete_volume" :: waited 0.026s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:42:05 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[5361082b-e0a3-4dfb-8c00-c15d3df23305]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:42:05 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-b0217b65-008a-458a-84ed-459ba2b5c48c tempest-VolumesGetTest-752433910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-727aad21-5552-4cf8-bad5-b86990a91821 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:42:05 devstack sudo[100398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-727aad21-5552-4cf8-bad5-b86990a91821 Sep 06 06:42:05 devstack sudo[100398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:42:05 devstack sudo[100398]: pam_unix(sudo:session): session closed for user root Sep 06 06:42:05 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-b0217b65-008a-458a-84ed-459ba2b5c48c tempest-VolumesGetTest-752433910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-727aad21-5552-4cf8-bad5-b86990a91821" returned: 0 in 0.440s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:42:05 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-b0217b65-008a-458a-84ed-459ba2b5c48c tempest-VolumesGetTest-752433910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-727aad21-5552-4cf8-bad5-b86990a91821 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:42:05 devstack sudo[100403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-727aad21-5552-4cf8-bad5-b86990a91821 Sep 06 06:42:05 devstack sudo[100403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:42:05 devstack sudo[100403]: pam_unix(sudo:session): session closed for user root Sep 06 06:42:05 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-b0217b65-008a-458a-84ed-459ba2b5c48c tempest-VolumesGetTest-752433910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-727aad21-5552-4cf8-bad5-b86990a91821" returned: 0 in 0.273s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:42:05 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-b0217b65-008a-458a-84ed-459ba2b5c48c tempest-VolumesGetTest-752433910 None] Lock "cinder-quobyte-727aad21-5552-4cf8-bad5-b86990a91821" released by "delete_volume" :: held 0.766s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:42:06 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-b0217b65-008a-458a-84ed-459ba2b5c48c tempest-VolumesGetTest-752433910 None] Created reservations ['82f94175-9a5f-4cde-90d4-5139113e9b70', '4f6f87ce-bfa0-4ae8-bd13-19a125a218c6', '02f69ac7-9cf9-47fe-8435-1a93965c6293', '1e6c49f7-8e0c-4bbf-bf85-e61aaff294a5'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:42:06 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-b0217b65-008a-458a-84ed-459ba2b5c48c tempest-VolumesGetTest-752433910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:42:06 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-b0217b65-008a-458a-84ed-459ba2b5c48c tempest-VolumesGetTest-752433910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:42:06 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-b0217b65-008a-458a-84ed-459ba2b5c48c tempest-VolumesGetTest-752433910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:42:06 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-b0217b65-008a-458a-84ed-459ba2b5c48c tempest-VolumesGetTest-752433910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:42:06 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-b0217b65-008a-458a-84ed-459ba2b5c48c tempest-VolumesGetTest-752433910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:42:06 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-b0217b65-008a-458a-84ed-459ba2b5c48c tempest-VolumesGetTest-752433910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:42:06 devstack sudo[100406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:42:06 devstack sudo[100406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:42:06 devstack sudo[100406]: pam_unix(sudo:session): session closed for user root Sep 06 06:42:06 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-4493ec7d-f1f6-4b2c-aaf3-3c9fb3115ee6 tempest-VolumesGetTest-752433910 None] Acquiring lock "cinder-b2a5e452-c82c-442d-9b78-f4b2aab1cf45-delete_volume" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:42:06 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-b0217b65-008a-458a-84ed-459ba2b5c48c tempest-VolumesGetTest-752433910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.308s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:42:06 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-b0217b65-008a-458a-84ed-459ba2b5c48c tempest-VolumesGetTest-752433910 None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:42:06 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-b0217b65-008a-458a-84ed-459ba2b5c48c tempest-VolumesGetTest-752433910 None] Deleted volume successfully. Sep 06 06:42:06 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-4493ec7d-f1f6-4b2c-aaf3-3c9fb3115ee6 tempest-VolumesGetTest-752433910 None] Lock "cinder-b2a5e452-c82c-442d-9b78-f4b2aab1cf45-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:42:06 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-b0217b65-008a-458a-84ed-459ba2b5c48c tempest-VolumesGetTest-752433910 None] Lock "cinder-727aad21-5552-4cf8-bad5-b86990a91821-delete_volume" released by "delete_volume" :: held 1.356s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:42:06 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-4493ec7d-f1f6-4b2c-aaf3-3c9fb3115ee6 tempest-VolumesGetTest-752433910 None] Acquiring lock "cinder-quobyte-b2a5e452-c82c-442d-9b78-f4b2aab1cf45" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:42:06 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-4493ec7d-f1f6-4b2c-aaf3-3c9fb3115ee6 tempest-VolumesGetTest-752433910 None] Lock "cinder-quobyte-b2a5e452-c82c-442d-9b78-f4b2aab1cf45" acquired by "delete_volume" :: waited 0.017s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:42:06 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[587c4169-031d-4bf1-8d68-91a41d22fbc9]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:42:06 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-4493ec7d-f1f6-4b2c-aaf3-3c9fb3115ee6 tempest-VolumesGetTest-752433910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b2a5e452-c82c-442d-9b78-f4b2aab1cf45 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:42:06 devstack sudo[100411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b2a5e452-c82c-442d-9b78-f4b2aab1cf45 Sep 06 06:42:06 devstack sudo[100411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:42:06 devstack sudo[100411]: pam_unix(sudo:session): session closed for user root Sep 06 06:42:06 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-4493ec7d-f1f6-4b2c-aaf3-3c9fb3115ee6 tempest-VolumesGetTest-752433910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b2a5e452-c82c-442d-9b78-f4b2aab1cf45" returned: 0 in 0.390s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:42:06 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-4493ec7d-f1f6-4b2c-aaf3-3c9fb3115ee6 tempest-VolumesGetTest-752433910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b2a5e452-c82c-442d-9b78-f4b2aab1cf45 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:42:06 devstack sudo[100416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b2a5e452-c82c-442d-9b78-f4b2aab1cf45 Sep 06 06:42:06 devstack sudo[100416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:42:07 devstack sudo[100416]: pam_unix(sudo:session): session closed for user root Sep 06 06:42:07 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-4493ec7d-f1f6-4b2c-aaf3-3c9fb3115ee6 tempest-VolumesGetTest-752433910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b2a5e452-c82c-442d-9b78-f4b2aab1cf45" returned: 0 in 0.285s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:42:07 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-4493ec7d-f1f6-4b2c-aaf3-3c9fb3115ee6 tempest-VolumesGetTest-752433910 None] Lock "cinder-quobyte-b2a5e452-c82c-442d-9b78-f4b2aab1cf45" released by "delete_volume" :: held 0.756s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:42:07 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-4493ec7d-f1f6-4b2c-aaf3-3c9fb3115ee6 tempest-VolumesGetTest-752433910 None] Created reservations ['3f0bceea-dc00-404b-ad19-7121ed58707f', '7495a50c-97f6-4a1d-ac51-4b4e9a66fd53', '09702d89-6791-48aa-b274-6bd866176020', '9cf642b5-60df-4487-b1ba-fdd258c61fe4'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:42:07 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-4493ec7d-f1f6-4b2c-aaf3-3c9fb3115ee6 tempest-VolumesGetTest-752433910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:42:07 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-4493ec7d-f1f6-4b2c-aaf3-3c9fb3115ee6 tempest-VolumesGetTest-752433910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:42:07 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-4493ec7d-f1f6-4b2c-aaf3-3c9fb3115ee6 tempest-VolumesGetTest-752433910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:42:07 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-4493ec7d-f1f6-4b2c-aaf3-3c9fb3115ee6 tempest-VolumesGetTest-752433910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:42:07 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-4493ec7d-f1f6-4b2c-aaf3-3c9fb3115ee6 tempest-VolumesGetTest-752433910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:42:07 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-4493ec7d-f1f6-4b2c-aaf3-3c9fb3115ee6 tempest-VolumesGetTest-752433910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:42:07 devstack sudo[100424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:42:07 devstack sudo[100424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:42:07 devstack sudo[100424]: pam_unix(sudo:session): session closed for user root Sep 06 06:42:07 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-4493ec7d-f1f6-4b2c-aaf3-3c9fb3115ee6 tempest-VolumesGetTest-752433910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.315s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:42:07 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-4493ec7d-f1f6-4b2c-aaf3-3c9fb3115ee6 tempest-VolumesGetTest-752433910 None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:42:07 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-4493ec7d-f1f6-4b2c-aaf3-3c9fb3115ee6 tempest-VolumesGetTest-752433910 None] Deleted volume successfully. Sep 06 06:42:07 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-4493ec7d-f1f6-4b2c-aaf3-3c9fb3115ee6 tempest-VolumesGetTest-752433910 None] Lock "cinder-b2a5e452-c82c-442d-9b78-f4b2aab1cf45-delete_volume" released by "delete_volume" :: held 1.322s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:42:08 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-2832dcd2-8e55-4ef9-bf91-84f8b9d43a9d tempest-VolumesGetTest-752433910 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87329) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 06:42:08 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-2832dcd2-8e55-4ef9-bf91-84f8b9d43a9d tempest-VolumesGetTest-752433910 None] Flow 'volume_create_manager' (1135600c-531f-426a-b97b-1216acdaed0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:42:08 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-2832dcd2-8e55-4ef9-bf91-84f8b9d43a9d tempest-VolumesGetTest-752433910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (203fd4c4-7dca-4fb6-8917-c1f4dbb0888d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:42:08 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-2832dcd2-8e55-4ef9-bf91-84f8b9d43a9d tempest-VolumesGetTest-752433910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (203fd4c4-7dca-4fb6-8917-c1f4dbb0888d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:42:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-709559685',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e46229e-4caa-46f2-a8c3-f63c70401cfd,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='c90d8f93af0e4316b970f01878855707',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:42:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:42:09Z,use_quota=True,user_id='b403002bde0446738f1c0ea9206318e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:42:08 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-2832dcd2-8e55-4ef9-bf91-84f8b9d43a9d tempest-VolumesGetTest-752433910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d433f75f-3d2f-4794-a46e-600849fa39eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:42:08 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-2832dcd2-8e55-4ef9-bf91-84f8b9d43a9d tempest-VolumesGetTest-752433910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d433f75f-3d2f-4794-a46e-600849fa39eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:42:08 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-2832dcd2-8e55-4ef9-bf91-84f8b9d43a9d tempest-VolumesGetTest-752433910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99510143-c7f3-4a62-b6be-7c9686faa64d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:42:08 devstack cinder-volume[87329]: DEBUG cinder.image.glance [None req-2832dcd2-8e55-4ef9-bf91-84f8b9d43a9d tempest-VolumesGetTest-752433910 None] Creating Keystone auth plugin from conf {{(pid=87329) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 06 06:42:09 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-2832dcd2-8e55-4ef9-bf91-84f8b9d43a9d tempest-VolumesGetTest-752433910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99510143-c7f3-4a62-b6be-7c9686faa64d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0e46229e-4caa-46f2-a8c3-f63c70401cfd', 'volume_name': 'volume-0e46229e-4caa-46f2-a8c3-f63c70401cfd', 'volume_size': 1, 'image_id': '7005ba32-ec39-44a3-88d9-ca6af0b34ea0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7005ba32-ec39-44a3-88d9-ca6af0b34ea0', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '65b0d6d605b2427d8db787d4220dbeb4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7005ba32-ec39-44a3-88d9-ca6af0b34ea0', 'created_at': datetime.datetime(2026, 9, 6, 4, 25, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 6, 4, 25, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7005ba32-ec39-44a3-88d9-ca6af0b34ea0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:42:09 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-2832dcd2-8e55-4ef9-bf91-84f8b9d43a9d tempest-VolumesGetTest-752433910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c06d8af9-aec9-4fba-b94b-b65113154334) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:42:09 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-2832dcd2-8e55-4ef9-bf91-84f8b9d43a9d tempest-VolumesGetTest-752433910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c06d8af9-aec9-4fba-b94b-b65113154334) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:42:09 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-2832dcd2-8e55-4ef9-bf91-84f8b9d43a9d tempest-VolumesGetTest-752433910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f922a3e-9857-43ea-9d11-a1da357d4bad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:42:09 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-2832dcd2-8e55-4ef9-bf91-84f8b9d43a9d tempest-VolumesGetTest-752433910 None] Volume 0e46229e-4caa-46f2-a8c3-f63c70401cfd: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0e46229e-4caa-46f2-a8c3-f63c70401cfd', 'volume_size': 1, 'image_id': '7005ba32-ec39-44a3-88d9-ca6af0b34ea0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7005ba32-ec39-44a3-88d9-ca6af0b34ea0', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '65b0d6d605b2427d8db787d4220dbeb4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7005ba32-ec39-44a3-88d9-ca6af0b34ea0', 'created_at': datetime.datetime(2026, 9, 6, 4, 25, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 6, 4, 25, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7005ba32-ec39-44a3-88d9-ca6af0b34ea0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 06 06:42:09 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-2832dcd2-8e55-4ef9-bf91-84f8b9d43a9d tempest-VolumesGetTest-752433910 None] Trying to clone 0e46229e-4caa-46f2-a8c3-f63c70401cfd from image 7005ba32-ec39-44a3-88d9-ca6af0b34ea0 at location (None, [{'url': 'file:///opt/stack/data/glance/images/7005ba32-ec39-44a3-88d9-ca6af0b34ea0', 'metadata': {}}]). {{(pid=87329) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 06 06:42:09 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-314c1ea3-2856-4376-b640-8f083e0c3516 tempest-SnapshotDependencyTests-1700047514 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87329) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 06:42:09 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-314c1ea3-2856-4376-b640-8f083e0c3516 tempest-SnapshotDependencyTests-1700047514 None] Flow 'volume_create_manager' (082e45d9-0c3b-4066-9349-5b682341e2fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:42:09 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-314c1ea3-2856-4376-b640-8f083e0c3516 tempest-SnapshotDependencyTests-1700047514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64969e95-a5b8-4391-9890-2e450a277eee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:42:09 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-314c1ea3-2856-4376-b640-8f083e0c3516 tempest-SnapshotDependencyTests-1700047514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64969e95-a5b8-4391-9890-2e450a277eee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:42:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1333173631',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34ec050f-0c87-40f2-8c06-d276232602a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e95349392ce549fca8c01367939232aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:42:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:42:09Z,use_quota=True,user_id='a753e23934e545458c2b2b9feb64db6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:42:09 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-314c1ea3-2856-4376-b640-8f083e0c3516 tempest-SnapshotDependencyTests-1700047514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa500143-17c6-4e0b-8c17-f1734c7d0f26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:42:09 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-314c1ea3-2856-4376-b640-8f083e0c3516 tempest-SnapshotDependencyTests-1700047514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa500143-17c6-4e0b-8c17-f1734c7d0f26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:42:09 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-314c1ea3-2856-4376-b640-8f083e0c3516 tempest-SnapshotDependencyTests-1700047514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05862cdc-a796-4775-8c6e-682be7afb79e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:42:09 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-314c1ea3-2856-4376-b640-8f083e0c3516 tempest-SnapshotDependencyTests-1700047514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05862cdc-a796-4775-8c6e-682be7afb79e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34ec050f-0c87-40f2-8c06-d276232602a6', 'volume_name': 'volume-34ec050f-0c87-40f2-8c06-d276232602a6', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:42:09 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-314c1ea3-2856-4376-b640-8f083e0c3516 tempest-SnapshotDependencyTests-1700047514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d966b7c4-5570-4a68-8244-71712eebaffe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:42:09 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-314c1ea3-2856-4376-b640-8f083e0c3516 tempest-SnapshotDependencyTests-1700047514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d966b7c4-5570-4a68-8244-71712eebaffe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:42:09 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-314c1ea3-2856-4376-b640-8f083e0c3516 tempest-SnapshotDependencyTests-1700047514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fe1205e-b23b-4d36-998f-872c33e1df84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:42:09 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-314c1ea3-2856-4376-b640-8f083e0c3516 tempest-SnapshotDependencyTests-1700047514 None] Volume 34ec050f-0c87-40f2-8c06-d276232602a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34ec050f-0c87-40f2-8c06-d276232602a6', 'volume_size': 1} Sep 06 06:42:09 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-314c1ea3-2856-4376-b640-8f083e0c3516 tempest-SnapshotDependencyTests-1700047514 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:42:09 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-314c1ea3-2856-4376-b640-8f083e0c3516 tempest-SnapshotDependencyTests-1700047514 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:42:09 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-314c1ea3-2856-4376-b640-8f083e0c3516 tempest-SnapshotDependencyTests-1700047514 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:42:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1333173631',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34ec050f-0c87-40f2-8c06-d276232602a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e95349392ce549fca8c01367939232aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:42:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:42:09Z,use_quota=True,user_id='a753e23934e545458c2b2b9feb64db6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)}" {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 06:42:09 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-314c1ea3-2856-4376-b640-8f083e0c3516 tempest-SnapshotDependencyTests-1700047514 None] Creating volume 34ec050f-0c87-40f2-8c06-d276232602a6 {{(pid=87329) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 06:42:09 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-314c1ea3-2856-4376-b640-8f083e0c3516 tempest-SnapshotDependencyTests-1700047514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:42:09 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-314c1ea3-2856-4376-b640-8f083e0c3516 tempest-SnapshotDependencyTests-1700047514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:42:09 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-314c1ea3-2856-4376-b640-8f083e0c3516 tempest-SnapshotDependencyTests-1700047514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:42:09 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-314c1ea3-2856-4376-b640-8f083e0c3516 tempest-SnapshotDependencyTests-1700047514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:42:09 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-314c1ea3-2856-4376-b640-8f083e0c3516 tempest-SnapshotDependencyTests-1700047514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:42:09 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-314c1ea3-2856-4376-b640-8f083e0c3516 tempest-SnapshotDependencyTests-1700047514 None] Selected osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 as target Quobyte volume. {{(pid=87329) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 06:42:09 devstack cinder-volume[87329]: INFO cinder.volume.drivers.remotefs [None req-314c1ea3-2856-4376-b640-8f083e0c3516 tempest-SnapshotDependencyTests-1700047514 None] casted to osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 Sep 06 06:42:09 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-314c1ea3-2856-4376-b640-8f083e0c3516 tempest-SnapshotDependencyTests-1700047514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-34ec050f-0c87-40f2-8c06-d276232602a6 1073741824 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:42:09 devstack sudo[100430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-34ec050f-0c87-40f2-8c06-d276232602a6 1073741824 Sep 06 06:42:09 devstack sudo[100430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:42:09 devstack cinder-volume[87329]: DEBUG cinder.image.image_utils [None req-2832dcd2-8e55-4ef9-bf91-84f8b9d43a9d tempest-VolumesGetTest-752433910 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_7005ba32-ec39-44a3-88d9-ca6af0b34ea0_6_ynt87ydevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87329) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 06 06:42:09 devstack cinder-volume[87329]: INFO cinder.image.image_utils [None req-2832dcd2-8e55-4ef9-bf91-84f8b9d43a9d tempest-VolumesGetTest-752433910 None] Image download 20.69 MB at 20.69 MB/s Sep 06 06:42:09 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e0d3e34-8462-4a2d-9652-2160395b60ef]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:42:09 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-2832dcd2-8e55-4ef9-bf91-84f8b9d43a9d tempest-VolumesGetTest-752433910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7005ba32-ec39-44a3-88d9-ca6af0b34ea0_6_ynt87ydevstack@QuobyteHD {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:42:09 devstack sudo[100437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7005ba32-ec39-44a3-88d9-ca6af0b34ea0_6_ynt87ydevstack@QuobyteHD Sep 06 06:42:09 devstack sudo[100437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:42:09 devstack sudo[100430]: pam_unix(sudo:session): session closed for user root Sep 06 06:42:09 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-314c1ea3-2856-4376-b640-8f083e0c3516 tempest-SnapshotDependencyTests-1700047514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-34ec050f-0c87-40f2-8c06-d276232602a6 1073741824" returned: 0 in 0.445s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:42:09 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-314c1ea3-2856-4376-b640-8f083e0c3516 tempest-SnapshotDependencyTests-1700047514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-34ec050f-0c87-40f2-8c06-d276232602a6 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:42:09 devstack sudo[100440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-34ec050f-0c87-40f2-8c06-d276232602a6 Sep 06 06:42:09 devstack sudo[100440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:42:09 devstack sudo[100437]: pam_unix(sudo:session): session closed for user root Sep 06 06:42:09 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-2832dcd2-8e55-4ef9-bf91-84f8b9d43a9d tempest-VolumesGetTest-752433910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7005ba32-ec39-44a3-88d9-ca6af0b34ea0_6_ynt87ydevstack@QuobyteHD" returned: 0 in 0.347s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:42:09 devstack cinder-volume[87329]: DEBUG cinder.image.image_utils [None req-2832dcd2-8e55-4ef9-bf91-84f8b9d43a9d tempest-VolumesGetTest-752433910 None] Temporary image 7005ba32-ec39-44a3-88d9-ca6af0b34ea0 is fetched for user b403002bde0446738f1c0ea9206318e4. {{(pid=87329) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 06 06:42:10 devstack sudo[100440]: pam_unix(sudo:session): session closed for user root Sep 06 06:42:10 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-314c1ea3-2856-4376-b640-8f083e0c3516 tempest-SnapshotDependencyTests-1700047514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-34ec050f-0c87-40f2-8c06-d276232602a6" returned: 0 in 0.243s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:42:10 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-314c1ea3-2856-4376-b640-8f083e0c3516 tempest-SnapshotDependencyTests-1700047514 None] <== create_volume: return (731ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'} {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 06:42:10 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-314c1ea3-2856-4376-b640-8f083e0c3516 tempest-SnapshotDependencyTests-1700047514 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.734s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:42:10 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb8c3a5a-436b-499f-9b6a-d022708c3b6f]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:42:10 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-2832dcd2-8e55-4ef9-bf91-84f8b9d43a9d tempest-VolumesGetTest-752433910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7005ba32-ec39-44a3-88d9-ca6af0b34ea0_6_ynt87ydevstack@QuobyteHD {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:42:10 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-314c1ea3-2856-4376-b640-8f083e0c3516 tempest-SnapshotDependencyTests-1700047514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fe1205e-b23b-4d36-998f-872c33e1df84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34ec050f-0c87-40f2-8c06-d276232602a6', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:42:10 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-314c1ea3-2856-4376-b640-8f083e0c3516 tempest-SnapshotDependencyTests-1700047514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f7a09a0-34af-4e9d-a335-24c3dbbf8c0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:42:10 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-314c1ea3-2856-4376-b640-8f083e0c3516 tempest-SnapshotDependencyTests-1700047514 None] Volume volume-34ec050f-0c87-40f2-8c06-d276232602a6 (34ec050f-0c87-40f2-8c06-d276232602a6): created successfully Sep 06 06:42:10 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-314c1ea3-2856-4376-b640-8f083e0c3516 tempest-SnapshotDependencyTests-1700047514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f7a09a0-34af-4e9d-a335-24c3dbbf8c0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:42:10 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-314c1ea3-2856-4376-b640-8f083e0c3516 tempest-SnapshotDependencyTests-1700047514 None] Flow 'volume_create_manager' (082e45d9-0c3b-4066-9349-5b682341e2fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:42:10 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-314c1ea3-2856-4376-b640-8f083e0c3516 tempest-SnapshotDependencyTests-1700047514 None] Created volume successfully. Sep 06 06:42:10 devstack sudo[100446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7005ba32-ec39-44a3-88d9-ca6af0b34ea0_6_ynt87ydevstack@QuobyteHD Sep 06 06:42:10 devstack sudo[100446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:42:10 devstack sudo[100446]: pam_unix(sudo:session): session closed for user root Sep 06 06:42:10 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-2832dcd2-8e55-4ef9-bf91-84f8b9d43a9d tempest-VolumesGetTest-752433910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7005ba32-ec39-44a3-88d9-ca6af0b34ea0_6_ynt87ydevstack@QuobyteHD" returned: 0 in 0.326s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:42:10 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-2832dcd2-8e55-4ef9-bf91-84f8b9d43a9d tempest-VolumesGetTest-752433910 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:42:10 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-2832dcd2-8e55-4ef9-bf91-84f8b9d43a9d tempest-VolumesGetTest-752433910 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:42:10 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-2832dcd2-8e55-4ef9-bf91-84f8b9d43a9d tempest-VolumesGetTest-752433910 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:42:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-709559685',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e46229e-4caa-46f2-a8c3-f63c70401cfd,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='c90d8f93af0e4316b970f01878855707',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:42:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:42:09Z,use_quota=True,user_id='b403002bde0446738f1c0ea9206318e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)}" {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 06:42:10 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-2832dcd2-8e55-4ef9-bf91-84f8b9d43a9d tempest-VolumesGetTest-752433910 None] Creating volume 0e46229e-4caa-46f2-a8c3-f63c70401cfd {{(pid=87329) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 06:42:10 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-2832dcd2-8e55-4ef9-bf91-84f8b9d43a9d tempest-VolumesGetTest-752433910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:42:10 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-2832dcd2-8e55-4ef9-bf91-84f8b9d43a9d tempest-VolumesGetTest-752433910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:42:10 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-2832dcd2-8e55-4ef9-bf91-84f8b9d43a9d tempest-VolumesGetTest-752433910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:42:10 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-2832dcd2-8e55-4ef9-bf91-84f8b9d43a9d tempest-VolumesGetTest-752433910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:42:10 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-2832dcd2-8e55-4ef9-bf91-84f8b9d43a9d tempest-VolumesGetTest-752433910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:42:10 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-2832dcd2-8e55-4ef9-bf91-84f8b9d43a9d tempest-VolumesGetTest-752433910 None] Selected osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 as target Quobyte volume. {{(pid=87329) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 06:42:10 devstack cinder-volume[87329]: INFO cinder.volume.drivers.remotefs [None req-2832dcd2-8e55-4ef9-bf91-84f8b9d43a9d tempest-VolumesGetTest-752433910 None] casted to osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 Sep 06 06:42:10 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-2832dcd2-8e55-4ef9-bf91-84f8b9d43a9d tempest-VolumesGetTest-752433910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-0e46229e-4caa-46f2-a8c3-f63c70401cfd 1073741824 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:42:10 devstack sudo[100451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-0e46229e-4caa-46f2-a8c3-f63c70401cfd 1073741824 Sep 06 06:42:10 devstack sudo[100451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:42:10 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-964fa7f8-25ed-42d3-ba59-176762448a14 tempest-SnapshotDependencyTests-1700047514 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:42:10 devstack sudo[100451]: pam_unix(sudo:session): session closed for user root Sep 06 06:42:10 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-2832dcd2-8e55-4ef9-bf91-84f8b9d43a9d tempest-VolumesGetTest-752433910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-0e46229e-4caa-46f2-a8c3-f63c70401cfd 1073741824" returned: 0 in 0.407s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:42:10 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-2832dcd2-8e55-4ef9-bf91-84f8b9d43a9d tempest-VolumesGetTest-752433910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-0e46229e-4caa-46f2-a8c3-f63c70401cfd {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:42:10 devstack sudo[100457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-0e46229e-4caa-46f2-a8c3-f63c70401cfd Sep 06 06:42:10 devstack sudo[100457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:42:11 devstack sudo[100457]: pam_unix(sudo:session): session closed for user root Sep 06 06:42:11 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-2832dcd2-8e55-4ef9-bf91-84f8b9d43a9d tempest-VolumesGetTest-752433910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-0e46229e-4caa-46f2-a8c3-f63c70401cfd" returned: 0 in 0.236s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:42:11 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-2832dcd2-8e55-4ef9-bf91-84f8b9d43a9d tempest-VolumesGetTest-752433910 None] <== create_volume: return (679ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'} {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 06:42:11 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-2832dcd2-8e55-4ef9-bf91-84f8b9d43a9d tempest-VolumesGetTest-752433910 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.682s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:42:11 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-964fa7f8-25ed-42d3-ba59-176762448a14 tempest-SnapshotDependencyTests-1700047514 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.607s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:42:11 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-964fa7f8-25ed-42d3-ba59-176762448a14 tempest-SnapshotDependencyTests-1700047514 None] Creating offline snapshot fb75f3b0-1244-483d-b66c-cb112076accb of volume 34ec050f-0c87-40f2-8c06-d276232602a6 {{(pid=87329) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 06 06:42:11 devstack cinder-volume[87329]: DEBUG cinder.volume.volume_utils [None req-2832dcd2-8e55-4ef9-bf91-84f8b9d43a9d tempest-VolumesGetTest-752433910 None] Attempting download of 7005ba32-ec39-44a3-88d9-ca6af0b34ea0 ((None, [{'url': 'file:///opt/stack/data/glance/images/7005ba32-ec39-44a3-88d9-ca6af0b34ea0', 'metadata': {}}])) to volume 0e46229e-4caa-46f2-a8c3-f63c70401cfd. {{(pid=87329) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 06 06:42:11 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[68f0a90d-1def-4fed-8671-48773052d362]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:42:11 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-964fa7f8-25ed-42d3-ba59-176762448a14 tempest-SnapshotDependencyTests-1700047514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-34ec050f-0c87-40f2-8c06-d276232602a6 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:42:11 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce7e79fa-20fc-4dad-9061-f3f6d1b683d1]: (4, 'raw') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:42:11 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-2832dcd2-8e55-4ef9-bf91-84f8b9d43a9d tempest-VolumesGetTest-752433910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7005ba32-ec39-44a3-88d9-ca6af0b34ea0_iiuwqoso {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:42:11 devstack sudo[100460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-34ec050f-0c87-40f2-8c06-d276232602a6 Sep 06 06:42:11 devstack sudo[100460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:42:11 devstack sudo[100461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7005ba32-ec39-44a3-88d9-ca6af0b34ea0_iiuwqoso Sep 06 06:42:11 devstack sudo[100461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:42:11 devstack sudo[100460]: pam_unix(sudo:session): session closed for user root Sep 06 06:42:11 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-964fa7f8-25ed-42d3-ba59-176762448a14 tempest-SnapshotDependencyTests-1700047514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-34ec050f-0c87-40f2-8c06-d276232602a6" returned: 0 in 0.359s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:42:11 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-964fa7f8-25ed-42d3-ba59-176762448a14 tempest-SnapshotDependencyTests-1700047514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-34ec050f-0c87-40f2-8c06-d276232602a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-34ec050f-0c87-40f2-8c06-d276232602a6.fb75f3b0-1244-483d-b66c-cb112076accb 1G {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:42:11 devstack sudo[100461]: pam_unix(sudo:session): session closed for user root Sep 06 06:42:11 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-2832dcd2-8e55-4ef9-bf91-84f8b9d43a9d tempest-VolumesGetTest-752433910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7005ba32-ec39-44a3-88d9-ca6af0b34ea0_iiuwqoso" returned: 0 in 0.333s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:42:11 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-2832dcd2-8e55-4ef9-bf91-84f8b9d43a9d tempest-VolumesGetTest-752433910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7005ba32-ec39-44a3-88d9-ca6af0b34ea0_iiuwqoso {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:42:11 devstack sudo[100469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-34ec050f-0c87-40f2-8c06-d276232602a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-34ec050f-0c87-40f2-8c06-d276232602a6.fb75f3b0-1244-483d-b66c-cb112076accb 1G Sep 06 06:42:11 devstack sudo[100469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:42:11 devstack sudo[100470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7005ba32-ec39-44a3-88d9-ca6af0b34ea0_iiuwqoso Sep 06 06:42:11 devstack sudo[100470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:42:11 devstack sudo[100470]: pam_unix(sudo:session): session closed for user root Sep 06 06:42:11 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-2832dcd2-8e55-4ef9-bf91-84f8b9d43a9d tempest-VolumesGetTest-752433910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7005ba32-ec39-44a3-88d9-ca6af0b34ea0_iiuwqoso" returned: 1 in 0.320s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:42:11 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-2832dcd2-8e55-4ef9-bf91-84f8b9d43a9d tempest-VolumesGetTest-752433910 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7005ba32-ec39-44a3-88d9-ca6af0b34ea0_iiuwqoso' failed. Not Retrying. {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 06 06:42:11 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f048b69-85e6-4026-9d8b-a10485ef6dac]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:42:11 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-2832dcd2-8e55-4ef9-bf91-84f8b9d43a9d tempest-VolumesGetTest-752433910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7005ba32-ec39-44a3-88d9-ca6af0b34ea0_6_ynt87ydevstack@QuobyteHD {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:42:11 devstack sudo[100469]: pam_unix(sudo:session): session closed for user root Sep 06 06:42:11 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-964fa7f8-25ed-42d3-ba59-176762448a14 tempest-SnapshotDependencyTests-1700047514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-34ec050f-0c87-40f2-8c06-d276232602a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-34ec050f-0c87-40f2-8c06-d276232602a6.fb75f3b0-1244-483d-b66c-cb112076accb 1G" returned: 0 in 0.376s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:42:11 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-964fa7f8-25ed-42d3-ba59-176762448a14 tempest-SnapshotDependencyTests-1700047514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34ec050f-0c87-40f2-8c06-d276232602a6 -F qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-34ec050f-0c87-40f2-8c06-d276232602a6.fb75f3b0-1244-483d-b66c-cb112076accb {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:42:11 devstack sudo[100479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34ec050f-0c87-40f2-8c06-d276232602a6 -F qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-34ec050f-0c87-40f2-8c06-d276232602a6.fb75f3b0-1244-483d-b66c-cb112076accb Sep 06 06:42:11 devstack sudo[100479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:42:11 devstack sudo[100478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7005ba32-ec39-44a3-88d9-ca6af0b34ea0_6_ynt87ydevstack@QuobyteHD Sep 06 06:42:11 devstack sudo[100478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:42:12 devstack sudo[100479]: pam_unix(sudo:session): session closed for user root Sep 06 06:42:12 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-964fa7f8-25ed-42d3-ba59-176762448a14 tempest-SnapshotDependencyTests-1700047514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34ec050f-0c87-40f2-8c06-d276232602a6 -F qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-34ec050f-0c87-40f2-8c06-d276232602a6.fb75f3b0-1244-483d-b66c-cb112076accb" returned: 0 in 0.295s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:42:12 devstack cinder-volume[87329]: WARNING cinder.volume.drivers.remotefs [None req-964fa7f8-25ed-42d3-ba59-176762448a14 tempest-SnapshotDependencyTests-1700047514 None] /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-34ec050f-0c87-40f2-8c06-d276232602a6.fb75f3b0-1244-483d-b66c-cb112076accb is being set with open permissions: ugo+rw Sep 06 06:42:12 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-964fa7f8-25ed-42d3-ba59-176762448a14 tempest-SnapshotDependencyTests-1700047514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-34ec050f-0c87-40f2-8c06-d276232602a6.fb75f3b0-1244-483d-b66c-cb112076accb {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:42:12 devstack sudo[100478]: pam_unix(sudo:session): session closed for user root Sep 06 06:42:12 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-2832dcd2-8e55-4ef9-bf91-84f8b9d43a9d tempest-VolumesGetTest-752433910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7005ba32-ec39-44a3-88d9-ca6af0b34ea0_6_ynt87ydevstack@QuobyteHD" returned: 0 in 0.338s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:42:12 devstack cinder-volume[87329]: DEBUG cinder.image.image_utils [None req-2832dcd2-8e55-4ef9-bf91-84f8b9d43a9d tempest-VolumesGetTest-752433910 None] 7005ba32-ec39-44a3-88d9-ca6af0b34ea0 was qcow2, converting to qcow2 {{(pid=87329) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 06 06:42:12 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-2832dcd2-8e55-4ef9-bf91-84f8b9d43a9d tempest-VolumesGetTest-752433910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7005ba32-ec39-44a3-88d9-ca6af0b34ea0_6_ynt87ydevstack@QuobyteHD /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-0e46229e-4caa-46f2-a8c3-f63c70401cfd {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:42:12 devstack sudo[100488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-34ec050f-0c87-40f2-8c06-d276232602a6.fb75f3b0-1244-483d-b66c-cb112076accb Sep 06 06:42:12 devstack sudo[100488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:42:12 devstack sudo[100489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7005ba32-ec39-44a3-88d9-ca6af0b34ea0_6_ynt87ydevstack@QuobyteHD /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-0e46229e-4caa-46f2-a8c3-f63c70401cfd Sep 06 06:42:12 devstack sudo[100489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:42:12 devstack sudo[100488]: pam_unix(sudo:session): session closed for user root Sep 06 06:42:12 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-964fa7f8-25ed-42d3-ba59-176762448a14 tempest-SnapshotDependencyTests-1700047514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-34ec050f-0c87-40f2-8c06-d276232602a6.fb75f3b0-1244-483d-b66c-cb112076accb" returned: 0 in 0.243s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:42:12 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-964fa7f8-25ed-42d3-ba59-176762448a14 tempest-SnapshotDependencyTests-1700047514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-34ec050f-0c87-40f2-8c06-d276232602a6.info {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:42:12 devstack sudo[100496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-34ec050f-0c87-40f2-8c06-d276232602a6.info Sep 06 06:42:12 devstack sudo[100496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:42:12 devstack sudo[100496]: pam_unix(sudo:session): session closed for user root Sep 06 06:42:12 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-964fa7f8-25ed-42d3-ba59-176762448a14 tempest-SnapshotDependencyTests-1700047514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-34ec050f-0c87-40f2-8c06-d276232602a6.info" returned: 0 in 0.273s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:42:12 devstack cinder-volume[87329]: WARNING cinder.volume.drivers.remotefs [None req-964fa7f8-25ed-42d3-ba59-176762448a14 tempest-SnapshotDependencyTests-1700047514 None] /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-34ec050f-0c87-40f2-8c06-d276232602a6.info is being set with open permissions: ugo+rw Sep 06 06:42:12 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-964fa7f8-25ed-42d3-ba59-176762448a14 tempest-SnapshotDependencyTests-1700047514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-34ec050f-0c87-40f2-8c06-d276232602a6.info {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:42:12 devstack sudo[100508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-34ec050f-0c87-40f2-8c06-d276232602a6.info Sep 06 06:42:12 devstack sudo[100508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:42:12 devstack sudo[100508]: pam_unix(sudo:session): session closed for user root Sep 06 06:42:12 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-964fa7f8-25ed-42d3-ba59-176762448a14 tempest-SnapshotDependencyTests-1700047514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-34ec050f-0c87-40f2-8c06-d276232602a6.info" returned: 0 in 0.267s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:42:12 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-964fa7f8-25ed-42d3-ba59-176762448a14 tempest-SnapshotDependencyTests-1700047514 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.911s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:42:13 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-964fa7f8-25ed-42d3-ba59-176762448a14 tempest-SnapshotDependencyTests-1700047514 None] Create snapshot completed successfully Sep 06 06:42:13 devstack sudo[100489]: pam_unix(sudo:session): session closed for user root Sep 06 06:42:13 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-2832dcd2-8e55-4ef9-bf91-84f8b9d43a9d tempest-VolumesGetTest-752433910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7005ba32-ec39-44a3-88d9-ca6af0b34ea0_6_ynt87ydevstack@QuobyteHD /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-0e46229e-4caa-46f2-a8c3-f63c70401cfd" returned: 0 in 1.619s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:42:13 devstack cinder-volume[87329]: DEBUG cinder.image.image_utils [None req-2832dcd2-8e55-4ef9-bf91-84f8b9d43a9d tempest-VolumesGetTest-752433910 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_7005ba32-ec39-44a3-88d9-ca6af0b34ea0_6_ynt87ydevstack@QuobyteHD, size 112.00 MB, duration 1.62 sec, destination /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-0e46229e-4caa-46f2-a8c3-f63c70401cfd {{(pid=87329) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 06 06:42:13 devstack cinder-volume[87329]: INFO cinder.image.image_utils [None req-2832dcd2-8e55-4ef9-bf91-84f8b9d43a9d tempest-VolumesGetTest-752433910 None] Converted 112.00 MB image at 69.13 MB/s Sep 06 06:42:13 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-2832dcd2-8e55-4ef9-bf91-84f8b9d43a9d tempest-VolumesGetTest-752433910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-0e46229e-4caa-46f2-a8c3-f63c70401cfd 1G {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:42:13 devstack sudo[100511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-0e46229e-4caa-46f2-a8c3-f63c70401cfd 1G Sep 06 06:42:13 devstack sudo[100511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:42:14 devstack sudo[100511]: pam_unix(sudo:session): session closed for user root Sep 06 06:42:14 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-2832dcd2-8e55-4ef9-bf91-84f8b9d43a9d tempest-VolumesGetTest-752433910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-0e46229e-4caa-46f2-a8c3-f63c70401cfd 1G" returned: 0 in 0.387s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:42:14 devstack cinder-volume[87329]: DEBUG cinder.volume.volume_utils [None req-2832dcd2-8e55-4ef9-bf91-84f8b9d43a9d tempest-VolumesGetTest-752433910 None] Downloaded image 7005ba32-ec39-44a3-88d9-ca6af0b34ea0 ((None, [{'url': 'file:///opt/stack/data/glance/images/7005ba32-ec39-44a3-88d9-ca6af0b34ea0', 'metadata': {}}])) to volume 0e46229e-4caa-46f2-a8c3-f63c70401cfd successfully. {{(pid=87329) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 06 06:42:14 devstack cinder-volume[87329]: DEBUG cinder.image.image_utils [None req-2832dcd2-8e55-4ef9-bf91-84f8b9d43a9d tempest-VolumesGetTest-752433910 None] Temporary image 7005ba32-ec39-44a3-88d9-ca6af0b34ea0 for user b403002bde0446738f1c0ea9206318e4 is deleted. {{(pid=87329) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 06 06:42:14 devstack cinder-volume[87329]: DEBUG cinder.volume.volume_utils [None req-2832dcd2-8e55-4ef9-bf91-84f8b9d43a9d tempest-VolumesGetTest-752433910 None] Marking volume 0e46229e-4caa-46f2-a8c3-f63c70401cfd as bootable. {{(pid=87329) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 06 06:42:14 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-2832dcd2-8e55-4ef9-bf91-84f8b9d43a9d tempest-VolumesGetTest-752433910 None] Copying metadata from image 7005ba32-ec39-44a3-88d9-ca6af0b34ea0 to 0e46229e-4caa-46f2-a8c3-f63c70401cfd. {{(pid=87329) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 06 06:42:14 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-2832dcd2-8e55-4ef9-bf91-84f8b9d43a9d tempest-VolumesGetTest-752433910 None] Creating volume glance metadata for volume 0e46229e-4caa-46f2-a8c3-f63c70401cfd backed by image 7005ba32-ec39-44a3-88d9-ca6af0b34ea0 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '7005ba32-ec39-44a3-88d9-ca6af0b34ea0', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87329) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 06 06:42:14 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-2832dcd2-8e55-4ef9-bf91-84f8b9d43a9d tempest-VolumesGetTest-752433910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f922a3e-9857-43ea-9d11-a1da357d4bad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e46229e-4caa-46f2-a8c3-f63c70401cfd', 'volume_size': 1, 'image_id': '7005ba32-ec39-44a3-88d9-ca6af0b34ea0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7005ba32-ec39-44a3-88d9-ca6af0b34ea0', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '65b0d6d605b2427d8db787d4220dbeb4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7005ba32-ec39-44a3-88d9-ca6af0b34ea0', 'created_at': datetime.datetime(2026, 9, 6, 4, 25, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 6, 4, 25, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7005ba32-ec39-44a3-88d9-ca6af0b34ea0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:42:14 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-2832dcd2-8e55-4ef9-bf91-84f8b9d43a9d tempest-VolumesGetTest-752433910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87347390-4762-4e9e-837e-4679d4d2c542) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:42:14 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-2832dcd2-8e55-4ef9-bf91-84f8b9d43a9d tempest-VolumesGetTest-752433910 None] Volume volume-0e46229e-4caa-46f2-a8c3-f63c70401cfd (0e46229e-4caa-46f2-a8c3-f63c70401cfd): created successfully Sep 06 06:42:14 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-2832dcd2-8e55-4ef9-bf91-84f8b9d43a9d tempest-VolumesGetTest-752433910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87347390-4762-4e9e-837e-4679d4d2c542) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:42:14 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-2832dcd2-8e55-4ef9-bf91-84f8b9d43a9d tempest-VolumesGetTest-752433910 None] Flow 'volume_create_manager' (1135600c-531f-426a-b97b-1216acdaed0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:42:14 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-2832dcd2-8e55-4ef9-bf91-84f8b9d43a9d tempest-VolumesGetTest-752433910 None] Created volume successfully. Sep 06 06:42:14 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-928c15ed-233b-44f3-81de-eb5a689e05da tempest-SnapshotDependencyTests-1700047514 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87329) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 06:42:14 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-928c15ed-233b-44f3-81de-eb5a689e05da tempest-SnapshotDependencyTests-1700047514 None] Flow 'volume_create_manager' (6c2def38-2184-426a-a263-ada9fc4289b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:42:14 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-928c15ed-233b-44f3-81de-eb5a689e05da tempest-SnapshotDependencyTests-1700047514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2bf32d4-358d-40c5-b05f-1194e85d8a73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:42:14 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-928c15ed-233b-44f3-81de-eb5a689e05da tempest-SnapshotDependencyTests-1700047514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2bf32d4-358d-40c5-b05f-1194e85d8a73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:42:14Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5652d22-331e-4c0f-9785-7e1547d26d2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e95349392ce549fca8c01367939232aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:42:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=fb75f3b0-1244-483d-b66c-cb112076accb,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:42:14Z,use_quota=True,user_id='a753e23934e545458c2b2b9feb64db6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:42:14 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-928c15ed-233b-44f3-81de-eb5a689e05da tempest-SnapshotDependencyTests-1700047514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3bb8abc-3c08-4981-a3e4-7d7c903a09e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:42:14 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-928c15ed-233b-44f3-81de-eb5a689e05da tempest-SnapshotDependencyTests-1700047514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3bb8abc-3c08-4981-a3e4-7d7c903a09e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:42:14 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-928c15ed-233b-44f3-81de-eb5a689e05da tempest-SnapshotDependencyTests-1700047514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0392fedc-af4a-49c0-a2dc-600e7533607c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:42:14 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-928c15ed-233b-44f3-81de-eb5a689e05da tempest-SnapshotDependencyTests-1700047514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0392fedc-af4a-49c0-a2dc-600e7533607c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd5652d22-331e-4c0f-9785-7e1547d26d2d', 'volume_name': 'volume-d5652d22-331e-4c0f-9785-7e1547d26d2d', 'volume_size': 1, 'snapshot_id': 'fb75f3b0-1244-483d-b66c-cb112076accb'}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:42:14 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-928c15ed-233b-44f3-81de-eb5a689e05da tempest-SnapshotDependencyTests-1700047514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (829768ca-a61d-4193-a522-a652887d56e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:42:14 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-928c15ed-233b-44f3-81de-eb5a689e05da tempest-SnapshotDependencyTests-1700047514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (829768ca-a61d-4193-a522-a652887d56e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:42:14 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-928c15ed-233b-44f3-81de-eb5a689e05da tempest-SnapshotDependencyTests-1700047514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7274c4b2-ec48-4ef3-8aae-3c5bf1f0c1f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:42:14 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-928c15ed-233b-44f3-81de-eb5a689e05da tempest-SnapshotDependencyTests-1700047514 None] Volume d5652d22-331e-4c0f-9785-7e1547d26d2d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d5652d22-331e-4c0f-9785-7e1547d26d2d', 'volume_size': 1, 'snapshot_id': 'fb75f3b0-1244-483d-b66c-cb112076accb'} Sep 06 06:42:14 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-928c15ed-233b-44f3-81de-eb5a689e05da tempest-SnapshotDependencyTests-1700047514 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:42:14 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-928c15ed-233b-44f3-81de-eb5a689e05da tempest-SnapshotDependencyTests-1700047514 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:42:14 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-928c15ed-233b-44f3-81de-eb5a689e05da tempest-SnapshotDependencyTests-1700047514 None] Acquiring lock "cinder-quobyte-fb75f3b0-1244-483d-b66c-cb112076accb-d5652d22-331e-4c0f-9785-7e1547d26d2d" by "_create_volume_from_snapshot" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:42:14 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-928c15ed-233b-44f3-81de-eb5a689e05da tempest-SnapshotDependencyTests-1700047514 None] Lock "cinder-quobyte-fb75f3b0-1244-483d-b66c-cb112076accb-d5652d22-331e-4c0f-9785-7e1547d26d2d" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:42:14 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-928c15ed-233b-44f3-81de-eb5a689e05da tempest-SnapshotDependencyTests-1700047514 None] Creating volume d5652d22-331e-4c0f-9785-7e1547d26d2d from snapshot fb75f3b0-1244-483d-b66c-cb112076accb {{(pid=87329) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 06 06:42:14 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-928c15ed-233b-44f3-81de-eb5a689e05da tempest-SnapshotDependencyTests-1700047514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:42:14 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-928c15ed-233b-44f3-81de-eb5a689e05da tempest-SnapshotDependencyTests-1700047514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:42:14 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-928c15ed-233b-44f3-81de-eb5a689e05da tempest-SnapshotDependencyTests-1700047514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:42:14 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-928c15ed-233b-44f3-81de-eb5a689e05da tempest-SnapshotDependencyTests-1700047514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:42:14 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-928c15ed-233b-44f3-81de-eb5a689e05da tempest-SnapshotDependencyTests-1700047514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:42:14 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-928c15ed-233b-44f3-81de-eb5a689e05da tempest-SnapshotDependencyTests-1700047514 None] Selected osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 as target Quobyte volume. {{(pid=87329) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 06:42:14 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-928c15ed-233b-44f3-81de-eb5a689e05da tempest-SnapshotDependencyTests-1700047514 None] Acquiring lock "cinder-quobyte-d5652d22-331e-4c0f-9785-7e1547d26d2d" by "_copy_volume_from_snapshot" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:42:14 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-928c15ed-233b-44f3-81de-eb5a689e05da tempest-SnapshotDependencyTests-1700047514 None] Lock "cinder-quobyte-d5652d22-331e-4c0f-9785-7e1547d26d2d" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:42:14 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-928c15ed-233b-44f3-81de-eb5a689e05da tempest-SnapshotDependencyTests-1700047514 None] snapshot: fb75f3b0-1244-483d-b66c-cb112076accb, volume: d5652d22-331e-4c0f-9785-7e1547d26d2d, {{(pid=87329) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 06 06:42:14 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-928c15ed-233b-44f3-81de-eb5a689e05da tempest-SnapshotDependencyTests-1700047514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:42:14 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-928c15ed-233b-44f3-81de-eb5a689e05da tempest-SnapshotDependencyTests-1700047514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:42:14 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-928c15ed-233b-44f3-81de-eb5a689e05da tempest-SnapshotDependencyTests-1700047514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:42:14 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-928c15ed-233b-44f3-81de-eb5a689e05da tempest-SnapshotDependencyTests-1700047514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:42:14 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-928c15ed-233b-44f3-81de-eb5a689e05da tempest-SnapshotDependencyTests-1700047514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:42:14 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[0520142a-9d68-4f32-8a29-3b5f695ceed2]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:42:14 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-928c15ed-233b-44f3-81de-eb5a689e05da tempest-SnapshotDependencyTests-1700047514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-34ec050f-0c87-40f2-8c06-d276232602a6.fb75f3b0-1244-483d-b66c-cb112076accb {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:42:14 devstack sudo[100516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-34ec050f-0c87-40f2-8c06-d276232602a6.fb75f3b0-1244-483d-b66c-cb112076accb Sep 06 06:42:14 devstack sudo[100516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:42:14 devstack sudo[100516]: pam_unix(sudo:session): session closed for user root Sep 06 06:42:14 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-928c15ed-233b-44f3-81de-eb5a689e05da tempest-SnapshotDependencyTests-1700047514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-34ec050f-0c87-40f2-8c06-d276232602a6.fb75f3b0-1244-483d-b66c-cb112076accb" returned: 0 in 0.354s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:42:14 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-928c15ed-233b-44f3-81de-eb5a689e05da tempest-SnapshotDependencyTests-1700047514 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-34ec050f-0c87-40f2-8c06-d276232602a6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87329) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 06:42:14 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[68ba232d-23a3-4e1a-978c-67bf56cf1ef9]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:42:14 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-928c15ed-233b-44f3-81de-eb5a689e05da tempest-SnapshotDependencyTests-1700047514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-34ec050f-0c87-40f2-8c06-d276232602a6 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:42:14 devstack sudo[100521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-34ec050f-0c87-40f2-8c06-d276232602a6 Sep 06 06:42:14 devstack sudo[100521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:42:15 devstack sudo[100521]: pam_unix(sudo:session): session closed for user root Sep 06 06:42:15 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-928c15ed-233b-44f3-81de-eb5a689e05da tempest-SnapshotDependencyTests-1700047514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-34ec050f-0c87-40f2-8c06-d276232602a6" returned: 0 in 0.363s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:42:15 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-928c15ed-233b-44f3-81de-eb5a689e05da tempest-SnapshotDependencyTests-1700047514 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-34ec050f-0c87-40f2-8c06-d276232602a6 {{(pid=87329) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 06 06:42:15 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-928c15ed-233b-44f3-81de-eb5a689e05da tempest-SnapshotDependencyTests-1700047514 None] Creating direct copy from snapshot {{(pid=87329) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 06 06:42:15 devstack cinder-volume[87329]: DEBUG cinder.utils [None req-928c15ed-233b-44f3-81de-eb5a689e05da tempest-SnapshotDependencyTests-1700047514 None] Path /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-d5652d22-331e-4c0f-9785-7e1547d26d2d not found in is_blk_device check {{(pid=87329) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 06 06:42:15 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-928c15ed-233b-44f3-81de-eb5a689e05da tempest-SnapshotDependencyTests-1700047514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-34ec050f-0c87-40f2-8c06-d276232602a6 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-d5652d22-331e-4c0f-9785-7e1547d26d2d {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:42:15 devstack sudo[100526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-34ec050f-0c87-40f2-8c06-d276232602a6 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-d5652d22-331e-4c0f-9785-7e1547d26d2d Sep 06 06:42:15 devstack sudo[100526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:42:16 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-01a8a30a-658f-453a-9a8a-c71b99baa885 tempest-VolumesGetTest-752433910 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87329) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 06:42:16 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-01a8a30a-658f-453a-9a8a-c71b99baa885 tempest-VolumesGetTest-752433910 None] Flow 'volume_create_manager' (6d260185-5666-4e58-a2aa-3082ef7d6487) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:42:16 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-01a8a30a-658f-453a-9a8a-c71b99baa885 tempest-VolumesGetTest-752433910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa11ac7e-3d54-4778-aca6-cce229487d65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:42:16 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-01a8a30a-658f-453a-9a8a-c71b99baa885 tempest-VolumesGetTest-752433910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa11ac7e-3d54-4778-aca6-cce229487d65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:42:16Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-404793058',display_name='tempest-VolumesGetTest-Volume-695496334',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb81c72c-1e71-42aa-b3df-3bf88aab3922,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c90d8f93af0e4316b970f01878855707',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:42:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:42:16Z,use_quota=True,user_id='b403002bde0446738f1c0ea9206318e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:42:16 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-01a8a30a-658f-453a-9a8a-c71b99baa885 tempest-VolumesGetTest-752433910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f9de0cc-7ff1-4277-9ee5-5af42e651584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:42:16 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-01a8a30a-658f-453a-9a8a-c71b99baa885 tempest-VolumesGetTest-752433910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f9de0cc-7ff1-4277-9ee5-5af42e651584) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:42:16 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-01a8a30a-658f-453a-9a8a-c71b99baa885 tempest-VolumesGetTest-752433910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c11623b-9d44-4767-9b8f-a5a7534587d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:42:16 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-01a8a30a-658f-453a-9a8a-c71b99baa885 tempest-VolumesGetTest-752433910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c11623b-9d44-4767-9b8f-a5a7534587d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb81c72c-1e71-42aa-b3df-3bf88aab3922', 'volume_name': 'volume-eb81c72c-1e71-42aa-b3df-3bf88aab3922', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:42:16 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-01a8a30a-658f-453a-9a8a-c71b99baa885 tempest-VolumesGetTest-752433910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17885d0b-380d-4e37-b5f7-89669b95e872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:42:16 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-01a8a30a-658f-453a-9a8a-c71b99baa885 tempest-VolumesGetTest-752433910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17885d0b-380d-4e37-b5f7-89669b95e872) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:42:16 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-01a8a30a-658f-453a-9a8a-c71b99baa885 tempest-VolumesGetTest-752433910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c52f039a-1a7f-4970-9aa0-1ff804029c09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:42:16 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-01a8a30a-658f-453a-9a8a-c71b99baa885 tempest-VolumesGetTest-752433910 None] Volume eb81c72c-1e71-42aa-b3df-3bf88aab3922: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb81c72c-1e71-42aa-b3df-3bf88aab3922', 'volume_size': 1} Sep 06 06:42:16 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-01a8a30a-658f-453a-9a8a-c71b99baa885 tempest-VolumesGetTest-752433910 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:42:20 devstack sudo[100526]: pam_unix(sudo:session): session closed for user root Sep 06 06:42:20 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-928c15ed-233b-44f3-81de-eb5a689e05da tempest-SnapshotDependencyTests-1700047514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-34ec050f-0c87-40f2-8c06-d276232602a6 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-d5652d22-331e-4c0f-9785-7e1547d26d2d" returned: 0 in 5.517s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:42:20 devstack cinder-volume[87329]: DEBUG cinder.image.image_utils [None req-928c15ed-233b-44f3-81de-eb5a689e05da tempest-SnapshotDependencyTests-1700047514 None] Image conversion details: src /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-34ec050f-0c87-40f2-8c06-d276232602a6, size 1024.00 MB, duration 5.52 sec, destination /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-d5652d22-331e-4c0f-9785-7e1547d26d2d {{(pid=87329) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 06 06:42:20 devstack cinder-volume[87329]: INFO cinder.image.image_utils [None req-928c15ed-233b-44f3-81de-eb5a689e05da tempest-SnapshotDependencyTests-1700047514 None] Converted 1024.00 MB image at 185.59 MB/s Sep 06 06:42:20 devstack cinder-volume[87329]: WARNING cinder.volume.drivers.remotefs [None req-928c15ed-233b-44f3-81de-eb5a689e05da tempest-SnapshotDependencyTests-1700047514 None] /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-d5652d22-331e-4c0f-9785-7e1547d26d2d is being set with open permissions: ugo+rw Sep 06 06:42:20 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-928c15ed-233b-44f3-81de-eb5a689e05da tempest-SnapshotDependencyTests-1700047514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-d5652d22-331e-4c0f-9785-7e1547d26d2d {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:42:20 devstack sudo[100566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-d5652d22-331e-4c0f-9785-7e1547d26d2d Sep 06 06:42:20 devstack sudo[100566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:42:20 devstack sudo[100566]: pam_unix(sudo:session): session closed for user root Sep 06 06:42:21 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-928c15ed-233b-44f3-81de-eb5a689e05da tempest-SnapshotDependencyTests-1700047514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-d5652d22-331e-4c0f-9785-7e1547d26d2d" returned: 0 in 0.239s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:42:21 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-928c15ed-233b-44f3-81de-eb5a689e05da tempest-SnapshotDependencyTests-1700047514 None] Lock "cinder-quobyte-d5652d22-331e-4c0f-9785-7e1547d26d2d" released by "_copy_volume_from_snapshot" :: held 6.544s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:42:21 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-928c15ed-233b-44f3-81de-eb5a689e05da tempest-SnapshotDependencyTests-1700047514 None] Lock "cinder-quobyte-fb75f3b0-1244-483d-b66c-cb112076accb-d5652d22-331e-4c0f-9785-7e1547d26d2d" released by "_create_volume_from_snapshot" :: held 6.603s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:42:21 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-928c15ed-233b-44f3-81de-eb5a689e05da tempest-SnapshotDependencyTests-1700047514 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.617s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:42:21 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-01a8a30a-658f-453a-9a8a-c71b99baa885 tempest-VolumesGetTest-752433910 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.331s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:42:21 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-01a8a30a-658f-453a-9a8a-c71b99baa885 tempest-VolumesGetTest-752433910 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:42:16Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-404793058',display_name='tempest-VolumesGetTest-Volume-695496334',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb81c72c-1e71-42aa-b3df-3bf88aab3922,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c90d8f93af0e4316b970f01878855707',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:42:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:42:16Z,use_quota=True,user_id='b403002bde0446738f1c0ea9206318e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)}" {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 06:42:21 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-01a8a30a-658f-453a-9a8a-c71b99baa885 tempest-VolumesGetTest-752433910 None] Creating volume eb81c72c-1e71-42aa-b3df-3bf88aab3922 {{(pid=87329) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 06:42:21 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-01a8a30a-658f-453a-9a8a-c71b99baa885 tempest-VolumesGetTest-752433910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:42:21 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-01a8a30a-658f-453a-9a8a-c71b99baa885 tempest-VolumesGetTest-752433910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:42:21 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-01a8a30a-658f-453a-9a8a-c71b99baa885 tempest-VolumesGetTest-752433910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:42:21 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-01a8a30a-658f-453a-9a8a-c71b99baa885 tempest-VolumesGetTest-752433910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:42:21 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-01a8a30a-658f-453a-9a8a-c71b99baa885 tempest-VolumesGetTest-752433910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:42:21 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-01a8a30a-658f-453a-9a8a-c71b99baa885 tempest-VolumesGetTest-752433910 None] Selected osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 as target Quobyte volume. {{(pid=87329) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 06:42:21 devstack cinder-volume[87329]: INFO cinder.volume.drivers.remotefs [None req-01a8a30a-658f-453a-9a8a-c71b99baa885 tempest-VolumesGetTest-752433910 None] casted to osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 Sep 06 06:42:21 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-01a8a30a-658f-453a-9a8a-c71b99baa885 tempest-VolumesGetTest-752433910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-eb81c72c-1e71-42aa-b3df-3bf88aab3922 1073741824 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:42:21 devstack sudo[100569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-eb81c72c-1e71-42aa-b3df-3bf88aab3922 1073741824 Sep 06 06:42:21 devstack sudo[100569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:42:21 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-928c15ed-233b-44f3-81de-eb5a689e05da tempest-SnapshotDependencyTests-1700047514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7274c4b2-ec48-4ef3-8aae-3c5bf1f0c1f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5652d22-331e-4c0f-9785-7e1547d26d2d', 'volume_size': 1, 'snapshot_id': 'fb75f3b0-1244-483d-b66c-cb112076accb'}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:42:21 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-928c15ed-233b-44f3-81de-eb5a689e05da tempest-SnapshotDependencyTests-1700047514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (525eed7e-4c43-49de-a0c7-b20115945012) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:42:21 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-928c15ed-233b-44f3-81de-eb5a689e05da tempest-SnapshotDependencyTests-1700047514 None] Volume volume-d5652d22-331e-4c0f-9785-7e1547d26d2d (d5652d22-331e-4c0f-9785-7e1547d26d2d): created successfully Sep 06 06:42:21 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-928c15ed-233b-44f3-81de-eb5a689e05da tempest-SnapshotDependencyTests-1700047514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (525eed7e-4c43-49de-a0c7-b20115945012) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:42:21 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-928c15ed-233b-44f3-81de-eb5a689e05da tempest-SnapshotDependencyTests-1700047514 None] Flow 'volume_create_manager' (6c2def38-2184-426a-a263-ada9fc4289b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:42:21 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-928c15ed-233b-44f3-81de-eb5a689e05da tempest-SnapshotDependencyTests-1700047514 None] Created volume successfully. Sep 06 06:42:21 devstack sudo[100569]: pam_unix(sudo:session): session closed for user root Sep 06 06:42:21 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-01a8a30a-658f-453a-9a8a-c71b99baa885 tempest-VolumesGetTest-752433910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-eb81c72c-1e71-42aa-b3df-3bf88aab3922 1073741824" returned: 0 in 0.422s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:42:21 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-01a8a30a-658f-453a-9a8a-c71b99baa885 tempest-VolumesGetTest-752433910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-eb81c72c-1e71-42aa-b3df-3bf88aab3922 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:42:21 devstack sudo[100575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-eb81c72c-1e71-42aa-b3df-3bf88aab3922 Sep 06 06:42:21 devstack sudo[100575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:42:21 devstack sudo[100575]: pam_unix(sudo:session): session closed for user root Sep 06 06:42:21 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-01a8a30a-658f-453a-9a8a-c71b99baa885 tempest-VolumesGetTest-752433910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-eb81c72c-1e71-42aa-b3df-3bf88aab3922" returned: 0 in 0.254s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:42:21 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-01a8a30a-658f-453a-9a8a-c71b99baa885 tempest-VolumesGetTest-752433910 None] <== create_volume: return (717ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'} {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 06:42:21 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-01a8a30a-658f-453a-9a8a-c71b99baa885 tempest-VolumesGetTest-752433910 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.721s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:42:21 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-01a8a30a-658f-453a-9a8a-c71b99baa885 tempest-VolumesGetTest-752433910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c52f039a-1a7f-4970-9aa0-1ff804029c09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb81c72c-1e71-42aa-b3df-3bf88aab3922', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:42:21 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-01a8a30a-658f-453a-9a8a-c71b99baa885 tempest-VolumesGetTest-752433910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28036d00-e909-4668-865f-69e1bb8b2982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:42:21 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-01a8a30a-658f-453a-9a8a-c71b99baa885 tempest-VolumesGetTest-752433910 None] Volume volume-eb81c72c-1e71-42aa-b3df-3bf88aab3922 (eb81c72c-1e71-42aa-b3df-3bf88aab3922): created successfully Sep 06 06:42:21 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-01a8a30a-658f-453a-9a8a-c71b99baa885 tempest-VolumesGetTest-752433910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28036d00-e909-4668-865f-69e1bb8b2982) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:42:21 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-01a8a30a-658f-453a-9a8a-c71b99baa885 tempest-VolumesGetTest-752433910 None] Flow 'volume_create_manager' (6d260185-5666-4e58-a2aa-3082ef7d6487) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:42:21 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-01a8a30a-658f-453a-9a8a-c71b99baa885 tempest-VolumesGetTest-752433910 None] Created volume successfully. Sep 06 06:42:22 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-56e1252d-6cce-4a47-9164-e64e6c80e99d tempest-SnapshotDependencyTests-1700047514 None] Acquiring lock "cinder-fb75f3b0-1244-483d-b66c-cb112076accb-delete_snapshot" by "delete_snapshot" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:42:22 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-56e1252d-6cce-4a47-9164-e64e6c80e99d tempest-SnapshotDependencyTests-1700047514 None] Lock "cinder-fb75f3b0-1244-483d-b66c-cb112076accb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:42:22 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-56e1252d-6cce-4a47-9164-e64e6c80e99d tempest-SnapshotDependencyTests-1700047514 None] Acquiring lock "cinder-quobyte-34ec050f-0c87-40f2-8c06-d276232602a6" by "delete_snapshot" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:42:22 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-56e1252d-6cce-4a47-9164-e64e6c80e99d tempest-SnapshotDependencyTests-1700047514 None] Lock "cinder-quobyte-34ec050f-0c87-40f2-8c06-d276232602a6" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:42:22 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-56e1252d-6cce-4a47-9164-e64e6c80e99d tempest-SnapshotDependencyTests-1700047514 None] Acquiring lock "cinder-quobyte-fb75f3b0-1244-483d-b66c-cb112076accb" by "_delete_snapshot" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:42:22 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-56e1252d-6cce-4a47-9164-e64e6c80e99d tempest-SnapshotDependencyTests-1700047514 None] Lock "cinder-quobyte-fb75f3b0-1244-483d-b66c-cb112076accb" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:42:22 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-56e1252d-6cce-4a47-9164-e64e6c80e99d tempest-SnapshotDependencyTests-1700047514 None] Deleting offline snapshot fb75f3b0-1244-483d-b66c-cb112076accb of volume 34ec050f-0c87-40f2-8c06-d276232602a6 {{(pid=87329) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 06 06:42:22 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-56e1252d-6cce-4a47-9164-e64e6c80e99d tempest-SnapshotDependencyTests-1700047514 None] snapshot_file for this snap is: volume-34ec050f-0c87-40f2-8c06-d276232602a6.fb75f3b0-1244-483d-b66c-cb112076accb {{(pid=87329) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 06 06:42:22 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[0729d016-c2cf-435e-8e86-82910d369a2f]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:42:22 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-56e1252d-6cce-4a47-9164-e64e6c80e99d tempest-SnapshotDependencyTests-1700047514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-34ec050f-0c87-40f2-8c06-d276232602a6.fb75f3b0-1244-483d-b66c-cb112076accb {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:42:22 devstack sudo[100578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-34ec050f-0c87-40f2-8c06-d276232602a6.fb75f3b0-1244-483d-b66c-cb112076accb Sep 06 06:42:22 devstack sudo[100578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:42:22 devstack sudo[100578]: pam_unix(sudo:session): session closed for user root Sep 06 06:42:22 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-56e1252d-6cce-4a47-9164-e64e6c80e99d tempest-SnapshotDependencyTests-1700047514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-34ec050f-0c87-40f2-8c06-d276232602a6.fb75f3b0-1244-483d-b66c-cb112076accb" returned: 0 in 0.437s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:42:22 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-56e1252d-6cce-4a47-9164-e64e6c80e99d tempest-SnapshotDependencyTests-1700047514 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-34ec050f-0c87-40f2-8c06-d276232602a6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87329) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 06:42:22 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[2504ebf6-68ed-495b-85be-fc8c65240a56]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:42:22 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-56e1252d-6cce-4a47-9164-e64e6c80e99d tempest-SnapshotDependencyTests-1700047514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-34ec050f-0c87-40f2-8c06-d276232602a6 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:42:22 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-e7ac8116-175b-48fb-913b-c11c67cf7790 tempest-VolumesGetTest-752433910 None] Acquiring lock "cinder-eb81c72c-1e71-42aa-b3df-3bf88aab3922-delete_volume" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:42:22 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-e7ac8116-175b-48fb-913b-c11c67cf7790 tempest-VolumesGetTest-752433910 None] Lock "cinder-eb81c72c-1e71-42aa-b3df-3bf88aab3922-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:42:22 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-e7ac8116-175b-48fb-913b-c11c67cf7790 tempest-VolumesGetTest-752433910 None] Acquiring lock "cinder-quobyte-eb81c72c-1e71-42aa-b3df-3bf88aab3922" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:42:22 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-e7ac8116-175b-48fb-913b-c11c67cf7790 tempest-VolumesGetTest-752433910 None] Lock "cinder-quobyte-eb81c72c-1e71-42aa-b3df-3bf88aab3922" acquired by "delete_volume" :: waited 0.022s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:42:22 devstack sudo[100583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-34ec050f-0c87-40f2-8c06-d276232602a6 Sep 06 06:42:22 devstack sudo[100583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:42:22 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[26da937c-9331-4049-a499-f93a65b59d8c]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:42:22 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-e7ac8116-175b-48fb-913b-c11c67cf7790 tempest-VolumesGetTest-752433910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-eb81c72c-1e71-42aa-b3df-3bf88aab3922 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:42:23 devstack sudo[100585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-eb81c72c-1e71-42aa-b3df-3bf88aab3922 Sep 06 06:42:23 devstack sudo[100585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:42:23 devstack sudo[100585]: pam_unix(sudo:session): session closed for user root Sep 06 06:42:23 devstack sudo[100583]: pam_unix(sudo:session): session closed for user root Sep 06 06:42:23 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-e7ac8116-175b-48fb-913b-c11c67cf7790 tempest-VolumesGetTest-752433910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-eb81c72c-1e71-42aa-b3df-3bf88aab3922" returned: 0 in 0.401s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:42:23 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-e7ac8116-175b-48fb-913b-c11c67cf7790 tempest-VolumesGetTest-752433910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-eb81c72c-1e71-42aa-b3df-3bf88aab3922 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:42:23 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-56e1252d-6cce-4a47-9164-e64e6c80e99d tempest-SnapshotDependencyTests-1700047514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-34ec050f-0c87-40f2-8c06-d276232602a6" returned: 0 in 0.590s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:42:23 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-56e1252d-6cce-4a47-9164-e64e6c80e99d tempest-SnapshotDependencyTests-1700047514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-34ec050f-0c87-40f2-8c06-d276232602a6.fb75f3b0-1244-483d-b66c-cb112076accb {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:42:23 devstack sudo[100593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-eb81c72c-1e71-42aa-b3df-3bf88aab3922 Sep 06 06:42:23 devstack sudo[100593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:42:23 devstack sudo[100594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-34ec050f-0c87-40f2-8c06-d276232602a6.fb75f3b0-1244-483d-b66c-cb112076accb Sep 06 06:42:23 devstack sudo[100594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:42:23 devstack sudo[100593]: pam_unix(sudo:session): session closed for user root Sep 06 06:42:23 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-e7ac8116-175b-48fb-913b-c11c67cf7790 tempest-VolumesGetTest-752433910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-eb81c72c-1e71-42aa-b3df-3bf88aab3922" returned: 0 in 0.260s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:42:23 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-e7ac8116-175b-48fb-913b-c11c67cf7790 tempest-VolumesGetTest-752433910 None] Lock "cinder-quobyte-eb81c72c-1e71-42aa-b3df-3bf88aab3922" released by "delete_volume" :: held 0.711s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:42:23 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-e7ac8116-175b-48fb-913b-c11c67cf7790 tempest-VolumesGetTest-752433910 None] Created reservations ['d8edbf2b-305d-441d-971a-da02c57b0983', 'e0cf8c76-7e25-4ead-b0cd-5dd83d5d40bf', '9d7ffb67-e3ff-436d-8161-6ee79ac303bd', 'f044bff4-ec5c-43a5-8249-951f33f82839'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:42:23 devstack sudo[100594]: pam_unix(sudo:session): session closed for user root Sep 06 06:42:23 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-56e1252d-6cce-4a47-9164-e64e6c80e99d tempest-SnapshotDependencyTests-1700047514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-34ec050f-0c87-40f2-8c06-d276232602a6.fb75f3b0-1244-483d-b66c-cb112076accb" returned: 0 in 0.369s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:42:23 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-56e1252d-6cce-4a47-9164-e64e6c80e99d tempest-SnapshotDependencyTests-1700047514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-34ec050f-0c87-40f2-8c06-d276232602a6.fb75f3b0-1244-483d-b66c-cb112076accb {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:42:23 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-e7ac8116-175b-48fb-913b-c11c67cf7790 tempest-VolumesGetTest-752433910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:42:23 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-e7ac8116-175b-48fb-913b-c11c67cf7790 tempest-VolumesGetTest-752433910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:42:23 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-e7ac8116-175b-48fb-913b-c11c67cf7790 tempest-VolumesGetTest-752433910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:42:23 devstack sudo[100602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-34ec050f-0c87-40f2-8c06-d276232602a6.fb75f3b0-1244-483d-b66c-cb112076accb Sep 06 06:42:23 devstack sudo[100602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:42:23 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-e7ac8116-175b-48fb-913b-c11c67cf7790 tempest-VolumesGetTest-752433910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:42:23 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-e7ac8116-175b-48fb-913b-c11c67cf7790 tempest-VolumesGetTest-752433910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:42:23 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-e7ac8116-175b-48fb-913b-c11c67cf7790 tempest-VolumesGetTest-752433910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:42:23 devstack sudo[100604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:42:23 devstack sudo[100604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:42:23 devstack sudo[100602]: pam_unix(sudo:session): session closed for user root Sep 06 06:42:23 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-56e1252d-6cce-4a47-9164-e64e6c80e99d tempest-SnapshotDependencyTests-1700047514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-34ec050f-0c87-40f2-8c06-d276232602a6.fb75f3b0-1244-483d-b66c-cb112076accb" returned: 0 in 0.282s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:42:24 devstack sudo[100604]: pam_unix(sudo:session): session closed for user root Sep 06 06:42:24 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-e7ac8116-175b-48fb-913b-c11c67cf7790 tempest-VolumesGetTest-752433910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.255s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:42:24 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-e7ac8116-175b-48fb-913b-c11c67cf7790 tempest-VolumesGetTest-752433910 None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:42:24 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-e7ac8116-175b-48fb-913b-c11c67cf7790 tempest-VolumesGetTest-752433910 None] Deleted volume successfully. Sep 06 06:42:24 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-56e1252d-6cce-4a47-9164-e64e6c80e99d tempest-SnapshotDependencyTests-1700047514 None] Lock "cinder-quobyte-fb75f3b0-1244-483d-b66c-cb112076accb" released by "_delete_snapshot" :: held 1.834s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:42:24 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-56e1252d-6cce-4a47-9164-e64e6c80e99d tempest-SnapshotDependencyTests-1700047514 None] Lock "cinder-quobyte-34ec050f-0c87-40f2-8c06-d276232602a6" released by "delete_snapshot" :: held 1.863s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:42:24 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-e7ac8116-175b-48fb-913b-c11c67cf7790 tempest-VolumesGetTest-752433910 None] Lock "cinder-eb81c72c-1e71-42aa-b3df-3bf88aab3922-delete_volume" released by "delete_volume" :: held 1.253s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:42:24 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-80e8b582-7e2b-4c3f-8bd6-3c8748a77f52 tempest-VolumesGetTest-752433910 None] Acquiring lock "cinder-0e46229e-4caa-46f2-a8c3-f63c70401cfd-delete_volume" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:42:24 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-80e8b582-7e2b-4c3f-8bd6-3c8748a77f52 tempest-VolumesGetTest-752433910 None] Lock "cinder-0e46229e-4caa-46f2-a8c3-f63c70401cfd-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:42:24 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-80e8b582-7e2b-4c3f-8bd6-3c8748a77f52 tempest-VolumesGetTest-752433910 None] Acquiring lock "cinder-quobyte-0e46229e-4caa-46f2-a8c3-f63c70401cfd" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:42:24 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-56e1252d-6cce-4a47-9164-e64e6c80e99d tempest-SnapshotDependencyTests-1700047514 None] Created reservations ['dfaa6c4b-83f6-47f9-9010-4525223a86e2', '6e661ef0-7aa1-4410-9c9f-aab7078ea4b6', '1ddac557-b787-480b-97b1-5bc897f2a8f0', '5efc9138-410a-4f65-a3a5-609992baa16d'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:42:24 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-80e8b582-7e2b-4c3f-8bd6-3c8748a77f52 tempest-VolumesGetTest-752433910 None] Lock "cinder-quobyte-0e46229e-4caa-46f2-a8c3-f63c70401cfd" acquired by "delete_volume" :: waited 0.019s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:42:24 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[41393444-f522-4bcb-9425-7f0d035d4552]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:42:24 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-80e8b582-7e2b-4c3f-8bd6-3c8748a77f52 tempest-VolumesGetTest-752433910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-0e46229e-4caa-46f2-a8c3-f63c70401cfd {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:42:24 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-56e1252d-6cce-4a47-9164-e64e6c80e99d tempest-SnapshotDependencyTests-1700047514 None] Delete snapshot completed successfully. Sep 06 06:42:24 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-56e1252d-6cce-4a47-9164-e64e6c80e99d tempest-SnapshotDependencyTests-1700047514 None] Lock "cinder-fb75f3b0-1244-483d-b66c-cb112076accb-delete_snapshot" released by "delete_snapshot" :: held 2.098s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:42:24 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-ad8c9c95-a186-467b-a2e3-01ac366e610b tempest-SnapshotDependencyTests-1700047514 None] Acquiring lock "cinder-34ec050f-0c87-40f2-8c06-d276232602a6-delete_volume" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:42:24 devstack sudo[100608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-0e46229e-4caa-46f2-a8c3-f63c70401cfd Sep 06 06:42:24 devstack sudo[100608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:42:24 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-ad8c9c95-a186-467b-a2e3-01ac366e610b tempest-SnapshotDependencyTests-1700047514 None] Lock "cinder-34ec050f-0c87-40f2-8c06-d276232602a6-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:42:24 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-ad8c9c95-a186-467b-a2e3-01ac366e610b tempest-SnapshotDependencyTests-1700047514 None] Acquiring lock "cinder-quobyte-34ec050f-0c87-40f2-8c06-d276232602a6" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:42:24 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-ad8c9c95-a186-467b-a2e3-01ac366e610b tempest-SnapshotDependencyTests-1700047514 None] Lock "cinder-quobyte-34ec050f-0c87-40f2-8c06-d276232602a6" acquired by "delete_volume" :: waited 0.021s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:42:24 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[2983fe09-16f2-4f75-9f7f-e5b5760d3643]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:42:24 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-ad8c9c95-a186-467b-a2e3-01ac366e610b tempest-SnapshotDependencyTests-1700047514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-34ec050f-0c87-40f2-8c06-d276232602a6 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:42:24 devstack sudo[100610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-34ec050f-0c87-40f2-8c06-d276232602a6 Sep 06 06:42:24 devstack sudo[100610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:42:24 devstack sudo[100608]: pam_unix(sudo:session): session closed for user root Sep 06 06:42:24 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-80e8b582-7e2b-4c3f-8bd6-3c8748a77f52 tempest-VolumesGetTest-752433910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-0e46229e-4caa-46f2-a8c3-f63c70401cfd" returned: 0 in 0.438s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:42:24 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-80e8b582-7e2b-4c3f-8bd6-3c8748a77f52 tempest-VolumesGetTest-752433910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-0e46229e-4caa-46f2-a8c3-f63c70401cfd {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:42:24 devstack sudo[100615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-0e46229e-4caa-46f2-a8c3-f63c70401cfd Sep 06 06:42:24 devstack sudo[100615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:42:24 devstack sudo[100610]: pam_unix(sudo:session): session closed for user root Sep 06 06:42:24 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-ad8c9c95-a186-467b-a2e3-01ac366e610b tempest-SnapshotDependencyTests-1700047514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-34ec050f-0c87-40f2-8c06-d276232602a6" returned: 0 in 0.415s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:42:24 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-ad8c9c95-a186-467b-a2e3-01ac366e610b tempest-SnapshotDependencyTests-1700047514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-34ec050f-0c87-40f2-8c06-d276232602a6 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:42:24 devstack sudo[100615]: pam_unix(sudo:session): session closed for user root Sep 06 06:42:24 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-80e8b582-7e2b-4c3f-8bd6-3c8748a77f52 tempest-VolumesGetTest-752433910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-0e46229e-4caa-46f2-a8c3-f63c70401cfd" returned: 0 in 0.254s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:42:24 devstack sudo[100621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-34ec050f-0c87-40f2-8c06-d276232602a6 Sep 06 06:42:24 devstack sudo[100621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:42:24 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-80e8b582-7e2b-4c3f-8bd6-3c8748a77f52 tempest-VolumesGetTest-752433910 None] Lock "cinder-quobyte-0e46229e-4caa-46f2-a8c3-f63c70401cfd" released by "delete_volume" :: held 0.736s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:42:24 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-80e8b582-7e2b-4c3f-8bd6-3c8748a77f52 tempest-VolumesGetTest-752433910 None] Created reservations ['46499232-bb6d-4720-ae37-0fdcb7c23da3', 'c2c758a1-0828-4bac-bcd3-2e088329252c', '9c12b99f-0ee5-4205-b8bc-82a298059643', '5d1a7990-ca48-4c31-a448-7ac3a3f4e302'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:42:25 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-80e8b582-7e2b-4c3f-8bd6-3c8748a77f52 tempest-VolumesGetTest-752433910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:42:25 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-80e8b582-7e2b-4c3f-8bd6-3c8748a77f52 tempest-VolumesGetTest-752433910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:42:25 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-80e8b582-7e2b-4c3f-8bd6-3c8748a77f52 tempest-VolumesGetTest-752433910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:42:25 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-80e8b582-7e2b-4c3f-8bd6-3c8748a77f52 tempest-VolumesGetTest-752433910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:42:25 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-80e8b582-7e2b-4c3f-8bd6-3c8748a77f52 tempest-VolumesGetTest-752433910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:42:25 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-80e8b582-7e2b-4c3f-8bd6-3c8748a77f52 tempest-VolumesGetTest-752433910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:42:25 devstack sudo[100623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:42:25 devstack sudo[100623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:42:25 devstack sudo[100621]: pam_unix(sudo:session): session closed for user root Sep 06 06:42:25 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-ad8c9c95-a186-467b-a2e3-01ac366e610b tempest-SnapshotDependencyTests-1700047514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-34ec050f-0c87-40f2-8c06-d276232602a6" returned: 0 in 0.332s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:42:25 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-ad8c9c95-a186-467b-a2e3-01ac366e610b tempest-SnapshotDependencyTests-1700047514 None] Lock "cinder-quobyte-34ec050f-0c87-40f2-8c06-d276232602a6" released by "delete_volume" :: held 0.829s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:42:25 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-ad8c9c95-a186-467b-a2e3-01ac366e610b tempest-SnapshotDependencyTests-1700047514 None] Created reservations ['61cf7381-3176-4081-a020-fd4c56e73ff2', '8c6f6fa5-8290-4096-a535-eb4e521b2fcb', 'e822f508-d56b-4103-852a-8f04089738d2', '4e394be6-7156-4bcf-b09d-f09bc5de3684'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:42:25 devstack sudo[100623]: pam_unix(sudo:session): session closed for user root Sep 06 06:42:25 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-80e8b582-7e2b-4c3f-8bd6-3c8748a77f52 tempest-VolumesGetTest-752433910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.321s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:42:25 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-80e8b582-7e2b-4c3f-8bd6-3c8748a77f52 tempest-VolumesGetTest-752433910 None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:42:25 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-80e8b582-7e2b-4c3f-8bd6-3c8748a77f52 tempest-VolumesGetTest-752433910 None] Deleted volume successfully. Sep 06 06:42:25 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-ad8c9c95-a186-467b-a2e3-01ac366e610b tempest-SnapshotDependencyTests-1700047514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:42:25 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-ad8c9c95-a186-467b-a2e3-01ac366e610b tempest-SnapshotDependencyTests-1700047514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:42:25 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-ad8c9c95-a186-467b-a2e3-01ac366e610b tempest-SnapshotDependencyTests-1700047514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:42:25 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-ad8c9c95-a186-467b-a2e3-01ac366e610b tempest-SnapshotDependencyTests-1700047514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:42:25 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-ad8c9c95-a186-467b-a2e3-01ac366e610b tempest-SnapshotDependencyTests-1700047514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:42:25 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-ad8c9c95-a186-467b-a2e3-01ac366e610b tempest-SnapshotDependencyTests-1700047514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:42:25 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-80e8b582-7e2b-4c3f-8bd6-3c8748a77f52 tempest-VolumesGetTest-752433910 None] Lock "cinder-0e46229e-4caa-46f2-a8c3-f63c70401cfd-delete_volume" released by "delete_volume" :: held 1.308s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:42:25 devstack sudo[100630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:42:25 devstack sudo[100630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:42:25 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-3497fbb2-8473-432b-9c5c-ba8db571ed71 tempest-SnapshotDependencyTests-1700047514 None] Acquiring lock "cinder-d5652d22-331e-4c0f-9785-7e1547d26d2d-delete_volume" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:42:25 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-3497fbb2-8473-432b-9c5c-ba8db571ed71 tempest-SnapshotDependencyTests-1700047514 None] Lock "cinder-d5652d22-331e-4c0f-9785-7e1547d26d2d-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:42:25 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-3497fbb2-8473-432b-9c5c-ba8db571ed71 tempest-SnapshotDependencyTests-1700047514 None] Acquiring lock "cinder-quobyte-d5652d22-331e-4c0f-9785-7e1547d26d2d" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:42:25 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-3497fbb2-8473-432b-9c5c-ba8db571ed71 tempest-SnapshotDependencyTests-1700047514 None] Lock "cinder-quobyte-d5652d22-331e-4c0f-9785-7e1547d26d2d" acquired by "delete_volume" :: waited 0.026s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:42:25 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[f70cb924-3842-4101-a630-db73086b6734]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:42:25 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-3497fbb2-8473-432b-9c5c-ba8db571ed71 tempest-SnapshotDependencyTests-1700047514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-d5652d22-331e-4c0f-9785-7e1547d26d2d {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:42:25 devstack sudo[100630]: pam_unix(sudo:session): session closed for user root Sep 06 06:42:25 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-ad8c9c95-a186-467b-a2e3-01ac366e610b tempest-SnapshotDependencyTests-1700047514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.356s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:42:25 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-ad8c9c95-a186-467b-a2e3-01ac366e610b tempest-SnapshotDependencyTests-1700047514 None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:42:25 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-ad8c9c95-a186-467b-a2e3-01ac366e610b tempest-SnapshotDependencyTests-1700047514 None] Deleted volume successfully. Sep 06 06:42:25 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-ad8c9c95-a186-467b-a2e3-01ac366e610b tempest-SnapshotDependencyTests-1700047514 None] Lock "cinder-34ec050f-0c87-40f2-8c06-d276232602a6-delete_volume" released by "delete_volume" :: held 1.475s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:42:25 devstack sudo[100633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-d5652d22-331e-4c0f-9785-7e1547d26d2d Sep 06 06:42:25 devstack sudo[100633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:42:26 devstack sudo[100633]: pam_unix(sudo:session): session closed for user root Sep 06 06:42:26 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-3497fbb2-8473-432b-9c5c-ba8db571ed71 tempest-SnapshotDependencyTests-1700047514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-d5652d22-331e-4c0f-9785-7e1547d26d2d" returned: 0 in 0.417s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:42:26 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-3497fbb2-8473-432b-9c5c-ba8db571ed71 tempest-SnapshotDependencyTests-1700047514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-d5652d22-331e-4c0f-9785-7e1547d26d2d {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:42:26 devstack sudo[100638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-d5652d22-331e-4c0f-9785-7e1547d26d2d Sep 06 06:42:26 devstack sudo[100638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:42:26 devstack sudo[100638]: pam_unix(sudo:session): session closed for user root Sep 06 06:42:26 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-3497fbb2-8473-432b-9c5c-ba8db571ed71 tempest-SnapshotDependencyTests-1700047514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-d5652d22-331e-4c0f-9785-7e1547d26d2d" returned: 0 in 0.264s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:42:26 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-3497fbb2-8473-432b-9c5c-ba8db571ed71 tempest-SnapshotDependencyTests-1700047514 None] Lock "cinder-quobyte-d5652d22-331e-4c0f-9785-7e1547d26d2d" released by "delete_volume" :: held 0.742s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:42:26 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-3497fbb2-8473-432b-9c5c-ba8db571ed71 tempest-SnapshotDependencyTests-1700047514 None] Created reservations ['941283b4-9803-42a9-8f29-9bda9ab77823', '6a938b66-8c9a-4d5b-aa52-4e85040ad9b0', 'cc89b221-d978-4c86-9874-49d6e3582d41', '8922d1c7-d7b7-4e4f-acc7-de0604382d90'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:42:26 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-3497fbb2-8473-432b-9c5c-ba8db571ed71 tempest-SnapshotDependencyTests-1700047514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:42:26 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-3497fbb2-8473-432b-9c5c-ba8db571ed71 tempest-SnapshotDependencyTests-1700047514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:42:26 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-3497fbb2-8473-432b-9c5c-ba8db571ed71 tempest-SnapshotDependencyTests-1700047514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:42:26 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-3497fbb2-8473-432b-9c5c-ba8db571ed71 tempest-SnapshotDependencyTests-1700047514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:42:26 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-3497fbb2-8473-432b-9c5c-ba8db571ed71 tempest-SnapshotDependencyTests-1700047514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:42:26 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-3497fbb2-8473-432b-9c5c-ba8db571ed71 tempest-SnapshotDependencyTests-1700047514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:42:26 devstack sudo[100641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:42:26 devstack sudo[100641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:42:26 devstack sudo[100641]: pam_unix(sudo:session): session closed for user root Sep 06 06:42:26 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-3497fbb2-8473-432b-9c5c-ba8db571ed71 tempest-SnapshotDependencyTests-1700047514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.329s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:42:26 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-3497fbb2-8473-432b-9c5c-ba8db571ed71 tempest-SnapshotDependencyTests-1700047514 None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:42:26 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-3497fbb2-8473-432b-9c5c-ba8db571ed71 tempest-SnapshotDependencyTests-1700047514 None] Deleted volume successfully. Sep 06 06:42:26 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-3497fbb2-8473-432b-9c5c-ba8db571ed71 tempest-SnapshotDependencyTests-1700047514 None] Lock "cinder-d5652d22-331e-4c0f-9785-7e1547d26d2d-delete_volume" released by "delete_volume" :: held 1.372s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:42:36 devstack cinder-volume[87329]: DEBUG dbcounter [-] [87329] Writing DB stats cinder:UPDATE=85,cinder:DELETE=6,cinder:SELECT=68,cinder:INSERT=23 {{(pid=87329) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 06:42:36 devstack cinder-volume[87329]: DEBUG dbcounter [-] [87329] Writing DB stats cinder:UPDATE=81,cinder:SELECT=61,cinder:INSERT=29,cinder:DELETE=8 {{(pid=87329) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 06:42:48 devstack cinder-volume[87329]: DEBUG oslo_service.periodic_task [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87329) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 06 06:42:48 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:42:48 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:42:48 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:42:48 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:42:48 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:42:48 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:42:48 devstack sudo[100778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:42:48 devstack sudo[100778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:42:48 devstack sudo[100778]: pam_unix(sudo:session): session closed for user root Sep 06 06:42:48 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.352s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:42:48 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:42:48 devstack cinder-volume[87329]: DEBUG oslo_service.periodic_task [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Running periodic task VolumeManager._thread_info {{(pid=87329) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 06 06:42:48 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] thread count: 28 {{(pid=87329) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 06 06:42:48 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] thread info: [<_MainThread(MainThread, started 126855043821696)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87329) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 06 06:42:58 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5175c94-7fcd-465c-968e-708032d1fb72 tempest-AttachVolumeTestJSON-1525867077 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87329) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 06:42:58 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-e5175c94-7fcd-465c-968e-708032d1fb72 tempest-AttachVolumeTestJSON-1525867077 None] Flow 'volume_create_manager' (eddf643f-613a-4d7b-a5c3-07c8205630d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:42:58 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-e5175c94-7fcd-465c-968e-708032d1fb72 tempest-AttachVolumeTestJSON-1525867077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a78416a-9167-405e-8143-623f22e54572) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:42:58 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-e5175c94-7fcd-465c-968e-708032d1fb72 tempest-AttachVolumeTestJSON-1525867077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a78416a-9167-405e-8143-623f22e54572) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:42:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1932903366',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=577fd0b3-a5de-4e63-9623-e67764d0afa0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0963cc134ebb4365b128ea7e41f4469c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:42:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:42:58Z,use_quota=True,user_id='e1bdadfacfaf4b9394e7ded7f4848d7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:42:58 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-e5175c94-7fcd-465c-968e-708032d1fb72 tempest-AttachVolumeTestJSON-1525867077 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aeac72a1-98d6-4209-acd1-12883b158cb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:42:58 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-e5175c94-7fcd-465c-968e-708032d1fb72 tempest-AttachVolumeTestJSON-1525867077 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aeac72a1-98d6-4209-acd1-12883b158cb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:42:58 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-e5175c94-7fcd-465c-968e-708032d1fb72 tempest-AttachVolumeTestJSON-1525867077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78af8afe-598e-435d-8e07-ca0319d9d201) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:42:58 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-e5175c94-7fcd-465c-968e-708032d1fb72 tempest-AttachVolumeTestJSON-1525867077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78af8afe-598e-435d-8e07-ca0319d9d201) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '577fd0b3-a5de-4e63-9623-e67764d0afa0', 'volume_name': 'volume-577fd0b3-a5de-4e63-9623-e67764d0afa0', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:42:58 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-e5175c94-7fcd-465c-968e-708032d1fb72 tempest-AttachVolumeTestJSON-1525867077 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c802340c-6322-4370-849d-970afb629adf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:42:58 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-e5175c94-7fcd-465c-968e-708032d1fb72 tempest-AttachVolumeTestJSON-1525867077 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c802340c-6322-4370-849d-970afb629adf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:42:58 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-e5175c94-7fcd-465c-968e-708032d1fb72 tempest-AttachVolumeTestJSON-1525867077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5fd45ad-e318-44ec-b112-76fc008c4e0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:42:58 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-e5175c94-7fcd-465c-968e-708032d1fb72 tempest-AttachVolumeTestJSON-1525867077 None] Volume 577fd0b3-a5de-4e63-9623-e67764d0afa0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-577fd0b3-a5de-4e63-9623-e67764d0afa0', 'volume_size': 1} Sep 06 06:42:58 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-e5175c94-7fcd-465c-968e-708032d1fb72 tempest-AttachVolumeTestJSON-1525867077 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:42:58 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-e5175c94-7fcd-465c-968e-708032d1fb72 tempest-AttachVolumeTestJSON-1525867077 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:42:58 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-e5175c94-7fcd-465c-968e-708032d1fb72 tempest-AttachVolumeTestJSON-1525867077 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:42:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1932903366',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=577fd0b3-a5de-4e63-9623-e67764d0afa0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0963cc134ebb4365b128ea7e41f4469c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:42:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:42:58Z,use_quota=True,user_id='e1bdadfacfaf4b9394e7ded7f4848d7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)}" {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 06:42:58 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-e5175c94-7fcd-465c-968e-708032d1fb72 tempest-AttachVolumeTestJSON-1525867077 None] Creating volume 577fd0b3-a5de-4e63-9623-e67764d0afa0 {{(pid=87329) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 06:42:58 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-e5175c94-7fcd-465c-968e-708032d1fb72 tempest-AttachVolumeTestJSON-1525867077 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:42:58 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-e5175c94-7fcd-465c-968e-708032d1fb72 tempest-AttachVolumeTestJSON-1525867077 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:42:58 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-e5175c94-7fcd-465c-968e-708032d1fb72 tempest-AttachVolumeTestJSON-1525867077 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:42:58 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-e5175c94-7fcd-465c-968e-708032d1fb72 tempest-AttachVolumeTestJSON-1525867077 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:42:58 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-e5175c94-7fcd-465c-968e-708032d1fb72 tempest-AttachVolumeTestJSON-1525867077 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:42:58 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-e5175c94-7fcd-465c-968e-708032d1fb72 tempest-AttachVolumeTestJSON-1525867077 None] Selected osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 as target Quobyte volume. {{(pid=87329) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 06:42:58 devstack cinder-volume[87329]: INFO cinder.volume.drivers.remotefs [None req-e5175c94-7fcd-465c-968e-708032d1fb72 tempest-AttachVolumeTestJSON-1525867077 None] casted to osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 Sep 06 06:42:58 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-e5175c94-7fcd-465c-968e-708032d1fb72 tempest-AttachVolumeTestJSON-1525867077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-577fd0b3-a5de-4e63-9623-e67764d0afa0 1073741824 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:42:58 devstack sudo[100912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-577fd0b3-a5de-4e63-9623-e67764d0afa0 1073741824 Sep 06 06:42:58 devstack sudo[100912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:42:58 devstack sudo[100912]: pam_unix(sudo:session): session closed for user root Sep 06 06:42:58 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-e5175c94-7fcd-465c-968e-708032d1fb72 tempest-AttachVolumeTestJSON-1525867077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-577fd0b3-a5de-4e63-9623-e67764d0afa0 1073741824" returned: 0 in 0.522s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:42:58 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-e5175c94-7fcd-465c-968e-708032d1fb72 tempest-AttachVolumeTestJSON-1525867077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-577fd0b3-a5de-4e63-9623-e67764d0afa0 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:42:59 devstack sudo[100920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-577fd0b3-a5de-4e63-9623-e67764d0afa0 Sep 06 06:42:59 devstack sudo[100920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:42:59 devstack sudo[100920]: pam_unix(sudo:session): session closed for user root Sep 06 06:42:59 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-e5175c94-7fcd-465c-968e-708032d1fb72 tempest-AttachVolumeTestJSON-1525867077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-577fd0b3-a5de-4e63-9623-e67764d0afa0" returned: 0 in 0.262s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:42:59 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-e5175c94-7fcd-465c-968e-708032d1fb72 tempest-AttachVolumeTestJSON-1525867077 None] <== create_volume: return (826ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'} {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 06:42:59 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-e5175c94-7fcd-465c-968e-708032d1fb72 tempest-AttachVolumeTestJSON-1525867077 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.831s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:42:59 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-e5175c94-7fcd-465c-968e-708032d1fb72 tempest-AttachVolumeTestJSON-1525867077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5fd45ad-e318-44ec-b112-76fc008c4e0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-577fd0b3-a5de-4e63-9623-e67764d0afa0', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:42:59 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-e5175c94-7fcd-465c-968e-708032d1fb72 tempest-AttachVolumeTestJSON-1525867077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b1642de-6906-4967-aa59-715d4c7fc3e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:42:59 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-e5175c94-7fcd-465c-968e-708032d1fb72 tempest-AttachVolumeTestJSON-1525867077 None] Volume volume-577fd0b3-a5de-4e63-9623-e67764d0afa0 (577fd0b3-a5de-4e63-9623-e67764d0afa0): created successfully Sep 06 06:42:59 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-e5175c94-7fcd-465c-968e-708032d1fb72 tempest-AttachVolumeTestJSON-1525867077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b1642de-6906-4967-aa59-715d4c7fc3e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:42:59 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-e5175c94-7fcd-465c-968e-708032d1fb72 tempest-AttachVolumeTestJSON-1525867077 None] Flow 'volume_create_manager' (eddf643f-613a-4d7b-a5c3-07c8205630d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:42:59 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-e5175c94-7fcd-465c-968e-708032d1fb72 tempest-AttachVolumeTestJSON-1525867077 None] Created volume successfully. Sep 06 06:43:01 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-80db6686-f525-4d1b-9cab-f07fb9ad9c78 tempest-TestMinimumBasicScenario-261614628 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87329) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 06:43:01 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-80db6686-f525-4d1b-9cab-f07fb9ad9c78 tempest-TestMinimumBasicScenario-261614628 None] Flow 'volume_create_manager' (2a994fa3-0ad6-427d-90e9-eef8ab8ebcac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:43:01 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-80db6686-f525-4d1b-9cab-f07fb9ad9c78 tempest-TestMinimumBasicScenario-261614628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8085eed-eb26-4803-8d07-6b784a693382) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:43:01 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-80db6686-f525-4d1b-9cab-f07fb9ad9c78 tempest-TestMinimumBasicScenario-261614628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8085eed-eb26-4803-8d07-6b784a693382) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:43:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-854542336',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64ecd7db-42d3-4cef-8bcd-81e392af5e98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c4fb09efa2f451bad2966acd13a7880',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:43:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:43:01Z,use_quota=True,user_id='c46c61a09f5540b789b0f4e3fdf650b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:43:01 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-80db6686-f525-4d1b-9cab-f07fb9ad9c78 tempest-TestMinimumBasicScenario-261614628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc8d9b7e-7fc9-44c1-bda2-cf00b7854491) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:43:01 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-80db6686-f525-4d1b-9cab-f07fb9ad9c78 tempest-TestMinimumBasicScenario-261614628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc8d9b7e-7fc9-44c1-bda2-cf00b7854491) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:43:01 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-80db6686-f525-4d1b-9cab-f07fb9ad9c78 tempest-TestMinimumBasicScenario-261614628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95778e0e-6012-4c48-9808-1662016001f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:43:01 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-80db6686-f525-4d1b-9cab-f07fb9ad9c78 tempest-TestMinimumBasicScenario-261614628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95778e0e-6012-4c48-9808-1662016001f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64ecd7db-42d3-4cef-8bcd-81e392af5e98', 'volume_name': 'volume-64ecd7db-42d3-4cef-8bcd-81e392af5e98', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:43:01 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-80db6686-f525-4d1b-9cab-f07fb9ad9c78 tempest-TestMinimumBasicScenario-261614628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (324d8e09-90fa-48e5-8ada-51c1c840185a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:43:01 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-80db6686-f525-4d1b-9cab-f07fb9ad9c78 tempest-TestMinimumBasicScenario-261614628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (324d8e09-90fa-48e5-8ada-51c1c840185a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:43:01 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-80db6686-f525-4d1b-9cab-f07fb9ad9c78 tempest-TestMinimumBasicScenario-261614628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c1b9b39-814e-45f6-91e0-b0cd525fd199) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:43:01 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-80db6686-f525-4d1b-9cab-f07fb9ad9c78 tempest-TestMinimumBasicScenario-261614628 None] Volume 64ecd7db-42d3-4cef-8bcd-81e392af5e98: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64ecd7db-42d3-4cef-8bcd-81e392af5e98', 'volume_size': 1} Sep 06 06:43:01 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-80db6686-f525-4d1b-9cab-f07fb9ad9c78 tempest-TestMinimumBasicScenario-261614628 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:43:01 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-80db6686-f525-4d1b-9cab-f07fb9ad9c78 tempest-TestMinimumBasicScenario-261614628 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:43:01 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-80db6686-f525-4d1b-9cab-f07fb9ad9c78 tempest-TestMinimumBasicScenario-261614628 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:43:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-854542336',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64ecd7db-42d3-4cef-8bcd-81e392af5e98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c4fb09efa2f451bad2966acd13a7880',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:43:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:43:01Z,use_quota=True,user_id='c46c61a09f5540b789b0f4e3fdf650b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)}" {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 06:43:01 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-80db6686-f525-4d1b-9cab-f07fb9ad9c78 tempest-TestMinimumBasicScenario-261614628 None] Creating volume 64ecd7db-42d3-4cef-8bcd-81e392af5e98 {{(pid=87329) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 06:43:01 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-80db6686-f525-4d1b-9cab-f07fb9ad9c78 tempest-TestMinimumBasicScenario-261614628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:43:01 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-80db6686-f525-4d1b-9cab-f07fb9ad9c78 tempest-TestMinimumBasicScenario-261614628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:43:01 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-80db6686-f525-4d1b-9cab-f07fb9ad9c78 tempest-TestMinimumBasicScenario-261614628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:43:01 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-80db6686-f525-4d1b-9cab-f07fb9ad9c78 tempest-TestMinimumBasicScenario-261614628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:43:01 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-80db6686-f525-4d1b-9cab-f07fb9ad9c78 tempest-TestMinimumBasicScenario-261614628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:43:01 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-80db6686-f525-4d1b-9cab-f07fb9ad9c78 tempest-TestMinimumBasicScenario-261614628 None] Selected osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 as target Quobyte volume. {{(pid=87329) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 06:43:01 devstack cinder-volume[87329]: INFO cinder.volume.drivers.remotefs [None req-80db6686-f525-4d1b-9cab-f07fb9ad9c78 tempest-TestMinimumBasicScenario-261614628 None] casted to osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 Sep 06 06:43:01 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-80db6686-f525-4d1b-9cab-f07fb9ad9c78 tempest-TestMinimumBasicScenario-261614628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-64ecd7db-42d3-4cef-8bcd-81e392af5e98 1073741824 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:43:01 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [req-ba67cefd-8a2c-47f5-bbbe-fb936116eb16 req-9a323dc8-0196-4ffc-885c-ffbc41b9c155 tempest-AttachVolumeTestJSON-1525867077 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:43:01 devstack sudo[100935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-64ecd7db-42d3-4cef-8bcd-81e392af5e98 1073741824 Sep 06 06:43:01 devstack sudo[100935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:43:01 devstack sudo[100935]: pam_unix(sudo:session): session closed for user root Sep 06 06:43:01 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-80db6686-f525-4d1b-9cab-f07fb9ad9c78 tempest-TestMinimumBasicScenario-261614628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-64ecd7db-42d3-4cef-8bcd-81e392af5e98 1073741824" returned: 0 in 0.431s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:43:01 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-80db6686-f525-4d1b-9cab-f07fb9ad9c78 tempest-TestMinimumBasicScenario-261614628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-64ecd7db-42d3-4cef-8bcd-81e392af5e98 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:43:01 devstack sudo[100940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-64ecd7db-42d3-4cef-8bcd-81e392af5e98 Sep 06 06:43:01 devstack sudo[100940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:43:02 devstack sudo[100940]: pam_unix(sudo:session): session closed for user root Sep 06 06:43:02 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-80db6686-f525-4d1b-9cab-f07fb9ad9c78 tempest-TestMinimumBasicScenario-261614628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-64ecd7db-42d3-4cef-8bcd-81e392af5e98" returned: 0 in 0.255s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:43:02 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-80db6686-f525-4d1b-9cab-f07fb9ad9c78 tempest-TestMinimumBasicScenario-261614628 None] <== create_volume: return (726ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'} {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 06:43:02 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-80db6686-f525-4d1b-9cab-f07fb9ad9c78 tempest-TestMinimumBasicScenario-261614628 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.729s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:43:02 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [req-ba67cefd-8a2c-47f5-bbbe-fb936116eb16 req-9a323dc8-0196-4ffc-885c-ffbc41b9c155 tempest-AttachVolumeTestJSON-1525867077 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.702s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:43:02 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [req-ba67cefd-8a2c-47f5-bbbe-fb936116eb16 req-9a323dc8-0196-4ffc-885c-ffbc41b9c155 tempest-AttachVolumeTestJSON-1525867077 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:43:02 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-80db6686-f525-4d1b-9cab-f07fb9ad9c78 tempest-TestMinimumBasicScenario-261614628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c1b9b39-814e-45f6-91e0-b0cd525fd199) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64ecd7db-42d3-4cef-8bcd-81e392af5e98', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:43:02 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-80db6686-f525-4d1b-9cab-f07fb9ad9c78 tempest-TestMinimumBasicScenario-261614628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b399fead-8a42-4323-91ec-04a8e7af757f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:43:02 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-80db6686-f525-4d1b-9cab-f07fb9ad9c78 tempest-TestMinimumBasicScenario-261614628 None] Volume volume-64ecd7db-42d3-4cef-8bcd-81e392af5e98 (64ecd7db-42d3-4cef-8bcd-81e392af5e98): created successfully Sep 06 06:43:02 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-80db6686-f525-4d1b-9cab-f07fb9ad9c78 tempest-TestMinimumBasicScenario-261614628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b399fead-8a42-4323-91ec-04a8e7af757f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:43:02 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-80db6686-f525-4d1b-9cab-f07fb9ad9c78 tempest-TestMinimumBasicScenario-261614628 None] Flow 'volume_create_manager' (2a994fa3-0ad6-427d-90e9-eef8ab8ebcac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:43:02 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [req-ba67cefd-8a2c-47f5-bbbe-fb936116eb16 req-9a323dc8-0196-4ffc-885c-ffbc41b9c155 tempest-AttachVolumeTestJSON-1525867077 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6', 'name': 'volume-577fd0b3-a5de-4e63-9623-e67764d0afa0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '53fbbf77-1605-4c27-8c9f-531781ed91fe', 'enforce_multipath': True} {{(pid=87329) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 06 06:43:02 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-80db6686-f525-4d1b-9cab-f07fb9ad9c78 tempest-TestMinimumBasicScenario-261614628 None] Created volume successfully. Sep 06 06:43:02 devstack cinder-volume[87329]: INFO cinder.volume.manager [req-ba67cefd-8a2c-47f5-bbbe-fb936116eb16 req-9a323dc8-0196-4ffc-885c-ffbc41b9c155 tempest-AttachVolumeTestJSON-1525867077 None] attachment_update completed successfully. Sep 06 06:43:03 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-de35fa39-5791-49df-a3ac-4e1721e57f5e tempest-AttachVolumeTestJSON-1525867077 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87329) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 06:43:03 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-de35fa39-5791-49df-a3ac-4e1721e57f5e tempest-AttachVolumeTestJSON-1525867077 None] Flow 'volume_create_manager' (7a97737c-3e27-43bd-853b-72469560bb6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:43:04 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-de35fa39-5791-49df-a3ac-4e1721e57f5e tempest-AttachVolumeTestJSON-1525867077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49c3c884-a482-459b-8ae8-adcf6fde64ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:43:04 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-de35fa39-5791-49df-a3ac-4e1721e57f5e tempest-AttachVolumeTestJSON-1525867077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49c3c884-a482-459b-8ae8-adcf6fde64ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:43:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-602577431',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0991a793-8038-4394-adca-7c27fe13ad58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0963cc134ebb4365b128ea7e41f4469c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:43:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:43:04Z,use_quota=True,user_id='e1bdadfacfaf4b9394e7ded7f4848d7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:43:04 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-de35fa39-5791-49df-a3ac-4e1721e57f5e tempest-AttachVolumeTestJSON-1525867077 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae30390e-aa2e-4ffa-889a-9c4a3f75cd2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:43:04 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-de35fa39-5791-49df-a3ac-4e1721e57f5e tempest-AttachVolumeTestJSON-1525867077 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae30390e-aa2e-4ffa-889a-9c4a3f75cd2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:43:04 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-de35fa39-5791-49df-a3ac-4e1721e57f5e tempest-AttachVolumeTestJSON-1525867077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f69a4999-8a27-4dd8-9ec3-6a253b65cc96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:43:04 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-de35fa39-5791-49df-a3ac-4e1721e57f5e tempest-AttachVolumeTestJSON-1525867077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f69a4999-8a27-4dd8-9ec3-6a253b65cc96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0991a793-8038-4394-adca-7c27fe13ad58', 'volume_name': 'volume-0991a793-8038-4394-adca-7c27fe13ad58', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:43:04 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-de35fa39-5791-49df-a3ac-4e1721e57f5e tempest-AttachVolumeTestJSON-1525867077 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27e5d61d-102c-4b91-9e96-c466b924efe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:43:04 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-de35fa39-5791-49df-a3ac-4e1721e57f5e tempest-AttachVolumeTestJSON-1525867077 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27e5d61d-102c-4b91-9e96-c466b924efe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:43:04 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-de35fa39-5791-49df-a3ac-4e1721e57f5e tempest-AttachVolumeTestJSON-1525867077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a67073c-f565-42ae-b9fd-8ca5bdc405a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:43:04 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-de35fa39-5791-49df-a3ac-4e1721e57f5e tempest-AttachVolumeTestJSON-1525867077 None] Volume 0991a793-8038-4394-adca-7c27fe13ad58: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0991a793-8038-4394-adca-7c27fe13ad58', 'volume_size': 1} Sep 06 06:43:04 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-de35fa39-5791-49df-a3ac-4e1721e57f5e tempest-AttachVolumeTestJSON-1525867077 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:43:04 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-de35fa39-5791-49df-a3ac-4e1721e57f5e tempest-AttachVolumeTestJSON-1525867077 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:43:04 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-de35fa39-5791-49df-a3ac-4e1721e57f5e tempest-AttachVolumeTestJSON-1525867077 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:43:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-602577431',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0991a793-8038-4394-adca-7c27fe13ad58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0963cc134ebb4365b128ea7e41f4469c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:43:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:43:04Z,use_quota=True,user_id='e1bdadfacfaf4b9394e7ded7f4848d7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)}" {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 06:43:04 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-de35fa39-5791-49df-a3ac-4e1721e57f5e tempest-AttachVolumeTestJSON-1525867077 None] Creating volume 0991a793-8038-4394-adca-7c27fe13ad58 {{(pid=87329) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 06:43:04 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-de35fa39-5791-49df-a3ac-4e1721e57f5e tempest-AttachVolumeTestJSON-1525867077 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:43:04 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-de35fa39-5791-49df-a3ac-4e1721e57f5e tempest-AttachVolumeTestJSON-1525867077 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:43:04 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-de35fa39-5791-49df-a3ac-4e1721e57f5e tempest-AttachVolumeTestJSON-1525867077 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:43:04 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-de35fa39-5791-49df-a3ac-4e1721e57f5e tempest-AttachVolumeTestJSON-1525867077 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:43:04 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-de35fa39-5791-49df-a3ac-4e1721e57f5e tempest-AttachVolumeTestJSON-1525867077 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:43:04 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-de35fa39-5791-49df-a3ac-4e1721e57f5e tempest-AttachVolumeTestJSON-1525867077 None] Selected osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 as target Quobyte volume. {{(pid=87329) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 06:43:04 devstack cinder-volume[87329]: INFO cinder.volume.drivers.remotefs [None req-de35fa39-5791-49df-a3ac-4e1721e57f5e tempest-AttachVolumeTestJSON-1525867077 None] casted to osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 Sep 06 06:43:04 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-de35fa39-5791-49df-a3ac-4e1721e57f5e tempest-AttachVolumeTestJSON-1525867077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-0991a793-8038-4394-adca-7c27fe13ad58 1073741824 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:43:04 devstack sudo[101331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-0991a793-8038-4394-adca-7c27fe13ad58 1073741824 Sep 06 06:43:04 devstack sudo[101331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:43:04 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [req-49bd9f3a-93dd-43aa-8d4f-cde53770431f req-8fdf7f62-13a0-44ff-a68c-a31557d1bb10 tempest-TestMinimumBasicScenario-261614628 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:43:04 devstack sudo[101331]: pam_unix(sudo:session): session closed for user root Sep 06 06:43:04 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-de35fa39-5791-49df-a3ac-4e1721e57f5e tempest-AttachVolumeTestJSON-1525867077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-0991a793-8038-4394-adca-7c27fe13ad58 1073741824" returned: 0 in 0.449s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:43:04 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-de35fa39-5791-49df-a3ac-4e1721e57f5e tempest-AttachVolumeTestJSON-1525867077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-0991a793-8038-4394-adca-7c27fe13ad58 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:43:04 devstack sudo[101342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-0991a793-8038-4394-adca-7c27fe13ad58 Sep 06 06:43:04 devstack sudo[101342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:43:04 devstack sudo[101342]: pam_unix(sudo:session): session closed for user root Sep 06 06:43:04 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-de35fa39-5791-49df-a3ac-4e1721e57f5e tempest-AttachVolumeTestJSON-1525867077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-0991a793-8038-4394-adca-7c27fe13ad58" returned: 0 in 0.260s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:43:04 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-de35fa39-5791-49df-a3ac-4e1721e57f5e tempest-AttachVolumeTestJSON-1525867077 None] <== create_volume: return (752ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'} {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 06:43:04 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-de35fa39-5791-49df-a3ac-4e1721e57f5e tempest-AttachVolumeTestJSON-1525867077 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.755s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:43:04 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [req-49bd9f3a-93dd-43aa-8d4f-cde53770431f req-8fdf7f62-13a0-44ff-a68c-a31557d1bb10 tempest-TestMinimumBasicScenario-261614628 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.529s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:43:04 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-de35fa39-5791-49df-a3ac-4e1721e57f5e tempest-AttachVolumeTestJSON-1525867077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a67073c-f565-42ae-b9fd-8ca5bdc405a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0991a793-8038-4394-adca-7c27fe13ad58', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:43:04 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-de35fa39-5791-49df-a3ac-4e1721e57f5e tempest-AttachVolumeTestJSON-1525867077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c6b1be0-0237-4e22-a333-60fcf9ed58b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:43:04 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [req-49bd9f3a-93dd-43aa-8d4f-cde53770431f req-8fdf7f62-13a0-44ff-a68c-a31557d1bb10 tempest-TestMinimumBasicScenario-261614628 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.036s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:43:04 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-de35fa39-5791-49df-a3ac-4e1721e57f5e tempest-AttachVolumeTestJSON-1525867077 None] Volume volume-0991a793-8038-4394-adca-7c27fe13ad58 (0991a793-8038-4394-adca-7c27fe13ad58): created successfully Sep 06 06:43:04 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-de35fa39-5791-49df-a3ac-4e1721e57f5e tempest-AttachVolumeTestJSON-1525867077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c6b1be0-0237-4e22-a333-60fcf9ed58b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:43:04 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-de35fa39-5791-49df-a3ac-4e1721e57f5e tempest-AttachVolumeTestJSON-1525867077 None] Flow 'volume_create_manager' (7a97737c-3e27-43bd-853b-72469560bb6c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:43:04 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-de35fa39-5791-49df-a3ac-4e1721e57f5e tempest-AttachVolumeTestJSON-1525867077 None] Created volume successfully. Sep 06 06:43:04 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [req-49bd9f3a-93dd-43aa-8d4f-cde53770431f req-8fdf7f62-13a0-44ff-a68c-a31557d1bb10 tempest-TestMinimumBasicScenario-261614628 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6', 'name': 'volume-64ecd7db-42d3-4cef-8bcd-81e392af5e98', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6cb24694-551b-4694-8e0e-8e639042535d', 'enforce_multipath': True} {{(pid=87329) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 06 06:43:05 devstack cinder-volume[87329]: INFO cinder.volume.manager [req-49bd9f3a-93dd-43aa-8d4f-cde53770431f req-8fdf7f62-13a0-44ff-a68c-a31557d1bb10 tempest-TestMinimumBasicScenario-261614628 None] attachment_update completed successfully. Sep 06 06:43:06 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [req-88cf7b38-d762-4d01-971c-52400d3a1195 req-cbc829a3-b020-41c1-84ac-f65c76f84e4b tempest-AttachVolumeTestJSON-1525867077 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:43:06 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [req-88cf7b38-d762-4d01-971c-52400d3a1195 req-cbc829a3-b020-41c1-84ac-f65c76f84e4b tempest-AttachVolumeTestJSON-1525867077 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:43:06 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [req-88cf7b38-d762-4d01-971c-52400d3a1195 req-cbc829a3-b020-41c1-84ac-f65c76f84e4b tempest-AttachVolumeTestJSON-1525867077 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:43:06 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [req-88cf7b38-d762-4d01-971c-52400d3a1195 req-cbc829a3-b020-41c1-84ac-f65c76f84e4b tempest-AttachVolumeTestJSON-1525867077 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6', 'name': 'volume-0991a793-8038-4394-adca-7c27fe13ad58', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e8351d37-044b-494f-9dcf-91c371e39c07', 'enforce_multipath': True} {{(pid=87329) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 06 06:43:06 devstack cinder-volume[87329]: INFO cinder.volume.manager [req-88cf7b38-d762-4d01-971c-52400d3a1195 req-cbc829a3-b020-41c1-84ac-f65c76f84e4b tempest-AttachVolumeTestJSON-1525867077 None] attachment_update completed successfully. Sep 06 06:43:08 devstack cinder-volume[87329]: INFO cinder.volume.manager [req-e444405d-6a43-4ad7-9e02-79352577d6ec req-34f2fbac-4e98-4329-8852-32951d0238e7 tempest-AttachVolumeTestJSON-1525867077 None] Terminate volume connection completed successfully. Sep 06 06:43:08 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [req-e444405d-6a43-4ad7-9e02-79352577d6ec req-34f2fbac-4e98-4329-8852-32951d0238e7 tempest-AttachVolumeTestJSON-1525867077 None] Deleting attachment 53fbbf77-1605-4c27-8c9f-531781ed91fe. {{(pid=87329) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 06 06:43:10 devstack cinder-volume[87329]: INFO cinder.volume.manager [req-1ec02231-f75c-4331-b070-598b3cc3fc83 req-a51c294a-6ae8-4442-8631-24ff0264aac6 tempest-AttachVolumeTestJSON-1525867077 None] Terminate volume connection completed successfully. Sep 06 06:43:10 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [req-1ec02231-f75c-4331-b070-598b3cc3fc83 req-a51c294a-6ae8-4442-8631-24ff0264aac6 tempest-AttachVolumeTestJSON-1525867077 None] Deleting attachment e8351d37-044b-494f-9dcf-91c371e39c07. {{(pid=87329) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 06 06:43:15 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-cc81c34e-4a14-4292-b0a4-aad6117cbe55 tempest-AttachVolumeTestJSON-1525867077 None] Acquiring lock "cinder-0991a793-8038-4394-adca-7c27fe13ad58-delete_volume" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:43:15 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-cc81c34e-4a14-4292-b0a4-aad6117cbe55 tempest-AttachVolumeTestJSON-1525867077 None] Lock "cinder-0991a793-8038-4394-adca-7c27fe13ad58-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:43:15 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-cc81c34e-4a14-4292-b0a4-aad6117cbe55 tempest-AttachVolumeTestJSON-1525867077 None] Acquiring lock "cinder-quobyte-0991a793-8038-4394-adca-7c27fe13ad58" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:43:15 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-cc81c34e-4a14-4292-b0a4-aad6117cbe55 tempest-AttachVolumeTestJSON-1525867077 None] Lock "cinder-quobyte-0991a793-8038-4394-adca-7c27fe13ad58" acquired by "delete_volume" :: waited 0.014s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:43:15 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[1426ac78-65d9-4669-a88c-3be8825ef931]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:43:15 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-cc81c34e-4a14-4292-b0a4-aad6117cbe55 tempest-AttachVolumeTestJSON-1525867077 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-0991a793-8038-4394-adca-7c27fe13ad58 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:43:15 devstack sudo[101432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-0991a793-8038-4394-adca-7c27fe13ad58 Sep 06 06:43:15 devstack sudo[101432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:43:15 devstack sudo[101432]: pam_unix(sudo:session): session closed for user root Sep 06 06:43:15 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-cc81c34e-4a14-4292-b0a4-aad6117cbe55 tempest-AttachVolumeTestJSON-1525867077 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-0991a793-8038-4394-adca-7c27fe13ad58" returned: 0 in 0.352s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:43:15 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-cc81c34e-4a14-4292-b0a4-aad6117cbe55 tempest-AttachVolumeTestJSON-1525867077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-0991a793-8038-4394-adca-7c27fe13ad58 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:43:15 devstack sudo[101437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-0991a793-8038-4394-adca-7c27fe13ad58 Sep 06 06:43:15 devstack sudo[101437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:43:16 devstack sudo[101437]: pam_unix(sudo:session): session closed for user root Sep 06 06:43:16 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-cc81c34e-4a14-4292-b0a4-aad6117cbe55 tempest-AttachVolumeTestJSON-1525867077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-0991a793-8038-4394-adca-7c27fe13ad58" returned: 0 in 0.240s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:43:16 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-cc81c34e-4a14-4292-b0a4-aad6117cbe55 tempest-AttachVolumeTestJSON-1525867077 None] Lock "cinder-quobyte-0991a793-8038-4394-adca-7c27fe13ad58" released by "delete_volume" :: held 0.627s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:43:16 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-cc81c34e-4a14-4292-b0a4-aad6117cbe55 tempest-AttachVolumeTestJSON-1525867077 None] Created reservations ['74903e20-efa4-4baa-817f-205a3ec4e8de', 'ffa0451c-0ee5-48ca-be75-816c900e7079', '82acfc31-93ce-41ad-8644-dc5eaa3ef9f2', 'fb890179-c15e-432b-aee2-30bcfdf6814c'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:43:16 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-cc81c34e-4a14-4292-b0a4-aad6117cbe55 tempest-AttachVolumeTestJSON-1525867077 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:43:16 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-cc81c34e-4a14-4292-b0a4-aad6117cbe55 tempest-AttachVolumeTestJSON-1525867077 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:43:16 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-cc81c34e-4a14-4292-b0a4-aad6117cbe55 tempest-AttachVolumeTestJSON-1525867077 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:43:16 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-cc81c34e-4a14-4292-b0a4-aad6117cbe55 tempest-AttachVolumeTestJSON-1525867077 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:43:16 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-cc81c34e-4a14-4292-b0a4-aad6117cbe55 tempest-AttachVolumeTestJSON-1525867077 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:43:16 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-cc81c34e-4a14-4292-b0a4-aad6117cbe55 tempest-AttachVolumeTestJSON-1525867077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:43:16 devstack sudo[101440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:43:16 devstack sudo[101440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:43:16 devstack sudo[101440]: pam_unix(sudo:session): session closed for user root Sep 06 06:43:16 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-cc81c34e-4a14-4292-b0a4-aad6117cbe55 tempest-AttachVolumeTestJSON-1525867077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.237s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:43:16 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-cc81c34e-4a14-4292-b0a4-aad6117cbe55 tempest-AttachVolumeTestJSON-1525867077 None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:43:16 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-cc81c34e-4a14-4292-b0a4-aad6117cbe55 tempest-AttachVolumeTestJSON-1525867077 None] Deleted volume successfully. Sep 06 06:43:16 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-cc81c34e-4a14-4292-b0a4-aad6117cbe55 tempest-AttachVolumeTestJSON-1525867077 None] Lock "cinder-0991a793-8038-4394-adca-7c27fe13ad58-delete_volume" released by "delete_volume" :: held 1.050s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:43:16 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-fbd5bbb9-822d-486a-8713-2bc114ea4201 tempest-AttachVolumeTestJSON-1525867077 None] Acquiring lock "cinder-577fd0b3-a5de-4e63-9623-e67764d0afa0-delete_volume" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:43:16 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-fbd5bbb9-822d-486a-8713-2bc114ea4201 tempest-AttachVolumeTestJSON-1525867077 None] Lock "cinder-577fd0b3-a5de-4e63-9623-e67764d0afa0-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:43:16 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-fbd5bbb9-822d-486a-8713-2bc114ea4201 tempest-AttachVolumeTestJSON-1525867077 None] Acquiring lock "cinder-quobyte-577fd0b3-a5de-4e63-9623-e67764d0afa0" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:43:16 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-fbd5bbb9-822d-486a-8713-2bc114ea4201 tempest-AttachVolumeTestJSON-1525867077 None] Lock "cinder-quobyte-577fd0b3-a5de-4e63-9623-e67764d0afa0" acquired by "delete_volume" :: waited 0.013s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:43:16 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[b478ebd3-0690-4124-8340-3f26304b2c0e]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:43:16 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-fbd5bbb9-822d-486a-8713-2bc114ea4201 tempest-AttachVolumeTestJSON-1525867077 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-577fd0b3-a5de-4e63-9623-e67764d0afa0 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:43:16 devstack sudo[101443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-577fd0b3-a5de-4e63-9623-e67764d0afa0 Sep 06 06:43:16 devstack sudo[101443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:43:16 devstack sudo[101443]: pam_unix(sudo:session): session closed for user root Sep 06 06:43:16 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-fbd5bbb9-822d-486a-8713-2bc114ea4201 tempest-AttachVolumeTestJSON-1525867077 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-577fd0b3-a5de-4e63-9623-e67764d0afa0" returned: 0 in 0.365s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:43:16 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-fbd5bbb9-822d-486a-8713-2bc114ea4201 tempest-AttachVolumeTestJSON-1525867077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-577fd0b3-a5de-4e63-9623-e67764d0afa0 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:43:16 devstack sudo[101448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-577fd0b3-a5de-4e63-9623-e67764d0afa0 Sep 06 06:43:16 devstack sudo[101448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:43:17 devstack sudo[101448]: pam_unix(sudo:session): session closed for user root Sep 06 06:43:17 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-fbd5bbb9-822d-486a-8713-2bc114ea4201 tempest-AttachVolumeTestJSON-1525867077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-577fd0b3-a5de-4e63-9623-e67764d0afa0" returned: 0 in 0.242s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:43:17 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-fbd5bbb9-822d-486a-8713-2bc114ea4201 tempest-AttachVolumeTestJSON-1525867077 None] Lock "cinder-quobyte-577fd0b3-a5de-4e63-9623-e67764d0afa0" released by "delete_volume" :: held 0.645s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:43:17 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-fbd5bbb9-822d-486a-8713-2bc114ea4201 tempest-AttachVolumeTestJSON-1525867077 None] Created reservations ['36b9fd1c-04ed-48ce-95c7-02d6bd9f5f82', 'c5c6a9cf-2aec-486d-8105-c3c6ff4a2107', 'bfef92ee-2a01-4704-8ea9-438e99a88ea7', '3ef020dd-e7a8-4f36-98c1-79f78c49205c'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:43:17 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-fbd5bbb9-822d-486a-8713-2bc114ea4201 tempest-AttachVolumeTestJSON-1525867077 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:43:17 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-fbd5bbb9-822d-486a-8713-2bc114ea4201 tempest-AttachVolumeTestJSON-1525867077 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:43:17 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-fbd5bbb9-822d-486a-8713-2bc114ea4201 tempest-AttachVolumeTestJSON-1525867077 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:43:17 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-fbd5bbb9-822d-486a-8713-2bc114ea4201 tempest-AttachVolumeTestJSON-1525867077 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:43:17 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-fbd5bbb9-822d-486a-8713-2bc114ea4201 tempest-AttachVolumeTestJSON-1525867077 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:43:17 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-fbd5bbb9-822d-486a-8713-2bc114ea4201 tempest-AttachVolumeTestJSON-1525867077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:43:17 devstack sudo[101451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:43:17 devstack sudo[101451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:43:17 devstack sudo[101451]: pam_unix(sudo:session): session closed for user root Sep 06 06:43:17 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-fbd5bbb9-822d-486a-8713-2bc114ea4201 tempest-AttachVolumeTestJSON-1525867077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.238s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:43:17 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-fbd5bbb9-822d-486a-8713-2bc114ea4201 tempest-AttachVolumeTestJSON-1525867077 None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:43:17 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-fbd5bbb9-822d-486a-8713-2bc114ea4201 tempest-AttachVolumeTestJSON-1525867077 None] Deleted volume successfully. Sep 06 06:43:17 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-fbd5bbb9-822d-486a-8713-2bc114ea4201 tempest-AttachVolumeTestJSON-1525867077 None] Lock "cinder-577fd0b3-a5de-4e63-9623-e67764d0afa0-delete_volume" released by "delete_volume" :: held 1.065s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:43:17 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-53601345-87e9-45d9-aa06-c8f03fd97532 tempest-AttachVolumeTestJSON-1525867077 None] Acquiring lock "cinder-285d28b3-ee74-43a2-9ffc-15959096b0a9-delete_volume" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:43:17 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-53601345-87e9-45d9-aa06-c8f03fd97532 tempest-AttachVolumeTestJSON-1525867077 None] Lock "cinder-285d28b3-ee74-43a2-9ffc-15959096b0a9-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:43:17 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-53601345-87e9-45d9-aa06-c8f03fd97532 tempest-AttachVolumeTestJSON-1525867077 None] Acquiring lock "cinder-quobyte-285d28b3-ee74-43a2-9ffc-15959096b0a9" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:43:17 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-53601345-87e9-45d9-aa06-c8f03fd97532 tempest-AttachVolumeTestJSON-1525867077 None] Lock "cinder-quobyte-285d28b3-ee74-43a2-9ffc-15959096b0a9" acquired by "delete_volume" :: waited 0.015s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:43:17 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7fe03af-b195-4115-9670-04198ce5b4e4]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:43:17 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-53601345-87e9-45d9-aa06-c8f03fd97532 tempest-AttachVolumeTestJSON-1525867077 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-285d28b3-ee74-43a2-9ffc-15959096b0a9 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:43:17 devstack sudo[101454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-285d28b3-ee74-43a2-9ffc-15959096b0a9 Sep 06 06:43:17 devstack sudo[101454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:43:18 devstack sudo[101454]: pam_unix(sudo:session): session closed for user root Sep 06 06:43:18 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-53601345-87e9-45d9-aa06-c8f03fd97532 tempest-AttachVolumeTestJSON-1525867077 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-285d28b3-ee74-43a2-9ffc-15959096b0a9" returned: 0 in 0.347s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:43:18 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-53601345-87e9-45d9-aa06-c8f03fd97532 tempest-AttachVolumeTestJSON-1525867077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-285d28b3-ee74-43a2-9ffc-15959096b0a9 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:43:18 devstack sudo[101459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-285d28b3-ee74-43a2-9ffc-15959096b0a9 Sep 06 06:43:18 devstack sudo[101459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:43:18 devstack sudo[101459]: pam_unix(sudo:session): session closed for user root Sep 06 06:43:18 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-53601345-87e9-45d9-aa06-c8f03fd97532 tempest-AttachVolumeTestJSON-1525867077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-285d28b3-ee74-43a2-9ffc-15959096b0a9" returned: 0 in 0.245s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:43:18 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-53601345-87e9-45d9-aa06-c8f03fd97532 tempest-AttachVolumeTestJSON-1525867077 None] Lock "cinder-quobyte-285d28b3-ee74-43a2-9ffc-15959096b0a9" released by "delete_volume" :: held 0.633s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:43:18 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-53601345-87e9-45d9-aa06-c8f03fd97532 tempest-AttachVolumeTestJSON-1525867077 None] Created reservations ['a4ff502a-3d28-4e80-a707-c60fc6a20999', '6ea3f9e6-8c55-4922-8440-5999a5082cb5', 'e016408c-9eb8-47f1-b7e6-cd759a4683c0', 'e8e98ce4-6bf3-42f1-ab58-77e317fad182'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:43:18 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-53601345-87e9-45d9-aa06-c8f03fd97532 tempest-AttachVolumeTestJSON-1525867077 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:43:18 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-53601345-87e9-45d9-aa06-c8f03fd97532 tempest-AttachVolumeTestJSON-1525867077 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:43:18 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-53601345-87e9-45d9-aa06-c8f03fd97532 tempest-AttachVolumeTestJSON-1525867077 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:43:18 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-53601345-87e9-45d9-aa06-c8f03fd97532 tempest-AttachVolumeTestJSON-1525867077 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:43:18 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-53601345-87e9-45d9-aa06-c8f03fd97532 tempest-AttachVolumeTestJSON-1525867077 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:43:18 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-53601345-87e9-45d9-aa06-c8f03fd97532 tempest-AttachVolumeTestJSON-1525867077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:43:18 devstack sudo[101462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:43:18 devstack sudo[101462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:43:18 devstack sudo[101462]: pam_unix(sudo:session): session closed for user root Sep 06 06:43:18 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-53601345-87e9-45d9-aa06-c8f03fd97532 tempest-AttachVolumeTestJSON-1525867077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.264s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:43:18 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-53601345-87e9-45d9-aa06-c8f03fd97532 tempest-AttachVolumeTestJSON-1525867077 None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:43:18 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-53601345-87e9-45d9-aa06-c8f03fd97532 tempest-AttachVolumeTestJSON-1525867077 None] Deleted volume successfully. Sep 06 06:43:18 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-53601345-87e9-45d9-aa06-c8f03fd97532 tempest-AttachVolumeTestJSON-1525867077 None] Lock "cinder-285d28b3-ee74-43a2-9ffc-15959096b0a9-delete_volume" released by "delete_volume" :: held 1.130s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:43:25 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [req-623361df-defb-4c97-a814-7234f165499e req-66c39213-a4a2-47f1-a29e-e9188ad11cbc tempest-VolumesSnapshotsTestJSON-333542698 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87329) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 06:43:26 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [req-623361df-defb-4c97-a814-7234f165499e req-66c39213-a4a2-47f1-a29e-e9188ad11cbc tempest-VolumesSnapshotsTestJSON-333542698 None] Flow 'volume_create_manager' (9c2edb2e-bb7b-4a75-adfa-ef9116e7db8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:43:26 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [req-623361df-defb-4c97-a814-7234f165499e req-66c39213-a4a2-47f1-a29e-e9188ad11cbc tempest-VolumesSnapshotsTestJSON-333542698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97e45c99-e948-40a5-9ab7-f2f3c1b0229b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:43:26 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [req-623361df-defb-4c97-a814-7234f165499e req-66c39213-a4a2-47f1-a29e-e9188ad11cbc tempest-VolumesSnapshotsTestJSON-333542698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97e45c99-e948-40a5-9ab7-f2f3c1b0229b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:43:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1563711633',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b99bf69b-b424-4141-9f65-1db10a4d8cd0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c23958b3f454dbb89a040ba1bbf1d92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:43:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:43:26Z,use_quota=True,user_id='54f68fba756549a689f6a1da05962b5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:43:26 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [req-623361df-defb-4c97-a814-7234f165499e req-66c39213-a4a2-47f1-a29e-e9188ad11cbc tempest-VolumesSnapshotsTestJSON-333542698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aef0f0d6-c2bc-4ef6-937e-3deecd136e44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:43:26 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [req-623361df-defb-4c97-a814-7234f165499e req-66c39213-a4a2-47f1-a29e-e9188ad11cbc tempest-VolumesSnapshotsTestJSON-333542698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aef0f0d6-c2bc-4ef6-937e-3deecd136e44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:43:26 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [req-623361df-defb-4c97-a814-7234f165499e req-66c39213-a4a2-47f1-a29e-e9188ad11cbc tempest-VolumesSnapshotsTestJSON-333542698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e7c1523-9ed9-408b-b71a-e544d2e7ab1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:43:26 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [req-623361df-defb-4c97-a814-7234f165499e req-66c39213-a4a2-47f1-a29e-e9188ad11cbc tempest-VolumesSnapshotsTestJSON-333542698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e7c1523-9ed9-408b-b71a-e544d2e7ab1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b99bf69b-b424-4141-9f65-1db10a4d8cd0', 'volume_name': 'volume-b99bf69b-b424-4141-9f65-1db10a4d8cd0', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:43:26 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [req-623361df-defb-4c97-a814-7234f165499e req-66c39213-a4a2-47f1-a29e-e9188ad11cbc tempest-VolumesSnapshotsTestJSON-333542698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54ea1c8f-fc41-4a32-90b1-21f9dc2680f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:43:26 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [req-623361df-defb-4c97-a814-7234f165499e req-66c39213-a4a2-47f1-a29e-e9188ad11cbc tempest-VolumesSnapshotsTestJSON-333542698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54ea1c8f-fc41-4a32-90b1-21f9dc2680f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:43:26 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [req-623361df-defb-4c97-a814-7234f165499e req-66c39213-a4a2-47f1-a29e-e9188ad11cbc tempest-VolumesSnapshotsTestJSON-333542698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6387ec5a-8cff-451a-8ecf-0bde3fafd98d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:43:26 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [req-623361df-defb-4c97-a814-7234f165499e req-66c39213-a4a2-47f1-a29e-e9188ad11cbc tempest-VolumesSnapshotsTestJSON-333542698 None] Volume b99bf69b-b424-4141-9f65-1db10a4d8cd0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b99bf69b-b424-4141-9f65-1db10a4d8cd0', 'volume_size': 1} Sep 06 06:43:26 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [req-623361df-defb-4c97-a814-7234f165499e req-66c39213-a4a2-47f1-a29e-e9188ad11cbc tempest-VolumesSnapshotsTestJSON-333542698 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:43:26 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [req-623361df-defb-4c97-a814-7234f165499e req-66c39213-a4a2-47f1-a29e-e9188ad11cbc tempest-VolumesSnapshotsTestJSON-333542698 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:43:26 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [req-623361df-defb-4c97-a814-7234f165499e req-66c39213-a4a2-47f1-a29e-e9188ad11cbc tempest-VolumesSnapshotsTestJSON-333542698 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:43:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1563711633',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b99bf69b-b424-4141-9f65-1db10a4d8cd0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c23958b3f454dbb89a040ba1bbf1d92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:43:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:43:26Z,use_quota=True,user_id='54f68fba756549a689f6a1da05962b5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)}" {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 06:43:26 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [req-623361df-defb-4c97-a814-7234f165499e req-66c39213-a4a2-47f1-a29e-e9188ad11cbc tempest-VolumesSnapshotsTestJSON-333542698 None] Creating volume b99bf69b-b424-4141-9f65-1db10a4d8cd0 {{(pid=87329) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 06:43:26 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [req-623361df-defb-4c97-a814-7234f165499e req-66c39213-a4a2-47f1-a29e-e9188ad11cbc tempest-VolumesSnapshotsTestJSON-333542698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:43:26 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [req-623361df-defb-4c97-a814-7234f165499e req-66c39213-a4a2-47f1-a29e-e9188ad11cbc tempest-VolumesSnapshotsTestJSON-333542698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:43:26 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [req-623361df-defb-4c97-a814-7234f165499e req-66c39213-a4a2-47f1-a29e-e9188ad11cbc tempest-VolumesSnapshotsTestJSON-333542698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:43:26 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [req-623361df-defb-4c97-a814-7234f165499e req-66c39213-a4a2-47f1-a29e-e9188ad11cbc tempest-VolumesSnapshotsTestJSON-333542698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:43:26 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [req-623361df-defb-4c97-a814-7234f165499e req-66c39213-a4a2-47f1-a29e-e9188ad11cbc tempest-VolumesSnapshotsTestJSON-333542698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:43:26 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [req-623361df-defb-4c97-a814-7234f165499e req-66c39213-a4a2-47f1-a29e-e9188ad11cbc tempest-VolumesSnapshotsTestJSON-333542698 None] Selected osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 as target Quobyte volume. {{(pid=87329) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 06:43:26 devstack cinder-volume[87329]: INFO cinder.volume.drivers.remotefs [req-623361df-defb-4c97-a814-7234f165499e req-66c39213-a4a2-47f1-a29e-e9188ad11cbc tempest-VolumesSnapshotsTestJSON-333542698 None] casted to osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 Sep 06 06:43:26 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [req-623361df-defb-4c97-a814-7234f165499e req-66c39213-a4a2-47f1-a29e-e9188ad11cbc tempest-VolumesSnapshotsTestJSON-333542698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b99bf69b-b424-4141-9f65-1db10a4d8cd0 1073741824 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:43:26 devstack sudo[101521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b99bf69b-b424-4141-9f65-1db10a4d8cd0 1073741824 Sep 06 06:43:26 devstack sudo[101521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:43:26 devstack sudo[101521]: pam_unix(sudo:session): session closed for user root Sep 06 06:43:26 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [req-623361df-defb-4c97-a814-7234f165499e req-66c39213-a4a2-47f1-a29e-e9188ad11cbc tempest-VolumesSnapshotsTestJSON-333542698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b99bf69b-b424-4141-9f65-1db10a4d8cd0 1073741824" returned: 0 in 0.530s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:43:26 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [req-623361df-defb-4c97-a814-7234f165499e req-66c39213-a4a2-47f1-a29e-e9188ad11cbc tempest-VolumesSnapshotsTestJSON-333542698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b99bf69b-b424-4141-9f65-1db10a4d8cd0 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:43:26 devstack sudo[101530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b99bf69b-b424-4141-9f65-1db10a4d8cd0 Sep 06 06:43:26 devstack sudo[101530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:43:26 devstack sudo[101530]: pam_unix(sudo:session): session closed for user root Sep 06 06:43:26 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [req-623361df-defb-4c97-a814-7234f165499e req-66c39213-a4a2-47f1-a29e-e9188ad11cbc tempest-VolumesSnapshotsTestJSON-333542698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b99bf69b-b424-4141-9f65-1db10a4d8cd0" returned: 0 in 0.251s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:43:26 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [req-623361df-defb-4c97-a814-7234f165499e req-66c39213-a4a2-47f1-a29e-e9188ad11cbc tempest-VolumesSnapshotsTestJSON-333542698 None] <== create_volume: return (827ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'} {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 06:43:26 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [req-623361df-defb-4c97-a814-7234f165499e req-66c39213-a4a2-47f1-a29e-e9188ad11cbc tempest-VolumesSnapshotsTestJSON-333542698 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.829s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:43:26 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [req-623361df-defb-4c97-a814-7234f165499e req-66c39213-a4a2-47f1-a29e-e9188ad11cbc tempest-VolumesSnapshotsTestJSON-333542698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6387ec5a-8cff-451a-8ecf-0bde3fafd98d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b99bf69b-b424-4141-9f65-1db10a4d8cd0', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:43:26 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [req-623361df-defb-4c97-a814-7234f165499e req-66c39213-a4a2-47f1-a29e-e9188ad11cbc tempest-VolumesSnapshotsTestJSON-333542698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92122be6-2be2-40ef-b5b7-13cab4a28d8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:43:26 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [req-623361df-defb-4c97-a814-7234f165499e req-66c39213-a4a2-47f1-a29e-e9188ad11cbc tempest-VolumesSnapshotsTestJSON-333542698 None] Volume volume-b99bf69b-b424-4141-9f65-1db10a4d8cd0 (b99bf69b-b424-4141-9f65-1db10a4d8cd0): created successfully Sep 06 06:43:26 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [req-623361df-defb-4c97-a814-7234f165499e req-66c39213-a4a2-47f1-a29e-e9188ad11cbc tempest-VolumesSnapshotsTestJSON-333542698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92122be6-2be2-40ef-b5b7-13cab4a28d8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:43:26 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [req-623361df-defb-4c97-a814-7234f165499e req-66c39213-a4a2-47f1-a29e-e9188ad11cbc tempest-VolumesSnapshotsTestJSON-333542698 None] Flow 'volume_create_manager' (9c2edb2e-bb7b-4a75-adfa-ef9116e7db8d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:43:26 devstack cinder-volume[87329]: INFO cinder.volume.manager [req-623361df-defb-4c97-a814-7234f165499e req-66c39213-a4a2-47f1-a29e-e9188ad11cbc tempest-VolumesSnapshotsTestJSON-333542698 None] Created volume successfully. Sep 06 06:43:27 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [req-e170a0c6-8b2f-4e20-8f76-d43323411061 req-28de5a9a-3af7-4e44-9171-f2203d90737b tempest-VolumesSnapshotsTestJSON-333542698 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:43:27 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [req-e170a0c6-8b2f-4e20-8f76-d43323411061 req-28de5a9a-3af7-4e44-9171-f2203d90737b tempest-VolumesSnapshotsTestJSON-333542698 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:43:27 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [req-e170a0c6-8b2f-4e20-8f76-d43323411061 req-28de5a9a-3af7-4e44-9171-f2203d90737b tempest-VolumesSnapshotsTestJSON-333542698 None] Creating offline snapshot fd1bec25-8c46-4a81-94d5-8ad332e8a66f of volume b99bf69b-b424-4141-9f65-1db10a4d8cd0 {{(pid=87329) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 06 06:43:27 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[28b124b3-32ea-4b3f-958e-11bdc59f6f57]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:43:27 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [req-e170a0c6-8b2f-4e20-8f76-d43323411061 req-28de5a9a-3af7-4e44-9171-f2203d90737b tempest-VolumesSnapshotsTestJSON-333542698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b99bf69b-b424-4141-9f65-1db10a4d8cd0 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:43:27 devstack sudo[101533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b99bf69b-b424-4141-9f65-1db10a4d8cd0 Sep 06 06:43:27 devstack sudo[101533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:43:27 devstack sudo[101533]: pam_unix(sudo:session): session closed for user root Sep 06 06:43:27 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [req-e170a0c6-8b2f-4e20-8f76-d43323411061 req-28de5a9a-3af7-4e44-9171-f2203d90737b tempest-VolumesSnapshotsTestJSON-333542698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b99bf69b-b424-4141-9f65-1db10a4d8cd0" returned: 0 in 0.408s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:43:27 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [req-e170a0c6-8b2f-4e20-8f76-d43323411061 req-28de5a9a-3af7-4e44-9171-f2203d90737b tempest-VolumesSnapshotsTestJSON-333542698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b99bf69b-b424-4141-9f65-1db10a4d8cd0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b99bf69b-b424-4141-9f65-1db10a4d8cd0.fd1bec25-8c46-4a81-94d5-8ad332e8a66f 1G {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:43:27 devstack sudo[101538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b99bf69b-b424-4141-9f65-1db10a4d8cd0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b99bf69b-b424-4141-9f65-1db10a4d8cd0.fd1bec25-8c46-4a81-94d5-8ad332e8a66f 1G Sep 06 06:43:27 devstack sudo[101538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:43:28 devstack sudo[101538]: pam_unix(sudo:session): session closed for user root Sep 06 06:43:28 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [req-e170a0c6-8b2f-4e20-8f76-d43323411061 req-28de5a9a-3af7-4e44-9171-f2203d90737b tempest-VolumesSnapshotsTestJSON-333542698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b99bf69b-b424-4141-9f65-1db10a4d8cd0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b99bf69b-b424-4141-9f65-1db10a4d8cd0.fd1bec25-8c46-4a81-94d5-8ad332e8a66f 1G" returned: 0 in 0.397s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:43:28 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [req-e170a0c6-8b2f-4e20-8f76-d43323411061 req-28de5a9a-3af7-4e44-9171-f2203d90737b tempest-VolumesSnapshotsTestJSON-333542698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b99bf69b-b424-4141-9f65-1db10a4d8cd0 -F qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b99bf69b-b424-4141-9f65-1db10a4d8cd0.fd1bec25-8c46-4a81-94d5-8ad332e8a66f {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:43:28 devstack sudo[101543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b99bf69b-b424-4141-9f65-1db10a4d8cd0 -F qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b99bf69b-b424-4141-9f65-1db10a4d8cd0.fd1bec25-8c46-4a81-94d5-8ad332e8a66f Sep 06 06:43:28 devstack sudo[101543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:43:28 devstack sudo[101543]: pam_unix(sudo:session): session closed for user root Sep 06 06:43:28 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [req-e170a0c6-8b2f-4e20-8f76-d43323411061 req-28de5a9a-3af7-4e44-9171-f2203d90737b tempest-VolumesSnapshotsTestJSON-333542698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b99bf69b-b424-4141-9f65-1db10a4d8cd0 -F qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b99bf69b-b424-4141-9f65-1db10a4d8cd0.fd1bec25-8c46-4a81-94d5-8ad332e8a66f" returned: 0 in 0.288s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:43:28 devstack cinder-volume[87329]: WARNING cinder.volume.drivers.remotefs [req-e170a0c6-8b2f-4e20-8f76-d43323411061 req-28de5a9a-3af7-4e44-9171-f2203d90737b tempest-VolumesSnapshotsTestJSON-333542698 None] /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b99bf69b-b424-4141-9f65-1db10a4d8cd0.fd1bec25-8c46-4a81-94d5-8ad332e8a66f is being set with open permissions: ugo+rw Sep 06 06:43:28 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [req-e170a0c6-8b2f-4e20-8f76-d43323411061 req-28de5a9a-3af7-4e44-9171-f2203d90737b tempest-VolumesSnapshotsTestJSON-333542698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b99bf69b-b424-4141-9f65-1db10a4d8cd0.fd1bec25-8c46-4a81-94d5-8ad332e8a66f {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:43:28 devstack sudo[101548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b99bf69b-b424-4141-9f65-1db10a4d8cd0.fd1bec25-8c46-4a81-94d5-8ad332e8a66f Sep 06 06:43:28 devstack sudo[101548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:43:28 devstack sudo[101548]: pam_unix(sudo:session): session closed for user root Sep 06 06:43:28 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [req-e170a0c6-8b2f-4e20-8f76-d43323411061 req-28de5a9a-3af7-4e44-9171-f2203d90737b tempest-VolumesSnapshotsTestJSON-333542698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b99bf69b-b424-4141-9f65-1db10a4d8cd0.fd1bec25-8c46-4a81-94d5-8ad332e8a66f" returned: 0 in 0.246s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:43:28 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [req-e170a0c6-8b2f-4e20-8f76-d43323411061 req-28de5a9a-3af7-4e44-9171-f2203d90737b tempest-VolumesSnapshotsTestJSON-333542698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b99bf69b-b424-4141-9f65-1db10a4d8cd0.info {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:43:28 devstack sudo[101551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b99bf69b-b424-4141-9f65-1db10a4d8cd0.info Sep 06 06:43:28 devstack sudo[101551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:43:28 devstack sudo[101551]: pam_unix(sudo:session): session closed for user root Sep 06 06:43:28 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [req-e170a0c6-8b2f-4e20-8f76-d43323411061 req-28de5a9a-3af7-4e44-9171-f2203d90737b tempest-VolumesSnapshotsTestJSON-333542698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b99bf69b-b424-4141-9f65-1db10a4d8cd0.info" returned: 0 in 0.255s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:43:28 devstack cinder-volume[87329]: WARNING cinder.volume.drivers.remotefs [req-e170a0c6-8b2f-4e20-8f76-d43323411061 req-28de5a9a-3af7-4e44-9171-f2203d90737b tempest-VolumesSnapshotsTestJSON-333542698 None] /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b99bf69b-b424-4141-9f65-1db10a4d8cd0.info is being set with open permissions: ugo+rw Sep 06 06:43:28 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [req-e170a0c6-8b2f-4e20-8f76-d43323411061 req-28de5a9a-3af7-4e44-9171-f2203d90737b tempest-VolumesSnapshotsTestJSON-333542698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b99bf69b-b424-4141-9f65-1db10a4d8cd0.info {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:43:29 devstack sudo[101555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b99bf69b-b424-4141-9f65-1db10a4d8cd0.info Sep 06 06:43:29 devstack sudo[101555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:43:29 devstack sudo[101555]: pam_unix(sudo:session): session closed for user root Sep 06 06:43:29 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [req-e170a0c6-8b2f-4e20-8f76-d43323411061 req-28de5a9a-3af7-4e44-9171-f2203d90737b tempest-VolumesSnapshotsTestJSON-333542698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b99bf69b-b424-4141-9f65-1db10a4d8cd0.info" returned: 0 in 0.244s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:43:29 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [req-e170a0c6-8b2f-4e20-8f76-d43323411061 req-28de5a9a-3af7-4e44-9171-f2203d90737b tempest-VolumesSnapshotsTestJSON-333542698 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.945s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:43:29 devstack cinder-volume[87329]: INFO cinder.volume.manager [req-e170a0c6-8b2f-4e20-8f76-d43323411061 req-28de5a9a-3af7-4e44-9171-f2203d90737b tempest-VolumesSnapshotsTestJSON-333542698 None] Create snapshot completed successfully Sep 06 06:43:29 devstack cinder-volume[87329]: DEBUG cinder.coordination [req-4b91e808-3d03-46e3-bb71-47c5a66773b8 req-5333aa57-c061-4370-8f79-8a836a2998e0 tempest-VolumesSnapshotsTestJSON-333542698 None] Acquiring lock "cinder-fd1bec25-8c46-4a81-94d5-8ad332e8a66f-delete_snapshot" by "delete_snapshot" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:43:29 devstack cinder-volume[87329]: DEBUG cinder.coordination [req-4b91e808-3d03-46e3-bb71-47c5a66773b8 req-5333aa57-c061-4370-8f79-8a836a2998e0 tempest-VolumesSnapshotsTestJSON-333542698 None] Lock "cinder-fd1bec25-8c46-4a81-94d5-8ad332e8a66f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:43:29 devstack cinder-volume[87329]: DEBUG cinder.coordination [req-4b91e808-3d03-46e3-bb71-47c5a66773b8 req-5333aa57-c061-4370-8f79-8a836a2998e0 tempest-VolumesSnapshotsTestJSON-333542698 None] Acquiring lock "cinder-quobyte-b99bf69b-b424-4141-9f65-1db10a4d8cd0" by "delete_snapshot" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:43:29 devstack cinder-volume[87329]: DEBUG cinder.coordination [req-4b91e808-3d03-46e3-bb71-47c5a66773b8 req-5333aa57-c061-4370-8f79-8a836a2998e0 tempest-VolumesSnapshotsTestJSON-333542698 None] Lock "cinder-quobyte-b99bf69b-b424-4141-9f65-1db10a4d8cd0" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:43:29 devstack cinder-volume[87329]: DEBUG cinder.coordination [req-4b91e808-3d03-46e3-bb71-47c5a66773b8 req-5333aa57-c061-4370-8f79-8a836a2998e0 tempest-VolumesSnapshotsTestJSON-333542698 None] Acquiring lock "cinder-quobyte-fd1bec25-8c46-4a81-94d5-8ad332e8a66f" by "_delete_snapshot" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:43:29 devstack cinder-volume[87329]: DEBUG cinder.coordination [req-4b91e808-3d03-46e3-bb71-47c5a66773b8 req-5333aa57-c061-4370-8f79-8a836a2998e0 tempest-VolumesSnapshotsTestJSON-333542698 None] Lock "cinder-quobyte-fd1bec25-8c46-4a81-94d5-8ad332e8a66f" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:43:29 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [req-4b91e808-3d03-46e3-bb71-47c5a66773b8 req-5333aa57-c061-4370-8f79-8a836a2998e0 tempest-VolumesSnapshotsTestJSON-333542698 None] Deleting offline snapshot fd1bec25-8c46-4a81-94d5-8ad332e8a66f of volume b99bf69b-b424-4141-9f65-1db10a4d8cd0 {{(pid=87329) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 06 06:43:29 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [req-4b91e808-3d03-46e3-bb71-47c5a66773b8 req-5333aa57-c061-4370-8f79-8a836a2998e0 tempest-VolumesSnapshotsTestJSON-333542698 None] snapshot_file for this snap is: volume-b99bf69b-b424-4141-9f65-1db10a4d8cd0.fd1bec25-8c46-4a81-94d5-8ad332e8a66f {{(pid=87329) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 06 06:43:29 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e54aef5-cc1e-4fb9-a81e-1d38f8a72742]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:43:29 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [req-4b91e808-3d03-46e3-bb71-47c5a66773b8 req-5333aa57-c061-4370-8f79-8a836a2998e0 tempest-VolumesSnapshotsTestJSON-333542698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b99bf69b-b424-4141-9f65-1db10a4d8cd0.fd1bec25-8c46-4a81-94d5-8ad332e8a66f {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:43:29 devstack sudo[101559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b99bf69b-b424-4141-9f65-1db10a4d8cd0.fd1bec25-8c46-4a81-94d5-8ad332e8a66f Sep 06 06:43:29 devstack sudo[101559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:43:30 devstack sudo[101559]: pam_unix(sudo:session): session closed for user root Sep 06 06:43:30 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [req-4b91e808-3d03-46e3-bb71-47c5a66773b8 req-5333aa57-c061-4370-8f79-8a836a2998e0 tempest-VolumesSnapshotsTestJSON-333542698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b99bf69b-b424-4141-9f65-1db10a4d8cd0.fd1bec25-8c46-4a81-94d5-8ad332e8a66f" returned: 0 in 0.351s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:43:30 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [req-4b91e808-3d03-46e3-bb71-47c5a66773b8 req-5333aa57-c061-4370-8f79-8a836a2998e0 tempest-VolumesSnapshotsTestJSON-333542698 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b99bf69b-b424-4141-9f65-1db10a4d8cd0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87329) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 06:43:30 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7728809-8ece-4262-a79b-8ca9b234cd06]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:43:30 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [req-4b91e808-3d03-46e3-bb71-47c5a66773b8 req-5333aa57-c061-4370-8f79-8a836a2998e0 tempest-VolumesSnapshotsTestJSON-333542698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b99bf69b-b424-4141-9f65-1db10a4d8cd0 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:43:30 devstack sudo[101564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b99bf69b-b424-4141-9f65-1db10a4d8cd0 Sep 06 06:43:30 devstack sudo[101564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:43:30 devstack sudo[101564]: pam_unix(sudo:session): session closed for user root Sep 06 06:43:30 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [req-4b91e808-3d03-46e3-bb71-47c5a66773b8 req-5333aa57-c061-4370-8f79-8a836a2998e0 tempest-VolumesSnapshotsTestJSON-333542698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b99bf69b-b424-4141-9f65-1db10a4d8cd0" returned: 0 in 0.346s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:43:30 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [req-4b91e808-3d03-46e3-bb71-47c5a66773b8 req-5333aa57-c061-4370-8f79-8a836a2998e0 tempest-VolumesSnapshotsTestJSON-333542698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b99bf69b-b424-4141-9f65-1db10a4d8cd0.fd1bec25-8c46-4a81-94d5-8ad332e8a66f {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:43:30 devstack sudo[101569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b99bf69b-b424-4141-9f65-1db10a4d8cd0.fd1bec25-8c46-4a81-94d5-8ad332e8a66f Sep 06 06:43:30 devstack sudo[101569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:43:30 devstack sudo[101569]: pam_unix(sudo:session): session closed for user root Sep 06 06:43:30 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [req-4b91e808-3d03-46e3-bb71-47c5a66773b8 req-5333aa57-c061-4370-8f79-8a836a2998e0 tempest-VolumesSnapshotsTestJSON-333542698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b99bf69b-b424-4141-9f65-1db10a4d8cd0.fd1bec25-8c46-4a81-94d5-8ad332e8a66f" returned: 0 in 0.334s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:43:30 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [req-4b91e808-3d03-46e3-bb71-47c5a66773b8 req-5333aa57-c061-4370-8f79-8a836a2998e0 tempest-VolumesSnapshotsTestJSON-333542698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b99bf69b-b424-4141-9f65-1db10a4d8cd0.fd1bec25-8c46-4a81-94d5-8ad332e8a66f {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:43:30 devstack sudo[101575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b99bf69b-b424-4141-9f65-1db10a4d8cd0.fd1bec25-8c46-4a81-94d5-8ad332e8a66f Sep 06 06:43:30 devstack sudo[101575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:43:31 devstack sudo[101575]: pam_unix(sudo:session): session closed for user root Sep 06 06:43:31 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [req-4b91e808-3d03-46e3-bb71-47c5a66773b8 req-5333aa57-c061-4370-8f79-8a836a2998e0 tempest-VolumesSnapshotsTestJSON-333542698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b99bf69b-b424-4141-9f65-1db10a4d8cd0.fd1bec25-8c46-4a81-94d5-8ad332e8a66f" returned: 0 in 0.240s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:43:31 devstack cinder-volume[87329]: DEBUG cinder.coordination [req-4b91e808-3d03-46e3-bb71-47c5a66773b8 req-5333aa57-c061-4370-8f79-8a836a2998e0 tempest-VolumesSnapshotsTestJSON-333542698 None] Lock "cinder-quobyte-fd1bec25-8c46-4a81-94d5-8ad332e8a66f" released by "_delete_snapshot" :: held 1.363s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:43:31 devstack cinder-volume[87329]: DEBUG cinder.coordination [req-4b91e808-3d03-46e3-bb71-47c5a66773b8 req-5333aa57-c061-4370-8f79-8a836a2998e0 tempest-VolumesSnapshotsTestJSON-333542698 None] Lock "cinder-quobyte-b99bf69b-b424-4141-9f65-1db10a4d8cd0" released by "delete_snapshot" :: held 1.394s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:43:31 devstack cinder-volume[87329]: DEBUG cinder.quota [req-4b91e808-3d03-46e3-bb71-47c5a66773b8 req-5333aa57-c061-4370-8f79-8a836a2998e0 tempest-VolumesSnapshotsTestJSON-333542698 None] Created reservations ['38805455-9d0d-4ca2-99eb-c0a8354cae08', 'f4a8271d-e10b-4d8f-b445-c6a82cd4f744', '95190156-8811-42c1-8aed-1b3e58c6ba7d', 'f6291145-30c8-432c-9970-c1bfd22e6b50'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:43:31 devstack cinder-volume[87329]: INFO cinder.volume.manager [req-4b91e808-3d03-46e3-bb71-47c5a66773b8 req-5333aa57-c061-4370-8f79-8a836a2998e0 tempest-VolumesSnapshotsTestJSON-333542698 None] Delete snapshot completed successfully. Sep 06 06:43:31 devstack cinder-volume[87329]: DEBUG cinder.coordination [req-4b91e808-3d03-46e3-bb71-47c5a66773b8 req-5333aa57-c061-4370-8f79-8a836a2998e0 tempest-VolumesSnapshotsTestJSON-333542698 None] Lock "cinder-fd1bec25-8c46-4a81-94d5-8ad332e8a66f-delete_snapshot" released by "delete_snapshot" :: held 1.525s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:43:31 devstack cinder-volume[87329]: DEBUG cinder.coordination [req-9dba05fe-5ab7-47de-909f-349b4a75421e req-91ce269e-e3af-436a-8732-6db3cb148134 tempest-VolumesSnapshotsTestJSON-333542698 None] Acquiring lock "cinder-b99bf69b-b424-4141-9f65-1db10a4d8cd0-delete_volume" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:43:31 devstack cinder-volume[87329]: DEBUG cinder.coordination [req-9dba05fe-5ab7-47de-909f-349b4a75421e req-91ce269e-e3af-436a-8732-6db3cb148134 tempest-VolumesSnapshotsTestJSON-333542698 None] Lock "cinder-b99bf69b-b424-4141-9f65-1db10a4d8cd0-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:43:31 devstack cinder-volume[87329]: DEBUG cinder.coordination [req-9dba05fe-5ab7-47de-909f-349b4a75421e req-91ce269e-e3af-436a-8732-6db3cb148134 tempest-VolumesSnapshotsTestJSON-333542698 None] Acquiring lock "cinder-quobyte-b99bf69b-b424-4141-9f65-1db10a4d8cd0" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:43:31 devstack cinder-volume[87329]: DEBUG cinder.coordination [req-9dba05fe-5ab7-47de-909f-349b4a75421e req-91ce269e-e3af-436a-8732-6db3cb148134 tempest-VolumesSnapshotsTestJSON-333542698 None] Lock "cinder-quobyte-b99bf69b-b424-4141-9f65-1db10a4d8cd0" acquired by "delete_volume" :: waited 0.023s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:43:32 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[262ae3a1-d8e5-40a8-a349-734e32076b25]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:43:32 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [req-9dba05fe-5ab7-47de-909f-349b4a75421e req-91ce269e-e3af-436a-8732-6db3cb148134 tempest-VolumesSnapshotsTestJSON-333542698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b99bf69b-b424-4141-9f65-1db10a4d8cd0 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:43:32 devstack sudo[101578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b99bf69b-b424-4141-9f65-1db10a4d8cd0 Sep 06 06:43:32 devstack sudo[101578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:43:32 devstack sudo[101578]: pam_unix(sudo:session): session closed for user root Sep 06 06:43:32 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [req-9dba05fe-5ab7-47de-909f-349b4a75421e req-91ce269e-e3af-436a-8732-6db3cb148134 tempest-VolumesSnapshotsTestJSON-333542698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b99bf69b-b424-4141-9f65-1db10a4d8cd0" returned: 0 in 0.354s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:43:32 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [req-9dba05fe-5ab7-47de-909f-349b4a75421e req-91ce269e-e3af-436a-8732-6db3cb148134 tempest-VolumesSnapshotsTestJSON-333542698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b99bf69b-b424-4141-9f65-1db10a4d8cd0 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:43:32 devstack sudo[101583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b99bf69b-b424-4141-9f65-1db10a4d8cd0 Sep 06 06:43:32 devstack sudo[101583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:43:32 devstack sudo[101583]: pam_unix(sudo:session): session closed for user root Sep 06 06:43:32 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [req-9dba05fe-5ab7-47de-909f-349b4a75421e req-91ce269e-e3af-436a-8732-6db3cb148134 tempest-VolumesSnapshotsTestJSON-333542698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b99bf69b-b424-4141-9f65-1db10a4d8cd0" returned: 0 in 0.247s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:43:32 devstack cinder-volume[87329]: DEBUG cinder.coordination [req-9dba05fe-5ab7-47de-909f-349b4a75421e req-91ce269e-e3af-436a-8732-6db3cb148134 tempest-VolumesSnapshotsTestJSON-333542698 None] Lock "cinder-quobyte-b99bf69b-b424-4141-9f65-1db10a4d8cd0" released by "delete_volume" :: held 0.660s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:43:32 devstack cinder-volume[87329]: DEBUG cinder.quota [req-9dba05fe-5ab7-47de-909f-349b4a75421e req-91ce269e-e3af-436a-8732-6db3cb148134 tempest-VolumesSnapshotsTestJSON-333542698 None] Created reservations ['55854571-7387-4189-8f88-bb42f35b7759', '501467da-83bb-4c6d-bfae-be7b99b1543c', 'f24f9f88-ff38-4d06-b2f4-5b067562a993', '06a56cbc-6bfd-4e9f-9ecf-895702bb89ed'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:43:32 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [req-9dba05fe-5ab7-47de-909f-349b4a75421e req-91ce269e-e3af-436a-8732-6db3cb148134 tempest-VolumesSnapshotsTestJSON-333542698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:43:32 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [req-9dba05fe-5ab7-47de-909f-349b4a75421e req-91ce269e-e3af-436a-8732-6db3cb148134 tempest-VolumesSnapshotsTestJSON-333542698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:43:32 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [req-9dba05fe-5ab7-47de-909f-349b4a75421e req-91ce269e-e3af-436a-8732-6db3cb148134 tempest-VolumesSnapshotsTestJSON-333542698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:43:32 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [req-9dba05fe-5ab7-47de-909f-349b4a75421e req-91ce269e-e3af-436a-8732-6db3cb148134 tempest-VolumesSnapshotsTestJSON-333542698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:43:32 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [req-9dba05fe-5ab7-47de-909f-349b4a75421e req-91ce269e-e3af-436a-8732-6db3cb148134 tempest-VolumesSnapshotsTestJSON-333542698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:43:32 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [req-9dba05fe-5ab7-47de-909f-349b4a75421e req-91ce269e-e3af-436a-8732-6db3cb148134 tempest-VolumesSnapshotsTestJSON-333542698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:43:32 devstack sudo[101586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:43:32 devstack sudo[101586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:43:33 devstack sudo[101586]: pam_unix(sudo:session): session closed for user root Sep 06 06:43:33 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [req-9dba05fe-5ab7-47de-909f-349b4a75421e req-91ce269e-e3af-436a-8732-6db3cb148134 tempest-VolumesSnapshotsTestJSON-333542698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.244s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:43:33 devstack cinder-volume[87329]: DEBUG cinder.manager [req-9dba05fe-5ab7-47de-909f-349b4a75421e req-91ce269e-e3af-436a-8732-6db3cb148134 tempest-VolumesSnapshotsTestJSON-333542698 None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:43:33 devstack cinder-volume[87329]: INFO cinder.volume.manager [req-9dba05fe-5ab7-47de-909f-349b4a75421e req-91ce269e-e3af-436a-8732-6db3cb148134 tempest-VolumesSnapshotsTestJSON-333542698 None] Deleted volume successfully. Sep 06 06:43:33 devstack cinder-volume[87329]: DEBUG cinder.coordination [req-9dba05fe-5ab7-47de-909f-349b4a75421e req-91ce269e-e3af-436a-8732-6db3cb148134 tempest-VolumesSnapshotsTestJSON-333542698 None] Lock "cinder-b99bf69b-b424-4141-9f65-1db10a4d8cd0-delete_volume" released by "delete_volume" :: held 1.125s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:43:36 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-3823981a-2a07-4e2a-9598-b10e4f49e6c5 tempest-VolumesTestJSON-1777515349 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87329) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 06:43:36 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-3823981a-2a07-4e2a-9598-b10e4f49e6c5 tempest-VolumesTestJSON-1777515349 None] Flow 'volume_create_manager' (363cce5a-7b32-4623-93c7-3a2f7397b864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:43:36 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-3823981a-2a07-4e2a-9598-b10e4f49e6c5 tempest-VolumesTestJSON-1777515349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d619c4f-1f67-44b7-9670-3925937f5846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:43:36 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-3823981a-2a07-4e2a-9598-b10e4f49e6c5 tempest-VolumesTestJSON-1777515349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d619c4f-1f67-44b7-9670-3925937f5846) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:43:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-557888783',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c766f50-d617-47a4-aae5-99a9c7d07750,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='51de725d0da3494089fca173f8c6d2a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:43:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:43:37Z,use_quota=True,user_id='7c6eb4c2871142b18df3dd4586677e53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:43:36 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-3823981a-2a07-4e2a-9598-b10e4f49e6c5 tempest-VolumesTestJSON-1777515349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98cd47ab-7d96-4c9a-aff7-50bac40fbf4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:43:36 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-3823981a-2a07-4e2a-9598-b10e4f49e6c5 tempest-VolumesTestJSON-1777515349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98cd47ab-7d96-4c9a-aff7-50bac40fbf4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:43:36 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-3823981a-2a07-4e2a-9598-b10e4f49e6c5 tempest-VolumesTestJSON-1777515349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (073834b5-7a5a-4a39-9a32-a40804dc90de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:43:36 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-3823981a-2a07-4e2a-9598-b10e4f49e6c5 tempest-VolumesTestJSON-1777515349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (073834b5-7a5a-4a39-9a32-a40804dc90de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c766f50-d617-47a4-aae5-99a9c7d07750', 'volume_name': 'volume-4c766f50-d617-47a4-aae5-99a9c7d07750', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:43:36 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-3823981a-2a07-4e2a-9598-b10e4f49e6c5 tempest-VolumesTestJSON-1777515349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b93ba340-a4ff-4280-98cc-eed93b10675d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:43:36 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-3823981a-2a07-4e2a-9598-b10e4f49e6c5 tempest-VolumesTestJSON-1777515349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b93ba340-a4ff-4280-98cc-eed93b10675d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:43:36 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-3823981a-2a07-4e2a-9598-b10e4f49e6c5 tempest-VolumesTestJSON-1777515349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1d21333-ebf4-42cc-b545-12e53159910f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:43:36 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-3823981a-2a07-4e2a-9598-b10e4f49e6c5 tempest-VolumesTestJSON-1777515349 None] Volume 4c766f50-d617-47a4-aae5-99a9c7d07750: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c766f50-d617-47a4-aae5-99a9c7d07750', 'volume_size': 1} Sep 06 06:43:36 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-3823981a-2a07-4e2a-9598-b10e4f49e6c5 tempest-VolumesTestJSON-1777515349 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:43:36 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-3823981a-2a07-4e2a-9598-b10e4f49e6c5 tempest-VolumesTestJSON-1777515349 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:43:36 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-3823981a-2a07-4e2a-9598-b10e4f49e6c5 tempest-VolumesTestJSON-1777515349 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:43:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-557888783',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c766f50-d617-47a4-aae5-99a9c7d07750,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='51de725d0da3494089fca173f8c6d2a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:43:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:43:37Z,use_quota=True,user_id='7c6eb4c2871142b18df3dd4586677e53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)}" {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 06:43:36 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-3823981a-2a07-4e2a-9598-b10e4f49e6c5 tempest-VolumesTestJSON-1777515349 None] Creating volume 4c766f50-d617-47a4-aae5-99a9c7d07750 {{(pid=87329) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 06:43:36 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-3823981a-2a07-4e2a-9598-b10e4f49e6c5 tempest-VolumesTestJSON-1777515349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:43:36 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-3823981a-2a07-4e2a-9598-b10e4f49e6c5 tempest-VolumesTestJSON-1777515349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:43:36 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-3823981a-2a07-4e2a-9598-b10e4f49e6c5 tempest-VolumesTestJSON-1777515349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:43:36 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-3823981a-2a07-4e2a-9598-b10e4f49e6c5 tempest-VolumesTestJSON-1777515349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:43:36 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-3823981a-2a07-4e2a-9598-b10e4f49e6c5 tempest-VolumesTestJSON-1777515349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:43:36 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-3823981a-2a07-4e2a-9598-b10e4f49e6c5 tempest-VolumesTestJSON-1777515349 None] Selected osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 as target Quobyte volume. {{(pid=87329) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 06:43:36 devstack cinder-volume[87329]: INFO cinder.volume.drivers.remotefs [None req-3823981a-2a07-4e2a-9598-b10e4f49e6c5 tempest-VolumesTestJSON-1777515349 None] casted to osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 Sep 06 06:43:36 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-3823981a-2a07-4e2a-9598-b10e4f49e6c5 tempest-VolumesTestJSON-1777515349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-4c766f50-d617-47a4-aae5-99a9c7d07750 1073741824 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:43:36 devstack sudo[101589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-4c766f50-d617-47a4-aae5-99a9c7d07750 1073741824 Sep 06 06:43:36 devstack sudo[101589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:43:37 devstack sudo[101589]: pam_unix(sudo:session): session closed for user root Sep 06 06:43:37 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-3823981a-2a07-4e2a-9598-b10e4f49e6c5 tempest-VolumesTestJSON-1777515349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-4c766f50-d617-47a4-aae5-99a9c7d07750 1073741824" returned: 0 in 0.409s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:43:37 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-3823981a-2a07-4e2a-9598-b10e4f49e6c5 tempest-VolumesTestJSON-1777515349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-4c766f50-d617-47a4-aae5-99a9c7d07750 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:43:37 devstack sudo[101594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-4c766f50-d617-47a4-aae5-99a9c7d07750 Sep 06 06:43:37 devstack sudo[101594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:43:37 devstack sudo[101594]: pam_unix(sudo:session): session closed for user root Sep 06 06:43:37 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-3823981a-2a07-4e2a-9598-b10e4f49e6c5 tempest-VolumesTestJSON-1777515349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-4c766f50-d617-47a4-aae5-99a9c7d07750" returned: 0 in 0.237s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:43:37 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-3823981a-2a07-4e2a-9598-b10e4f49e6c5 tempest-VolumesTestJSON-1777515349 None] <== create_volume: return (686ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'} {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 06:43:37 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-3823981a-2a07-4e2a-9598-b10e4f49e6c5 tempest-VolumesTestJSON-1777515349 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.689s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:43:37 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-3823981a-2a07-4e2a-9598-b10e4f49e6c5 tempest-VolumesTestJSON-1777515349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1d21333-ebf4-42cc-b545-12e53159910f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c766f50-d617-47a4-aae5-99a9c7d07750', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:43:37 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-3823981a-2a07-4e2a-9598-b10e4f49e6c5 tempest-VolumesTestJSON-1777515349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02e62182-8945-436e-a8bc-8274dfd8eeb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:43:37 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-3823981a-2a07-4e2a-9598-b10e4f49e6c5 tempest-VolumesTestJSON-1777515349 None] Volume volume-4c766f50-d617-47a4-aae5-99a9c7d07750 (4c766f50-d617-47a4-aae5-99a9c7d07750): created successfully Sep 06 06:43:37 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-3823981a-2a07-4e2a-9598-b10e4f49e6c5 tempest-VolumesTestJSON-1777515349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02e62182-8945-436e-a8bc-8274dfd8eeb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:43:37 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-3823981a-2a07-4e2a-9598-b10e4f49e6c5 tempest-VolumesTestJSON-1777515349 None] Flow 'volume_create_manager' (363cce5a-7b32-4623-93c7-3a2f7397b864) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:43:37 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-3823981a-2a07-4e2a-9598-b10e4f49e6c5 tempest-VolumesTestJSON-1777515349 None] Created volume successfully. Sep 06 06:43:38 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-cedf0088-c4b1-4df5-a9ea-9b4973d68132 tempest-VolumesTestJSON-1777515349 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87329) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 06:43:38 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-cedf0088-c4b1-4df5-a9ea-9b4973d68132 tempest-VolumesTestJSON-1777515349 None] Flow 'volume_create_manager' (b9a522ac-74d6-42da-8988-8c32426ac60c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:43:38 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-cedf0088-c4b1-4df5-a9ea-9b4973d68132 tempest-VolumesTestJSON-1777515349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b93b7265-ce81-49c9-a6f3-7525cfc57c37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:43:38 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-cedf0088-c4b1-4df5-a9ea-9b4973d68132 tempest-VolumesTestJSON-1777515349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b93b7265-ce81-49c9-a6f3-7525cfc57c37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:43:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1129165944',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e555446-f0ea-4704-a014-a5c2939e7a65,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='51de725d0da3494089fca173f8c6d2a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:43:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:43:38Z,use_quota=True,user_id='7c6eb4c2871142b18df3dd4586677e53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:43:38 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-cedf0088-c4b1-4df5-a9ea-9b4973d68132 tempest-VolumesTestJSON-1777515349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82495360-54fb-4ccd-8d75-7b32fad742cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:43:38 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-cedf0088-c4b1-4df5-a9ea-9b4973d68132 tempest-VolumesTestJSON-1777515349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82495360-54fb-4ccd-8d75-7b32fad742cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:43:38 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-cedf0088-c4b1-4df5-a9ea-9b4973d68132 tempest-VolumesTestJSON-1777515349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9958faf4-92e1-4055-9b70-285139f046d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:43:38 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-cedf0088-c4b1-4df5-a9ea-9b4973d68132 tempest-VolumesTestJSON-1777515349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9958faf4-92e1-4055-9b70-285139f046d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e555446-f0ea-4704-a014-a5c2939e7a65', 'volume_name': 'volume-7e555446-f0ea-4704-a014-a5c2939e7a65', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:43:38 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-cedf0088-c4b1-4df5-a9ea-9b4973d68132 tempest-VolumesTestJSON-1777515349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6ddcb2c-a14b-4937-a07f-5396b6e37728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:43:38 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-cedf0088-c4b1-4df5-a9ea-9b4973d68132 tempest-VolumesTestJSON-1777515349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6ddcb2c-a14b-4937-a07f-5396b6e37728) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:43:38 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-cedf0088-c4b1-4df5-a9ea-9b4973d68132 tempest-VolumesTestJSON-1777515349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fe5a966-9ed0-42bc-a87f-0b00b896305d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:43:38 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-cedf0088-c4b1-4df5-a9ea-9b4973d68132 tempest-VolumesTestJSON-1777515349 None] Volume 7e555446-f0ea-4704-a014-a5c2939e7a65: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e555446-f0ea-4704-a014-a5c2939e7a65', 'volume_size': 1} Sep 06 06:43:38 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-cedf0088-c4b1-4df5-a9ea-9b4973d68132 tempest-VolumesTestJSON-1777515349 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:43:38 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-cedf0088-c4b1-4df5-a9ea-9b4973d68132 tempest-VolumesTestJSON-1777515349 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:43:38 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-cedf0088-c4b1-4df5-a9ea-9b4973d68132 tempest-VolumesTestJSON-1777515349 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:43:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1129165944',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e555446-f0ea-4704-a014-a5c2939e7a65,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='51de725d0da3494089fca173f8c6d2a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:43:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:43:38Z,use_quota=True,user_id='7c6eb4c2871142b18df3dd4586677e53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)}" {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 06:43:38 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-cedf0088-c4b1-4df5-a9ea-9b4973d68132 tempest-VolumesTestJSON-1777515349 None] Creating volume 7e555446-f0ea-4704-a014-a5c2939e7a65 {{(pid=87329) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 06:43:38 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-cedf0088-c4b1-4df5-a9ea-9b4973d68132 tempest-VolumesTestJSON-1777515349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:43:38 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-cedf0088-c4b1-4df5-a9ea-9b4973d68132 tempest-VolumesTestJSON-1777515349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:43:38 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-cedf0088-c4b1-4df5-a9ea-9b4973d68132 tempest-VolumesTestJSON-1777515349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:43:38 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-cedf0088-c4b1-4df5-a9ea-9b4973d68132 tempest-VolumesTestJSON-1777515349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:43:38 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-cedf0088-c4b1-4df5-a9ea-9b4973d68132 tempest-VolumesTestJSON-1777515349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:43:38 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-cedf0088-c4b1-4df5-a9ea-9b4973d68132 tempest-VolumesTestJSON-1777515349 None] Selected osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 as target Quobyte volume. {{(pid=87329) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 06:43:38 devstack cinder-volume[87329]: INFO cinder.volume.drivers.remotefs [None req-cedf0088-c4b1-4df5-a9ea-9b4973d68132 tempest-VolumesTestJSON-1777515349 None] casted to osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 Sep 06 06:43:38 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-cedf0088-c4b1-4df5-a9ea-9b4973d68132 tempest-VolumesTestJSON-1777515349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-7e555446-f0ea-4704-a014-a5c2939e7a65 1073741824 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:43:38 devstack sudo[101597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-7e555446-f0ea-4704-a014-a5c2939e7a65 1073741824 Sep 06 06:43:38 devstack sudo[101597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:43:38 devstack sudo[101597]: pam_unix(sudo:session): session closed for user root Sep 06 06:43:38 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-cedf0088-c4b1-4df5-a9ea-9b4973d68132 tempest-VolumesTestJSON-1777515349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-7e555446-f0ea-4704-a014-a5c2939e7a65 1073741824" returned: 0 in 0.429s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:43:38 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-cedf0088-c4b1-4df5-a9ea-9b4973d68132 tempest-VolumesTestJSON-1777515349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-7e555446-f0ea-4704-a014-a5c2939e7a65 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:43:38 devstack sudo[101605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-7e555446-f0ea-4704-a014-a5c2939e7a65 Sep 06 06:43:38 devstack sudo[101605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:43:39 devstack sudo[101605]: pam_unix(sudo:session): session closed for user root Sep 06 06:43:39 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-cedf0088-c4b1-4df5-a9ea-9b4973d68132 tempest-VolumesTestJSON-1777515349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-7e555446-f0ea-4704-a014-a5c2939e7a65" returned: 0 in 0.248s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:43:39 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-cedf0088-c4b1-4df5-a9ea-9b4973d68132 tempest-VolumesTestJSON-1777515349 None] <== create_volume: return (719ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'} {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 06:43:39 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-cedf0088-c4b1-4df5-a9ea-9b4973d68132 tempest-VolumesTestJSON-1777515349 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.722s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:43:39 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-cedf0088-c4b1-4df5-a9ea-9b4973d68132 tempest-VolumesTestJSON-1777515349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fe5a966-9ed0-42bc-a87f-0b00b896305d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e555446-f0ea-4704-a014-a5c2939e7a65', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:43:39 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-cedf0088-c4b1-4df5-a9ea-9b4973d68132 tempest-VolumesTestJSON-1777515349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24bdcea1-34a4-49ea-916d-214b313b136f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:43:39 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-cedf0088-c4b1-4df5-a9ea-9b4973d68132 tempest-VolumesTestJSON-1777515349 None] Volume volume-7e555446-f0ea-4704-a014-a5c2939e7a65 (7e555446-f0ea-4704-a014-a5c2939e7a65): created successfully Sep 06 06:43:39 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-cedf0088-c4b1-4df5-a9ea-9b4973d68132 tempest-VolumesTestJSON-1777515349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24bdcea1-34a4-49ea-916d-214b313b136f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:43:39 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-cedf0088-c4b1-4df5-a9ea-9b4973d68132 tempest-VolumesTestJSON-1777515349 None] Flow 'volume_create_manager' (b9a522ac-74d6-42da-8988-8c32426ac60c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:43:39 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-cedf0088-c4b1-4df5-a9ea-9b4973d68132 tempest-VolumesTestJSON-1777515349 None] Created volume successfully. Sep 06 06:43:39 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-59f71df0-6b29-4269-867d-7c0bb013ac53 tempest-VolumesTestJSON-1777515349 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87329) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 06:43:39 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-59f71df0-6b29-4269-867d-7c0bb013ac53 tempest-VolumesTestJSON-1777515349 None] Flow 'volume_create_manager' (63a02d21-9240-4224-b78c-fbf8476f311f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:43:39 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-59f71df0-6b29-4269-867d-7c0bb013ac53 tempest-VolumesTestJSON-1777515349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fc20bb1-ee8c-40c4-9a27-7fa1c3019d61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:43:39 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-59f71df0-6b29-4269-867d-7c0bb013ac53 tempest-VolumesTestJSON-1777515349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fc20bb1-ee8c-40c4-9a27-7fa1c3019d61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:43:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1610812809',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb8b247a-8ea8-4ae3-9dd4-509530d1734c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='51de725d0da3494089fca173f8c6d2a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:43:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:43:40Z,use_quota=True,user_id='7c6eb4c2871142b18df3dd4586677e53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:43:39 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-59f71df0-6b29-4269-867d-7c0bb013ac53 tempest-VolumesTestJSON-1777515349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fa00c82-d8bf-4c9f-b308-c1a123e76721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:43:39 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-59f71df0-6b29-4269-867d-7c0bb013ac53 tempest-VolumesTestJSON-1777515349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fa00c82-d8bf-4c9f-b308-c1a123e76721) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:43:39 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-59f71df0-6b29-4269-867d-7c0bb013ac53 tempest-VolumesTestJSON-1777515349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c724ffe-964d-4342-9394-f5b8325e5852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:43:39 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-59f71df0-6b29-4269-867d-7c0bb013ac53 tempest-VolumesTestJSON-1777515349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c724ffe-964d-4342-9394-f5b8325e5852) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb8b247a-8ea8-4ae3-9dd4-509530d1734c', 'volume_name': 'volume-cb8b247a-8ea8-4ae3-9dd4-509530d1734c', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:43:39 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-59f71df0-6b29-4269-867d-7c0bb013ac53 tempest-VolumesTestJSON-1777515349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d791619-4998-4375-bea8-4270c289e4b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:43:39 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-59f71df0-6b29-4269-867d-7c0bb013ac53 tempest-VolumesTestJSON-1777515349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d791619-4998-4375-bea8-4270c289e4b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:43:39 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-59f71df0-6b29-4269-867d-7c0bb013ac53 tempest-VolumesTestJSON-1777515349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1ca09a8-9503-4cb2-9718-bff1e957f466) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:43:39 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-59f71df0-6b29-4269-867d-7c0bb013ac53 tempest-VolumesTestJSON-1777515349 None] Volume cb8b247a-8ea8-4ae3-9dd4-509530d1734c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb8b247a-8ea8-4ae3-9dd4-509530d1734c', 'volume_size': 1} Sep 06 06:43:39 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-59f71df0-6b29-4269-867d-7c0bb013ac53 tempest-VolumesTestJSON-1777515349 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:43:39 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-59f71df0-6b29-4269-867d-7c0bb013ac53 tempest-VolumesTestJSON-1777515349 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:43:39 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-59f71df0-6b29-4269-867d-7c0bb013ac53 tempest-VolumesTestJSON-1777515349 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:43:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1610812809',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb8b247a-8ea8-4ae3-9dd4-509530d1734c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='51de725d0da3494089fca173f8c6d2a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:43:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:43:40Z,use_quota=True,user_id='7c6eb4c2871142b18df3dd4586677e53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)}" {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 06:43:39 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-59f71df0-6b29-4269-867d-7c0bb013ac53 tempest-VolumesTestJSON-1777515349 None] Creating volume cb8b247a-8ea8-4ae3-9dd4-509530d1734c {{(pid=87329) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 06:43:39 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-59f71df0-6b29-4269-867d-7c0bb013ac53 tempest-VolumesTestJSON-1777515349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:43:39 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-59f71df0-6b29-4269-867d-7c0bb013ac53 tempest-VolumesTestJSON-1777515349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:43:39 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-59f71df0-6b29-4269-867d-7c0bb013ac53 tempest-VolumesTestJSON-1777515349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:43:39 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-59f71df0-6b29-4269-867d-7c0bb013ac53 tempest-VolumesTestJSON-1777515349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:43:39 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-59f71df0-6b29-4269-867d-7c0bb013ac53 tempest-VolumesTestJSON-1777515349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:43:39 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-59f71df0-6b29-4269-867d-7c0bb013ac53 tempest-VolumesTestJSON-1777515349 None] Selected osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 as target Quobyte volume. {{(pid=87329) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 06:43:39 devstack cinder-volume[87329]: INFO cinder.volume.drivers.remotefs [None req-59f71df0-6b29-4269-867d-7c0bb013ac53 tempest-VolumesTestJSON-1777515349 None] casted to osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 Sep 06 06:43:39 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-59f71df0-6b29-4269-867d-7c0bb013ac53 tempest-VolumesTestJSON-1777515349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-cb8b247a-8ea8-4ae3-9dd4-509530d1734c 1073741824 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:43:39 devstack sudo[101609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-cb8b247a-8ea8-4ae3-9dd4-509530d1734c 1073741824 Sep 06 06:43:39 devstack sudo[101609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:43:40 devstack sudo[101609]: pam_unix(sudo:session): session closed for user root Sep 06 06:43:40 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-59f71df0-6b29-4269-867d-7c0bb013ac53 tempest-VolumesTestJSON-1777515349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-cb8b247a-8ea8-4ae3-9dd4-509530d1734c 1073741824" returned: 0 in 0.473s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:43:40 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-59f71df0-6b29-4269-867d-7c0bb013ac53 tempest-VolumesTestJSON-1777515349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-cb8b247a-8ea8-4ae3-9dd4-509530d1734c {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:43:40 devstack sudo[101649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-cb8b247a-8ea8-4ae3-9dd4-509530d1734c Sep 06 06:43:40 devstack sudo[101649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:43:40 devstack sudo[101649]: pam_unix(sudo:session): session closed for user root Sep 06 06:43:40 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-59f71df0-6b29-4269-867d-7c0bb013ac53 tempest-VolumesTestJSON-1777515349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-cb8b247a-8ea8-4ae3-9dd4-509530d1734c" returned: 0 in 0.307s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:43:40 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-59f71df0-6b29-4269-867d-7c0bb013ac53 tempest-VolumesTestJSON-1777515349 None] <== create_volume: return (822ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'} {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 06:43:40 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-59f71df0-6b29-4269-867d-7c0bb013ac53 tempest-VolumesTestJSON-1777515349 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.825s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:43:40 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-59f71df0-6b29-4269-867d-7c0bb013ac53 tempest-VolumesTestJSON-1777515349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1ca09a8-9503-4cb2-9718-bff1e957f466) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb8b247a-8ea8-4ae3-9dd4-509530d1734c', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:43:40 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-59f71df0-6b29-4269-867d-7c0bb013ac53 tempest-VolumesTestJSON-1777515349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65fb9aa3-d2ca-4ae3-ab30-2d0c6fcf9f96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:43:40 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-59f71df0-6b29-4269-867d-7c0bb013ac53 tempest-VolumesTestJSON-1777515349 None] Volume volume-cb8b247a-8ea8-4ae3-9dd4-509530d1734c (cb8b247a-8ea8-4ae3-9dd4-509530d1734c): created successfully Sep 06 06:43:40 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-59f71df0-6b29-4269-867d-7c0bb013ac53 tempest-VolumesTestJSON-1777515349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65fb9aa3-d2ca-4ae3-ab30-2d0c6fcf9f96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:43:40 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-59f71df0-6b29-4269-867d-7c0bb013ac53 tempest-VolumesTestJSON-1777515349 None] Flow 'volume_create_manager' (63a02d21-9240-4224-b78c-fbf8476f311f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:43:40 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-59f71df0-6b29-4269-867d-7c0bb013ac53 tempest-VolumesTestJSON-1777515349 None] Created volume successfully. Sep 06 06:43:42 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-19c83076-1426-4a92-ab87-d50c35d2644d tempest-VolumesTestJSON-1777515349 None] Acquiring lock "cinder-cb8b247a-8ea8-4ae3-9dd4-509530d1734c-delete_volume" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:43:42 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-19c83076-1426-4a92-ab87-d50c35d2644d tempest-VolumesTestJSON-1777515349 None] Lock "cinder-cb8b247a-8ea8-4ae3-9dd4-509530d1734c-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:43:42 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-19c83076-1426-4a92-ab87-d50c35d2644d tempest-VolumesTestJSON-1777515349 None] Acquiring lock "cinder-quobyte-cb8b247a-8ea8-4ae3-9dd4-509530d1734c" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:43:42 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-19c83076-1426-4a92-ab87-d50c35d2644d tempest-VolumesTestJSON-1777515349 None] Lock "cinder-quobyte-cb8b247a-8ea8-4ae3-9dd4-509530d1734c" acquired by "delete_volume" :: waited 0.015s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:43:42 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[072b1b38-848a-49ff-8b5f-c4ce2b02e656]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:43:42 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-19c83076-1426-4a92-ab87-d50c35d2644d tempest-VolumesTestJSON-1777515349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-cb8b247a-8ea8-4ae3-9dd4-509530d1734c {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:43:42 devstack sudo[101654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-cb8b247a-8ea8-4ae3-9dd4-509530d1734c Sep 06 06:43:42 devstack sudo[101654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:43:43 devstack sudo[101654]: pam_unix(sudo:session): session closed for user root Sep 06 06:43:43 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-19c83076-1426-4a92-ab87-d50c35d2644d tempest-VolumesTestJSON-1777515349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-cb8b247a-8ea8-4ae3-9dd4-509530d1734c" returned: 0 in 0.351s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:43:43 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-19c83076-1426-4a92-ab87-d50c35d2644d tempest-VolumesTestJSON-1777515349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-cb8b247a-8ea8-4ae3-9dd4-509530d1734c {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:43:43 devstack sudo[101659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-cb8b247a-8ea8-4ae3-9dd4-509530d1734c Sep 06 06:43:43 devstack sudo[101659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:43:43 devstack sudo[101659]: pam_unix(sudo:session): session closed for user root Sep 06 06:43:43 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-19c83076-1426-4a92-ab87-d50c35d2644d tempest-VolumesTestJSON-1777515349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-cb8b247a-8ea8-4ae3-9dd4-509530d1734c" returned: 0 in 0.238s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:43:43 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-19c83076-1426-4a92-ab87-d50c35d2644d tempest-VolumesTestJSON-1777515349 None] Lock "cinder-quobyte-cb8b247a-8ea8-4ae3-9dd4-509530d1734c" released by "delete_volume" :: held 0.627s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:43:43 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-19c83076-1426-4a92-ab87-d50c35d2644d tempest-VolumesTestJSON-1777515349 None] Created reservations ['8042c8c0-e1ba-45fc-b20d-20d4c9b2e932', '00ddbb7a-f084-4c17-9935-dcb467daa0ef', 'c046b8f6-d87b-4f5d-9aea-8211b90c2fab', 'de412f29-b531-4a53-85c3-07aa4fcfa0f1'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:43:43 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-19c83076-1426-4a92-ab87-d50c35d2644d tempest-VolumesTestJSON-1777515349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:43:43 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-19c83076-1426-4a92-ab87-d50c35d2644d tempest-VolumesTestJSON-1777515349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:43:43 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-19c83076-1426-4a92-ab87-d50c35d2644d tempest-VolumesTestJSON-1777515349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:43:43 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-19c83076-1426-4a92-ab87-d50c35d2644d tempest-VolumesTestJSON-1777515349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:43:43 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-19c83076-1426-4a92-ab87-d50c35d2644d tempest-VolumesTestJSON-1777515349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:43:43 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-19c83076-1426-4a92-ab87-d50c35d2644d tempest-VolumesTestJSON-1777515349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:43:43 devstack sudo[101662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:43:43 devstack sudo[101662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:43:43 devstack sudo[101662]: pam_unix(sudo:session): session closed for user root Sep 06 06:43:43 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-19c83076-1426-4a92-ab87-d50c35d2644d tempest-VolumesTestJSON-1777515349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.240s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:43:43 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-19c83076-1426-4a92-ab87-d50c35d2644d tempest-VolumesTestJSON-1777515349 None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:43:43 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-19c83076-1426-4a92-ab87-d50c35d2644d tempest-VolumesTestJSON-1777515349 None] Deleted volume successfully. Sep 06 06:43:43 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-19c83076-1426-4a92-ab87-d50c35d2644d tempest-VolumesTestJSON-1777515349 None] Lock "cinder-cb8b247a-8ea8-4ae3-9dd4-509530d1734c-delete_volume" released by "delete_volume" :: held 1.090s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:43:43 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-f8cf27aa-b4a7-4a3d-9246-3af34820d89b tempest-VolumesTestJSON-1777515349 None] Acquiring lock "cinder-7e555446-f0ea-4704-a014-a5c2939e7a65-delete_volume" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:43:43 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-f8cf27aa-b4a7-4a3d-9246-3af34820d89b tempest-VolumesTestJSON-1777515349 None] Lock "cinder-7e555446-f0ea-4704-a014-a5c2939e7a65-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:43:43 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-f8cf27aa-b4a7-4a3d-9246-3af34820d89b tempest-VolumesTestJSON-1777515349 None] Acquiring lock "cinder-quobyte-7e555446-f0ea-4704-a014-a5c2939e7a65" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:43:43 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-f8cf27aa-b4a7-4a3d-9246-3af34820d89b tempest-VolumesTestJSON-1777515349 None] Lock "cinder-quobyte-7e555446-f0ea-4704-a014-a5c2939e7a65" acquired by "delete_volume" :: waited 0.016s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:43:43 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c79365a-ad04-4847-b8e5-d7e528fcfe85]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:43:43 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-f8cf27aa-b4a7-4a3d-9246-3af34820d89b tempest-VolumesTestJSON-1777515349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-7e555446-f0ea-4704-a014-a5c2939e7a65 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:43:43 devstack sudo[101665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-7e555446-f0ea-4704-a014-a5c2939e7a65 Sep 06 06:43:43 devstack sudo[101665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:43:44 devstack sudo[101665]: pam_unix(sudo:session): session closed for user root Sep 06 06:43:44 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-f8cf27aa-b4a7-4a3d-9246-3af34820d89b tempest-VolumesTestJSON-1777515349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-7e555446-f0ea-4704-a014-a5c2939e7a65" returned: 0 in 0.345s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:43:44 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-f8cf27aa-b4a7-4a3d-9246-3af34820d89b tempest-VolumesTestJSON-1777515349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-7e555446-f0ea-4704-a014-a5c2939e7a65 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:43:44 devstack sudo[101670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-7e555446-f0ea-4704-a014-a5c2939e7a65 Sep 06 06:43:44 devstack sudo[101670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:43:44 devstack sudo[101670]: pam_unix(sudo:session): session closed for user root Sep 06 06:43:44 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-f8cf27aa-b4a7-4a3d-9246-3af34820d89b tempest-VolumesTestJSON-1777515349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-7e555446-f0ea-4704-a014-a5c2939e7a65" returned: 0 in 0.241s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:43:44 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-f8cf27aa-b4a7-4a3d-9246-3af34820d89b tempest-VolumesTestJSON-1777515349 None] Lock "cinder-quobyte-7e555446-f0ea-4704-a014-a5c2939e7a65" released by "delete_volume" :: held 0.625s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:43:44 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-f8cf27aa-b4a7-4a3d-9246-3af34820d89b tempest-VolumesTestJSON-1777515349 None] Created reservations ['b7b94fb2-5794-4b6b-8548-87a9402b0257', '2745a302-b89b-44ee-921c-25b7044199d7', '516ae255-597a-4e48-82c9-2972bdb7e3aa', 'f0195ee4-7ecf-4715-b2a9-1f505af24faa'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:43:44 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-f8cf27aa-b4a7-4a3d-9246-3af34820d89b tempest-VolumesTestJSON-1777515349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:43:44 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-f8cf27aa-b4a7-4a3d-9246-3af34820d89b tempest-VolumesTestJSON-1777515349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:43:44 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-f8cf27aa-b4a7-4a3d-9246-3af34820d89b tempest-VolumesTestJSON-1777515349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:43:44 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-f8cf27aa-b4a7-4a3d-9246-3af34820d89b tempest-VolumesTestJSON-1777515349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:43:44 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-f8cf27aa-b4a7-4a3d-9246-3af34820d89b tempest-VolumesTestJSON-1777515349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:43:44 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-f8cf27aa-b4a7-4a3d-9246-3af34820d89b tempest-VolumesTestJSON-1777515349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:43:44 devstack sudo[101673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:43:44 devstack sudo[101673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:43:44 devstack sudo[101673]: pam_unix(sudo:session): session closed for user root Sep 06 06:43:44 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-f8cf27aa-b4a7-4a3d-9246-3af34820d89b tempest-VolumesTestJSON-1777515349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.257s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:43:44 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-f8cf27aa-b4a7-4a3d-9246-3af34820d89b tempest-VolumesTestJSON-1777515349 None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:43:44 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-f8cf27aa-b4a7-4a3d-9246-3af34820d89b tempest-VolumesTestJSON-1777515349 None] Deleted volume successfully. Sep 06 06:43:44 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-f8cf27aa-b4a7-4a3d-9246-3af34820d89b tempest-VolumesTestJSON-1777515349 None] Lock "cinder-7e555446-f0ea-4704-a014-a5c2939e7a65-delete_volume" released by "delete_volume" :: held 1.068s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:43:44 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-10764df8-495c-4b2e-8385-6501b36734d4 tempest-VolumesTestJSON-1777515349 None] Acquiring lock "cinder-4c766f50-d617-47a4-aae5-99a9c7d07750-delete_volume" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:43:44 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-10764df8-495c-4b2e-8385-6501b36734d4 tempest-VolumesTestJSON-1777515349 None] Lock "cinder-4c766f50-d617-47a4-aae5-99a9c7d07750-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:43:45 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-10764df8-495c-4b2e-8385-6501b36734d4 tempest-VolumesTestJSON-1777515349 None] Acquiring lock "cinder-quobyte-4c766f50-d617-47a4-aae5-99a9c7d07750" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:43:45 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-10764df8-495c-4b2e-8385-6501b36734d4 tempest-VolumesTestJSON-1777515349 None] Lock "cinder-quobyte-4c766f50-d617-47a4-aae5-99a9c7d07750" acquired by "delete_volume" :: waited 0.013s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:43:45 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a050d08-2424-480e-91f8-c5ed3ef54031]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:43:45 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-10764df8-495c-4b2e-8385-6501b36734d4 tempest-VolumesTestJSON-1777515349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-4c766f50-d617-47a4-aae5-99a9c7d07750 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:43:45 devstack sudo[101676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-4c766f50-d617-47a4-aae5-99a9c7d07750 Sep 06 06:43:45 devstack sudo[101676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:43:45 devstack sudo[101676]: pam_unix(sudo:session): session closed for user root Sep 06 06:43:45 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-10764df8-495c-4b2e-8385-6501b36734d4 tempest-VolumesTestJSON-1777515349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-4c766f50-d617-47a4-aae5-99a9c7d07750" returned: 0 in 0.357s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:43:45 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-10764df8-495c-4b2e-8385-6501b36734d4 tempest-VolumesTestJSON-1777515349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-4c766f50-d617-47a4-aae5-99a9c7d07750 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:43:45 devstack sudo[101682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-4c766f50-d617-47a4-aae5-99a9c7d07750 Sep 06 06:43:45 devstack sudo[101682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:43:45 devstack sudo[101682]: pam_unix(sudo:session): session closed for user root Sep 06 06:43:45 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-10764df8-495c-4b2e-8385-6501b36734d4 tempest-VolumesTestJSON-1777515349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-4c766f50-d617-47a4-aae5-99a9c7d07750" returned: 0 in 0.243s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:43:45 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-10764df8-495c-4b2e-8385-6501b36734d4 tempest-VolumesTestJSON-1777515349 None] Lock "cinder-quobyte-4c766f50-d617-47a4-aae5-99a9c7d07750" released by "delete_volume" :: held 0.638s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:43:45 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-10764df8-495c-4b2e-8385-6501b36734d4 tempest-VolumesTestJSON-1777515349 None] Created reservations ['1b5f8844-463f-4828-97a7-d8c6f7669e3b', '0ac8d9ef-91fb-497e-84d9-e4f766bf9751', 'dbe30854-57d3-4eaf-8f5a-e1a43aaac213', '6c054f82-2806-4d25-8220-9bdfa95ba502'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:43:45 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-10764df8-495c-4b2e-8385-6501b36734d4 tempest-VolumesTestJSON-1777515349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:43:45 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-10764df8-495c-4b2e-8385-6501b36734d4 tempest-VolumesTestJSON-1777515349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:43:45 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-10764df8-495c-4b2e-8385-6501b36734d4 tempest-VolumesTestJSON-1777515349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:43:45 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-10764df8-495c-4b2e-8385-6501b36734d4 tempest-VolumesTestJSON-1777515349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:43:45 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-10764df8-495c-4b2e-8385-6501b36734d4 tempest-VolumesTestJSON-1777515349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:43:45 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-10764df8-495c-4b2e-8385-6501b36734d4 tempest-VolumesTestJSON-1777515349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:43:45 devstack sudo[101685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:43:45 devstack sudo[101685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:43:46 devstack sudo[101685]: pam_unix(sudo:session): session closed for user root Sep 06 06:43:46 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-10764df8-495c-4b2e-8385-6501b36734d4 tempest-VolumesTestJSON-1777515349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.247s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:43:46 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-10764df8-495c-4b2e-8385-6501b36734d4 tempest-VolumesTestJSON-1777515349 None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:43:46 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-10764df8-495c-4b2e-8385-6501b36734d4 tempest-VolumesTestJSON-1777515349 None] Deleted volume successfully. Sep 06 06:43:46 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-10764df8-495c-4b2e-8385-6501b36734d4 tempest-VolumesTestJSON-1777515349 None] Lock "cinder-4c766f50-d617-47a4-aae5-99a9c7d07750-delete_volume" released by "delete_volume" :: held 1.087s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:43:48 devstack cinder-volume[87329]: DEBUG oslo_service.periodic_task [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87329) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 06 06:43:48 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:43:48 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:43:48 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:43:48 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:43:48 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:43:48 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:43:48 devstack sudo[101693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:43:48 devstack sudo[101693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:43:48 devstack sudo[101693]: pam_unix(sudo:session): session closed for user root Sep 06 06:43:48 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.316s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:43:48 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:43:48 devstack cinder-volume[87329]: DEBUG oslo_service.periodic_task [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Running periodic task VolumeManager._thread_info {{(pid=87329) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 06 06:43:48 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] thread count: 28 {{(pid=87329) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 06 06:43:48 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] thread info: [<_MainThread(MainThread, started 126855043821696)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87329) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 06 06:43:50 devstack cinder-volume[87329]: INFO cinder.volume.manager [req-53d2ac62-7010-4eb9-b67a-c811f5596539 req-07646422-d043-4743-9493-745934735d80 tempest-TestMinimumBasicScenario-261614628 None] Terminate volume connection completed successfully. Sep 06 06:43:50 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [req-53d2ac62-7010-4eb9-b67a-c811f5596539 req-07646422-d043-4743-9493-745934735d80 tempest-TestMinimumBasicScenario-261614628 None] Deleting attachment 6cb24694-551b-4694-8e0e-8e639042535d. {{(pid=87329) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 06 06:43:50 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-2b5c3a7d-3eb7-45cc-944c-b3adf603f47f tempest-GroupSnapshotsV319Test-871099538 None] Group tempest-GroupSnapshotsV319Test-Group-1626380744: creating Sep 06 06:43:50 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-2b5c3a7d-3eb7-45cc-944c-b3adf603f47f tempest-GroupSnapshotsV319Test-871099538 None] Group tempest-GroupSnapshotsV319Test-Group-1626380744: created successfully Sep 06 06:43:50 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-2b5c3a7d-3eb7-45cc-944c-b3adf603f47f tempest-GroupSnapshotsV319Test-871099538 None] Create group completed successfully. Sep 06 06:43:51 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-2d1c0ea5-d5eb-4f85-b427-96c87d390b7e tempest-TestMinimumBasicScenario-261614628 None] Acquiring lock "cinder-64ecd7db-42d3-4cef-8bcd-81e392af5e98-delete_volume" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:43:51 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-2d1c0ea5-d5eb-4f85-b427-96c87d390b7e tempest-TestMinimumBasicScenario-261614628 None] Lock "cinder-64ecd7db-42d3-4cef-8bcd-81e392af5e98-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:43:51 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-2d1c0ea5-d5eb-4f85-b427-96c87d390b7e tempest-TestMinimumBasicScenario-261614628 None] Acquiring lock "cinder-quobyte-64ecd7db-42d3-4cef-8bcd-81e392af5e98" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:43:51 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-2d1c0ea5-d5eb-4f85-b427-96c87d390b7e tempest-TestMinimumBasicScenario-261614628 None] Lock "cinder-quobyte-64ecd7db-42d3-4cef-8bcd-81e392af5e98" acquired by "delete_volume" :: waited 0.014s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:43:51 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[3af6ed44-42d8-4fa8-b60d-52694efeeb36]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:43:51 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-2d1c0ea5-d5eb-4f85-b427-96c87d390b7e tempest-TestMinimumBasicScenario-261614628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-64ecd7db-42d3-4cef-8bcd-81e392af5e98 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:43:51 devstack sudo[101703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-64ecd7db-42d3-4cef-8bcd-81e392af5e98 Sep 06 06:43:51 devstack sudo[101703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:43:51 devstack sudo[101703]: pam_unix(sudo:session): session closed for user root Sep 06 06:43:51 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-2d1c0ea5-d5eb-4f85-b427-96c87d390b7e tempest-TestMinimumBasicScenario-261614628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-64ecd7db-42d3-4cef-8bcd-81e392af5e98" returned: 0 in 0.356s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:43:51 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-2d1c0ea5-d5eb-4f85-b427-96c87d390b7e tempest-TestMinimumBasicScenario-261614628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-64ecd7db-42d3-4cef-8bcd-81e392af5e98 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:43:51 devstack sudo[101708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-64ecd7db-42d3-4cef-8bcd-81e392af5e98 Sep 06 06:43:51 devstack sudo[101708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:43:51 devstack sudo[101708]: pam_unix(sudo:session): session closed for user root Sep 06 06:43:51 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-2d1c0ea5-d5eb-4f85-b427-96c87d390b7e tempest-TestMinimumBasicScenario-261614628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-64ecd7db-42d3-4cef-8bcd-81e392af5e98" returned: 0 in 0.245s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:43:52 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-2d1c0ea5-d5eb-4f85-b427-96c87d390b7e tempest-TestMinimumBasicScenario-261614628 None] Lock "cinder-quobyte-64ecd7db-42d3-4cef-8bcd-81e392af5e98" released by "delete_volume" :: held 0.639s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:43:52 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-2d1c0ea5-d5eb-4f85-b427-96c87d390b7e tempest-TestMinimumBasicScenario-261614628 None] Created reservations ['b5b8c5a7-5c45-494e-a1c5-9a8f76d64e38', 'd6d7d2a8-b7b3-49cf-80d6-2183ef400465', 'd206bd49-9e17-4581-9817-252adb1bf9bc', 'c1340b4a-2f5c-44b8-a85d-5579a402063b'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:43:52 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-2d1c0ea5-d5eb-4f85-b427-96c87d390b7e tempest-TestMinimumBasicScenario-261614628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:43:52 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-2d1c0ea5-d5eb-4f85-b427-96c87d390b7e tempest-TestMinimumBasicScenario-261614628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:43:52 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-2d1c0ea5-d5eb-4f85-b427-96c87d390b7e tempest-TestMinimumBasicScenario-261614628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:43:52 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-2d1c0ea5-d5eb-4f85-b427-96c87d390b7e tempest-TestMinimumBasicScenario-261614628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:43:52 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-2d1c0ea5-d5eb-4f85-b427-96c87d390b7e tempest-TestMinimumBasicScenario-261614628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:43:52 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-2d1c0ea5-d5eb-4f85-b427-96c87d390b7e tempest-TestMinimumBasicScenario-261614628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:43:52 devstack sudo[101711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:43:52 devstack sudo[101711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:43:52 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-867154c9-2f67-4c3d-98b5-d98a2dadf430 tempest-GroupSnapshotsV319Test-871099538 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87329) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 06:43:52 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-867154c9-2f67-4c3d-98b5-d98a2dadf430 tempest-GroupSnapshotsV319Test-871099538 None] Flow 'volume_create_manager' (014f6759-a32d-4f51-ac19-110f28474eca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:43:52 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-867154c9-2f67-4c3d-98b5-d98a2dadf430 tempest-GroupSnapshotsV319Test-871099538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (366e8b6d-eb86-4fa2-8b84-fc3376365daf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:43:52 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-867154c9-2f67-4c3d-98b5-d98a2dadf430 tempest-GroupSnapshotsV319Test-871099538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (366e8b6d-eb86-4fa2-8b84-fc3376365daf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:43:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1677493681',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ab24f389-af24-45fb-a5e5-75055de5cf1f,host='devstack@QuobyteHD#QuobyteHD',id=d8c0cf6a-e4b0-4a40-9b04-250362202abb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4bd4f43273c4efc9b351d817babbac1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:43:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:43:52Z,use_quota=True,user_id='34bdf576edae4fe1a6ed3fd1654cccc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b75854e7-47e5-4cb2-8b5d-0429e9964db0),volume_type_id=b75854e7-47e5-4cb2-8b5d-0429e9964db0)' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:43:52 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-867154c9-2f67-4c3d-98b5-d98a2dadf430 tempest-GroupSnapshotsV319Test-871099538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72b71c64-4fbc-4aed-927f-b66ee5050c53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:43:52 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-867154c9-2f67-4c3d-98b5-d98a2dadf430 tempest-GroupSnapshotsV319Test-871099538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72b71c64-4fbc-4aed-927f-b66ee5050c53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:43:52 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-867154c9-2f67-4c3d-98b5-d98a2dadf430 tempest-GroupSnapshotsV319Test-871099538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8f3ec58-6453-49aa-86ac-8e6c77a66a9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:43:52 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-867154c9-2f67-4c3d-98b5-d98a2dadf430 tempest-GroupSnapshotsV319Test-871099538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8f3ec58-6453-49aa-86ac-8e6c77a66a9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8c0cf6a-e4b0-4a40-9b04-250362202abb', 'volume_name': 'volume-d8c0cf6a-e4b0-4a40-9b04-250362202abb', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:43:52 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-867154c9-2f67-4c3d-98b5-d98a2dadf430 tempest-GroupSnapshotsV319Test-871099538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (376b1567-756d-4263-bf4e-e601ddc3262b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:43:52 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-867154c9-2f67-4c3d-98b5-d98a2dadf430 tempest-GroupSnapshotsV319Test-871099538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (376b1567-756d-4263-bf4e-e601ddc3262b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:43:52 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-867154c9-2f67-4c3d-98b5-d98a2dadf430 tempest-GroupSnapshotsV319Test-871099538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af89a4e0-fc9d-4911-b457-2da999bd64c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:43:52 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-867154c9-2f67-4c3d-98b5-d98a2dadf430 tempest-GroupSnapshotsV319Test-871099538 None] Volume d8c0cf6a-e4b0-4a40-9b04-250362202abb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8c0cf6a-e4b0-4a40-9b04-250362202abb', 'volume_size': 1} Sep 06 06:43:52 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-867154c9-2f67-4c3d-98b5-d98a2dadf430 tempest-GroupSnapshotsV319Test-871099538 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:43:52 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-867154c9-2f67-4c3d-98b5-d98a2dadf430 tempest-GroupSnapshotsV319Test-871099538 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:43:52 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-867154c9-2f67-4c3d-98b5-d98a2dadf430 tempest-GroupSnapshotsV319Test-871099538 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=ab24f389-af24-45fb-a5e5-75055de5cf1f,created_at=2026-09-06T04:43:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1677493681',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ab24f389-af24-45fb-a5e5-75055de5cf1f,host='devstack@QuobyteHD#QuobyteHD',id=d8c0cf6a-e4b0-4a40-9b04-250362202abb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4bd4f43273c4efc9b351d817babbac1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:43:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:43:52Z,use_quota=True,user_id='34bdf576edae4fe1a6ed3fd1654cccc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b75854e7-47e5-4cb2-8b5d-0429e9964db0),volume_type_id=b75854e7-47e5-4cb2-8b5d-0429e9964db0)}" {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 06:43:52 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-867154c9-2f67-4c3d-98b5-d98a2dadf430 tempest-GroupSnapshotsV319Test-871099538 None] Creating volume d8c0cf6a-e4b0-4a40-9b04-250362202abb {{(pid=87329) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 06:43:52 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-867154c9-2f67-4c3d-98b5-d98a2dadf430 tempest-GroupSnapshotsV319Test-871099538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:43:52 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-867154c9-2f67-4c3d-98b5-d98a2dadf430 tempest-GroupSnapshotsV319Test-871099538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:43:52 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-867154c9-2f67-4c3d-98b5-d98a2dadf430 tempest-GroupSnapshotsV319Test-871099538 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:43:52 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-867154c9-2f67-4c3d-98b5-d98a2dadf430 tempest-GroupSnapshotsV319Test-871099538 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:43:52 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-867154c9-2f67-4c3d-98b5-d98a2dadf430 tempest-GroupSnapshotsV319Test-871099538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:43:52 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-867154c9-2f67-4c3d-98b5-d98a2dadf430 tempest-GroupSnapshotsV319Test-871099538 None] Selected osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 as target Quobyte volume. {{(pid=87329) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 06:43:52 devstack cinder-volume[87329]: INFO cinder.volume.drivers.remotefs [None req-867154c9-2f67-4c3d-98b5-d98a2dadf430 tempest-GroupSnapshotsV319Test-871099538 None] casted to osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 Sep 06 06:43:52 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-867154c9-2f67-4c3d-98b5-d98a2dadf430 tempest-GroupSnapshotsV319Test-871099538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-d8c0cf6a-e4b0-4a40-9b04-250362202abb 1073741824 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:43:52 devstack sudo[101713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-d8c0cf6a-e4b0-4a40-9b04-250362202abb 1073741824 Sep 06 06:43:52 devstack sudo[101713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:43:52 devstack sudo[101711]: pam_unix(sudo:session): session closed for user root Sep 06 06:43:52 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-2d1c0ea5-d5eb-4f85-b427-96c87d390b7e tempest-TestMinimumBasicScenario-261614628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.273s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:43:52 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-2d1c0ea5-d5eb-4f85-b427-96c87d390b7e tempest-TestMinimumBasicScenario-261614628 None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:43:52 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-2d1c0ea5-d5eb-4f85-b427-96c87d390b7e tempest-TestMinimumBasicScenario-261614628 None] Deleted volume successfully. Sep 06 06:43:52 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-2d1c0ea5-d5eb-4f85-b427-96c87d390b7e tempest-TestMinimumBasicScenario-261614628 None] Lock "cinder-64ecd7db-42d3-4cef-8bcd-81e392af5e98-delete_volume" released by "delete_volume" :: held 1.126s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:43:52 devstack sudo[101713]: pam_unix(sudo:session): session closed for user root Sep 06 06:43:52 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-867154c9-2f67-4c3d-98b5-d98a2dadf430 tempest-GroupSnapshotsV319Test-871099538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-d8c0cf6a-e4b0-4a40-9b04-250362202abb 1073741824" returned: 0 in 0.476s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:43:52 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-867154c9-2f67-4c3d-98b5-d98a2dadf430 tempest-GroupSnapshotsV319Test-871099538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-d8c0cf6a-e4b0-4a40-9b04-250362202abb {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:43:52 devstack sudo[101724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-d8c0cf6a-e4b0-4a40-9b04-250362202abb Sep 06 06:43:52 devstack sudo[101724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:43:53 devstack sudo[101724]: pam_unix(sudo:session): session closed for user root Sep 06 06:43:53 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-867154c9-2f67-4c3d-98b5-d98a2dadf430 tempest-GroupSnapshotsV319Test-871099538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-d8c0cf6a-e4b0-4a40-9b04-250362202abb" returned: 0 in 0.331s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:43:53 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-867154c9-2f67-4c3d-98b5-d98a2dadf430 tempest-GroupSnapshotsV319Test-871099538 None] <== create_volume: return (850ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'} {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 06:43:53 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-867154c9-2f67-4c3d-98b5-d98a2dadf430 tempest-GroupSnapshotsV319Test-871099538 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.853s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:43:53 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-867154c9-2f67-4c3d-98b5-d98a2dadf430 tempest-GroupSnapshotsV319Test-871099538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af89a4e0-fc9d-4911-b457-2da999bd64c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8c0cf6a-e4b0-4a40-9b04-250362202abb', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:43:53 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-867154c9-2f67-4c3d-98b5-d98a2dadf430 tempest-GroupSnapshotsV319Test-871099538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47fecc0d-609f-4f49-9946-0170b20345b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:43:53 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-867154c9-2f67-4c3d-98b5-d98a2dadf430 tempest-GroupSnapshotsV319Test-871099538 None] Volume volume-d8c0cf6a-e4b0-4a40-9b04-250362202abb (d8c0cf6a-e4b0-4a40-9b04-250362202abb): created successfully Sep 06 06:43:53 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-867154c9-2f67-4c3d-98b5-d98a2dadf430 tempest-GroupSnapshotsV319Test-871099538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47fecc0d-609f-4f49-9946-0170b20345b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:43:53 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-867154c9-2f67-4c3d-98b5-d98a2dadf430 tempest-GroupSnapshotsV319Test-871099538 None] Flow 'volume_create_manager' (014f6759-a32d-4f51-ac19-110f28474eca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:43:53 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-867154c9-2f67-4c3d-98b5-d98a2dadf430 tempest-GroupSnapshotsV319Test-871099538 None] Created volume successfully. Sep 06 06:43:53 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-ccefbbb2-0b77-4b0a-8759-46f8ecad6a3b tempest-GroupSnapshotsV319Test-871099538 None] GroupSnapshot b890a2e1-a685-4b20-808f-fc2dc5f973e0: creating. Sep 06 06:43:53 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-ccefbbb2-0b77-4b0a-8759-46f8ecad6a3b tempest-GroupSnapshotsV319Test-871099538 None] Group snapshot b890a2e1-a685-4b20-808f-fc2dc5f973e0: creating. {{(pid=87329) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 06 06:43:53 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-ccefbbb2-0b77-4b0a-8759-46f8ecad6a3b tempest-GroupSnapshotsV319Test-871099538 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:43:53 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-ccefbbb2-0b77-4b0a-8759-46f8ecad6a3b tempest-GroupSnapshotsV319Test-871099538 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:43:53 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-ccefbbb2-0b77-4b0a-8759-46f8ecad6a3b tempest-GroupSnapshotsV319Test-871099538 None] Creating offline snapshot d1536b90-3957-4dbc-b9a4-8038c594fa60 of volume d8c0cf6a-e4b0-4a40-9b04-250362202abb {{(pid=87329) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 06 06:43:53 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b13481c-ea42-436d-a761-36719c54edbb]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:43:53 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-ccefbbb2-0b77-4b0a-8759-46f8ecad6a3b tempest-GroupSnapshotsV319Test-871099538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-d8c0cf6a-e4b0-4a40-9b04-250362202abb {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:43:53 devstack sudo[101745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-d8c0cf6a-e4b0-4a40-9b04-250362202abb Sep 06 06:43:53 devstack sudo[101745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:43:54 devstack sudo[101745]: pam_unix(sudo:session): session closed for user root Sep 06 06:43:54 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-ccefbbb2-0b77-4b0a-8759-46f8ecad6a3b tempest-GroupSnapshotsV319Test-871099538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-d8c0cf6a-e4b0-4a40-9b04-250362202abb" returned: 0 in 0.401s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:43:54 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-ccefbbb2-0b77-4b0a-8759-46f8ecad6a3b tempest-GroupSnapshotsV319Test-871099538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-d8c0cf6a-e4b0-4a40-9b04-250362202abb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-d8c0cf6a-e4b0-4a40-9b04-250362202abb.d1536b90-3957-4dbc-b9a4-8038c594fa60 1G {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:43:54 devstack sudo[101752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-d8c0cf6a-e4b0-4a40-9b04-250362202abb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-d8c0cf6a-e4b0-4a40-9b04-250362202abb.d1536b90-3957-4dbc-b9a4-8038c594fa60 1G Sep 06 06:43:54 devstack sudo[101752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:43:54 devstack sudo[101752]: pam_unix(sudo:session): session closed for user root Sep 06 06:43:54 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-ccefbbb2-0b77-4b0a-8759-46f8ecad6a3b tempest-GroupSnapshotsV319Test-871099538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-d8c0cf6a-e4b0-4a40-9b04-250362202abb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-d8c0cf6a-e4b0-4a40-9b04-250362202abb.d1536b90-3957-4dbc-b9a4-8038c594fa60 1G" returned: 0 in 0.385s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:43:54 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-ccefbbb2-0b77-4b0a-8759-46f8ecad6a3b tempest-GroupSnapshotsV319Test-871099538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d8c0cf6a-e4b0-4a40-9b04-250362202abb -F qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-d8c0cf6a-e4b0-4a40-9b04-250362202abb.d1536b90-3957-4dbc-b9a4-8038c594fa60 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:43:54 devstack sudo[101757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d8c0cf6a-e4b0-4a40-9b04-250362202abb -F qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-d8c0cf6a-e4b0-4a40-9b04-250362202abb.d1536b90-3957-4dbc-b9a4-8038c594fa60 Sep 06 06:43:54 devstack sudo[101757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:43:54 devstack sudo[101757]: pam_unix(sudo:session): session closed for user root Sep 06 06:43:54 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-ccefbbb2-0b77-4b0a-8759-46f8ecad6a3b tempest-GroupSnapshotsV319Test-871099538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d8c0cf6a-e4b0-4a40-9b04-250362202abb -F qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-d8c0cf6a-e4b0-4a40-9b04-250362202abb.d1536b90-3957-4dbc-b9a4-8038c594fa60" returned: 0 in 0.293s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:43:54 devstack cinder-volume[87329]: WARNING cinder.volume.drivers.remotefs [None req-ccefbbb2-0b77-4b0a-8759-46f8ecad6a3b tempest-GroupSnapshotsV319Test-871099538 None] /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-d8c0cf6a-e4b0-4a40-9b04-250362202abb.d1536b90-3957-4dbc-b9a4-8038c594fa60 is being set with open permissions: ugo+rw: NotImplementedError Sep 06 06:43:54 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-ccefbbb2-0b77-4b0a-8759-46f8ecad6a3b tempest-GroupSnapshotsV319Test-871099538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-d8c0cf6a-e4b0-4a40-9b04-250362202abb.d1536b90-3957-4dbc-b9a4-8038c594fa60 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:43:54 devstack sudo[101762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-d8c0cf6a-e4b0-4a40-9b04-250362202abb.d1536b90-3957-4dbc-b9a4-8038c594fa60 Sep 06 06:43:54 devstack sudo[101762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:43:55 devstack sudo[101762]: pam_unix(sudo:session): session closed for user root Sep 06 06:43:55 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-ccefbbb2-0b77-4b0a-8759-46f8ecad6a3b tempest-GroupSnapshotsV319Test-871099538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-d8c0cf6a-e4b0-4a40-9b04-250362202abb.d1536b90-3957-4dbc-b9a4-8038c594fa60" returned: 0 in 0.248s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:43:55 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-ccefbbb2-0b77-4b0a-8759-46f8ecad6a3b tempest-GroupSnapshotsV319Test-871099538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-d8c0cf6a-e4b0-4a40-9b04-250362202abb.info {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:43:55 devstack sudo[101765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-d8c0cf6a-e4b0-4a40-9b04-250362202abb.info Sep 06 06:43:55 devstack sudo[101765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:43:55 devstack sudo[101765]: pam_unix(sudo:session): session closed for user root Sep 06 06:43:55 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-ccefbbb2-0b77-4b0a-8759-46f8ecad6a3b tempest-GroupSnapshotsV319Test-871099538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-d8c0cf6a-e4b0-4a40-9b04-250362202abb.info" returned: 0 in 0.245s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:43:55 devstack cinder-volume[87329]: WARNING cinder.volume.drivers.remotefs [None req-ccefbbb2-0b77-4b0a-8759-46f8ecad6a3b tempest-GroupSnapshotsV319Test-871099538 None] /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-d8c0cf6a-e4b0-4a40-9b04-250362202abb.info is being set with open permissions: ugo+rw: NotImplementedError Sep 06 06:43:55 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-ccefbbb2-0b77-4b0a-8759-46f8ecad6a3b tempest-GroupSnapshotsV319Test-871099538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-d8c0cf6a-e4b0-4a40-9b04-250362202abb.info {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:43:55 devstack sudo[101768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-d8c0cf6a-e4b0-4a40-9b04-250362202abb.info Sep 06 06:43:55 devstack sudo[101768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:43:55 devstack sudo[101768]: pam_unix(sudo:session): session closed for user root Sep 06 06:43:55 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-ccefbbb2-0b77-4b0a-8759-46f8ecad6a3b tempest-GroupSnapshotsV319Test-871099538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-d8c0cf6a-e4b0-4a40-9b04-250362202abb.info" returned: 0 in 0.242s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:43:55 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-ccefbbb2-0b77-4b0a-8759-46f8ecad6a3b tempest-GroupSnapshotsV319Test-871099538 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.900s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:43:55 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-ccefbbb2-0b77-4b0a-8759-46f8ecad6a3b tempest-GroupSnapshotsV319Test-871099538 None] group_snapshot b890a2e1-a685-4b20-808f-fc2dc5f973e0: created successfully Sep 06 06:43:56 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-32ad4f71-558b-4fe7-8a3a-3d121851f055 tempest-GroupSnapshotsV319Test-871099538 None] group_snapshot b890a2e1-a685-4b20-808f-fc2dc5f973e0: deleting Sep 06 06:43:56 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-32ad4f71-558b-4fe7-8a3a-3d121851f055 tempest-GroupSnapshotsV319Test-871099538 None] group_snapshot b890a2e1-a685-4b20-808f-fc2dc5f973e0: deleting {{(pid=87329) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 06 06:43:56 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-32ad4f71-558b-4fe7-8a3a-3d121851f055 tempest-GroupSnapshotsV319Test-871099538 None] Acquiring lock "cinder-quobyte-d8c0cf6a-e4b0-4a40-9b04-250362202abb" by "delete_snapshot" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:43:56 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-32ad4f71-558b-4fe7-8a3a-3d121851f055 tempest-GroupSnapshotsV319Test-871099538 None] Lock "cinder-quobyte-d8c0cf6a-e4b0-4a40-9b04-250362202abb" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:43:56 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-32ad4f71-558b-4fe7-8a3a-3d121851f055 tempest-GroupSnapshotsV319Test-871099538 None] Acquiring lock "cinder-quobyte-d1536b90-3957-4dbc-b9a4-8038c594fa60" by "_delete_snapshot" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:43:56 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-32ad4f71-558b-4fe7-8a3a-3d121851f055 tempest-GroupSnapshotsV319Test-871099538 None] Lock "cinder-quobyte-d1536b90-3957-4dbc-b9a4-8038c594fa60" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:43:56 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-32ad4f71-558b-4fe7-8a3a-3d121851f055 tempest-GroupSnapshotsV319Test-871099538 None] Deleting offline snapshot d1536b90-3957-4dbc-b9a4-8038c594fa60 of volume d8c0cf6a-e4b0-4a40-9b04-250362202abb {{(pid=87329) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 06 06:43:56 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-32ad4f71-558b-4fe7-8a3a-3d121851f055 tempest-GroupSnapshotsV319Test-871099538 None] snapshot_file for this snap is: volume-d8c0cf6a-e4b0-4a40-9b04-250362202abb.d1536b90-3957-4dbc-b9a4-8038c594fa60 {{(pid=87329) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 06 06:43:56 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[87a0d922-92e1-4b14-b086-b3f638d14901]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:43:56 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-32ad4f71-558b-4fe7-8a3a-3d121851f055 tempest-GroupSnapshotsV319Test-871099538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-d8c0cf6a-e4b0-4a40-9b04-250362202abb.d1536b90-3957-4dbc-b9a4-8038c594fa60 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:43:56 devstack sudo[101771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-d8c0cf6a-e4b0-4a40-9b04-250362202abb.d1536b90-3957-4dbc-b9a4-8038c594fa60 Sep 06 06:43:56 devstack sudo[101771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:43:56 devstack sudo[101771]: pam_unix(sudo:session): session closed for user root Sep 06 06:43:56 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-32ad4f71-558b-4fe7-8a3a-3d121851f055 tempest-GroupSnapshotsV319Test-871099538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-d8c0cf6a-e4b0-4a40-9b04-250362202abb.d1536b90-3957-4dbc-b9a4-8038c594fa60" returned: 0 in 0.388s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:43:56 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-32ad4f71-558b-4fe7-8a3a-3d121851f055 tempest-GroupSnapshotsV319Test-871099538 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d8c0cf6a-e4b0-4a40-9b04-250362202abb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87329) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 06:43:56 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a8e1dea-38ce-4ee6-827e-c91c3b30c2b0]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:43:56 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-32ad4f71-558b-4fe7-8a3a-3d121851f055 tempest-GroupSnapshotsV319Test-871099538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-d8c0cf6a-e4b0-4a40-9b04-250362202abb {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:43:56 devstack sudo[101777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-d8c0cf6a-e4b0-4a40-9b04-250362202abb Sep 06 06:43:56 devstack sudo[101777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:43:57 devstack sudo[101777]: pam_unix(sudo:session): session closed for user root Sep 06 06:43:57 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-32ad4f71-558b-4fe7-8a3a-3d121851f055 tempest-GroupSnapshotsV319Test-871099538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-d8c0cf6a-e4b0-4a40-9b04-250362202abb" returned: 0 in 0.363s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:43:57 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-32ad4f71-558b-4fe7-8a3a-3d121851f055 tempest-GroupSnapshotsV319Test-871099538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-d8c0cf6a-e4b0-4a40-9b04-250362202abb.d1536b90-3957-4dbc-b9a4-8038c594fa60 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:43:57 devstack sudo[101782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-d8c0cf6a-e4b0-4a40-9b04-250362202abb.d1536b90-3957-4dbc-b9a4-8038c594fa60 Sep 06 06:43:57 devstack sudo[101782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:43:57 devstack sudo[101782]: pam_unix(sudo:session): session closed for user root Sep 06 06:43:57 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-32ad4f71-558b-4fe7-8a3a-3d121851f055 tempest-GroupSnapshotsV319Test-871099538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-d8c0cf6a-e4b0-4a40-9b04-250362202abb.d1536b90-3957-4dbc-b9a4-8038c594fa60" returned: 0 in 0.336s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:43:57 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-32ad4f71-558b-4fe7-8a3a-3d121851f055 tempest-GroupSnapshotsV319Test-871099538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-d8c0cf6a-e4b0-4a40-9b04-250362202abb.d1536b90-3957-4dbc-b9a4-8038c594fa60 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:43:57 devstack sudo[101787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-d8c0cf6a-e4b0-4a40-9b04-250362202abb.d1536b90-3957-4dbc-b9a4-8038c594fa60 Sep 06 06:43:57 devstack sudo[101787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:43:57 devstack sudo[101787]: pam_unix(sudo:session): session closed for user root Sep 06 06:43:57 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-32ad4f71-558b-4fe7-8a3a-3d121851f055 tempest-GroupSnapshotsV319Test-871099538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-d8c0cf6a-e4b0-4a40-9b04-250362202abb.d1536b90-3957-4dbc-b9a4-8038c594fa60" returned: 0 in 0.278s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:43:57 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-32ad4f71-558b-4fe7-8a3a-3d121851f055 tempest-GroupSnapshotsV319Test-871099538 None] Lock "cinder-quobyte-d1536b90-3957-4dbc-b9a4-8038c594fa60" released by "_delete_snapshot" :: held 1.464s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:43:57 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-32ad4f71-558b-4fe7-8a3a-3d121851f055 tempest-GroupSnapshotsV319Test-871099538 None] Lock "cinder-quobyte-d8c0cf6a-e4b0-4a40-9b04-250362202abb" released by "delete_snapshot" :: held 1.488s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:43:57 devstack cinder-volume[87329]: DEBUG dbcounter [-] [87329] Writing DB stats cinder:SELECT=100,cinder:INSERT=23,cinder:UPDATE=102,cinder:DELETE=10 {{(pid=87329) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 06:43:57 devstack cinder-volume[87329]: DEBUG dbcounter [-] [87329] Writing DB stats cinder:UPDATE=104,cinder:SELECT=94,cinder:DELETE=7,cinder:INSERT=23 {{(pid=87329) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 06:43:57 devstack cinder-volume[87329]: WARNING cinder.quota [None req-32ad4f71-558b-4fe7-8a3a-3d121851f055 tempest-GroupSnapshotsV319Test-871099538 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-2065296985 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-2065296985, it is now deprecated. Please use the default quota class for default quota. Sep 06 06:43:57 devstack cinder-volume[87329]: WARNING cinder.quota [None req-32ad4f71-558b-4fe7-8a3a-3d121851f055 tempest-GroupSnapshotsV319Test-871099538 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-2065296985 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-2065296985, it is now deprecated. Please use the default quota class for default quota. Sep 06 06:43:57 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-32ad4f71-558b-4fe7-8a3a-3d121851f055 tempest-GroupSnapshotsV319Test-871099538 None] Created reservations ['5efd749b-df55-400f-a92e-28c10f28dad4', 'da3d7aff-eac4-4354-9160-9609b9c2d2ba', 'bda102ed-62a4-4b36-80db-adf89e95e50f', 'aedf670b-7bed-4f89-9a49-4056fbdb822c'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:43:57 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-32ad4f71-558b-4fe7-8a3a-3d121851f055 tempest-GroupSnapshotsV319Test-871099538 None] group_snapshot b890a2e1-a685-4b20-808f-fc2dc5f973e0: deleted successfully Sep 06 06:43:58 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-197dbb5b-0089-4190-85fb-1138a7538d4b tempest-GroupSnapshotsV319Test-871099538 None] Acquiring lock "cinder-quobyte-d8c0cf6a-e4b0-4a40-9b04-250362202abb" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:43:58 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-197dbb5b-0089-4190-85fb-1138a7538d4b tempest-GroupSnapshotsV319Test-871099538 None] Lock "cinder-quobyte-d8c0cf6a-e4b0-4a40-9b04-250362202abb" acquired by "delete_volume" :: waited 0.026s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:43:58 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0be58c0-04a7-4c5d-87aa-8010f53564b2]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:43:58 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-197dbb5b-0089-4190-85fb-1138a7538d4b tempest-GroupSnapshotsV319Test-871099538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-d8c0cf6a-e4b0-4a40-9b04-250362202abb {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:43:59 devstack sudo[101796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-d8c0cf6a-e4b0-4a40-9b04-250362202abb Sep 06 06:43:59 devstack sudo[101796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:43:59 devstack sudo[101796]: pam_unix(sudo:session): session closed for user root Sep 06 06:43:59 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-197dbb5b-0089-4190-85fb-1138a7538d4b tempest-GroupSnapshotsV319Test-871099538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-d8c0cf6a-e4b0-4a40-9b04-250362202abb" returned: 0 in 0.379s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:43:59 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-197dbb5b-0089-4190-85fb-1138a7538d4b tempest-GroupSnapshotsV319Test-871099538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-d8c0cf6a-e4b0-4a40-9b04-250362202abb {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:43:59 devstack sudo[101802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-d8c0cf6a-e4b0-4a40-9b04-250362202abb Sep 06 06:43:59 devstack sudo[101802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:43:59 devstack sudo[101802]: pam_unix(sudo:session): session closed for user root Sep 06 06:43:59 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-197dbb5b-0089-4190-85fb-1138a7538d4b tempest-GroupSnapshotsV319Test-871099538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-d8c0cf6a-e4b0-4a40-9b04-250362202abb" returned: 0 in 0.241s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:43:59 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-197dbb5b-0089-4190-85fb-1138a7538d4b tempest-GroupSnapshotsV319Test-871099538 None] Lock "cinder-quobyte-d8c0cf6a-e4b0-4a40-9b04-250362202abb" released by "delete_volume" :: held 0.684s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:43:59 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-197dbb5b-0089-4190-85fb-1138a7538d4b tempest-GroupSnapshotsV319Test-871099538 None] Created reservations ['ba5b7821-6d4f-474c-8a35-1de97998c80d'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:43:59 devstack cinder-volume[87329]: WARNING cinder.quota [None req-197dbb5b-0089-4190-85fb-1138a7538d4b tempest-GroupSnapshotsV319Test-871099538 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-2065296985 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-2065296985, it is now deprecated. Please use the default quota class for default quota. Sep 06 06:43:59 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-197dbb5b-0089-4190-85fb-1138a7538d4b tempest-GroupSnapshotsV319Test-871099538 None] Created reservations ['f3c6e16c-9cb7-4844-8f5f-7c8a0df5e283', '4f98a75a-3579-41f8-b92b-b36c8b111b16', 'a1c3b6bb-02b3-4d57-a8c0-4d0f193536f2', '5e6576cd-2421-46aa-b748-f89e4c94f0d5'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:43:59 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-197dbb5b-0089-4190-85fb-1138a7538d4b tempest-GroupSnapshotsV319Test-871099538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:43:59 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-197dbb5b-0089-4190-85fb-1138a7538d4b tempest-GroupSnapshotsV319Test-871099538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:43:59 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-197dbb5b-0089-4190-85fb-1138a7538d4b tempest-GroupSnapshotsV319Test-871099538 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:43:59 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-197dbb5b-0089-4190-85fb-1138a7538d4b tempest-GroupSnapshotsV319Test-871099538 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:43:59 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-197dbb5b-0089-4190-85fb-1138a7538d4b tempest-GroupSnapshotsV319Test-871099538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:43:59 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-197dbb5b-0089-4190-85fb-1138a7538d4b tempest-GroupSnapshotsV319Test-871099538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:43:59 devstack sudo[101806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:43:59 devstack sudo[101806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:44:00 devstack sudo[101806]: pam_unix(sudo:session): session closed for user root Sep 06 06:44:00 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-197dbb5b-0089-4190-85fb-1138a7538d4b tempest-GroupSnapshotsV319Test-871099538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.265s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:44:00 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-197dbb5b-0089-4190-85fb-1138a7538d4b tempest-GroupSnapshotsV319Test-871099538 None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:44:00 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-197dbb5b-0089-4190-85fb-1138a7538d4b tempest-GroupSnapshotsV319Test-871099538 None] Delete group completed successfully. Sep 06 06:44:09 devstack cinder-volume[87329]: DEBUG dbcounter [-] [87329] Writing DB stats cinder:SELECT=13,cinder:INSERT=5,cinder:UPDATE=14 {{(pid=87329) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 06:44:11 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-a8c2abd8-8c9d-4e2b-94a8-de2fb2c8b0f5 tempest-GroupsV320Test-1516060820 None] Group tempest-GroupsV320Test-Group-906239383: creating Sep 06 06:44:11 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-a8c2abd8-8c9d-4e2b-94a8-de2fb2c8b0f5 tempest-GroupsV320Test-1516060820 None] Group tempest-GroupsV320Test-Group-906239383: created successfully Sep 06 06:44:11 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-a8c2abd8-8c9d-4e2b-94a8-de2fb2c8b0f5 tempest-GroupsV320Test-1516060820 None] Create group completed successfully. Sep 06 06:44:13 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-a9f466d5-0bbd-41be-8802-25cc7d759966 tempest-GroupsV320Test-1516060820 None] Created reservations ['340a0ce2-be95-42bf-afbf-6954c58e2b6a'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:44:13 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-a9f466d5-0bbd-41be-8802-25cc7d759966 tempest-GroupsV320Test-1516060820 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:44:13 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-a9f466d5-0bbd-41be-8802-25cc7d759966 tempest-GroupsV320Test-1516060820 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:44:13 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-a9f466d5-0bbd-41be-8802-25cc7d759966 tempest-GroupsV320Test-1516060820 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:44:13 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-a9f466d5-0bbd-41be-8802-25cc7d759966 tempest-GroupsV320Test-1516060820 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:44:13 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-a9f466d5-0bbd-41be-8802-25cc7d759966 tempest-GroupsV320Test-1516060820 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:44:13 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-a9f466d5-0bbd-41be-8802-25cc7d759966 tempest-GroupsV320Test-1516060820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:44:13 devstack sudo[101817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:44:13 devstack sudo[101817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:44:13 devstack sudo[101817]: pam_unix(sudo:session): session closed for user root Sep 06 06:44:13 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-a9f466d5-0bbd-41be-8802-25cc7d759966 tempest-GroupsV320Test-1516060820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.245s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:44:13 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-a9f466d5-0bbd-41be-8802-25cc7d759966 tempest-GroupsV320Test-1516060820 None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:44:13 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-a9f466d5-0bbd-41be-8802-25cc7d759966 tempest-GroupsV320Test-1516060820 None] Delete group completed successfully. Sep 06 06:44:23 devstack cinder-volume[87329]: DEBUG dbcounter [-] [87329] Writing DB stats cinder:SELECT=21,cinder:INSERT=5,cinder:UPDATE=24 {{(pid=87329) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 06:44:23 devstack cinder-volume[87329]: DEBUG dbcounter [-] [87329] Writing DB stats cinder:UPDATE=3,cinder:SELECT=6 {{(pid=87329) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 06:44:27 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-44552844-78f9-4cb4-bc40-80276e0f5311 tempest-VolumeQuotasAdminTestJSON-1384570560 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87329) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 06:44:27 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-44552844-78f9-4cb4-bc40-80276e0f5311 tempest-VolumeQuotasAdminTestJSON-1384570560 None] Flow 'volume_create_manager' (7b9db74b-b199-4abb-b92d-6163a6811b35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:44:27 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-44552844-78f9-4cb4-bc40-80276e0f5311 tempest-VolumeQuotasAdminTestJSON-1384570560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b23c2c2f-37b0-4359-8fa7-1609b8961025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:44:27 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-44552844-78f9-4cb4-bc40-80276e0f5311 tempest-VolumeQuotasAdminTestJSON-1384570560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b23c2c2f-37b0-4359-8fa7-1609b8961025) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:44:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-913328163',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41e67fb2-1a4f-421c-9544-5fe416e98124,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fd41d2875414676bc77cc2cd245d446',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:44:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:44:27Z,use_quota=True,user_id='f4bb34473c634080a9d3191d4fe953f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:44:27 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-44552844-78f9-4cb4-bc40-80276e0f5311 tempest-VolumeQuotasAdminTestJSON-1384570560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edda14e6-94a5-4714-914a-f9d503ec0483) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:44:27 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-44552844-78f9-4cb4-bc40-80276e0f5311 tempest-VolumeQuotasAdminTestJSON-1384570560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edda14e6-94a5-4714-914a-f9d503ec0483) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:44:27 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-44552844-78f9-4cb4-bc40-80276e0f5311 tempest-VolumeQuotasAdminTestJSON-1384570560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58d99a62-1df1-45b7-9060-362bb8096374) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:44:27 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-44552844-78f9-4cb4-bc40-80276e0f5311 tempest-VolumeQuotasAdminTestJSON-1384570560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58d99a62-1df1-45b7-9060-362bb8096374) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41e67fb2-1a4f-421c-9544-5fe416e98124', 'volume_name': 'volume-41e67fb2-1a4f-421c-9544-5fe416e98124', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:44:27 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-44552844-78f9-4cb4-bc40-80276e0f5311 tempest-VolumeQuotasAdminTestJSON-1384570560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1524f31-885b-42be-bcb9-fa4b314f58d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:44:27 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-44552844-78f9-4cb4-bc40-80276e0f5311 tempest-VolumeQuotasAdminTestJSON-1384570560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1524f31-885b-42be-bcb9-fa4b314f58d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:44:27 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-44552844-78f9-4cb4-bc40-80276e0f5311 tempest-VolumeQuotasAdminTestJSON-1384570560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7547e878-8ca8-418d-a6cd-82abf7bff612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:44:27 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-44552844-78f9-4cb4-bc40-80276e0f5311 tempest-VolumeQuotasAdminTestJSON-1384570560 None] Volume 41e67fb2-1a4f-421c-9544-5fe416e98124: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41e67fb2-1a4f-421c-9544-5fe416e98124', 'volume_size': 1} Sep 06 06:44:27 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-44552844-78f9-4cb4-bc40-80276e0f5311 tempest-VolumeQuotasAdminTestJSON-1384570560 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:44:27 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-44552844-78f9-4cb4-bc40-80276e0f5311 tempest-VolumeQuotasAdminTestJSON-1384570560 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:44:27 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-44552844-78f9-4cb4-bc40-80276e0f5311 tempest-VolumeQuotasAdminTestJSON-1384570560 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:44:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-913328163',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41e67fb2-1a4f-421c-9544-5fe416e98124,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fd41d2875414676bc77cc2cd245d446',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:44:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:44:27Z,use_quota=True,user_id='f4bb34473c634080a9d3191d4fe953f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)}" {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 06:44:27 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-44552844-78f9-4cb4-bc40-80276e0f5311 tempest-VolumeQuotasAdminTestJSON-1384570560 None] Creating volume 41e67fb2-1a4f-421c-9544-5fe416e98124 {{(pid=87329) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 06:44:27 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-44552844-78f9-4cb4-bc40-80276e0f5311 tempest-VolumeQuotasAdminTestJSON-1384570560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:44:27 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-44552844-78f9-4cb4-bc40-80276e0f5311 tempest-VolumeQuotasAdminTestJSON-1384570560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:44:27 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-44552844-78f9-4cb4-bc40-80276e0f5311 tempest-VolumeQuotasAdminTestJSON-1384570560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:44:27 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-44552844-78f9-4cb4-bc40-80276e0f5311 tempest-VolumeQuotasAdminTestJSON-1384570560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:44:27 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-44552844-78f9-4cb4-bc40-80276e0f5311 tempest-VolumeQuotasAdminTestJSON-1384570560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:44:27 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-44552844-78f9-4cb4-bc40-80276e0f5311 tempest-VolumeQuotasAdminTestJSON-1384570560 None] Selected osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 as target Quobyte volume. {{(pid=87329) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 06:44:27 devstack cinder-volume[87329]: INFO cinder.volume.drivers.remotefs [None req-44552844-78f9-4cb4-bc40-80276e0f5311 tempest-VolumeQuotasAdminTestJSON-1384570560 None] casted to osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 Sep 06 06:44:27 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-44552844-78f9-4cb4-bc40-80276e0f5311 tempest-VolumeQuotasAdminTestJSON-1384570560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-41e67fb2-1a4f-421c-9544-5fe416e98124 1073741824 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:44:27 devstack sudo[101821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-41e67fb2-1a4f-421c-9544-5fe416e98124 1073741824 Sep 06 06:44:27 devstack sudo[101821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:44:27 devstack sudo[101821]: pam_unix(sudo:session): session closed for user root Sep 06 06:44:27 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-44552844-78f9-4cb4-bc40-80276e0f5311 tempest-VolumeQuotasAdminTestJSON-1384570560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-41e67fb2-1a4f-421c-9544-5fe416e98124 1073741824" returned: 0 in 0.453s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:44:27 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-44552844-78f9-4cb4-bc40-80276e0f5311 tempest-VolumeQuotasAdminTestJSON-1384570560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-41e67fb2-1a4f-421c-9544-5fe416e98124 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:44:27 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-5bb96971-374e-4246-97cf-53b13ca8b6dc tempest-TestServerVolumeAttachmentScenario-2056758786 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87329) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 06:44:27 devstack sudo[101827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-41e67fb2-1a4f-421c-9544-5fe416e98124 Sep 06 06:44:27 devstack sudo[101827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:44:27 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-5bb96971-374e-4246-97cf-53b13ca8b6dc tempest-TestServerVolumeAttachmentScenario-2056758786 None] Flow 'volume_create_manager' (919e7809-d062-4b49-b18b-c06ea51dc482) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:44:27 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-5bb96971-374e-4246-97cf-53b13ca8b6dc tempest-TestServerVolumeAttachmentScenario-2056758786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d6aee4a-ba26-4927-8844-c1ac2af62676) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:44:27 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-5bb96971-374e-4246-97cf-53b13ca8b6dc tempest-TestServerVolumeAttachmentScenario-2056758786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d6aee4a-ba26-4927-8844-c1ac2af62676) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:44:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1365164454',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=babca842-c8ce-4f3b-ba77-bf341af88d90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='521db6231df4440e9d7d13f7a5ddd238',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:44:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:44:28Z,use_quota=True,user_id='4aa373c116d447c7a35633a34cedadc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:44:27 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-5bb96971-374e-4246-97cf-53b13ca8b6dc tempest-TestServerVolumeAttachmentScenario-2056758786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10604356-d7aa-437f-ae9d-c3fdab2097de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:44:27 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-5bb96971-374e-4246-97cf-53b13ca8b6dc tempest-TestServerVolumeAttachmentScenario-2056758786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10604356-d7aa-437f-ae9d-c3fdab2097de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:44:27 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-5bb96971-374e-4246-97cf-53b13ca8b6dc tempest-TestServerVolumeAttachmentScenario-2056758786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3055f6d1-c306-473a-b608-d7a035d779d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:44:27 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-5bb96971-374e-4246-97cf-53b13ca8b6dc tempest-TestServerVolumeAttachmentScenario-2056758786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3055f6d1-c306-473a-b608-d7a035d779d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'babca842-c8ce-4f3b-ba77-bf341af88d90', 'volume_name': 'volume-babca842-c8ce-4f3b-ba77-bf341af88d90', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:44:27 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-5bb96971-374e-4246-97cf-53b13ca8b6dc tempest-TestServerVolumeAttachmentScenario-2056758786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3602489a-83bf-4c01-ad23-d2c74c8992ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:44:27 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-5bb96971-374e-4246-97cf-53b13ca8b6dc tempest-TestServerVolumeAttachmentScenario-2056758786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3602489a-83bf-4c01-ad23-d2c74c8992ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:44:27 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-5bb96971-374e-4246-97cf-53b13ca8b6dc tempest-TestServerVolumeAttachmentScenario-2056758786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3373a416-4bfe-47b3-ab8e-c31750658fa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:44:27 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-5bb96971-374e-4246-97cf-53b13ca8b6dc tempest-TestServerVolumeAttachmentScenario-2056758786 None] Volume babca842-c8ce-4f3b-ba77-bf341af88d90: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-babca842-c8ce-4f3b-ba77-bf341af88d90', 'volume_size': 1} Sep 06 06:44:27 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-5bb96971-374e-4246-97cf-53b13ca8b6dc tempest-TestServerVolumeAttachmentScenario-2056758786 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:44:27 devstack sudo[101827]: pam_unix(sudo:session): session closed for user root Sep 06 06:44:27 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-44552844-78f9-4cb4-bc40-80276e0f5311 tempest-VolumeQuotasAdminTestJSON-1384570560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-41e67fb2-1a4f-421c-9544-5fe416e98124" returned: 0 in 0.256s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:44:27 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-44552844-78f9-4cb4-bc40-80276e0f5311 tempest-VolumeQuotasAdminTestJSON-1384570560 None] <== create_volume: return (763ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'} {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 06:44:27 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-44552844-78f9-4cb4-bc40-80276e0f5311 tempest-VolumeQuotasAdminTestJSON-1384570560 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.766s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:44:27 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-5bb96971-374e-4246-97cf-53b13ca8b6dc tempest-TestServerVolumeAttachmentScenario-2056758786 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.149s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:44:27 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-5bb96971-374e-4246-97cf-53b13ca8b6dc tempest-TestServerVolumeAttachmentScenario-2056758786 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:44:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1365164454',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=babca842-c8ce-4f3b-ba77-bf341af88d90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='521db6231df4440e9d7d13f7a5ddd238',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:44:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:44:28Z,use_quota=True,user_id='4aa373c116d447c7a35633a34cedadc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)}" {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 06:44:27 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-5bb96971-374e-4246-97cf-53b13ca8b6dc tempest-TestServerVolumeAttachmentScenario-2056758786 None] Creating volume babca842-c8ce-4f3b-ba77-bf341af88d90 {{(pid=87329) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 06:44:27 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-5bb96971-374e-4246-97cf-53b13ca8b6dc tempest-TestServerVolumeAttachmentScenario-2056758786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:44:27 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-5bb96971-374e-4246-97cf-53b13ca8b6dc tempest-TestServerVolumeAttachmentScenario-2056758786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:44:27 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-5bb96971-374e-4246-97cf-53b13ca8b6dc tempest-TestServerVolumeAttachmentScenario-2056758786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:44:27 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-5bb96971-374e-4246-97cf-53b13ca8b6dc tempest-TestServerVolumeAttachmentScenario-2056758786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:44:27 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-5bb96971-374e-4246-97cf-53b13ca8b6dc tempest-TestServerVolumeAttachmentScenario-2056758786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:44:27 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-5bb96971-374e-4246-97cf-53b13ca8b6dc tempest-TestServerVolumeAttachmentScenario-2056758786 None] Selected osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 as target Quobyte volume. {{(pid=87329) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 06:44:27 devstack cinder-volume[87329]: INFO cinder.volume.drivers.remotefs [None req-5bb96971-374e-4246-97cf-53b13ca8b6dc tempest-TestServerVolumeAttachmentScenario-2056758786 None] casted to osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 Sep 06 06:44:27 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-5bb96971-374e-4246-97cf-53b13ca8b6dc tempest-TestServerVolumeAttachmentScenario-2056758786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-babca842-c8ce-4f3b-ba77-bf341af88d90 1073741824 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:44:28 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-44552844-78f9-4cb4-bc40-80276e0f5311 tempest-VolumeQuotasAdminTestJSON-1384570560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7547e878-8ca8-418d-a6cd-82abf7bff612) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41e67fb2-1a4f-421c-9544-5fe416e98124', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:44:28 devstack sudo[101830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-babca842-c8ce-4f3b-ba77-bf341af88d90 1073741824 Sep 06 06:44:28 devstack sudo[101830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:44:28 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-44552844-78f9-4cb4-bc40-80276e0f5311 tempest-VolumeQuotasAdminTestJSON-1384570560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b486f0af-b97a-4494-8044-15f08dbedfd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:44:28 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-44552844-78f9-4cb4-bc40-80276e0f5311 tempest-VolumeQuotasAdminTestJSON-1384570560 None] Volume volume-41e67fb2-1a4f-421c-9544-5fe416e98124 (41e67fb2-1a4f-421c-9544-5fe416e98124): created successfully Sep 06 06:44:28 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-44552844-78f9-4cb4-bc40-80276e0f5311 tempest-VolumeQuotasAdminTestJSON-1384570560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b486f0af-b97a-4494-8044-15f08dbedfd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:44:28 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-44552844-78f9-4cb4-bc40-80276e0f5311 tempest-VolumeQuotasAdminTestJSON-1384570560 None] Flow 'volume_create_manager' (7b9db74b-b199-4abb-b92d-6163a6811b35) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:44:28 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-44552844-78f9-4cb4-bc40-80276e0f5311 tempest-VolumeQuotasAdminTestJSON-1384570560 None] Created volume successfully. Sep 06 06:44:28 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b01585f-8fc2-4272-acb9-4119d35b6a6d tempest-TestServerVolumeAttachmentScenario-2056758786 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87329) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 06:44:28 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-6b01585f-8fc2-4272-acb9-4119d35b6a6d tempest-TestServerVolumeAttachmentScenario-2056758786 None] Flow 'volume_create_manager' (8fc06ee0-96cd-44bd-88cd-0d1febc1907e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:44:28 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-6b01585f-8fc2-4272-acb9-4119d35b6a6d tempest-TestServerVolumeAttachmentScenario-2056758786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55a50358-900f-46ee-b44e-83adede9544c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:44:28 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-6b01585f-8fc2-4272-acb9-4119d35b6a6d tempest-TestServerVolumeAttachmentScenario-2056758786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55a50358-900f-46ee-b44e-83adede9544c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:44:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1628241045',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be4b465f-1cdb-499f-a56a-9addf4cbc513,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='521db6231df4440e9d7d13f7a5ddd238',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:44:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:44:28Z,use_quota=True,user_id='4aa373c116d447c7a35633a34cedadc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:44:28 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-6b01585f-8fc2-4272-acb9-4119d35b6a6d tempest-TestServerVolumeAttachmentScenario-2056758786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e5809cb-1ef4-4cdd-b1d5-dd137eb6668f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:44:28 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-6b01585f-8fc2-4272-acb9-4119d35b6a6d tempest-TestServerVolumeAttachmentScenario-2056758786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e5809cb-1ef4-4cdd-b1d5-dd137eb6668f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:44:28 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-6b01585f-8fc2-4272-acb9-4119d35b6a6d tempest-TestServerVolumeAttachmentScenario-2056758786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de38a2c3-3a65-453d-a5e6-0aa314b0c736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:44:28 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-6b01585f-8fc2-4272-acb9-4119d35b6a6d tempest-TestServerVolumeAttachmentScenario-2056758786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de38a2c3-3a65-453d-a5e6-0aa314b0c736) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be4b465f-1cdb-499f-a56a-9addf4cbc513', 'volume_name': 'volume-be4b465f-1cdb-499f-a56a-9addf4cbc513', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:44:28 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-6b01585f-8fc2-4272-acb9-4119d35b6a6d tempest-TestServerVolumeAttachmentScenario-2056758786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a5bba4f-8dad-45aa-97df-f3670e55f30e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:44:28 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-6b01585f-8fc2-4272-acb9-4119d35b6a6d tempest-TestServerVolumeAttachmentScenario-2056758786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a5bba4f-8dad-45aa-97df-f3670e55f30e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:44:28 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-6b01585f-8fc2-4272-acb9-4119d35b6a6d tempest-TestServerVolumeAttachmentScenario-2056758786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1df4a6b-c5d1-442d-8b63-18a651f03071) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:44:28 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-6b01585f-8fc2-4272-acb9-4119d35b6a6d tempest-TestServerVolumeAttachmentScenario-2056758786 None] Volume be4b465f-1cdb-499f-a56a-9addf4cbc513: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be4b465f-1cdb-499f-a56a-9addf4cbc513', 'volume_size': 1} Sep 06 06:44:28 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-6b01585f-8fc2-4272-acb9-4119d35b6a6d tempest-TestServerVolumeAttachmentScenario-2056758786 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:44:28 devstack sudo[101830]: pam_unix(sudo:session): session closed for user root Sep 06 06:44:28 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-5bb96971-374e-4246-97cf-53b13ca8b6dc tempest-TestServerVolumeAttachmentScenario-2056758786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-babca842-c8ce-4f3b-ba77-bf341af88d90 1073741824" returned: 0 in 0.488s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:44:28 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-5bb96971-374e-4246-97cf-53b13ca8b6dc tempest-TestServerVolumeAttachmentScenario-2056758786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-babca842-c8ce-4f3b-ba77-bf341af88d90 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:44:28 devstack sudo[101836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-babca842-c8ce-4f3b-ba77-bf341af88d90 Sep 06 06:44:28 devstack sudo[101836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:44:28 devstack sudo[101836]: pam_unix(sudo:session): session closed for user root Sep 06 06:44:28 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-5bb96971-374e-4246-97cf-53b13ca8b6dc tempest-TestServerVolumeAttachmentScenario-2056758786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-babca842-c8ce-4f3b-ba77-bf341af88d90" returned: 0 in 0.252s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:44:28 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-5bb96971-374e-4246-97cf-53b13ca8b6dc tempest-TestServerVolumeAttachmentScenario-2056758786 None] <== create_volume: return (784ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'} {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 06:44:28 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-5bb96971-374e-4246-97cf-53b13ca8b6dc tempest-TestServerVolumeAttachmentScenario-2056758786 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.788s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:44:28 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-6b01585f-8fc2-4272-acb9-4119d35b6a6d tempest-TestServerVolumeAttachmentScenario-2056758786 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.565s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:44:28 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-6b01585f-8fc2-4272-acb9-4119d35b6a6d tempest-TestServerVolumeAttachmentScenario-2056758786 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:44:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1628241045',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be4b465f-1cdb-499f-a56a-9addf4cbc513,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='521db6231df4440e9d7d13f7a5ddd238',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:44:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:44:28Z,use_quota=True,user_id='4aa373c116d447c7a35633a34cedadc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)}" {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 06:44:28 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-6b01585f-8fc2-4272-acb9-4119d35b6a6d tempest-TestServerVolumeAttachmentScenario-2056758786 None] Creating volume be4b465f-1cdb-499f-a56a-9addf4cbc513 {{(pid=87329) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 06:44:28 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-6b01585f-8fc2-4272-acb9-4119d35b6a6d tempest-TestServerVolumeAttachmentScenario-2056758786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:44:28 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-6b01585f-8fc2-4272-acb9-4119d35b6a6d tempest-TestServerVolumeAttachmentScenario-2056758786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:44:28 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-6b01585f-8fc2-4272-acb9-4119d35b6a6d tempest-TestServerVolumeAttachmentScenario-2056758786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:44:28 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-6b01585f-8fc2-4272-acb9-4119d35b6a6d tempest-TestServerVolumeAttachmentScenario-2056758786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:44:28 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-6b01585f-8fc2-4272-acb9-4119d35b6a6d tempest-TestServerVolumeAttachmentScenario-2056758786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:44:28 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-6b01585f-8fc2-4272-acb9-4119d35b6a6d tempest-TestServerVolumeAttachmentScenario-2056758786 None] Selected osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 as target Quobyte volume. {{(pid=87329) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 06:44:28 devstack cinder-volume[87329]: INFO cinder.volume.drivers.remotefs [None req-6b01585f-8fc2-4272-acb9-4119d35b6a6d tempest-TestServerVolumeAttachmentScenario-2056758786 None] casted to osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 Sep 06 06:44:28 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-6b01585f-8fc2-4272-acb9-4119d35b6a6d tempest-TestServerVolumeAttachmentScenario-2056758786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-be4b465f-1cdb-499f-a56a-9addf4cbc513 1073741824 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:44:28 devstack sudo[101839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-be4b465f-1cdb-499f-a56a-9addf4cbc513 1073741824 Sep 06 06:44:28 devstack sudo[101839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:44:28 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-5bb96971-374e-4246-97cf-53b13ca8b6dc tempest-TestServerVolumeAttachmentScenario-2056758786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3373a416-4bfe-47b3-ab8e-c31750658fa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-babca842-c8ce-4f3b-ba77-bf341af88d90', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:44:28 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-5bb96971-374e-4246-97cf-53b13ca8b6dc tempest-TestServerVolumeAttachmentScenario-2056758786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1834763a-bf7d-4a1c-b88a-8a962a69eeb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:44:28 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-5bb96971-374e-4246-97cf-53b13ca8b6dc tempest-TestServerVolumeAttachmentScenario-2056758786 None] Volume volume-babca842-c8ce-4f3b-ba77-bf341af88d90 (babca842-c8ce-4f3b-ba77-bf341af88d90): created successfully Sep 06 06:44:28 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-5bb96971-374e-4246-97cf-53b13ca8b6dc tempest-TestServerVolumeAttachmentScenario-2056758786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1834763a-bf7d-4a1c-b88a-8a962a69eeb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:44:28 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-5bb96971-374e-4246-97cf-53b13ca8b6dc tempest-TestServerVolumeAttachmentScenario-2056758786 None] Flow 'volume_create_manager' (919e7809-d062-4b49-b18b-c06ea51dc482) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:44:28 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-5bb96971-374e-4246-97cf-53b13ca8b6dc tempest-TestServerVolumeAttachmentScenario-2056758786 None] Created volume successfully. Sep 06 06:44:29 devstack sudo[101839]: pam_unix(sudo:session): session closed for user root Sep 06 06:44:29 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-6b01585f-8fc2-4272-acb9-4119d35b6a6d tempest-TestServerVolumeAttachmentScenario-2056758786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-be4b465f-1cdb-499f-a56a-9addf4cbc513 1073741824" returned: 0 in 0.430s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:44:29 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-6b01585f-8fc2-4272-acb9-4119d35b6a6d tempest-TestServerVolumeAttachmentScenario-2056758786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-be4b465f-1cdb-499f-a56a-9addf4cbc513 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:44:29 devstack sudo[101846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-be4b465f-1cdb-499f-a56a-9addf4cbc513 Sep 06 06:44:29 devstack sudo[101846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:44:29 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-6b8430d5-4637-4174-a885-6e9ac2c1ee83 tempest-VolumeQuotasAdminTestJSON-1384570560 None] Acquiring lock "cinder-41e67fb2-1a4f-421c-9544-5fe416e98124-delete_volume" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:44:29 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-6b8430d5-4637-4174-a885-6e9ac2c1ee83 tempest-VolumeQuotasAdminTestJSON-1384570560 None] Lock "cinder-41e67fb2-1a4f-421c-9544-5fe416e98124-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:44:29 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-6b8430d5-4637-4174-a885-6e9ac2c1ee83 tempest-VolumeQuotasAdminTestJSON-1384570560 None] Acquiring lock "cinder-quobyte-41e67fb2-1a4f-421c-9544-5fe416e98124" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:44:29 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-6b8430d5-4637-4174-a885-6e9ac2c1ee83 tempest-VolumeQuotasAdminTestJSON-1384570560 None] Lock "cinder-quobyte-41e67fb2-1a4f-421c-9544-5fe416e98124" acquired by "delete_volume" :: waited 0.016s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:44:29 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a4a5d9f-b7ba-4efa-81a9-82c29916ca62]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:44:29 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-6b8430d5-4637-4174-a885-6e9ac2c1ee83 tempest-VolumeQuotasAdminTestJSON-1384570560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-41e67fb2-1a4f-421c-9544-5fe416e98124 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:44:29 devstack sudo[101846]: pam_unix(sudo:session): session closed for user root Sep 06 06:44:29 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-6b01585f-8fc2-4272-acb9-4119d35b6a6d tempest-TestServerVolumeAttachmentScenario-2056758786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-be4b465f-1cdb-499f-a56a-9addf4cbc513" returned: 0 in 0.281s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:44:29 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-6b01585f-8fc2-4272-acb9-4119d35b6a6d tempest-TestServerVolumeAttachmentScenario-2056758786 None] <== create_volume: return (753ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'} {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 06:44:29 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-6b01585f-8fc2-4272-acb9-4119d35b6a6d tempest-TestServerVolumeAttachmentScenario-2056758786 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.756s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:44:29 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-6b01585f-8fc2-4272-acb9-4119d35b6a6d tempest-TestServerVolumeAttachmentScenario-2056758786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1df4a6b-c5d1-442d-8b63-18a651f03071) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be4b465f-1cdb-499f-a56a-9addf4cbc513', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:44:29 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-6b01585f-8fc2-4272-acb9-4119d35b6a6d tempest-TestServerVolumeAttachmentScenario-2056758786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82733902-337c-4de5-a1e5-ca3fd10fda98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:44:29 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-6b01585f-8fc2-4272-acb9-4119d35b6a6d tempest-TestServerVolumeAttachmentScenario-2056758786 None] Volume volume-be4b465f-1cdb-499f-a56a-9addf4cbc513 (be4b465f-1cdb-499f-a56a-9addf4cbc513): created successfully Sep 06 06:44:29 devstack sudo[101848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-41e67fb2-1a4f-421c-9544-5fe416e98124 Sep 06 06:44:29 devstack sudo[101848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:44:29 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-6b01585f-8fc2-4272-acb9-4119d35b6a6d tempest-TestServerVolumeAttachmentScenario-2056758786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82733902-337c-4de5-a1e5-ca3fd10fda98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:44:29 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-6b01585f-8fc2-4272-acb9-4119d35b6a6d tempest-TestServerVolumeAttachmentScenario-2056758786 None] Flow 'volume_create_manager' (8fc06ee0-96cd-44bd-88cd-0d1febc1907e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:44:29 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-6b01585f-8fc2-4272-acb9-4119d35b6a6d tempest-TestServerVolumeAttachmentScenario-2056758786 None] Created volume successfully. Sep 06 06:44:29 devstack sudo[101848]: pam_unix(sudo:session): session closed for user root Sep 06 06:44:29 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-6b8430d5-4637-4174-a885-6e9ac2c1ee83 tempest-VolumeQuotasAdminTestJSON-1384570560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-41e67fb2-1a4f-421c-9544-5fe416e98124" returned: 0 in 0.393s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:44:29 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-6b8430d5-4637-4174-a885-6e9ac2c1ee83 tempest-VolumeQuotasAdminTestJSON-1384570560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-41e67fb2-1a4f-421c-9544-5fe416e98124 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:44:29 devstack sudo[101855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-41e67fb2-1a4f-421c-9544-5fe416e98124 Sep 06 06:44:29 devstack sudo[101855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:44:30 devstack sudo[101855]: pam_unix(sudo:session): session closed for user root Sep 06 06:44:30 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-6b8430d5-4637-4174-a885-6e9ac2c1ee83 tempest-VolumeQuotasAdminTestJSON-1384570560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-41e67fb2-1a4f-421c-9544-5fe416e98124" returned: 0 in 0.264s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:44:30 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-6b8430d5-4637-4174-a885-6e9ac2c1ee83 tempest-VolumeQuotasAdminTestJSON-1384570560 None] Lock "cinder-quobyte-41e67fb2-1a4f-421c-9544-5fe416e98124" released by "delete_volume" :: held 0.698s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:44:30 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-6b8430d5-4637-4174-a885-6e9ac2c1ee83 tempest-VolumeQuotasAdminTestJSON-1384570560 None] Created reservations ['ad43a1cc-5e3d-4863-b5b3-637414e59cc9', '8924ad8c-2509-4999-a161-758764bcea55', '862483c5-69c1-4f48-91ae-87231ffdaaa8', 'e1498e1f-8777-4c2f-aae6-a005664d55f9'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:44:30 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-6b8430d5-4637-4174-a885-6e9ac2c1ee83 tempest-VolumeQuotasAdminTestJSON-1384570560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:44:30 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-6b8430d5-4637-4174-a885-6e9ac2c1ee83 tempest-VolumeQuotasAdminTestJSON-1384570560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:44:30 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-6b8430d5-4637-4174-a885-6e9ac2c1ee83 tempest-VolumeQuotasAdminTestJSON-1384570560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:44:30 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-6b8430d5-4637-4174-a885-6e9ac2c1ee83 tempest-VolumeQuotasAdminTestJSON-1384570560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:44:30 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-6b8430d5-4637-4174-a885-6e9ac2c1ee83 tempest-VolumeQuotasAdminTestJSON-1384570560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:44:30 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-6b8430d5-4637-4174-a885-6e9ac2c1ee83 tempest-VolumeQuotasAdminTestJSON-1384570560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:44:30 devstack sudo[101858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:44:30 devstack sudo[101858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:44:30 devstack sudo[101858]: pam_unix(sudo:session): session closed for user root Sep 06 06:44:30 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-6b8430d5-4637-4174-a885-6e9ac2c1ee83 tempest-VolumeQuotasAdminTestJSON-1384570560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.248s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:44:30 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-6b8430d5-4637-4174-a885-6e9ac2c1ee83 tempest-VolumeQuotasAdminTestJSON-1384570560 None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:44:30 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-6b8430d5-4637-4174-a885-6e9ac2c1ee83 tempest-VolumeQuotasAdminTestJSON-1384570560 None] Deleted volume successfully. Sep 06 06:44:30 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-6b8430d5-4637-4174-a885-6e9ac2c1ee83 tempest-VolumeQuotasAdminTestJSON-1384570560 None] Lock "cinder-41e67fb2-1a4f-421c-9544-5fe416e98124-delete_volume" released by "delete_volume" :: held 1.157s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:44:31 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e174a54-14bf-45b7-8f82-00039aac0e33 tempest-VolumeQuotasAdminTestJSON-1384570560 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87329) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 06:44:31 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-2e174a54-14bf-45b7-8f82-00039aac0e33 tempest-VolumeQuotasAdminTestJSON-1384570560 None] Flow 'volume_create_manager' (984e9e1a-a456-491a-8d04-a2739dfc36e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:44:31 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-2e174a54-14bf-45b7-8f82-00039aac0e33 tempest-VolumeQuotasAdminTestJSON-1384570560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f94b991-9931-4223-9dc5-9abd12a8d8cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:44:31 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-2e174a54-14bf-45b7-8f82-00039aac0e33 tempest-VolumeQuotasAdminTestJSON-1384570560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f94b991-9931-4223-9dc5-9abd12a8d8cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:44:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-754289550',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd3ef4aa-3320-4b80-a2b1-4a0e83be5849,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fd41d2875414676bc77cc2cd245d446',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:44:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:44:31Z,use_quota=True,user_id='f4bb34473c634080a9d3191d4fe953f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:44:31 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-2e174a54-14bf-45b7-8f82-00039aac0e33 tempest-VolumeQuotasAdminTestJSON-1384570560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9adc33d-e340-4132-b293-f247bdc9c2bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:44:31 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-2e174a54-14bf-45b7-8f82-00039aac0e33 tempest-VolumeQuotasAdminTestJSON-1384570560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9adc33d-e340-4132-b293-f247bdc9c2bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:44:31 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-2e174a54-14bf-45b7-8f82-00039aac0e33 tempest-VolumeQuotasAdminTestJSON-1384570560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87e8dc41-2cbf-43f6-bd90-baf4ead4d179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:44:31 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-2e174a54-14bf-45b7-8f82-00039aac0e33 tempest-VolumeQuotasAdminTestJSON-1384570560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87e8dc41-2cbf-43f6-bd90-baf4ead4d179) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd3ef4aa-3320-4b80-a2b1-4a0e83be5849', 'volume_name': 'volume-cd3ef4aa-3320-4b80-a2b1-4a0e83be5849', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:44:31 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-2e174a54-14bf-45b7-8f82-00039aac0e33 tempest-VolumeQuotasAdminTestJSON-1384570560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ccdf5be-43b5-47f6-ac80-0484da4b1f0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:44:31 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-2e174a54-14bf-45b7-8f82-00039aac0e33 tempest-VolumeQuotasAdminTestJSON-1384570560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ccdf5be-43b5-47f6-ac80-0484da4b1f0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:44:31 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-2e174a54-14bf-45b7-8f82-00039aac0e33 tempest-VolumeQuotasAdminTestJSON-1384570560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99a8769c-e019-4ea6-a854-fd354e82ef81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:44:31 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-2e174a54-14bf-45b7-8f82-00039aac0e33 tempest-VolumeQuotasAdminTestJSON-1384570560 None] Volume cd3ef4aa-3320-4b80-a2b1-4a0e83be5849: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd3ef4aa-3320-4b80-a2b1-4a0e83be5849', 'volume_size': 1} Sep 06 06:44:31 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-2e174a54-14bf-45b7-8f82-00039aac0e33 tempest-VolumeQuotasAdminTestJSON-1384570560 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:44:31 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-2e174a54-14bf-45b7-8f82-00039aac0e33 tempest-VolumeQuotasAdminTestJSON-1384570560 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:44:31 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-2e174a54-14bf-45b7-8f82-00039aac0e33 tempest-VolumeQuotasAdminTestJSON-1384570560 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:44:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-754289550',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd3ef4aa-3320-4b80-a2b1-4a0e83be5849,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fd41d2875414676bc77cc2cd245d446',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:44:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:44:31Z,use_quota=True,user_id='f4bb34473c634080a9d3191d4fe953f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)}" {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 06:44:31 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-2e174a54-14bf-45b7-8f82-00039aac0e33 tempest-VolumeQuotasAdminTestJSON-1384570560 None] Creating volume cd3ef4aa-3320-4b80-a2b1-4a0e83be5849 {{(pid=87329) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 06:44:31 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-2e174a54-14bf-45b7-8f82-00039aac0e33 tempest-VolumeQuotasAdminTestJSON-1384570560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:44:31 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-2e174a54-14bf-45b7-8f82-00039aac0e33 tempest-VolumeQuotasAdminTestJSON-1384570560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:44:31 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-2e174a54-14bf-45b7-8f82-00039aac0e33 tempest-VolumeQuotasAdminTestJSON-1384570560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:44:31 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-2e174a54-14bf-45b7-8f82-00039aac0e33 tempest-VolumeQuotasAdminTestJSON-1384570560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:44:31 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-2e174a54-14bf-45b7-8f82-00039aac0e33 tempest-VolumeQuotasAdminTestJSON-1384570560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:44:31 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-2e174a54-14bf-45b7-8f82-00039aac0e33 tempest-VolumeQuotasAdminTestJSON-1384570560 None] Selected osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 as target Quobyte volume. {{(pid=87329) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 06:44:31 devstack cinder-volume[87329]: INFO cinder.volume.drivers.remotefs [None req-2e174a54-14bf-45b7-8f82-00039aac0e33 tempest-VolumeQuotasAdminTestJSON-1384570560 None] casted to osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 Sep 06 06:44:31 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-2e174a54-14bf-45b7-8f82-00039aac0e33 tempest-VolumeQuotasAdminTestJSON-1384570560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-cd3ef4aa-3320-4b80-a2b1-4a0e83be5849 1073741824 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:44:31 devstack sudo[101864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-cd3ef4aa-3320-4b80-a2b1-4a0e83be5849 1073741824 Sep 06 06:44:31 devstack sudo[101864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:44:31 devstack sudo[101864]: pam_unix(sudo:session): session closed for user root Sep 06 06:44:31 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-2e174a54-14bf-45b7-8f82-00039aac0e33 tempest-VolumeQuotasAdminTestJSON-1384570560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-cd3ef4aa-3320-4b80-a2b1-4a0e83be5849 1073741824" returned: 0 in 0.463s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:44:31 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-2e174a54-14bf-45b7-8f82-00039aac0e33 tempest-VolumeQuotasAdminTestJSON-1384570560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-cd3ef4aa-3320-4b80-a2b1-4a0e83be5849 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:44:31 devstack sudo[101870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-cd3ef4aa-3320-4b80-a2b1-4a0e83be5849 Sep 06 06:44:31 devstack sudo[101870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:44:32 devstack sudo[101870]: pam_unix(sudo:session): session closed for user root Sep 06 06:44:32 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-2e174a54-14bf-45b7-8f82-00039aac0e33 tempest-VolumeQuotasAdminTestJSON-1384570560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-cd3ef4aa-3320-4b80-a2b1-4a0e83be5849" returned: 0 in 0.357s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:44:32 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-2e174a54-14bf-45b7-8f82-00039aac0e33 tempest-VolumeQuotasAdminTestJSON-1384570560 None] <== create_volume: return (879ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'} {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 06:44:32 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-2e174a54-14bf-45b7-8f82-00039aac0e33 tempest-VolumeQuotasAdminTestJSON-1384570560 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.882s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:44:32 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-2e174a54-14bf-45b7-8f82-00039aac0e33 tempest-VolumeQuotasAdminTestJSON-1384570560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99a8769c-e019-4ea6-a854-fd354e82ef81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd3ef4aa-3320-4b80-a2b1-4a0e83be5849', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:44:32 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-2e174a54-14bf-45b7-8f82-00039aac0e33 tempest-VolumeQuotasAdminTestJSON-1384570560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a2dbc52-a3e1-4d5c-80da-cadf408f1a5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:44:32 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-2e174a54-14bf-45b7-8f82-00039aac0e33 tempest-VolumeQuotasAdminTestJSON-1384570560 None] Volume volume-cd3ef4aa-3320-4b80-a2b1-4a0e83be5849 (cd3ef4aa-3320-4b80-a2b1-4a0e83be5849): created successfully Sep 06 06:44:32 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-2e174a54-14bf-45b7-8f82-00039aac0e33 tempest-VolumeQuotasAdminTestJSON-1384570560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a2dbc52-a3e1-4d5c-80da-cadf408f1a5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:44:32 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-2e174a54-14bf-45b7-8f82-00039aac0e33 tempest-VolumeQuotasAdminTestJSON-1384570560 None] Flow 'volume_create_manager' (984e9e1a-a456-491a-8d04-a2739dfc36e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:44:32 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-2e174a54-14bf-45b7-8f82-00039aac0e33 tempest-VolumeQuotasAdminTestJSON-1384570560 None] Created volume successfully. Sep 06 06:44:33 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-2d8687d1-aa72-4d7a-88b5-79b641bf777a tempest-VolumeQuotasAdminTestJSON-1895903858 None] Transfer volume completed successfully. Sep 06 06:44:34 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-981b83fd-e3ad-4245-8337-257ce05478de tempest-VolumeQuotasAdminTestJSON-553092519 None] Acquiring lock "cinder-cd3ef4aa-3320-4b80-a2b1-4a0e83be5849-delete_volume" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:44:34 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-981b83fd-e3ad-4245-8337-257ce05478de tempest-VolumeQuotasAdminTestJSON-553092519 None] Lock "cinder-cd3ef4aa-3320-4b80-a2b1-4a0e83be5849-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:44:34 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-981b83fd-e3ad-4245-8337-257ce05478de tempest-VolumeQuotasAdminTestJSON-553092519 None] Acquiring lock "cinder-quobyte-cd3ef4aa-3320-4b80-a2b1-4a0e83be5849" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:44:34 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-981b83fd-e3ad-4245-8337-257ce05478de tempest-VolumeQuotasAdminTestJSON-553092519 None] Lock "cinder-quobyte-cd3ef4aa-3320-4b80-a2b1-4a0e83be5849" acquired by "delete_volume" :: waited 0.037s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:44:34 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[2619f6f4-19ae-4061-b45a-bf8e7cbd6a4a]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:44:34 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-981b83fd-e3ad-4245-8337-257ce05478de tempest-VolumeQuotasAdminTestJSON-553092519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-cd3ef4aa-3320-4b80-a2b1-4a0e83be5849 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:44:34 devstack sudo[101922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-cd3ef4aa-3320-4b80-a2b1-4a0e83be5849 Sep 06 06:44:34 devstack sudo[101922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:44:35 devstack sudo[101922]: pam_unix(sudo:session): session closed for user root Sep 06 06:44:35 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-981b83fd-e3ad-4245-8337-257ce05478de tempest-VolumeQuotasAdminTestJSON-553092519 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-cd3ef4aa-3320-4b80-a2b1-4a0e83be5849" returned: 0 in 0.535s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:44:35 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-981b83fd-e3ad-4245-8337-257ce05478de tempest-VolumeQuotasAdminTestJSON-553092519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-cd3ef4aa-3320-4b80-a2b1-4a0e83be5849 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:44:35 devstack sudo[101954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-cd3ef4aa-3320-4b80-a2b1-4a0e83be5849 Sep 06 06:44:35 devstack sudo[101954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:44:35 devstack sudo[101954]: pam_unix(sudo:session): session closed for user root Sep 06 06:44:35 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-981b83fd-e3ad-4245-8337-257ce05478de tempest-VolumeQuotasAdminTestJSON-553092519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-cd3ef4aa-3320-4b80-a2b1-4a0e83be5849" returned: 0 in 0.317s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:44:35 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-981b83fd-e3ad-4245-8337-257ce05478de tempest-VolumeQuotasAdminTestJSON-553092519 None] Lock "cinder-quobyte-cd3ef4aa-3320-4b80-a2b1-4a0e83be5849" released by "delete_volume" :: held 0.944s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:44:35 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-981b83fd-e3ad-4245-8337-257ce05478de tempest-VolumeQuotasAdminTestJSON-553092519 None] Created reservations ['4c0c027c-b607-41fe-a0a7-fa42b46a4709', '1e57d856-760d-49bf-b4dc-d73fa1adb331', '3f590181-0c1a-4efb-af82-b43206178001', 'fee6c676-0fbd-48ee-a3da-a09ce65c4e08'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:44:35 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-981b83fd-e3ad-4245-8337-257ce05478de tempest-VolumeQuotasAdminTestJSON-553092519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:44:35 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-981b83fd-e3ad-4245-8337-257ce05478de tempest-VolumeQuotasAdminTestJSON-553092519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:44:35 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-981b83fd-e3ad-4245-8337-257ce05478de tempest-VolumeQuotasAdminTestJSON-553092519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:44:35 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-981b83fd-e3ad-4245-8337-257ce05478de tempest-VolumeQuotasAdminTestJSON-553092519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:44:35 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-981b83fd-e3ad-4245-8337-257ce05478de tempest-VolumeQuotasAdminTestJSON-553092519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:44:35 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-981b83fd-e3ad-4245-8337-257ce05478de tempest-VolumeQuotasAdminTestJSON-553092519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:44:35 devstack sudo[101962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:44:35 devstack sudo[101962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:44:35 devstack sudo[101962]: pam_unix(sudo:session): session closed for user root Sep 06 06:44:35 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-981b83fd-e3ad-4245-8337-257ce05478de tempest-VolumeQuotasAdminTestJSON-553092519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.282s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:44:35 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-981b83fd-e3ad-4245-8337-257ce05478de tempest-VolumeQuotasAdminTestJSON-553092519 None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:44:35 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-981b83fd-e3ad-4245-8337-257ce05478de tempest-VolumeQuotasAdminTestJSON-553092519 None] Deleted volume successfully. Sep 06 06:44:35 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-981b83fd-e3ad-4245-8337-257ce05478de tempest-VolumeQuotasAdminTestJSON-553092519 None] Lock "cinder-cd3ef4aa-3320-4b80-a2b1-4a0e83be5849-delete_volume" released by "delete_volume" :: held 1.534s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:44:45 devstack cinder-volume[87329]: DEBUG dbcounter [-] [87329] Writing DB stats cinder:SELECT=21,cinder:UPDATE=28,cinder:INSERT=8,cinder:DELETE=1 {{(pid=87329) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 06:44:45 devstack cinder-volume[87329]: DEBUG dbcounter [-] [87329] Writing DB stats cinder:UPDATE=28,cinder:SELECT=16,cinder:DELETE=5,cinder:INSERT=4 {{(pid=87329) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 06:44:48 devstack cinder-volume[87329]: DEBUG oslo_service.periodic_task [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87329) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 06 06:44:48 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:44:48 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:44:48 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:44:48 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:44:48 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:44:48 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:44:48 devstack sudo[102024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:44:48 devstack sudo[102024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:44:48 devstack sudo[102024]: pam_unix(sudo:session): session closed for user root Sep 06 06:44:48 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.256s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:44:48 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:44:48 devstack cinder-volume[87329]: DEBUG oslo_service.periodic_task [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Running periodic task VolumeManager._thread_info {{(pid=87329) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 06 06:44:48 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] thread count: 28 {{(pid=87329) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 06 06:44:48 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] thread info: [<_MainThread(MainThread, started 126855043821696)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87329) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 06 06:44:49 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-c38b975f-14f2-4903-9f4f-6e7b8a8edb5f tempest-VolumeTypesAccessTest-1590066801 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87329) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 06:44:49 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-c38b975f-14f2-4903-9f4f-6e7b8a8edb5f tempest-VolumeTypesAccessTest-1590066801 None] Flow 'volume_create_manager' (741c7c47-7d57-4580-bea4-e52c7d2006a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:44:49 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-c38b975f-14f2-4903-9f4f-6e7b8a8edb5f tempest-VolumeTypesAccessTest-1590066801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (142dd225-a5ac-4f09-8c7f-ed484cae4957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:44:49 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-c38b975f-14f2-4903-9f4f-6e7b8a8edb5f tempest-VolumeTypesAccessTest-1590066801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (142dd225-a5ac-4f09-8c7f-ed484cae4957) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:44:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1237414412',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77056c7f-b491-44a6-8511-1fc5b4c0a873,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3609e63e6abb4f2ca69ba89d226a03ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:44:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:44:49Z,use_quota=True,user_id='62a56a527e4e4bcdbcf4b7673a12d1c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(059886ff-39bf-485e-b399-8e6afb78ec4b),volume_type_id=059886ff-39bf-485e-b399-8e6afb78ec4b)' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:44:49 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-c38b975f-14f2-4903-9f4f-6e7b8a8edb5f tempest-VolumeTypesAccessTest-1590066801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c66f006-ad1b-4018-a019-6adfa75d6ad3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:44:49 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-c38b975f-14f2-4903-9f4f-6e7b8a8edb5f tempest-VolumeTypesAccessTest-1590066801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c66f006-ad1b-4018-a019-6adfa75d6ad3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:44:49 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-c38b975f-14f2-4903-9f4f-6e7b8a8edb5f tempest-VolumeTypesAccessTest-1590066801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bcdf649-6a1f-4931-8f95-1c7d5c63cdb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:44:49 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-c38b975f-14f2-4903-9f4f-6e7b8a8edb5f tempest-VolumeTypesAccessTest-1590066801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bcdf649-6a1f-4931-8f95-1c7d5c63cdb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '77056c7f-b491-44a6-8511-1fc5b4c0a873', 'volume_name': 'volume-77056c7f-b491-44a6-8511-1fc5b4c0a873', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:44:49 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-c38b975f-14f2-4903-9f4f-6e7b8a8edb5f tempest-VolumeTypesAccessTest-1590066801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29ad112d-bf7e-4e32-9a9f-57bb09c7f48e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:44:49 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-c38b975f-14f2-4903-9f4f-6e7b8a8edb5f tempest-VolumeTypesAccessTest-1590066801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29ad112d-bf7e-4e32-9a9f-57bb09c7f48e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:44:49 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-c38b975f-14f2-4903-9f4f-6e7b8a8edb5f tempest-VolumeTypesAccessTest-1590066801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7460c802-2554-4460-9f9a-f8a007d2166b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:44:49 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-c38b975f-14f2-4903-9f4f-6e7b8a8edb5f tempest-VolumeTypesAccessTest-1590066801 None] Volume 77056c7f-b491-44a6-8511-1fc5b4c0a873: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-77056c7f-b491-44a6-8511-1fc5b4c0a873', 'volume_size': 1} Sep 06 06:44:49 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-c38b975f-14f2-4903-9f4f-6e7b8a8edb5f tempest-VolumeTypesAccessTest-1590066801 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:44:49 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-c38b975f-14f2-4903-9f4f-6e7b8a8edb5f tempest-VolumeTypesAccessTest-1590066801 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:44:49 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-c38b975f-14f2-4903-9f4f-6e7b8a8edb5f tempest-VolumeTypesAccessTest-1590066801 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:44:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1237414412',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77056c7f-b491-44a6-8511-1fc5b4c0a873,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3609e63e6abb4f2ca69ba89d226a03ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:44:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:44:49Z,use_quota=True,user_id='62a56a527e4e4bcdbcf4b7673a12d1c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(059886ff-39bf-485e-b399-8e6afb78ec4b),volume_type_id=059886ff-39bf-485e-b399-8e6afb78ec4b)}" {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 06:44:49 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-c38b975f-14f2-4903-9f4f-6e7b8a8edb5f tempest-VolumeTypesAccessTest-1590066801 None] Creating volume 77056c7f-b491-44a6-8511-1fc5b4c0a873 {{(pid=87329) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 06:44:49 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-c38b975f-14f2-4903-9f4f-6e7b8a8edb5f tempest-VolumeTypesAccessTest-1590066801 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:44:49 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-c38b975f-14f2-4903-9f4f-6e7b8a8edb5f tempest-VolumeTypesAccessTest-1590066801 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:44:49 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-c38b975f-14f2-4903-9f4f-6e7b8a8edb5f tempest-VolumeTypesAccessTest-1590066801 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:44:49 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-c38b975f-14f2-4903-9f4f-6e7b8a8edb5f tempest-VolumeTypesAccessTest-1590066801 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:44:49 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-c38b975f-14f2-4903-9f4f-6e7b8a8edb5f tempest-VolumeTypesAccessTest-1590066801 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:44:49 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-c38b975f-14f2-4903-9f4f-6e7b8a8edb5f tempest-VolumeTypesAccessTest-1590066801 None] Selected osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 as target Quobyte volume. {{(pid=87329) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 06:44:49 devstack cinder-volume[87329]: INFO cinder.volume.drivers.remotefs [None req-c38b975f-14f2-4903-9f4f-6e7b8a8edb5f tempest-VolumeTypesAccessTest-1590066801 None] casted to osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 Sep 06 06:44:49 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-c38b975f-14f2-4903-9f4f-6e7b8a8edb5f tempest-VolumeTypesAccessTest-1590066801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-77056c7f-b491-44a6-8511-1fc5b4c0a873 1073741824 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:44:49 devstack sudo[102028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-77056c7f-b491-44a6-8511-1fc5b4c0a873 1073741824 Sep 06 06:44:49 devstack sudo[102028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:44:49 devstack sudo[102028]: pam_unix(sudo:session): session closed for user root Sep 06 06:44:49 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-c38b975f-14f2-4903-9f4f-6e7b8a8edb5f tempest-VolumeTypesAccessTest-1590066801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-77056c7f-b491-44a6-8511-1fc5b4c0a873 1073741824" returned: 0 in 0.403s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:44:49 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-c38b975f-14f2-4903-9f4f-6e7b8a8edb5f tempest-VolumeTypesAccessTest-1590066801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-77056c7f-b491-44a6-8511-1fc5b4c0a873 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:44:49 devstack sudo[102035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-77056c7f-b491-44a6-8511-1fc5b4c0a873 Sep 06 06:44:49 devstack sudo[102035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:44:50 devstack sudo[102035]: pam_unix(sudo:session): session closed for user root Sep 06 06:44:50 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-c38b975f-14f2-4903-9f4f-6e7b8a8edb5f tempest-VolumeTypesAccessTest-1590066801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-77056c7f-b491-44a6-8511-1fc5b4c0a873" returned: 0 in 0.252s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:44:50 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-c38b975f-14f2-4903-9f4f-6e7b8a8edb5f tempest-VolumeTypesAccessTest-1590066801 None] <== create_volume: return (694ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'} {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 06:44:50 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-c38b975f-14f2-4903-9f4f-6e7b8a8edb5f tempest-VolumeTypesAccessTest-1590066801 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.696s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:44:50 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-c38b975f-14f2-4903-9f4f-6e7b8a8edb5f tempest-VolumeTypesAccessTest-1590066801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7460c802-2554-4460-9f9a-f8a007d2166b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77056c7f-b491-44a6-8511-1fc5b4c0a873', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:44:50 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-c38b975f-14f2-4903-9f4f-6e7b8a8edb5f tempest-VolumeTypesAccessTest-1590066801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8526f828-17d4-4bfe-b899-498bc536424e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:44:50 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-c38b975f-14f2-4903-9f4f-6e7b8a8edb5f tempest-VolumeTypesAccessTest-1590066801 None] Volume volume-77056c7f-b491-44a6-8511-1fc5b4c0a873 (77056c7f-b491-44a6-8511-1fc5b4c0a873): created successfully Sep 06 06:44:50 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-c38b975f-14f2-4903-9f4f-6e7b8a8edb5f tempest-VolumeTypesAccessTest-1590066801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8526f828-17d4-4bfe-b899-498bc536424e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:44:50 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-c38b975f-14f2-4903-9f4f-6e7b8a8edb5f tempest-VolumeTypesAccessTest-1590066801 None] Flow 'volume_create_manager' (741c7c47-7d57-4580-bea4-e52c7d2006a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:44:50 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-c38b975f-14f2-4903-9f4f-6e7b8a8edb5f tempest-VolumeTypesAccessTest-1590066801 None] Created volume successfully. Sep 06 06:44:50 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-033dd458-e59c-4970-aa12-4c62a079bcf8 tempest-VolumeTypesAccessTest-1590066801 None] Acquiring lock "cinder-77056c7f-b491-44a6-8511-1fc5b4c0a873-delete_volume" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:44:50 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-033dd458-e59c-4970-aa12-4c62a079bcf8 tempest-VolumeTypesAccessTest-1590066801 None] Lock "cinder-77056c7f-b491-44a6-8511-1fc5b4c0a873-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:44:50 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-033dd458-e59c-4970-aa12-4c62a079bcf8 tempest-VolumeTypesAccessTest-1590066801 None] Acquiring lock "cinder-quobyte-77056c7f-b491-44a6-8511-1fc5b4c0a873" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:44:50 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-033dd458-e59c-4970-aa12-4c62a079bcf8 tempest-VolumeTypesAccessTest-1590066801 None] Lock "cinder-quobyte-77056c7f-b491-44a6-8511-1fc5b4c0a873" acquired by "delete_volume" :: waited 0.014s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:44:50 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff726344-f9e1-4cb1-beaf-bed6f6571ad1]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:44:50 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-033dd458-e59c-4970-aa12-4c62a079bcf8 tempest-VolumeTypesAccessTest-1590066801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-77056c7f-b491-44a6-8511-1fc5b4c0a873 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:44:50 devstack sudo[102038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-77056c7f-b491-44a6-8511-1fc5b4c0a873 Sep 06 06:44:50 devstack sudo[102038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:44:50 devstack sudo[102038]: pam_unix(sudo:session): session closed for user root Sep 06 06:44:50 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-033dd458-e59c-4970-aa12-4c62a079bcf8 tempest-VolumeTypesAccessTest-1590066801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-77056c7f-b491-44a6-8511-1fc5b4c0a873" returned: 0 in 0.364s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:44:50 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-033dd458-e59c-4970-aa12-4c62a079bcf8 tempest-VolumeTypesAccessTest-1590066801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-77056c7f-b491-44a6-8511-1fc5b4c0a873 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:44:50 devstack sudo[102044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-77056c7f-b491-44a6-8511-1fc5b4c0a873 Sep 06 06:44:50 devstack sudo[102044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:44:51 devstack sudo[102044]: pam_unix(sudo:session): session closed for user root Sep 06 06:44:51 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-033dd458-e59c-4970-aa12-4c62a079bcf8 tempest-VolumeTypesAccessTest-1590066801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-77056c7f-b491-44a6-8511-1fc5b4c0a873" returned: 0 in 0.249s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:44:51 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-033dd458-e59c-4970-aa12-4c62a079bcf8 tempest-VolumeTypesAccessTest-1590066801 None] Lock "cinder-quobyte-77056c7f-b491-44a6-8511-1fc5b4c0a873" released by "delete_volume" :: held 0.652s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:44:51 devstack cinder-volume[87329]: WARNING cinder.quota [None req-033dd458-e59c-4970-aa12-4c62a079bcf8 tempest-VolumeTypesAccessTest-1590066801 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-620285073 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-620285073, it is now deprecated. Please use the default quota class for default quota. Sep 06 06:44:51 devstack cinder-volume[87329]: WARNING cinder.quota [None req-033dd458-e59c-4970-aa12-4c62a079bcf8 tempest-VolumeTypesAccessTest-1590066801 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-620285073 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-620285073, it is now deprecated. Please use the default quota class for default quota. Sep 06 06:44:51 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-033dd458-e59c-4970-aa12-4c62a079bcf8 tempest-VolumeTypesAccessTest-1590066801 None] Created reservations ['7694ab6f-138e-4e07-b9ed-11d17beee839', '014c0916-8bdd-4f0b-b8f6-609d5f7374ea', '01753ede-4394-4e5c-9c42-c77c37a1c589', 'b209edc6-e01b-4223-bd17-96e04dae14ea'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:44:51 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-033dd458-e59c-4970-aa12-4c62a079bcf8 tempest-VolumeTypesAccessTest-1590066801 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:44:51 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-033dd458-e59c-4970-aa12-4c62a079bcf8 tempest-VolumeTypesAccessTest-1590066801 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:44:51 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-033dd458-e59c-4970-aa12-4c62a079bcf8 tempest-VolumeTypesAccessTest-1590066801 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:44:51 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-033dd458-e59c-4970-aa12-4c62a079bcf8 tempest-VolumeTypesAccessTest-1590066801 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:44:51 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-033dd458-e59c-4970-aa12-4c62a079bcf8 tempest-VolumeTypesAccessTest-1590066801 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:44:51 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-033dd458-e59c-4970-aa12-4c62a079bcf8 tempest-VolumeTypesAccessTest-1590066801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:44:51 devstack sudo[102047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:44:51 devstack sudo[102047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:44:51 devstack sudo[102047]: pam_unix(sudo:session): session closed for user root Sep 06 06:44:51 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-033dd458-e59c-4970-aa12-4c62a079bcf8 tempest-VolumeTypesAccessTest-1590066801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.233s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:44:51 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-033dd458-e59c-4970-aa12-4c62a079bcf8 tempest-VolumeTypesAccessTest-1590066801 None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:44:51 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-033dd458-e59c-4970-aa12-4c62a079bcf8 tempest-VolumeTypesAccessTest-1590066801 None] Deleted volume successfully. Sep 06 06:44:51 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-033dd458-e59c-4970-aa12-4c62a079bcf8 tempest-VolumeTypesAccessTest-1590066801 None] Lock "cinder-77056c7f-b491-44a6-8511-1fc5b4c0a873-delete_volume" released by "delete_volume" :: held 1.066s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:44:59 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [req-7818d865-7465-4105-a672-a7fc9c062e3b req-7f295b05-aa16-4e33-a11d-cd8e9e7e4336 tempest-TestServerVolumeAttachmentScenario-2056758786 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:44:59 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [req-7818d865-7465-4105-a672-a7fc9c062e3b req-7f295b05-aa16-4e33-a11d-cd8e9e7e4336 tempest-TestServerVolumeAttachmentScenario-2056758786 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:44:59 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [req-7818d865-7465-4105-a672-a7fc9c062e3b req-7f295b05-aa16-4e33-a11d-cd8e9e7e4336 tempest-TestServerVolumeAttachmentScenario-2056758786 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:44:59 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [req-7818d865-7465-4105-a672-a7fc9c062e3b req-7f295b05-aa16-4e33-a11d-cd8e9e7e4336 tempest-TestServerVolumeAttachmentScenario-2056758786 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6', 'name': 'volume-babca842-c8ce-4f3b-ba77-bf341af88d90', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cdcd7587-3bc5-4f2b-8e2a-858fb24248dc', 'enforce_multipath': True} {{(pid=87329) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 06 06:44:59 devstack cinder-volume[87329]: INFO cinder.volume.manager [req-7818d865-7465-4105-a672-a7fc9c062e3b req-7f295b05-aa16-4e33-a11d-cd8e9e7e4336 tempest-TestServerVolumeAttachmentScenario-2056758786 None] attachment_update completed successfully. Sep 06 06:45:04 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [req-449f1dd7-ca58-4f92-b114-754ad0c01fb9 req-da045ebf-d736-4655-991b-4f56d0f9bf2f tempest-TestServerVolumeAttachmentScenario-2056758786 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:45:04 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [req-449f1dd7-ca58-4f92-b114-754ad0c01fb9 req-da045ebf-d736-4655-991b-4f56d0f9bf2f tempest-TestServerVolumeAttachmentScenario-2056758786 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:45:04 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [req-449f1dd7-ca58-4f92-b114-754ad0c01fb9 req-da045ebf-d736-4655-991b-4f56d0f9bf2f tempest-TestServerVolumeAttachmentScenario-2056758786 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:45:04 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [req-449f1dd7-ca58-4f92-b114-754ad0c01fb9 req-da045ebf-d736-4655-991b-4f56d0f9bf2f tempest-TestServerVolumeAttachmentScenario-2056758786 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6', 'name': 'volume-be4b465f-1cdb-499f-a56a-9addf4cbc513', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8aedf771-d86b-4935-84f6-329034bc104c', 'enforce_multipath': True} {{(pid=87329) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 06 06:45:04 devstack cinder-volume[87329]: INFO cinder.volume.manager [req-449f1dd7-ca58-4f92-b114-754ad0c01fb9 req-da045ebf-d736-4655-991b-4f56d0f9bf2f tempest-TestServerVolumeAttachmentScenario-2056758786 None] attachment_update completed successfully. Sep 06 06:45:06 devstack cinder-volume[87329]: INFO cinder.volume.manager [req-d91c8712-8c63-4926-9ff7-c7ad2f8b23e0 req-ca19571d-0371-446a-839b-eb3828168507 tempest-TestServerVolumeAttachmentScenario-2056758786 None] Terminate volume connection completed successfully. Sep 06 06:45:06 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [req-d91c8712-8c63-4926-9ff7-c7ad2f8b23e0 req-ca19571d-0371-446a-839b-eb3828168507 tempest-TestServerVolumeAttachmentScenario-2056758786 None] Deleting attachment 8aedf771-d86b-4935-84f6-329034bc104c. {{(pid=87329) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 06 06:45:07 devstack cinder-volume[87329]: INFO cinder.volume.manager [req-fb8b79f1-6746-40af-9446-6f3da1348608 req-a6c6532c-0c25-4e4d-ba87-385c9dd3c5d6 tempest-TestServerVolumeAttachmentScenario-2056758786 None] Terminate volume connection completed successfully. Sep 06 06:45:07 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [req-fb8b79f1-6746-40af-9446-6f3da1348608 req-a6c6532c-0c25-4e4d-ba87-385c9dd3c5d6 tempest-TestServerVolumeAttachmentScenario-2056758786 None] Deleting attachment cdcd7587-3bc5-4f2b-8e2a-858fb24248dc. {{(pid=87329) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 06 06:45:13 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-db603cb5-b2ba-464d-8a9a-11a09df37e6b tempest-TestServerVolumeAttachmentScenario-2056758786 None] Acquiring lock "cinder-be4b465f-1cdb-499f-a56a-9addf4cbc513-delete_volume" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:45:13 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-db603cb5-b2ba-464d-8a9a-11a09df37e6b tempest-TestServerVolumeAttachmentScenario-2056758786 None] Lock "cinder-be4b465f-1cdb-499f-a56a-9addf4cbc513-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:45:13 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-db603cb5-b2ba-464d-8a9a-11a09df37e6b tempest-TestServerVolumeAttachmentScenario-2056758786 None] Acquiring lock "cinder-quobyte-be4b465f-1cdb-499f-a56a-9addf4cbc513" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:45:13 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-db603cb5-b2ba-464d-8a9a-11a09df37e6b tempest-TestServerVolumeAttachmentScenario-2056758786 None] Lock "cinder-quobyte-be4b465f-1cdb-499f-a56a-9addf4cbc513" acquired by "delete_volume" :: waited 0.025s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:45:13 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a58eb9d-e988-47c3-9728-ea752b295622]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:45:13 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-db603cb5-b2ba-464d-8a9a-11a09df37e6b tempest-TestServerVolumeAttachmentScenario-2056758786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-be4b465f-1cdb-499f-a56a-9addf4cbc513 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:45:13 devstack sudo[102527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-be4b465f-1cdb-499f-a56a-9addf4cbc513 Sep 06 06:45:13 devstack sudo[102527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:45:13 devstack sudo[102527]: pam_unix(sudo:session): session closed for user root Sep 06 06:45:13 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-db603cb5-b2ba-464d-8a9a-11a09df37e6b tempest-TestServerVolumeAttachmentScenario-2056758786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-be4b465f-1cdb-499f-a56a-9addf4cbc513" returned: 0 in 0.424s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:45:13 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-db603cb5-b2ba-464d-8a9a-11a09df37e6b tempest-TestServerVolumeAttachmentScenario-2056758786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-be4b465f-1cdb-499f-a56a-9addf4cbc513 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:45:13 devstack sudo[102532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-be4b465f-1cdb-499f-a56a-9addf4cbc513 Sep 06 06:45:13 devstack sudo[102532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:45:14 devstack sudo[102532]: pam_unix(sudo:session): session closed for user root Sep 06 06:45:14 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-db603cb5-b2ba-464d-8a9a-11a09df37e6b tempest-TestServerVolumeAttachmentScenario-2056758786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-be4b465f-1cdb-499f-a56a-9addf4cbc513" returned: 0 in 0.252s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:45:14 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-db603cb5-b2ba-464d-8a9a-11a09df37e6b tempest-TestServerVolumeAttachmentScenario-2056758786 None] Lock "cinder-quobyte-be4b465f-1cdb-499f-a56a-9addf4cbc513" released by "delete_volume" :: held 0.729s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:45:14 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-db603cb5-b2ba-464d-8a9a-11a09df37e6b tempest-TestServerVolumeAttachmentScenario-2056758786 None] Created reservations ['da9a22a4-fd67-4b1b-952b-656dd8d85807', '1741c6e8-33b3-4cb7-88ce-e35c19d1a9f3', 'c85afdbb-1d6f-4548-a6d6-3c98895e2813', 'ecd7e7b6-395a-48f3-889d-4328ae8dd409'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:45:14 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-db603cb5-b2ba-464d-8a9a-11a09df37e6b tempest-TestServerVolumeAttachmentScenario-2056758786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:45:14 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-db603cb5-b2ba-464d-8a9a-11a09df37e6b tempest-TestServerVolumeAttachmentScenario-2056758786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:45:14 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-db603cb5-b2ba-464d-8a9a-11a09df37e6b tempest-TestServerVolumeAttachmentScenario-2056758786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:45:14 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-db603cb5-b2ba-464d-8a9a-11a09df37e6b tempest-TestServerVolumeAttachmentScenario-2056758786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:45:14 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-db603cb5-b2ba-464d-8a9a-11a09df37e6b tempest-TestServerVolumeAttachmentScenario-2056758786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:45:14 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-db603cb5-b2ba-464d-8a9a-11a09df37e6b tempest-TestServerVolumeAttachmentScenario-2056758786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:45:14 devstack sudo[102535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:45:14 devstack sudo[102535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:45:14 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-81e527b1-468d-434c-b1e6-e63ebcf1bcc0 tempest-TestServerVolumeAttachmentScenario-2056758786 None] Acquiring lock "cinder-babca842-c8ce-4f3b-ba77-bf341af88d90-delete_volume" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:45:14 devstack sudo[102535]: pam_unix(sudo:session): session closed for user root Sep 06 06:45:14 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-db603cb5-b2ba-464d-8a9a-11a09df37e6b tempest-TestServerVolumeAttachmentScenario-2056758786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.258s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:45:14 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-db603cb5-b2ba-464d-8a9a-11a09df37e6b tempest-TestServerVolumeAttachmentScenario-2056758786 None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:45:14 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-81e527b1-468d-434c-b1e6-e63ebcf1bcc0 tempest-TestServerVolumeAttachmentScenario-2056758786 None] Lock "cinder-babca842-c8ce-4f3b-ba77-bf341af88d90-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:45:14 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-db603cb5-b2ba-464d-8a9a-11a09df37e6b tempest-TestServerVolumeAttachmentScenario-2056758786 None] Deleted volume successfully. Sep 06 06:45:14 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-db603cb5-b2ba-464d-8a9a-11a09df37e6b tempest-TestServerVolumeAttachmentScenario-2056758786 None] Lock "cinder-be4b465f-1cdb-499f-a56a-9addf4cbc513-delete_volume" released by "delete_volume" :: held 1.227s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:45:14 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-81e527b1-468d-434c-b1e6-e63ebcf1bcc0 tempest-TestServerVolumeAttachmentScenario-2056758786 None] Acquiring lock "cinder-quobyte-babca842-c8ce-4f3b-ba77-bf341af88d90" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:45:14 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-81e527b1-468d-434c-b1e6-e63ebcf1bcc0 tempest-TestServerVolumeAttachmentScenario-2056758786 None] Lock "cinder-quobyte-babca842-c8ce-4f3b-ba77-bf341af88d90" acquired by "delete_volume" :: waited 0.026s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:45:14 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[59a2d2c2-1406-4466-8fff-0a73e9209f20]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:45:14 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-81e527b1-468d-434c-b1e6-e63ebcf1bcc0 tempest-TestServerVolumeAttachmentScenario-2056758786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-babca842-c8ce-4f3b-ba77-bf341af88d90 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:45:14 devstack sudo[102538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-babca842-c8ce-4f3b-ba77-bf341af88d90 Sep 06 06:45:14 devstack sudo[102538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:45:14 devstack sudo[102538]: pam_unix(sudo:session): session closed for user root Sep 06 06:45:14 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-81e527b1-468d-434c-b1e6-e63ebcf1bcc0 tempest-TestServerVolumeAttachmentScenario-2056758786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-babca842-c8ce-4f3b-ba77-bf341af88d90" returned: 0 in 0.383s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:45:14 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-81e527b1-468d-434c-b1e6-e63ebcf1bcc0 tempest-TestServerVolumeAttachmentScenario-2056758786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-babca842-c8ce-4f3b-ba77-bf341af88d90 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:45:15 devstack sudo[102543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-babca842-c8ce-4f3b-ba77-bf341af88d90 Sep 06 06:45:15 devstack sudo[102543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:45:15 devstack sudo[102543]: pam_unix(sudo:session): session closed for user root Sep 06 06:45:15 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-81e527b1-468d-434c-b1e6-e63ebcf1bcc0 tempest-TestServerVolumeAttachmentScenario-2056758786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-babca842-c8ce-4f3b-ba77-bf341af88d90" returned: 0 in 0.254s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:45:15 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-81e527b1-468d-434c-b1e6-e63ebcf1bcc0 tempest-TestServerVolumeAttachmentScenario-2056758786 None] Lock "cinder-quobyte-babca842-c8ce-4f3b-ba77-bf341af88d90" released by "delete_volume" :: held 0.697s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:45:15 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-81e527b1-468d-434c-b1e6-e63ebcf1bcc0 tempest-TestServerVolumeAttachmentScenario-2056758786 None] Created reservations ['76ddba4e-154e-43a8-bc4a-6524630d2103', 'c1fafb62-269d-484d-b6ab-82a4e219c5c5', '823098b3-ed0e-4a91-a764-94bc0048cc6b', '2a17e4dd-f73e-4706-b422-be9ded88f049'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:45:15 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-81e527b1-468d-434c-b1e6-e63ebcf1bcc0 tempest-TestServerVolumeAttachmentScenario-2056758786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:45:15 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-81e527b1-468d-434c-b1e6-e63ebcf1bcc0 tempest-TestServerVolumeAttachmentScenario-2056758786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:45:15 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-81e527b1-468d-434c-b1e6-e63ebcf1bcc0 tempest-TestServerVolumeAttachmentScenario-2056758786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:45:15 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-81e527b1-468d-434c-b1e6-e63ebcf1bcc0 tempest-TestServerVolumeAttachmentScenario-2056758786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:45:15 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-81e527b1-468d-434c-b1e6-e63ebcf1bcc0 tempest-TestServerVolumeAttachmentScenario-2056758786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:45:15 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-81e527b1-468d-434c-b1e6-e63ebcf1bcc0 tempest-TestServerVolumeAttachmentScenario-2056758786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:45:15 devstack sudo[102546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:45:15 devstack sudo[102546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:45:15 devstack sudo[102546]: pam_unix(sudo:session): session closed for user root Sep 06 06:45:15 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-81e527b1-468d-434c-b1e6-e63ebcf1bcc0 tempest-TestServerVolumeAttachmentScenario-2056758786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.277s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:45:15 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-81e527b1-468d-434c-b1e6-e63ebcf1bcc0 tempest-TestServerVolumeAttachmentScenario-2056758786 None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:45:15 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-81e527b1-468d-434c-b1e6-e63ebcf1bcc0 tempest-TestServerVolumeAttachmentScenario-2056758786 None] Deleted volume successfully. Sep 06 06:45:15 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-81e527b1-468d-434c-b1e6-e63ebcf1bcc0 tempest-TestServerVolumeAttachmentScenario-2056758786 None] Lock "cinder-babca842-c8ce-4f3b-ba77-bf341af88d90-delete_volume" released by "delete_volume" :: held 1.202s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:45:25 devstack cinder-volume[87329]: DEBUG dbcounter [-] [87329] Writing DB stats cinder:UPDATE=29,cinder:SELECT=32,cinder:DELETE=1,cinder:INSERT=6 {{(pid=87329) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 06:45:25 devstack cinder-volume[87329]: DEBUG dbcounter [-] [87329] Writing DB stats cinder:SELECT=32,cinder:UPDATE=31,cinder:INSERT=7,cinder:DELETE=3 {{(pid=87329) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 06:45:32 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0a4eada-fbc0-4327-8d19-f9203a2da8fa tempest-VolumesActionsTest-1485152331 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87329) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 06:45:32 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-a0a4eada-fbc0-4327-8d19-f9203a2da8fa tempest-VolumesActionsTest-1485152331 None] Flow 'volume_create_manager' (235bdcdb-52ea-4d34-bb04-964a679182a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:45:32 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-a0a4eada-fbc0-4327-8d19-f9203a2da8fa tempest-VolumesActionsTest-1485152331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37bda7d8-c46f-4052-875f-6ed349f9d998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:45:32 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-a0a4eada-fbc0-4327-8d19-f9203a2da8fa tempest-VolumesActionsTest-1485152331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37bda7d8-c46f-4052-875f-6ed349f9d998) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:45:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1557043279',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae893ecd-47c3-4107-aa9e-3b37d9b7cb0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aef2ed6a5f9f4754b454036150084cbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:45:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:45:32Z,use_quota=True,user_id='19d138a7c9474a91a73e4e2ab698c0a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:45:32 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-a0a4eada-fbc0-4327-8d19-f9203a2da8fa tempest-VolumesActionsTest-1485152331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68400ca0-a347-474c-9b66-07721f2e74de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:45:32 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-a0a4eada-fbc0-4327-8d19-f9203a2da8fa tempest-VolumesActionsTest-1485152331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68400ca0-a347-474c-9b66-07721f2e74de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:45:32 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-a0a4eada-fbc0-4327-8d19-f9203a2da8fa tempest-VolumesActionsTest-1485152331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e9627be-faf2-454c-a4d7-3ecb3577e7c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:45:32 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-a0a4eada-fbc0-4327-8d19-f9203a2da8fa tempest-VolumesActionsTest-1485152331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e9627be-faf2-454c-a4d7-3ecb3577e7c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae893ecd-47c3-4107-aa9e-3b37d9b7cb0f', 'volume_name': 'volume-ae893ecd-47c3-4107-aa9e-3b37d9b7cb0f', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:45:32 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-a0a4eada-fbc0-4327-8d19-f9203a2da8fa tempest-VolumesActionsTest-1485152331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5152976e-d6b3-476a-9934-1c7e26314646) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:45:32 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-a0a4eada-fbc0-4327-8d19-f9203a2da8fa tempest-VolumesActionsTest-1485152331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5152976e-d6b3-476a-9934-1c7e26314646) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:45:32 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-a0a4eada-fbc0-4327-8d19-f9203a2da8fa tempest-VolumesActionsTest-1485152331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96572ea6-f197-4d13-8f76-543ceb3196d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:45:32 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-a0a4eada-fbc0-4327-8d19-f9203a2da8fa tempest-VolumesActionsTest-1485152331 None] Volume ae893ecd-47c3-4107-aa9e-3b37d9b7cb0f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae893ecd-47c3-4107-aa9e-3b37d9b7cb0f', 'volume_size': 1} Sep 06 06:45:32 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-a0a4eada-fbc0-4327-8d19-f9203a2da8fa tempest-VolumesActionsTest-1485152331 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:45:32 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-a0a4eada-fbc0-4327-8d19-f9203a2da8fa tempest-VolumesActionsTest-1485152331 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:45:32 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-a0a4eada-fbc0-4327-8d19-f9203a2da8fa tempest-VolumesActionsTest-1485152331 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:45:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1557043279',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae893ecd-47c3-4107-aa9e-3b37d9b7cb0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aef2ed6a5f9f4754b454036150084cbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:45:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:45:32Z,use_quota=True,user_id='19d138a7c9474a91a73e4e2ab698c0a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)}" {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 06:45:32 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-a0a4eada-fbc0-4327-8d19-f9203a2da8fa tempest-VolumesActionsTest-1485152331 None] Creating volume ae893ecd-47c3-4107-aa9e-3b37d9b7cb0f {{(pid=87329) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 06:45:32 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-a0a4eada-fbc0-4327-8d19-f9203a2da8fa tempest-VolumesActionsTest-1485152331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:45:32 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-a0a4eada-fbc0-4327-8d19-f9203a2da8fa tempest-VolumesActionsTest-1485152331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:45:32 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-a0a4eada-fbc0-4327-8d19-f9203a2da8fa tempest-VolumesActionsTest-1485152331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:45:32 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-a0a4eada-fbc0-4327-8d19-f9203a2da8fa tempest-VolumesActionsTest-1485152331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:45:32 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-a0a4eada-fbc0-4327-8d19-f9203a2da8fa tempest-VolumesActionsTest-1485152331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:45:32 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-a0a4eada-fbc0-4327-8d19-f9203a2da8fa tempest-VolumesActionsTest-1485152331 None] Selected osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 as target Quobyte volume. {{(pid=87329) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 06:45:32 devstack cinder-volume[87329]: INFO cinder.volume.drivers.remotefs [None req-a0a4eada-fbc0-4327-8d19-f9203a2da8fa tempest-VolumesActionsTest-1485152331 None] casted to osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 Sep 06 06:45:32 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-a0a4eada-fbc0-4327-8d19-f9203a2da8fa tempest-VolumesActionsTest-1485152331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-ae893ecd-47c3-4107-aa9e-3b37d9b7cb0f 1073741824 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:45:32 devstack sudo[102643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-ae893ecd-47c3-4107-aa9e-3b37d9b7cb0f 1073741824 Sep 06 06:45:32 devstack sudo[102643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:45:32 devstack sudo[102643]: pam_unix(sudo:session): session closed for user root Sep 06 06:45:32 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-a0a4eada-fbc0-4327-8d19-f9203a2da8fa tempest-VolumesActionsTest-1485152331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-ae893ecd-47c3-4107-aa9e-3b37d9b7cb0f 1073741824" returned: 0 in 0.591s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:45:33 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-a0a4eada-fbc0-4327-8d19-f9203a2da8fa tempest-VolumesActionsTest-1485152331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-ae893ecd-47c3-4107-aa9e-3b37d9b7cb0f {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:45:33 devstack sudo[102649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-ae893ecd-47c3-4107-aa9e-3b37d9b7cb0f Sep 06 06:45:33 devstack sudo[102649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:45:33 devstack sudo[102649]: pam_unix(sudo:session): session closed for user root Sep 06 06:45:33 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-a0a4eada-fbc0-4327-8d19-f9203a2da8fa tempest-VolumesActionsTest-1485152331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-ae893ecd-47c3-4107-aa9e-3b37d9b7cb0f" returned: 0 in 0.251s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:45:33 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-a0a4eada-fbc0-4327-8d19-f9203a2da8fa tempest-VolumesActionsTest-1485152331 None] <== create_volume: return (884ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'} {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 06:45:33 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-a0a4eada-fbc0-4327-8d19-f9203a2da8fa tempest-VolumesActionsTest-1485152331 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.887s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:45:33 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-a0a4eada-fbc0-4327-8d19-f9203a2da8fa tempest-VolumesActionsTest-1485152331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96572ea6-f197-4d13-8f76-543ceb3196d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae893ecd-47c3-4107-aa9e-3b37d9b7cb0f', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:45:33 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-a0a4eada-fbc0-4327-8d19-f9203a2da8fa tempest-VolumesActionsTest-1485152331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69839ea6-1124-43c5-97e7-0b070d527dd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:45:33 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-a0a4eada-fbc0-4327-8d19-f9203a2da8fa tempest-VolumesActionsTest-1485152331 None] Volume volume-ae893ecd-47c3-4107-aa9e-3b37d9b7cb0f (ae893ecd-47c3-4107-aa9e-3b37d9b7cb0f): created successfully Sep 06 06:45:33 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-a0a4eada-fbc0-4327-8d19-f9203a2da8fa tempest-VolumesActionsTest-1485152331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69839ea6-1124-43c5-97e7-0b070d527dd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:45:33 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-a0a4eada-fbc0-4327-8d19-f9203a2da8fa tempest-VolumesActionsTest-1485152331 None] Flow 'volume_create_manager' (235bdcdb-52ea-4d34-bb04-964a679182a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:45:33 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-a0a4eada-fbc0-4327-8d19-f9203a2da8fa tempest-VolumesActionsTest-1485152331 None] Created volume successfully. Sep 06 06:45:34 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-ccd3ff0d-101f-459f-86da-7e7f13786956 tempest-VolumesActionsTest-1485152331 None] Acquiring lock "cinder-ae893ecd-47c3-4107-aa9e-3b37d9b7cb0f" by "attach_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:45:34 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-ccd3ff0d-101f-459f-86da-7e7f13786956 tempest-VolumesActionsTest-1485152331 None] Lock "cinder-ae893ecd-47c3-4107-aa9e-3b37d9b7cb0f" acquired by "attach_volume" :: waited 0.021s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:45:34 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-ccd3ff0d-101f-459f-86da-7e7f13786956 tempest-VolumesActionsTest-1485152331 None] Attaching volume ae893ecd-47c3-4107-aa9e-3b37d9b7cb0f to instance 58c83047-25fe-48c4-afe3-dd4536b9adf0 at mountpoint /dev/vdb on host None. Sep 06 06:45:34 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-ccd3ff0d-101f-459f-86da-7e7f13786956 tempest-VolumesActionsTest-1485152331 None] Attach volume completed successfully. Sep 06 06:45:34 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-ccd3ff0d-101f-459f-86da-7e7f13786956 tempest-VolumesActionsTest-1485152331 None] Lock "cinder-ae893ecd-47c3-4107-aa9e-3b37d9b7cb0f" released by "attach_volume" :: held 0.101s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:45:35 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-269db1ae-b1dc-4c01-8f60-862aa55ce180 tempest-VolumesActionsTest-313663387 None] Terminate volume connection completed successfully. Sep 06 06:45:35 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-269db1ae-b1dc-4c01-8f60-862aa55ce180 tempest-VolumesActionsTest-313663387 None] Acquiring lock "cinder-ae893ecd-47c3-4107-aa9e-3b37d9b7cb0f-detach_volume" by "detach_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:45:35 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-269db1ae-b1dc-4c01-8f60-862aa55ce180 tempest-VolumesActionsTest-313663387 None] Lock "cinder-ae893ecd-47c3-4107-aa9e-3b37d9b7cb0f-detach_volume" acquired by "detach_volume" :: waited 0.014s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:45:35 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-269db1ae-b1dc-4c01-8f60-862aa55ce180 tempest-VolumesActionsTest-313663387 None] Detaching volume ae893ecd-47c3-4107-aa9e-3b37d9b7cb0f from instance 58c83047-25fe-48c4-afe3-dd4536b9adf0. Sep 06 06:45:35 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-269db1ae-b1dc-4c01-8f60-862aa55ce180 tempest-VolumesActionsTest-313663387 None] Detach volume completed successfully. Sep 06 06:45:35 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-269db1ae-b1dc-4c01-8f60-862aa55ce180 tempest-VolumesActionsTest-313663387 None] Lock "cinder-ae893ecd-47c3-4107-aa9e-3b37d9b7cb0f-detach_volume" released by "detach_volume" :: held 0.083s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:45:35 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-53453c7e-c144-43a0-9472-9ae5b221e5e8 tempest-VolumesActionsTest-1485152331 None] Acquiring lock "cinder-ae893ecd-47c3-4107-aa9e-3b37d9b7cb0f-detach_volume" by "detach_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:45:35 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-53453c7e-c144-43a0-9472-9ae5b221e5e8 tempest-VolumesActionsTest-1485152331 None] Lock "cinder-ae893ecd-47c3-4107-aa9e-3b37d9b7cb0f-detach_volume" acquired by "detach_volume" :: waited 0.024s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:45:35 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-53453c7e-c144-43a0-9472-9ae5b221e5e8 tempest-VolumesActionsTest-1485152331 None] Volume detach called, but volume not attached. Sep 06 06:45:35 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-53453c7e-c144-43a0-9472-9ae5b221e5e8 tempest-VolumesActionsTest-1485152331 None] Lock "cinder-ae893ecd-47c3-4107-aa9e-3b37d9b7cb0f-detach_volume" released by "detach_volume" :: held 0.027s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:45:35 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-9196ba81-9ec1-4203-9f89-d2c7c1b34f5a tempest-VolumesActionsTest-1485152331 None] Acquiring lock "cinder-ae893ecd-47c3-4107-aa9e-3b37d9b7cb0f-delete_volume" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:45:35 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-9196ba81-9ec1-4203-9f89-d2c7c1b34f5a tempest-VolumesActionsTest-1485152331 None] Lock "cinder-ae893ecd-47c3-4107-aa9e-3b37d9b7cb0f-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:45:35 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-9196ba81-9ec1-4203-9f89-d2c7c1b34f5a tempest-VolumesActionsTest-1485152331 None] Acquiring lock "cinder-quobyte-ae893ecd-47c3-4107-aa9e-3b37d9b7cb0f" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:45:35 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-9196ba81-9ec1-4203-9f89-d2c7c1b34f5a tempest-VolumesActionsTest-1485152331 None] Lock "cinder-quobyte-ae893ecd-47c3-4107-aa9e-3b37d9b7cb0f" acquired by "delete_volume" :: waited 0.017s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:45:35 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e498aff-c699-4e1a-bafa-4094703c0ed6]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:45:35 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-9196ba81-9ec1-4203-9f89-d2c7c1b34f5a tempest-VolumesActionsTest-1485152331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-ae893ecd-47c3-4107-aa9e-3b37d9b7cb0f {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:45:36 devstack sudo[102652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-ae893ecd-47c3-4107-aa9e-3b37d9b7cb0f Sep 06 06:45:36 devstack sudo[102652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:45:36 devstack sudo[102652]: pam_unix(sudo:session): session closed for user root Sep 06 06:45:36 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-9196ba81-9ec1-4203-9f89-d2c7c1b34f5a tempest-VolumesActionsTest-1485152331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-ae893ecd-47c3-4107-aa9e-3b37d9b7cb0f" returned: 0 in 0.389s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:45:36 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-9196ba81-9ec1-4203-9f89-d2c7c1b34f5a tempest-VolumesActionsTest-1485152331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-ae893ecd-47c3-4107-aa9e-3b37d9b7cb0f {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:45:36 devstack sudo[102657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-ae893ecd-47c3-4107-aa9e-3b37d9b7cb0f Sep 06 06:45:36 devstack sudo[102657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:45:36 devstack sudo[102657]: pam_unix(sudo:session): session closed for user root Sep 06 06:45:36 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-9196ba81-9ec1-4203-9f89-d2c7c1b34f5a tempest-VolumesActionsTest-1485152331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-ae893ecd-47c3-4107-aa9e-3b37d9b7cb0f" returned: 0 in 0.260s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:45:36 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-9196ba81-9ec1-4203-9f89-d2c7c1b34f5a tempest-VolumesActionsTest-1485152331 None] Lock "cinder-quobyte-ae893ecd-47c3-4107-aa9e-3b37d9b7cb0f" released by "delete_volume" :: held 0.695s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:45:36 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-9196ba81-9ec1-4203-9f89-d2c7c1b34f5a tempest-VolumesActionsTest-1485152331 None] Created reservations ['38592eb7-0cd4-4d53-bb7a-c1504ae1bd33', 'b0fd0145-cc65-42fe-831a-d555cd7351ea', 'b0ecbbb4-3a18-4131-b520-b7535739773f', 'e05a9982-a1b8-4c9f-bf75-81dd511033c1'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:45:36 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-9196ba81-9ec1-4203-9f89-d2c7c1b34f5a tempest-VolumesActionsTest-1485152331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:45:36 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-9196ba81-9ec1-4203-9f89-d2c7c1b34f5a tempest-VolumesActionsTest-1485152331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:45:36 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-9196ba81-9ec1-4203-9f89-d2c7c1b34f5a tempest-VolumesActionsTest-1485152331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:45:36 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-9196ba81-9ec1-4203-9f89-d2c7c1b34f5a tempest-VolumesActionsTest-1485152331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:45:36 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-9196ba81-9ec1-4203-9f89-d2c7c1b34f5a tempest-VolumesActionsTest-1485152331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:45:36 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-9196ba81-9ec1-4203-9f89-d2c7c1b34f5a tempest-VolumesActionsTest-1485152331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:45:36 devstack sudo[102660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:45:36 devstack sudo[102660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:45:37 devstack sudo[102660]: pam_unix(sudo:session): session closed for user root Sep 06 06:45:37 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-9196ba81-9ec1-4203-9f89-d2c7c1b34f5a tempest-VolumesActionsTest-1485152331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.304s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:45:37 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-9196ba81-9ec1-4203-9f89-d2c7c1b34f5a tempest-VolumesActionsTest-1485152331 None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:45:37 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-9196ba81-9ec1-4203-9f89-d2c7c1b34f5a tempest-VolumesActionsTest-1485152331 None] Deleted volume successfully. Sep 06 06:45:37 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-9196ba81-9ec1-4203-9f89-d2c7c1b34f5a tempest-VolumesActionsTest-1485152331 None] Lock "cinder-ae893ecd-47c3-4107-aa9e-3b37d9b7cb0f-delete_volume" released by "delete_volume" :: held 1.349s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:45:40 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b1e06a0-55b3-4010-b484-854da667dd86 tempest-VolumesActionsTest-1485152331 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87329) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 06:45:40 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-5b1e06a0-55b3-4010-b484-854da667dd86 tempest-VolumesActionsTest-1485152331 None] Flow 'volume_create_manager' (d23a69a1-3343-40cb-8fab-ba62f8cf56ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:45:40 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-5b1e06a0-55b3-4010-b484-854da667dd86 tempest-VolumesActionsTest-1485152331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50db125f-e8c9-4eba-89f8-ad101c4c709b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:45:40 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-5b1e06a0-55b3-4010-b484-854da667dd86 tempest-VolumesActionsTest-1485152331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50db125f-e8c9-4eba-89f8-ad101c4c709b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:45:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1620500672',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6ee743d-7222-414f-9901-6b65a2cc34e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aef2ed6a5f9f4754b454036150084cbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:45:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:45:41Z,use_quota=True,user_id='19d138a7c9474a91a73e4e2ab698c0a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:45:40 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-5b1e06a0-55b3-4010-b484-854da667dd86 tempest-VolumesActionsTest-1485152331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8402a2d3-da93-479a-b379-080b1db27975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:45:40 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-5b1e06a0-55b3-4010-b484-854da667dd86 tempest-VolumesActionsTest-1485152331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8402a2d3-da93-479a-b379-080b1db27975) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:45:40 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-5b1e06a0-55b3-4010-b484-854da667dd86 tempest-VolumesActionsTest-1485152331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95e704cb-64d6-4148-8e21-e74aceb21438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:45:40 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-5b1e06a0-55b3-4010-b484-854da667dd86 tempest-VolumesActionsTest-1485152331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95e704cb-64d6-4148-8e21-e74aceb21438) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6ee743d-7222-414f-9901-6b65a2cc34e3', 'volume_name': 'volume-c6ee743d-7222-414f-9901-6b65a2cc34e3', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:45:40 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-5b1e06a0-55b3-4010-b484-854da667dd86 tempest-VolumesActionsTest-1485152331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38c164b5-160e-4012-ac12-c90fa2f4dd54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:45:40 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-5b1e06a0-55b3-4010-b484-854da667dd86 tempest-VolumesActionsTest-1485152331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38c164b5-160e-4012-ac12-c90fa2f4dd54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:45:40 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-5b1e06a0-55b3-4010-b484-854da667dd86 tempest-VolumesActionsTest-1485152331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b22eee13-537b-4d70-80c2-3f53999416c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:45:40 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-5b1e06a0-55b3-4010-b484-854da667dd86 tempest-VolumesActionsTest-1485152331 None] Volume c6ee743d-7222-414f-9901-6b65a2cc34e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6ee743d-7222-414f-9901-6b65a2cc34e3', 'volume_size': 1} Sep 06 06:45:40 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-5b1e06a0-55b3-4010-b484-854da667dd86 tempest-VolumesActionsTest-1485152331 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:45:40 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-5b1e06a0-55b3-4010-b484-854da667dd86 tempest-VolumesActionsTest-1485152331 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:45:40 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-5b1e06a0-55b3-4010-b484-854da667dd86 tempest-VolumesActionsTest-1485152331 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:45:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1620500672',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6ee743d-7222-414f-9901-6b65a2cc34e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aef2ed6a5f9f4754b454036150084cbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:45:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:45:41Z,use_quota=True,user_id='19d138a7c9474a91a73e4e2ab698c0a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)}" {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 06:45:40 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-5b1e06a0-55b3-4010-b484-854da667dd86 tempest-VolumesActionsTest-1485152331 None] Creating volume c6ee743d-7222-414f-9901-6b65a2cc34e3 {{(pid=87329) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 06:45:40 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-5b1e06a0-55b3-4010-b484-854da667dd86 tempest-VolumesActionsTest-1485152331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:45:40 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-5b1e06a0-55b3-4010-b484-854da667dd86 tempest-VolumesActionsTest-1485152331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:45:40 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-5b1e06a0-55b3-4010-b484-854da667dd86 tempest-VolumesActionsTest-1485152331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:45:40 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-5b1e06a0-55b3-4010-b484-854da667dd86 tempest-VolumesActionsTest-1485152331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:45:40 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-5b1e06a0-55b3-4010-b484-854da667dd86 tempest-VolumesActionsTest-1485152331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:45:40 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-5b1e06a0-55b3-4010-b484-854da667dd86 tempest-VolumesActionsTest-1485152331 None] Selected osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 as target Quobyte volume. {{(pid=87329) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 06:45:40 devstack cinder-volume[87329]: INFO cinder.volume.drivers.remotefs [None req-5b1e06a0-55b3-4010-b484-854da667dd86 tempest-VolumesActionsTest-1485152331 None] casted to osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 Sep 06 06:45:40 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-5b1e06a0-55b3-4010-b484-854da667dd86 tempest-VolumesActionsTest-1485152331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-c6ee743d-7222-414f-9901-6b65a2cc34e3 1073741824 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:45:40 devstack sudo[102687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-c6ee743d-7222-414f-9901-6b65a2cc34e3 1073741824 Sep 06 06:45:40 devstack sudo[102687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:45:41 devstack sudo[102687]: pam_unix(sudo:session): session closed for user root Sep 06 06:45:41 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-5b1e06a0-55b3-4010-b484-854da667dd86 tempest-VolumesActionsTest-1485152331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-c6ee743d-7222-414f-9901-6b65a2cc34e3 1073741824" returned: 0 in 0.448s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:45:41 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-5b1e06a0-55b3-4010-b484-854da667dd86 tempest-VolumesActionsTest-1485152331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-c6ee743d-7222-414f-9901-6b65a2cc34e3 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:45:41 devstack sudo[102701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-c6ee743d-7222-414f-9901-6b65a2cc34e3 Sep 06 06:45:41 devstack sudo[102701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:45:41 devstack sudo[102701]: pam_unix(sudo:session): session closed for user root Sep 06 06:45:41 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-5b1e06a0-55b3-4010-b484-854da667dd86 tempest-VolumesActionsTest-1485152331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-c6ee743d-7222-414f-9901-6b65a2cc34e3" returned: 0 in 0.260s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:45:41 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-5b1e06a0-55b3-4010-b484-854da667dd86 tempest-VolumesActionsTest-1485152331 None] <== create_volume: return (751ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'} {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 06:45:41 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-5b1e06a0-55b3-4010-b484-854da667dd86 tempest-VolumesActionsTest-1485152331 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.754s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:45:41 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-5b1e06a0-55b3-4010-b484-854da667dd86 tempest-VolumesActionsTest-1485152331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b22eee13-537b-4d70-80c2-3f53999416c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6ee743d-7222-414f-9901-6b65a2cc34e3', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:45:41 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-5b1e06a0-55b3-4010-b484-854da667dd86 tempest-VolumesActionsTest-1485152331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3895628b-5d54-4cb0-b19e-77c93af4f48f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:45:41 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-5b1e06a0-55b3-4010-b484-854da667dd86 tempest-VolumesActionsTest-1485152331 None] Volume volume-c6ee743d-7222-414f-9901-6b65a2cc34e3 (c6ee743d-7222-414f-9901-6b65a2cc34e3): created successfully Sep 06 06:45:41 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-5b1e06a0-55b3-4010-b484-854da667dd86 tempest-VolumesActionsTest-1485152331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3895628b-5d54-4cb0-b19e-77c93af4f48f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:45:41 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-5b1e06a0-55b3-4010-b484-854da667dd86 tempest-VolumesActionsTest-1485152331 None] Flow 'volume_create_manager' (d23a69a1-3343-40cb-8fab-ba62f8cf56ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:45:41 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-5b1e06a0-55b3-4010-b484-854da667dd86 tempest-VolumesActionsTest-1485152331 None] Created volume successfully. Sep 06 06:45:41 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-92057eec-df4a-49ca-8a84-d59d8c141d67 tempest-VolumesActionsTest-313663387 None] Acquiring lock "cinder-c6ee743d-7222-414f-9901-6b65a2cc34e3-delete_volume" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:45:41 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-92057eec-df4a-49ca-8a84-d59d8c141d67 tempest-VolumesActionsTest-313663387 None] Lock "cinder-c6ee743d-7222-414f-9901-6b65a2cc34e3-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:45:41 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-92057eec-df4a-49ca-8a84-d59d8c141d67 tempest-VolumesActionsTest-313663387 None] Acquiring lock "cinder-quobyte-c6ee743d-7222-414f-9901-6b65a2cc34e3" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:45:42 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-92057eec-df4a-49ca-8a84-d59d8c141d67 tempest-VolumesActionsTest-313663387 None] Lock "cinder-quobyte-c6ee743d-7222-414f-9901-6b65a2cc34e3" acquired by "delete_volume" :: waited 0.020s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:45:42 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1f3d1d9-9eb7-4085-b9e8-f9251f0da776]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:45:42 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-92057eec-df4a-49ca-8a84-d59d8c141d67 tempest-VolumesActionsTest-313663387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-c6ee743d-7222-414f-9901-6b65a2cc34e3 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:45:42 devstack sudo[102734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-c6ee743d-7222-414f-9901-6b65a2cc34e3 Sep 06 06:45:42 devstack sudo[102734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:45:42 devstack sudo[102734]: pam_unix(sudo:session): session closed for user root Sep 06 06:45:42 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-92057eec-df4a-49ca-8a84-d59d8c141d67 tempest-VolumesActionsTest-313663387 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-c6ee743d-7222-414f-9901-6b65a2cc34e3" returned: 0 in 0.367s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:45:42 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-92057eec-df4a-49ca-8a84-d59d8c141d67 tempest-VolumesActionsTest-313663387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-c6ee743d-7222-414f-9901-6b65a2cc34e3 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:45:42 devstack sudo[102739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-c6ee743d-7222-414f-9901-6b65a2cc34e3 Sep 06 06:45:42 devstack sudo[102739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:45:42 devstack sudo[102739]: pam_unix(sudo:session): session closed for user root Sep 06 06:45:42 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-92057eec-df4a-49ca-8a84-d59d8c141d67 tempest-VolumesActionsTest-313663387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-c6ee743d-7222-414f-9901-6b65a2cc34e3" returned: 0 in 0.239s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:45:42 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-92057eec-df4a-49ca-8a84-d59d8c141d67 tempest-VolumesActionsTest-313663387 None] Lock "cinder-quobyte-c6ee743d-7222-414f-9901-6b65a2cc34e3" released by "delete_volume" :: held 0.651s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:45:42 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-92057eec-df4a-49ca-8a84-d59d8c141d67 tempest-VolumesActionsTest-313663387 None] Created reservations ['2c9d4b4e-b691-4732-aa3a-c086b8d0ec25', 'e70941e5-4b84-4f87-a5f6-4ae880b0dc5f', 'eb8e5dd0-944d-4b75-a1fe-b975a58d59fd', '4b43c6d0-c380-4ae1-8fbe-d93b313d84d1'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:45:42 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-92057eec-df4a-49ca-8a84-d59d8c141d67 tempest-VolumesActionsTest-313663387 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:45:42 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-92057eec-df4a-49ca-8a84-d59d8c141d67 tempest-VolumesActionsTest-313663387 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:45:42 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-92057eec-df4a-49ca-8a84-d59d8c141d67 tempest-VolumesActionsTest-313663387 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:45:42 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-92057eec-df4a-49ca-8a84-d59d8c141d67 tempest-VolumesActionsTest-313663387 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:45:42 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-92057eec-df4a-49ca-8a84-d59d8c141d67 tempest-VolumesActionsTest-313663387 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:45:42 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-92057eec-df4a-49ca-8a84-d59d8c141d67 tempest-VolumesActionsTest-313663387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:45:42 devstack sudo[102742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:45:42 devstack sudo[102742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:45:43 devstack sudo[102742]: pam_unix(sudo:session): session closed for user root Sep 06 06:45:43 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-92057eec-df4a-49ca-8a84-d59d8c141d67 tempest-VolumesActionsTest-313663387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.274s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:45:43 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-92057eec-df4a-49ca-8a84-d59d8c141d67 tempest-VolumesActionsTest-313663387 None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:45:43 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-92057eec-df4a-49ca-8a84-d59d8c141d67 tempest-VolumesActionsTest-313663387 None] Deleted volume successfully. Sep 06 06:45:43 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-92057eec-df4a-49ca-8a84-d59d8c141d67 tempest-VolumesActionsTest-313663387 None] Lock "cinder-c6ee743d-7222-414f-9901-6b65a2cc34e3-delete_volume" released by "delete_volume" :: held 1.192s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:45:43 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-4953d191-be40-4884-b40f-f3615d4c8928 tempest-VolumesActionsTest-1485152331 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87329) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 06:45:43 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-4953d191-be40-4884-b40f-f3615d4c8928 tempest-VolumesActionsTest-1485152331 None] Flow 'volume_create_manager' (e82e6a12-8ac6-4103-83fa-8f4bce2ffae6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:45:43 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-4953d191-be40-4884-b40f-f3615d4c8928 tempest-VolumesActionsTest-1485152331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3693f200-47dc-48b5-aa6f-d8cdf6372a5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:45:43 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-4953d191-be40-4884-b40f-f3615d4c8928 tempest-VolumesActionsTest-1485152331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3693f200-47dc-48b5-aa6f-d8cdf6372a5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:45:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1743575978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e31b3f87-13e4-45f6-ba5e-b6187f988492,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aef2ed6a5f9f4754b454036150084cbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:45:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:45:44Z,use_quota=True,user_id='19d138a7c9474a91a73e4e2ab698c0a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:45:43 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-4953d191-be40-4884-b40f-f3615d4c8928 tempest-VolumesActionsTest-1485152331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bf167c4-3a57-4433-873f-3651bdae1095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:45:43 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-4953d191-be40-4884-b40f-f3615d4c8928 tempest-VolumesActionsTest-1485152331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bf167c4-3a57-4433-873f-3651bdae1095) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:45:43 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-4953d191-be40-4884-b40f-f3615d4c8928 tempest-VolumesActionsTest-1485152331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa6b0016-f20e-45ce-b66e-a337e4e6d4a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:45:43 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-4953d191-be40-4884-b40f-f3615d4c8928 tempest-VolumesActionsTest-1485152331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa6b0016-f20e-45ce-b66e-a337e4e6d4a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e31b3f87-13e4-45f6-ba5e-b6187f988492', 'volume_name': 'volume-e31b3f87-13e4-45f6-ba5e-b6187f988492', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:45:43 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-4953d191-be40-4884-b40f-f3615d4c8928 tempest-VolumesActionsTest-1485152331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b16c9f83-fd8b-4963-8f82-96e6e0289cca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:45:43 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-4953d191-be40-4884-b40f-f3615d4c8928 tempest-VolumesActionsTest-1485152331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b16c9f83-fd8b-4963-8f82-96e6e0289cca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:45:43 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-4953d191-be40-4884-b40f-f3615d4c8928 tempest-VolumesActionsTest-1485152331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3aa5cdaf-e1cd-4f26-aa60-b4873fe1d8f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:45:43 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-4953d191-be40-4884-b40f-f3615d4c8928 tempest-VolumesActionsTest-1485152331 None] Volume e31b3f87-13e4-45f6-ba5e-b6187f988492: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e31b3f87-13e4-45f6-ba5e-b6187f988492', 'volume_size': 1} Sep 06 06:45:43 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-4953d191-be40-4884-b40f-f3615d4c8928 tempest-VolumesActionsTest-1485152331 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:45:43 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-4953d191-be40-4884-b40f-f3615d4c8928 tempest-VolumesActionsTest-1485152331 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:45:43 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-4953d191-be40-4884-b40f-f3615d4c8928 tempest-VolumesActionsTest-1485152331 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:45:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1743575978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e31b3f87-13e4-45f6-ba5e-b6187f988492,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aef2ed6a5f9f4754b454036150084cbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:45:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:45:44Z,use_quota=True,user_id='19d138a7c9474a91a73e4e2ab698c0a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)}" {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 06:45:43 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-4953d191-be40-4884-b40f-f3615d4c8928 tempest-VolumesActionsTest-1485152331 None] Creating volume e31b3f87-13e4-45f6-ba5e-b6187f988492 {{(pid=87329) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 06:45:43 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-4953d191-be40-4884-b40f-f3615d4c8928 tempest-VolumesActionsTest-1485152331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:45:43 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-4953d191-be40-4884-b40f-f3615d4c8928 tempest-VolumesActionsTest-1485152331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:45:43 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-4953d191-be40-4884-b40f-f3615d4c8928 tempest-VolumesActionsTest-1485152331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:45:43 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-4953d191-be40-4884-b40f-f3615d4c8928 tempest-VolumesActionsTest-1485152331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:45:43 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-4953d191-be40-4884-b40f-f3615d4c8928 tempest-VolumesActionsTest-1485152331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:45:43 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-4953d191-be40-4884-b40f-f3615d4c8928 tempest-VolumesActionsTest-1485152331 None] Selected osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 as target Quobyte volume. {{(pid=87329) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 06:45:43 devstack cinder-volume[87329]: INFO cinder.volume.drivers.remotefs [None req-4953d191-be40-4884-b40f-f3615d4c8928 tempest-VolumesActionsTest-1485152331 None] casted to osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 Sep 06 06:45:43 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-4953d191-be40-4884-b40f-f3615d4c8928 tempest-VolumesActionsTest-1485152331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e31b3f87-13e4-45f6-ba5e-b6187f988492 1073741824 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:45:43 devstack sudo[102745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e31b3f87-13e4-45f6-ba5e-b6187f988492 1073741824 Sep 06 06:45:43 devstack sudo[102745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:45:44 devstack sudo[102745]: pam_unix(sudo:session): session closed for user root Sep 06 06:45:44 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-4953d191-be40-4884-b40f-f3615d4c8928 tempest-VolumesActionsTest-1485152331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e31b3f87-13e4-45f6-ba5e-b6187f988492 1073741824" returned: 0 in 0.490s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:45:44 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-4953d191-be40-4884-b40f-f3615d4c8928 tempest-VolumesActionsTest-1485152331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e31b3f87-13e4-45f6-ba5e-b6187f988492 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:45:44 devstack sudo[102751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e31b3f87-13e4-45f6-ba5e-b6187f988492 Sep 06 06:45:44 devstack sudo[102751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:45:44 devstack sudo[102751]: pam_unix(sudo:session): session closed for user root Sep 06 06:45:44 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-4953d191-be40-4884-b40f-f3615d4c8928 tempest-VolumesActionsTest-1485152331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e31b3f87-13e4-45f6-ba5e-b6187f988492" returned: 0 in 0.239s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:45:44 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-4953d191-be40-4884-b40f-f3615d4c8928 tempest-VolumesActionsTest-1485152331 None] <== create_volume: return (778ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'} {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 06:45:44 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-4953d191-be40-4884-b40f-f3615d4c8928 tempest-VolumesActionsTest-1485152331 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.780s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:45:44 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-4953d191-be40-4884-b40f-f3615d4c8928 tempest-VolumesActionsTest-1485152331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3aa5cdaf-e1cd-4f26-aa60-b4873fe1d8f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e31b3f87-13e4-45f6-ba5e-b6187f988492', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:45:44 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-4953d191-be40-4884-b40f-f3615d4c8928 tempest-VolumesActionsTest-1485152331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8918400-4dac-429a-a4b8-5968f678a482) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:45:44 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-4953d191-be40-4884-b40f-f3615d4c8928 tempest-VolumesActionsTest-1485152331 None] Volume volume-e31b3f87-13e4-45f6-ba5e-b6187f988492 (e31b3f87-13e4-45f6-ba5e-b6187f988492): created successfully Sep 06 06:45:44 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-4953d191-be40-4884-b40f-f3615d4c8928 tempest-VolumesActionsTest-1485152331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8918400-4dac-429a-a4b8-5968f678a482) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:45:44 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-4953d191-be40-4884-b40f-f3615d4c8928 tempest-VolumesActionsTest-1485152331 None] Flow 'volume_create_manager' (e82e6a12-8ac6-4103-83fa-8f4bce2ffae6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:45:44 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-4953d191-be40-4884-b40f-f3615d4c8928 tempest-VolumesActionsTest-1485152331 None] Created volume successfully. Sep 06 06:45:44 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-9ee31cc1-ae79-4ac3-9af6-6737be96a86a tempest-VolumesActionsTest-313663387 None] Acquiring lock "cinder-e31b3f87-13e4-45f6-ba5e-b6187f988492-delete_volume" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:45:44 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-9ee31cc1-ae79-4ac3-9af6-6737be96a86a tempest-VolumesActionsTest-313663387 None] Lock "cinder-e31b3f87-13e4-45f6-ba5e-b6187f988492-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:45:44 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-9ee31cc1-ae79-4ac3-9af6-6737be96a86a tempest-VolumesActionsTest-313663387 None] Acquiring lock "cinder-quobyte-e31b3f87-13e4-45f6-ba5e-b6187f988492" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:45:44 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-9ee31cc1-ae79-4ac3-9af6-6737be96a86a tempest-VolumesActionsTest-313663387 None] Lock "cinder-quobyte-e31b3f87-13e4-45f6-ba5e-b6187f988492" acquired by "delete_volume" :: waited 0.015s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:45:44 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[8da3fb30-d743-4063-b0dd-b602fb43b581]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:45:44 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-9ee31cc1-ae79-4ac3-9af6-6737be96a86a tempest-VolumesActionsTest-313663387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e31b3f87-13e4-45f6-ba5e-b6187f988492 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:45:44 devstack sudo[102756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e31b3f87-13e4-45f6-ba5e-b6187f988492 Sep 06 06:45:44 devstack sudo[102756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:45:45 devstack sudo[102756]: pam_unix(sudo:session): session closed for user root Sep 06 06:45:45 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-9ee31cc1-ae79-4ac3-9af6-6737be96a86a tempest-VolumesActionsTest-313663387 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e31b3f87-13e4-45f6-ba5e-b6187f988492" returned: 0 in 0.440s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:45:45 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-9ee31cc1-ae79-4ac3-9af6-6737be96a86a tempest-VolumesActionsTest-313663387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e31b3f87-13e4-45f6-ba5e-b6187f988492 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:45:45 devstack sudo[102762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e31b3f87-13e4-45f6-ba5e-b6187f988492 Sep 06 06:45:45 devstack sudo[102762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:45:45 devstack sudo[102762]: pam_unix(sudo:session): session closed for user root Sep 06 06:45:45 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-9ee31cc1-ae79-4ac3-9af6-6737be96a86a tempest-VolumesActionsTest-313663387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e31b3f87-13e4-45f6-ba5e-b6187f988492" returned: 0 in 0.260s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:45:45 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-9ee31cc1-ae79-4ac3-9af6-6737be96a86a tempest-VolumesActionsTest-313663387 None] Lock "cinder-quobyte-e31b3f87-13e4-45f6-ba5e-b6187f988492" released by "delete_volume" :: held 0.742s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:45:45 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-9ee31cc1-ae79-4ac3-9af6-6737be96a86a tempest-VolumesActionsTest-313663387 None] Created reservations ['77a4377e-d968-4ffc-a45f-de01ba85507d', '965dd6c2-afe0-4f5e-b68a-d850b2b572d0', 'bb530c19-332c-4309-88ea-129e2987d3b0', '17accc0c-da09-402e-a3f2-a339065ea4c8'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:45:45 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-9ee31cc1-ae79-4ac3-9af6-6737be96a86a tempest-VolumesActionsTest-313663387 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:45:45 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-9ee31cc1-ae79-4ac3-9af6-6737be96a86a tempest-VolumesActionsTest-313663387 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:45:45 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-9ee31cc1-ae79-4ac3-9af6-6737be96a86a tempest-VolumesActionsTest-313663387 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:45:45 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-9ee31cc1-ae79-4ac3-9af6-6737be96a86a tempest-VolumesActionsTest-313663387 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:45:45 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-9ee31cc1-ae79-4ac3-9af6-6737be96a86a tempest-VolumesActionsTest-313663387 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:45:45 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-9ee31cc1-ae79-4ac3-9af6-6737be96a86a tempest-VolumesActionsTest-313663387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:45:45 devstack sudo[102765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:45:45 devstack sudo[102765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:45:45 devstack sudo[102765]: pam_unix(sudo:session): session closed for user root Sep 06 06:45:45 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-9ee31cc1-ae79-4ac3-9af6-6737be96a86a tempest-VolumesActionsTest-313663387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.256s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:45:45 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-9ee31cc1-ae79-4ac3-9af6-6737be96a86a tempest-VolumesActionsTest-313663387 None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:45:45 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-9ee31cc1-ae79-4ac3-9af6-6737be96a86a tempest-VolumesActionsTest-313663387 None] Deleted volume successfully. Sep 06 06:45:46 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-9ee31cc1-ae79-4ac3-9af6-6737be96a86a tempest-VolumesActionsTest-313663387 None] Lock "cinder-e31b3f87-13e4-45f6-ba5e-b6187f988492-delete_volume" released by "delete_volume" :: held 1.218s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:45:46 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-cfd00f97-beea-4e80-990d-7111dca5d5a7 tempest-VolumesActionsTest-1485152331 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87329) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 06:45:46 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-cfd00f97-beea-4e80-990d-7111dca5d5a7 tempest-VolumesActionsTest-1485152331 None] Flow 'volume_create_manager' (0f43e3ae-fa41-401f-8ca1-599ddea7c97d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:45:46 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-cfd00f97-beea-4e80-990d-7111dca5d5a7 tempest-VolumesActionsTest-1485152331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca59d19c-ea20-4832-8282-17ef0a455e98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:45:46 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-cfd00f97-beea-4e80-990d-7111dca5d5a7 tempest-VolumesActionsTest-1485152331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca59d19c-ea20-4832-8282-17ef0a455e98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:45:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-858830318',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f824ab0-33d9-44b6-aa1e-341ba99e3476,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aef2ed6a5f9f4754b454036150084cbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:45:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:45:46Z,use_quota=True,user_id='19d138a7c9474a91a73e4e2ab698c0a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:45:46 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-cfd00f97-beea-4e80-990d-7111dca5d5a7 tempest-VolumesActionsTest-1485152331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0ff9c59-734b-42c5-8664-aab435660e76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:45:46 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-cfd00f97-beea-4e80-990d-7111dca5d5a7 tempest-VolumesActionsTest-1485152331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0ff9c59-734b-42c5-8664-aab435660e76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:45:46 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-cfd00f97-beea-4e80-990d-7111dca5d5a7 tempest-VolumesActionsTest-1485152331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7dd58c89-ef2b-41d0-adb5-73bfe87cea4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:45:46 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-cfd00f97-beea-4e80-990d-7111dca5d5a7 tempest-VolumesActionsTest-1485152331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7dd58c89-ef2b-41d0-adb5-73bfe87cea4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f824ab0-33d9-44b6-aa1e-341ba99e3476', 'volume_name': 'volume-3f824ab0-33d9-44b6-aa1e-341ba99e3476', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:45:46 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-cfd00f97-beea-4e80-990d-7111dca5d5a7 tempest-VolumesActionsTest-1485152331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3a848b5-b6cd-4173-aef0-522bf9c909cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:45:46 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-cfd00f97-beea-4e80-990d-7111dca5d5a7 tempest-VolumesActionsTest-1485152331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3a848b5-b6cd-4173-aef0-522bf9c909cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:45:46 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-cfd00f97-beea-4e80-990d-7111dca5d5a7 tempest-VolumesActionsTest-1485152331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3090074-df89-4f56-9ad6-30422e68f06f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:45:46 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-cfd00f97-beea-4e80-990d-7111dca5d5a7 tempest-VolumesActionsTest-1485152331 None] Volume 3f824ab0-33d9-44b6-aa1e-341ba99e3476: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f824ab0-33d9-44b6-aa1e-341ba99e3476', 'volume_size': 1} Sep 06 06:45:46 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-cfd00f97-beea-4e80-990d-7111dca5d5a7 tempest-VolumesActionsTest-1485152331 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:45:46 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-cfd00f97-beea-4e80-990d-7111dca5d5a7 tempest-VolumesActionsTest-1485152331 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:45:46 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-cfd00f97-beea-4e80-990d-7111dca5d5a7 tempest-VolumesActionsTest-1485152331 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:45:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-858830318',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f824ab0-33d9-44b6-aa1e-341ba99e3476,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aef2ed6a5f9f4754b454036150084cbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:45:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:45:46Z,use_quota=True,user_id='19d138a7c9474a91a73e4e2ab698c0a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)}" {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 06:45:46 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-cfd00f97-beea-4e80-990d-7111dca5d5a7 tempest-VolumesActionsTest-1485152331 None] Creating volume 3f824ab0-33d9-44b6-aa1e-341ba99e3476 {{(pid=87329) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 06:45:46 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-cfd00f97-beea-4e80-990d-7111dca5d5a7 tempest-VolumesActionsTest-1485152331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:45:46 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-cfd00f97-beea-4e80-990d-7111dca5d5a7 tempest-VolumesActionsTest-1485152331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:45:46 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-cfd00f97-beea-4e80-990d-7111dca5d5a7 tempest-VolumesActionsTest-1485152331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:45:46 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-cfd00f97-beea-4e80-990d-7111dca5d5a7 tempest-VolumesActionsTest-1485152331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:45:46 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-cfd00f97-beea-4e80-990d-7111dca5d5a7 tempest-VolumesActionsTest-1485152331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:45:46 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-cfd00f97-beea-4e80-990d-7111dca5d5a7 tempest-VolumesActionsTest-1485152331 None] Selected osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 as target Quobyte volume. {{(pid=87329) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 06:45:46 devstack cinder-volume[87329]: INFO cinder.volume.drivers.remotefs [None req-cfd00f97-beea-4e80-990d-7111dca5d5a7 tempest-VolumesActionsTest-1485152331 None] casted to osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 Sep 06 06:45:46 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-cfd00f97-beea-4e80-990d-7111dca5d5a7 tempest-VolumesActionsTest-1485152331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-3f824ab0-33d9-44b6-aa1e-341ba99e3476 1073741824 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:45:46 devstack sudo[102768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-3f824ab0-33d9-44b6-aa1e-341ba99e3476 1073741824 Sep 06 06:45:46 devstack sudo[102768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:45:46 devstack sudo[102768]: pam_unix(sudo:session): session closed for user root Sep 06 06:45:46 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-cfd00f97-beea-4e80-990d-7111dca5d5a7 tempest-VolumesActionsTest-1485152331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-3f824ab0-33d9-44b6-aa1e-341ba99e3476 1073741824" returned: 0 in 0.438s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:45:47 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-cfd00f97-beea-4e80-990d-7111dca5d5a7 tempest-VolumesActionsTest-1485152331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-3f824ab0-33d9-44b6-aa1e-341ba99e3476 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:45:47 devstack sudo[102773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-3f824ab0-33d9-44b6-aa1e-341ba99e3476 Sep 06 06:45:47 devstack sudo[102773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:45:47 devstack sudo[102773]: pam_unix(sudo:session): session closed for user root Sep 06 06:45:47 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-cfd00f97-beea-4e80-990d-7111dca5d5a7 tempest-VolumesActionsTest-1485152331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-3f824ab0-33d9-44b6-aa1e-341ba99e3476" returned: 0 in 0.249s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:45:47 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-cfd00f97-beea-4e80-990d-7111dca5d5a7 tempest-VolumesActionsTest-1485152331 None] <== create_volume: return (731ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'} {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 06:45:47 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-cfd00f97-beea-4e80-990d-7111dca5d5a7 tempest-VolumesActionsTest-1485152331 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.734s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:45:47 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-cfd00f97-beea-4e80-990d-7111dca5d5a7 tempest-VolumesActionsTest-1485152331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3090074-df89-4f56-9ad6-30422e68f06f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f824ab0-33d9-44b6-aa1e-341ba99e3476', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:45:47 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-cfd00f97-beea-4e80-990d-7111dca5d5a7 tempest-VolumesActionsTest-1485152331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4cec1f7-a968-45c9-8101-3db37417ea35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:45:47 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-cfd00f97-beea-4e80-990d-7111dca5d5a7 tempest-VolumesActionsTest-1485152331 None] Volume volume-3f824ab0-33d9-44b6-aa1e-341ba99e3476 (3f824ab0-33d9-44b6-aa1e-341ba99e3476): created successfully Sep 06 06:45:47 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-cfd00f97-beea-4e80-990d-7111dca5d5a7 tempest-VolumesActionsTest-1485152331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4cec1f7-a968-45c9-8101-3db37417ea35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:45:47 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-cfd00f97-beea-4e80-990d-7111dca5d5a7 tempest-VolumesActionsTest-1485152331 None] Flow 'volume_create_manager' (0f43e3ae-fa41-401f-8ca1-599ddea7c97d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:45:47 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-cfd00f97-beea-4e80-990d-7111dca5d5a7 tempest-VolumesActionsTest-1485152331 None] Created volume successfully. Sep 06 06:45:47 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-7f253696-966f-4488-aff3-7704e53a9808 tempest-VolumesActionsTest-313663387 None] Acquiring lock "cinder-3f824ab0-33d9-44b6-aa1e-341ba99e3476-delete_volume" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:45:47 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-7f253696-966f-4488-aff3-7704e53a9808 tempest-VolumesActionsTest-313663387 None] Lock "cinder-3f824ab0-33d9-44b6-aa1e-341ba99e3476-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:45:47 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-7f253696-966f-4488-aff3-7704e53a9808 tempest-VolumesActionsTest-313663387 None] Acquiring lock "cinder-quobyte-3f824ab0-33d9-44b6-aa1e-341ba99e3476" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:45:47 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-7f253696-966f-4488-aff3-7704e53a9808 tempest-VolumesActionsTest-313663387 None] Lock "cinder-quobyte-3f824ab0-33d9-44b6-aa1e-341ba99e3476" acquired by "delete_volume" :: waited 0.017s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:45:47 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[724dc94c-7efc-4b65-b57d-57113458fc75]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:45:47 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-7f253696-966f-4488-aff3-7704e53a9808 tempest-VolumesActionsTest-313663387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-3f824ab0-33d9-44b6-aa1e-341ba99e3476 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:45:47 devstack sudo[102776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-3f824ab0-33d9-44b6-aa1e-341ba99e3476 Sep 06 06:45:47 devstack sudo[102776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:45:48 devstack sudo[102776]: pam_unix(sudo:session): session closed for user root Sep 06 06:45:48 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-7f253696-966f-4488-aff3-7704e53a9808 tempest-VolumesActionsTest-313663387 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-3f824ab0-33d9-44b6-aa1e-341ba99e3476" returned: 0 in 0.381s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:45:48 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-7f253696-966f-4488-aff3-7704e53a9808 tempest-VolumesActionsTest-313663387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-3f824ab0-33d9-44b6-aa1e-341ba99e3476 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:45:48 devstack sudo[102781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-3f824ab0-33d9-44b6-aa1e-341ba99e3476 Sep 06 06:45:48 devstack sudo[102781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:45:48 devstack sudo[102781]: pam_unix(sudo:session): session closed for user root Sep 06 06:45:48 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-7f253696-966f-4488-aff3-7704e53a9808 tempest-VolumesActionsTest-313663387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-3f824ab0-33d9-44b6-aa1e-341ba99e3476" returned: 0 in 0.259s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:45:48 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-7f253696-966f-4488-aff3-7704e53a9808 tempest-VolumesActionsTest-313663387 None] Lock "cinder-quobyte-3f824ab0-33d9-44b6-aa1e-341ba99e3476" released by "delete_volume" :: held 0.696s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:45:48 devstack cinder-volume[87329]: DEBUG oslo_service.periodic_task [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87329) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 06 06:45:48 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:45:48 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:45:48 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:45:48 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:45:48 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:45:48 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:45:48 devstack sudo[102784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:45:48 devstack sudo[102784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:45:48 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-7f253696-966f-4488-aff3-7704e53a9808 tempest-VolumesActionsTest-313663387 None] Created reservations ['873ab2a3-c462-4de6-a188-fdb5ef9c8d56', 'e40008f8-622d-4f27-89b3-9d4209ff0177', '1201b694-0b12-4af2-aa4a-85e773dd494f', '98d12a36-117d-4875-9904-6cfc1ced338d'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:45:48 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-7f253696-966f-4488-aff3-7704e53a9808 tempest-VolumesActionsTest-313663387 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:45:48 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-7f253696-966f-4488-aff3-7704e53a9808 tempest-VolumesActionsTest-313663387 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:45:48 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-7f253696-966f-4488-aff3-7704e53a9808 tempest-VolumesActionsTest-313663387 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:45:48 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-7f253696-966f-4488-aff3-7704e53a9808 tempest-VolumesActionsTest-313663387 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:45:48 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-7f253696-966f-4488-aff3-7704e53a9808 tempest-VolumesActionsTest-313663387 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:45:48 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-7f253696-966f-4488-aff3-7704e53a9808 tempest-VolumesActionsTest-313663387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:45:48 devstack sudo[102786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:45:48 devstack sudo[102786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:45:48 devstack sudo[102784]: pam_unix(sudo:session): session closed for user root Sep 06 06:45:48 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.341s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:45:48 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:45:48 devstack cinder-volume[87329]: DEBUG oslo_service.periodic_task [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Running periodic task VolumeManager._thread_info {{(pid=87329) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 06 06:45:48 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] thread count: 28 {{(pid=87329) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 06 06:45:48 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] thread info: [<_MainThread(MainThread, started 126855043821696)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87329) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 06 06:45:48 devstack sudo[102786]: pam_unix(sudo:session): session closed for user root Sep 06 06:45:48 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-7f253696-966f-4488-aff3-7704e53a9808 tempest-VolumesActionsTest-313663387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.297s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:45:48 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-7f253696-966f-4488-aff3-7704e53a9808 tempest-VolumesActionsTest-313663387 None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:45:48 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-7f253696-966f-4488-aff3-7704e53a9808 tempest-VolumesActionsTest-313663387 None] Deleted volume successfully. Sep 06 06:45:48 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-7f253696-966f-4488-aff3-7704e53a9808 tempest-VolumesActionsTest-313663387 None] Lock "cinder-3f824ab0-33d9-44b6-aa1e-341ba99e3476-delete_volume" released by "delete_volume" :: held 1.290s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:45:49 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-47ea160b-e2b3-4c96-b3f0-a1fd8768782e tempest-VolumesActionsTest-1485152331 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87329) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 06:45:49 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-47ea160b-e2b3-4c96-b3f0-a1fd8768782e tempest-VolumesActionsTest-1485152331 None] Flow 'volume_create_manager' (b29fda48-0ec9-454d-b7a4-c103e2c250f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:45:49 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-47ea160b-e2b3-4c96-b3f0-a1fd8768782e tempest-VolumesActionsTest-1485152331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f01c6cd-7355-4fd7-b92d-7d013a7d5327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:45:49 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-47ea160b-e2b3-4c96-b3f0-a1fd8768782e tempest-VolumesActionsTest-1485152331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f01c6cd-7355-4fd7-b92d-7d013a7d5327) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:45:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1252344582',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6b4c436-5b79-45df-a304-e72bfc82e39b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aef2ed6a5f9f4754b454036150084cbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:45:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:45:49Z,use_quota=True,user_id='19d138a7c9474a91a73e4e2ab698c0a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:45:49 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-47ea160b-e2b3-4c96-b3f0-a1fd8768782e tempest-VolumesActionsTest-1485152331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74c43dcd-0ef4-4d27-b16a-979a51cd3e41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:45:49 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-47ea160b-e2b3-4c96-b3f0-a1fd8768782e tempest-VolumesActionsTest-1485152331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74c43dcd-0ef4-4d27-b16a-979a51cd3e41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:45:49 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-47ea160b-e2b3-4c96-b3f0-a1fd8768782e tempest-VolumesActionsTest-1485152331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f263cde0-4e2f-4872-ad80-ed9d635322dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:45:49 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-47ea160b-e2b3-4c96-b3f0-a1fd8768782e tempest-VolumesActionsTest-1485152331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f263cde0-4e2f-4872-ad80-ed9d635322dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6b4c436-5b79-45df-a304-e72bfc82e39b', 'volume_name': 'volume-b6b4c436-5b79-45df-a304-e72bfc82e39b', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:45:49 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-47ea160b-e2b3-4c96-b3f0-a1fd8768782e tempest-VolumesActionsTest-1485152331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4248cbb-2f9c-407c-856a-674eb5d6178b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:45:49 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-47ea160b-e2b3-4c96-b3f0-a1fd8768782e tempest-VolumesActionsTest-1485152331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4248cbb-2f9c-407c-856a-674eb5d6178b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:45:49 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-47ea160b-e2b3-4c96-b3f0-a1fd8768782e tempest-VolumesActionsTest-1485152331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7196690-679a-46f5-ac7d-04412cb1dcb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:45:49 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-47ea160b-e2b3-4c96-b3f0-a1fd8768782e tempest-VolumesActionsTest-1485152331 None] Volume b6b4c436-5b79-45df-a304-e72bfc82e39b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6b4c436-5b79-45df-a304-e72bfc82e39b', 'volume_size': 1} Sep 06 06:45:49 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-47ea160b-e2b3-4c96-b3f0-a1fd8768782e tempest-VolumesActionsTest-1485152331 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:45:49 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-47ea160b-e2b3-4c96-b3f0-a1fd8768782e tempest-VolumesActionsTest-1485152331 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:45:49 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-47ea160b-e2b3-4c96-b3f0-a1fd8768782e tempest-VolumesActionsTest-1485152331 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:45:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1252344582',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6b4c436-5b79-45df-a304-e72bfc82e39b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aef2ed6a5f9f4754b454036150084cbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:45:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:45:49Z,use_quota=True,user_id='19d138a7c9474a91a73e4e2ab698c0a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)}" {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 06:45:49 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-47ea160b-e2b3-4c96-b3f0-a1fd8768782e tempest-VolumesActionsTest-1485152331 None] Creating volume b6b4c436-5b79-45df-a304-e72bfc82e39b {{(pid=87329) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 06:45:49 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-47ea160b-e2b3-4c96-b3f0-a1fd8768782e tempest-VolumesActionsTest-1485152331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:45:49 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-47ea160b-e2b3-4c96-b3f0-a1fd8768782e tempest-VolumesActionsTest-1485152331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:45:49 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-47ea160b-e2b3-4c96-b3f0-a1fd8768782e tempest-VolumesActionsTest-1485152331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:45:49 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-47ea160b-e2b3-4c96-b3f0-a1fd8768782e tempest-VolumesActionsTest-1485152331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:45:49 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-47ea160b-e2b3-4c96-b3f0-a1fd8768782e tempest-VolumesActionsTest-1485152331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:45:49 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-47ea160b-e2b3-4c96-b3f0-a1fd8768782e tempest-VolumesActionsTest-1485152331 None] Selected osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 as target Quobyte volume. {{(pid=87329) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 06:45:49 devstack cinder-volume[87329]: INFO cinder.volume.drivers.remotefs [None req-47ea160b-e2b3-4c96-b3f0-a1fd8768782e tempest-VolumesActionsTest-1485152331 None] casted to osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 Sep 06 06:45:49 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-47ea160b-e2b3-4c96-b3f0-a1fd8768782e tempest-VolumesActionsTest-1485152331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b6b4c436-5b79-45df-a304-e72bfc82e39b 1073741824 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:45:49 devstack sudo[102790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b6b4c436-5b79-45df-a304-e72bfc82e39b 1073741824 Sep 06 06:45:49 devstack sudo[102790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:45:49 devstack sudo[102790]: pam_unix(sudo:session): session closed for user root Sep 06 06:45:49 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-47ea160b-e2b3-4c96-b3f0-a1fd8768782e tempest-VolumesActionsTest-1485152331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b6b4c436-5b79-45df-a304-e72bfc82e39b 1073741824" returned: 0 in 0.532s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:45:50 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-47ea160b-e2b3-4c96-b3f0-a1fd8768782e tempest-VolumesActionsTest-1485152331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b6b4c436-5b79-45df-a304-e72bfc82e39b {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:45:50 devstack sudo[102797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b6b4c436-5b79-45df-a304-e72bfc82e39b Sep 06 06:45:50 devstack sudo[102797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:45:50 devstack sudo[102797]: pam_unix(sudo:session): session closed for user root Sep 06 06:45:50 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-47ea160b-e2b3-4c96-b3f0-a1fd8768782e tempest-VolumesActionsTest-1485152331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b6b4c436-5b79-45df-a304-e72bfc82e39b" returned: 0 in 0.285s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:45:50 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-47ea160b-e2b3-4c96-b3f0-a1fd8768782e tempest-VolumesActionsTest-1485152331 None] <== create_volume: return (865ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'} {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 06:45:50 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-47ea160b-e2b3-4c96-b3f0-a1fd8768782e tempest-VolumesActionsTest-1485152331 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.868s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:45:50 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-47ea160b-e2b3-4c96-b3f0-a1fd8768782e tempest-VolumesActionsTest-1485152331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7196690-679a-46f5-ac7d-04412cb1dcb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6b4c436-5b79-45df-a304-e72bfc82e39b', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:45:50 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-47ea160b-e2b3-4c96-b3f0-a1fd8768782e tempest-VolumesActionsTest-1485152331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a5272e4-7d5a-4c7a-a224-5d3582edb9e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:45:50 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-47ea160b-e2b3-4c96-b3f0-a1fd8768782e tempest-VolumesActionsTest-1485152331 None] Volume volume-b6b4c436-5b79-45df-a304-e72bfc82e39b (b6b4c436-5b79-45df-a304-e72bfc82e39b): created successfully Sep 06 06:45:50 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-47ea160b-e2b3-4c96-b3f0-a1fd8768782e tempest-VolumesActionsTest-1485152331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a5272e4-7d5a-4c7a-a224-5d3582edb9e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:45:50 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-47ea160b-e2b3-4c96-b3f0-a1fd8768782e tempest-VolumesActionsTest-1485152331 None] Flow 'volume_create_manager' (b29fda48-0ec9-454d-b7a4-c103e2c250f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:45:50 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-47ea160b-e2b3-4c96-b3f0-a1fd8768782e tempest-VolumesActionsTest-1485152331 None] Created volume successfully. Sep 06 06:45:51 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-ae228359-e6af-460c-9a9e-2e327312b52e tempest-VolumesActionsTest-313663387 None] Acquiring lock "cinder-b6b4c436-5b79-45df-a304-e72bfc82e39b-delete_volume" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:45:51 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-ae228359-e6af-460c-9a9e-2e327312b52e tempest-VolumesActionsTest-313663387 None] Lock "cinder-b6b4c436-5b79-45df-a304-e72bfc82e39b-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:45:51 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-ae228359-e6af-460c-9a9e-2e327312b52e tempest-VolumesActionsTest-313663387 None] Acquiring lock "cinder-quobyte-b6b4c436-5b79-45df-a304-e72bfc82e39b" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:45:51 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-ae228359-e6af-460c-9a9e-2e327312b52e tempest-VolumesActionsTest-313663387 None] Lock "cinder-quobyte-b6b4c436-5b79-45df-a304-e72bfc82e39b" acquired by "delete_volume" :: waited 0.016s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:45:51 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0eed596-6f96-487d-8f45-b2f80f88f628]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:45:51 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-ae228359-e6af-460c-9a9e-2e327312b52e tempest-VolumesActionsTest-313663387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b6b4c436-5b79-45df-a304-e72bfc82e39b {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:45:51 devstack sudo[102800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b6b4c436-5b79-45df-a304-e72bfc82e39b Sep 06 06:45:51 devstack sudo[102800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:45:52 devstack sudo[102800]: pam_unix(sudo:session): session closed for user root Sep 06 06:45:52 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-ae228359-e6af-460c-9a9e-2e327312b52e tempest-VolumesActionsTest-313663387 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b6b4c436-5b79-45df-a304-e72bfc82e39b" returned: 0 in 0.376s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:45:52 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-ae228359-e6af-460c-9a9e-2e327312b52e tempest-VolumesActionsTest-313663387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b6b4c436-5b79-45df-a304-e72bfc82e39b {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:45:52 devstack sudo[102805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b6b4c436-5b79-45df-a304-e72bfc82e39b Sep 06 06:45:52 devstack sudo[102805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:45:52 devstack sudo[102805]: pam_unix(sudo:session): session closed for user root Sep 06 06:45:52 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-ae228359-e6af-460c-9a9e-2e327312b52e tempest-VolumesActionsTest-313663387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b6b4c436-5b79-45df-a304-e72bfc82e39b" returned: 0 in 0.254s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:45:52 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-ae228359-e6af-460c-9a9e-2e327312b52e tempest-VolumesActionsTest-313663387 None] Lock "cinder-quobyte-b6b4c436-5b79-45df-a304-e72bfc82e39b" released by "delete_volume" :: held 0.667s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:45:52 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-ae228359-e6af-460c-9a9e-2e327312b52e tempest-VolumesActionsTest-313663387 None] Created reservations ['4e31423b-2c10-4ea5-b19b-1f0b82873f69', 'abf002b0-3d9c-4f2a-a259-35e36b6f3018', '2cc31ea7-eca2-49d2-bd00-e07e1fe7a51f', 'af501c98-3faf-4c9e-a21b-a856411d4e52'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:45:52 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-ae228359-e6af-460c-9a9e-2e327312b52e tempest-VolumesActionsTest-313663387 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:45:52 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-ae228359-e6af-460c-9a9e-2e327312b52e tempest-VolumesActionsTest-313663387 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:45:52 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-ae228359-e6af-460c-9a9e-2e327312b52e tempest-VolumesActionsTest-313663387 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:45:52 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-ae228359-e6af-460c-9a9e-2e327312b52e tempest-VolumesActionsTest-313663387 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:45:52 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-ae228359-e6af-460c-9a9e-2e327312b52e tempest-VolumesActionsTest-313663387 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:45:52 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-ae228359-e6af-460c-9a9e-2e327312b52e tempest-VolumesActionsTest-313663387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:45:52 devstack sudo[102808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:45:52 devstack sudo[102808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:45:52 devstack sudo[102808]: pam_unix(sudo:session): session closed for user root Sep 06 06:45:52 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-ae228359-e6af-460c-9a9e-2e327312b52e tempest-VolumesActionsTest-313663387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.301s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:45:52 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-ae228359-e6af-460c-9a9e-2e327312b52e tempest-VolumesActionsTest-313663387 None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:45:52 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-ae228359-e6af-460c-9a9e-2e327312b52e tempest-VolumesActionsTest-313663387 None] Deleted volume successfully. Sep 06 06:45:52 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-ae228359-e6af-460c-9a9e-2e327312b52e tempest-VolumesActionsTest-313663387 None] Lock "cinder-b6b4c436-5b79-45df-a304-e72bfc82e39b-delete_volume" released by "delete_volume" :: held 1.186s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:45:53 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-c777a1bb-9dac-4e8e-b3b5-59f5073f9d85 tempest-VolumesActionsTest-1485152331 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87329) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 06:45:53 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-c777a1bb-9dac-4e8e-b3b5-59f5073f9d85 tempest-VolumesActionsTest-1485152331 None] Flow 'volume_create_manager' (fedf3e15-3ac7-43cd-b8c7-71394f2ef45b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:45:53 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-c777a1bb-9dac-4e8e-b3b5-59f5073f9d85 tempest-VolumesActionsTest-1485152331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db4883f6-7945-4bc0-9791-9e8de1fae134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:45:53 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-c777a1bb-9dac-4e8e-b3b5-59f5073f9d85 tempest-VolumesActionsTest-1485152331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db4883f6-7945-4bc0-9791-9e8de1fae134) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:45:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-423120949',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0097b101-300c-4c31-a8a1-f7fd9653db26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aef2ed6a5f9f4754b454036150084cbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:45:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:45:53Z,use_quota=True,user_id='19d138a7c9474a91a73e4e2ab698c0a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:45:53 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-c777a1bb-9dac-4e8e-b3b5-59f5073f9d85 tempest-VolumesActionsTest-1485152331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3e23cf7-3840-4e6c-a3dd-c7404a247886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:45:53 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-c777a1bb-9dac-4e8e-b3b5-59f5073f9d85 tempest-VolumesActionsTest-1485152331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3e23cf7-3840-4e6c-a3dd-c7404a247886) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:45:53 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-c777a1bb-9dac-4e8e-b3b5-59f5073f9d85 tempest-VolumesActionsTest-1485152331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8808f4be-fe51-4c99-aafa-35cbb3ebe628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:45:53 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-c777a1bb-9dac-4e8e-b3b5-59f5073f9d85 tempest-VolumesActionsTest-1485152331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8808f4be-fe51-4c99-aafa-35cbb3ebe628) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0097b101-300c-4c31-a8a1-f7fd9653db26', 'volume_name': 'volume-0097b101-300c-4c31-a8a1-f7fd9653db26', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:45:53 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-c777a1bb-9dac-4e8e-b3b5-59f5073f9d85 tempest-VolumesActionsTest-1485152331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96001088-bcc8-4f71-9c05-a30321c30dc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:45:53 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-c777a1bb-9dac-4e8e-b3b5-59f5073f9d85 tempest-VolumesActionsTest-1485152331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96001088-bcc8-4f71-9c05-a30321c30dc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:45:53 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-c777a1bb-9dac-4e8e-b3b5-59f5073f9d85 tempest-VolumesActionsTest-1485152331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08be9088-bd62-4ba6-9661-424862425366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:45:53 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-c777a1bb-9dac-4e8e-b3b5-59f5073f9d85 tempest-VolumesActionsTest-1485152331 None] Volume 0097b101-300c-4c31-a8a1-f7fd9653db26: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0097b101-300c-4c31-a8a1-f7fd9653db26', 'volume_size': 1} Sep 06 06:45:53 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-c777a1bb-9dac-4e8e-b3b5-59f5073f9d85 tempest-VolumesActionsTest-1485152331 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:45:53 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-c777a1bb-9dac-4e8e-b3b5-59f5073f9d85 tempest-VolumesActionsTest-1485152331 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:45:53 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-c777a1bb-9dac-4e8e-b3b5-59f5073f9d85 tempest-VolumesActionsTest-1485152331 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:45:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-423120949',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0097b101-300c-4c31-a8a1-f7fd9653db26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aef2ed6a5f9f4754b454036150084cbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:45:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:45:53Z,use_quota=True,user_id='19d138a7c9474a91a73e4e2ab698c0a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)}" {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 06:45:53 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-c777a1bb-9dac-4e8e-b3b5-59f5073f9d85 tempest-VolumesActionsTest-1485152331 None] Creating volume 0097b101-300c-4c31-a8a1-f7fd9653db26 {{(pid=87329) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 06:45:53 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-c777a1bb-9dac-4e8e-b3b5-59f5073f9d85 tempest-VolumesActionsTest-1485152331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:45:53 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-c777a1bb-9dac-4e8e-b3b5-59f5073f9d85 tempest-VolumesActionsTest-1485152331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:45:53 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-c777a1bb-9dac-4e8e-b3b5-59f5073f9d85 tempest-VolumesActionsTest-1485152331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:45:53 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-c777a1bb-9dac-4e8e-b3b5-59f5073f9d85 tempest-VolumesActionsTest-1485152331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:45:53 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-c777a1bb-9dac-4e8e-b3b5-59f5073f9d85 tempest-VolumesActionsTest-1485152331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:45:53 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-c777a1bb-9dac-4e8e-b3b5-59f5073f9d85 tempest-VolumesActionsTest-1485152331 None] Selected osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 as target Quobyte volume. {{(pid=87329) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 06:45:53 devstack cinder-volume[87329]: INFO cinder.volume.drivers.remotefs [None req-c777a1bb-9dac-4e8e-b3b5-59f5073f9d85 tempest-VolumesActionsTest-1485152331 None] casted to osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 Sep 06 06:45:53 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-c777a1bb-9dac-4e8e-b3b5-59f5073f9d85 tempest-VolumesActionsTest-1485152331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-0097b101-300c-4c31-a8a1-f7fd9653db26 1073741824 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:45:53 devstack sudo[102812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-0097b101-300c-4c31-a8a1-f7fd9653db26 1073741824 Sep 06 06:45:53 devstack sudo[102812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:45:53 devstack sudo[102812]: pam_unix(sudo:session): session closed for user root Sep 06 06:45:53 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-c777a1bb-9dac-4e8e-b3b5-59f5073f9d85 tempest-VolumesActionsTest-1485152331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-0097b101-300c-4c31-a8a1-f7fd9653db26 1073741824" returned: 0 in 0.449s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:45:53 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-c777a1bb-9dac-4e8e-b3b5-59f5073f9d85 tempest-VolumesActionsTest-1485152331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-0097b101-300c-4c31-a8a1-f7fd9653db26 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:45:53 devstack sudo[102817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-0097b101-300c-4c31-a8a1-f7fd9653db26 Sep 06 06:45:53 devstack sudo[102817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:45:54 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba9ccef9-9862-4180-803d-876bce49cf61 tempest-TestShelveInstance-2122303240 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87329) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 06:45:54 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-ba9ccef9-9862-4180-803d-876bce49cf61 tempest-TestShelveInstance-2122303240 None] Flow 'volume_create_manager' (82755d9f-3fb7-434b-be77-a5a74627092f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:45:54 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-ba9ccef9-9862-4180-803d-876bce49cf61 tempest-TestShelveInstance-2122303240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd62ea48-8918-4744-a4a0-097897379294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:45:54 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-ba9ccef9-9862-4180-803d-876bce49cf61 tempest-TestShelveInstance-2122303240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd62ea48-8918-4744-a4a0-097897379294) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:45:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-901044342',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f9f4f61-8db4-4e0b-9497-063182c791dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af33b39319eb41d6822a3b8ddbb7388c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:45:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:45:54Z,use_quota=True,user_id='105ba0eba0774a9da6a8a55a85ccadc9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:45:54 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-ba9ccef9-9862-4180-803d-876bce49cf61 tempest-TestShelveInstance-2122303240 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce9d4a36-0be2-45b5-8a95-f97f3e697dfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:45:54 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-ba9ccef9-9862-4180-803d-876bce49cf61 tempest-TestShelveInstance-2122303240 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce9d4a36-0be2-45b5-8a95-f97f3e697dfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:45:54 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-ba9ccef9-9862-4180-803d-876bce49cf61 tempest-TestShelveInstance-2122303240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ed93ef5-abfb-4ad5-8fb2-f56caed749b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:45:54 devstack cinder-volume[87329]: DEBUG cinder.image.glance [None req-ba9ccef9-9862-4180-803d-876bce49cf61 tempest-TestShelveInstance-2122303240 None] Creating Keystone auth plugin from conf {{(pid=87329) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 06 06:45:54 devstack sudo[102817]: pam_unix(sudo:session): session closed for user root Sep 06 06:45:54 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-c777a1bb-9dac-4e8e-b3b5-59f5073f9d85 tempest-VolumesActionsTest-1485152331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-0097b101-300c-4c31-a8a1-f7fd9653db26" returned: 0 in 0.243s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:45:54 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-c777a1bb-9dac-4e8e-b3b5-59f5073f9d85 tempest-VolumesActionsTest-1485152331 None] <== create_volume: return (746ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'} {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 06:45:54 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-c777a1bb-9dac-4e8e-b3b5-59f5073f9d85 tempest-VolumesActionsTest-1485152331 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.749s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:45:54 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-c777a1bb-9dac-4e8e-b3b5-59f5073f9d85 tempest-VolumesActionsTest-1485152331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08be9088-bd62-4ba6-9661-424862425366) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0097b101-300c-4c31-a8a1-f7fd9653db26', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:45:54 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-c777a1bb-9dac-4e8e-b3b5-59f5073f9d85 tempest-VolumesActionsTest-1485152331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ebb0595-751b-45dc-8998-899cd0060260) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:45:54 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-c777a1bb-9dac-4e8e-b3b5-59f5073f9d85 tempest-VolumesActionsTest-1485152331 None] Volume volume-0097b101-300c-4c31-a8a1-f7fd9653db26 (0097b101-300c-4c31-a8a1-f7fd9653db26): created successfully Sep 06 06:45:54 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-c777a1bb-9dac-4e8e-b3b5-59f5073f9d85 tempest-VolumesActionsTest-1485152331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ebb0595-751b-45dc-8998-899cd0060260) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:45:54 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-c777a1bb-9dac-4e8e-b3b5-59f5073f9d85 tempest-VolumesActionsTest-1485152331 None] Flow 'volume_create_manager' (fedf3e15-3ac7-43cd-b8c7-71394f2ef45b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:45:54 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-c777a1bb-9dac-4e8e-b3b5-59f5073f9d85 tempest-VolumesActionsTest-1485152331 None] Created volume successfully. Sep 06 06:45:54 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-ba9ccef9-9862-4180-803d-876bce49cf61 tempest-TestShelveInstance-2122303240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ed93ef5-abfb-4ad5-8fb2-f56caed749b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0f9f4f61-8db4-4e0b-9497-063182c791dd', 'volume_name': 'volume-0f9f4f61-8db4-4e0b-9497-063182c791dd', 'volume_size': 1, 'image_id': '7005ba32-ec39-44a3-88d9-ca6af0b34ea0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7005ba32-ec39-44a3-88d9-ca6af0b34ea0', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '65b0d6d605b2427d8db787d4220dbeb4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7005ba32-ec39-44a3-88d9-ca6af0b34ea0', 'created_at': datetime.datetime(2026, 9, 6, 4, 25, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 6, 4, 25, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7005ba32-ec39-44a3-88d9-ca6af0b34ea0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:45:54 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-ba9ccef9-9862-4180-803d-876bce49cf61 tempest-TestShelveInstance-2122303240 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8d5bf28-9709-4636-ba6e-244ed3dc59fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:45:54 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-ba9ccef9-9862-4180-803d-876bce49cf61 tempest-TestShelveInstance-2122303240 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8d5bf28-9709-4636-ba6e-244ed3dc59fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:45:54 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-ba9ccef9-9862-4180-803d-876bce49cf61 tempest-TestShelveInstance-2122303240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cabb6cca-eca8-4135-82da-80c4f7adffa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:45:54 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-ba9ccef9-9862-4180-803d-876bce49cf61 tempest-TestShelveInstance-2122303240 None] Volume 0f9f4f61-8db4-4e0b-9497-063182c791dd: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0f9f4f61-8db4-4e0b-9497-063182c791dd', 'volume_size': 1, 'image_id': '7005ba32-ec39-44a3-88d9-ca6af0b34ea0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7005ba32-ec39-44a3-88d9-ca6af0b34ea0', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '65b0d6d605b2427d8db787d4220dbeb4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7005ba32-ec39-44a3-88d9-ca6af0b34ea0', 'created_at': datetime.datetime(2026, 9, 6, 4, 25, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 6, 4, 25, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7005ba32-ec39-44a3-88d9-ca6af0b34ea0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 06 06:45:54 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba9ccef9-9862-4180-803d-876bce49cf61 tempest-TestShelveInstance-2122303240 None] Trying to clone 0f9f4f61-8db4-4e0b-9497-063182c791dd from image 7005ba32-ec39-44a3-88d9-ca6af0b34ea0 at location (None, [{'url': 'file:///opt/stack/data/glance/images/7005ba32-ec39-44a3-88d9-ca6af0b34ea0', 'metadata': {}}]). {{(pid=87329) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 06 06:45:54 devstack cinder-volume[87329]: DEBUG cinder.image.image_utils [None req-ba9ccef9-9862-4180-803d-876bce49cf61 tempest-TestShelveInstance-2122303240 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_7005ba32-ec39-44a3-88d9-ca6af0b34ea0_64t9dx8odevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87329) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 06 06:45:54 devstack cinder-volume[87329]: INFO cinder.image.image_utils [None req-ba9ccef9-9862-4180-803d-876bce49cf61 tempest-TestShelveInstance-2122303240 None] Image download 20.69 MB at 20.69 MB/s Sep 06 06:45:54 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[2652ab89-a187-4cf4-a531-04ebb8ee733f]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:45:54 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-ba9ccef9-9862-4180-803d-876bce49cf61 tempest-TestShelveInstance-2122303240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7005ba32-ec39-44a3-88d9-ca6af0b34ea0_64t9dx8odevstack@QuobyteHD {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:45:55 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-84b95b62-2d5d-4b00-bf7f-ddf7a1cc8550 tempest-VolumesActionsTest-1485152331 None] Acquiring lock "cinder-0097b101-300c-4c31-a8a1-f7fd9653db26-delete_volume" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:45:55 devstack sudo[102821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7005ba32-ec39-44a3-88d9-ca6af0b34ea0_64t9dx8odevstack@QuobyteHD Sep 06 06:45:55 devstack sudo[102821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:45:55 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-84b95b62-2d5d-4b00-bf7f-ddf7a1cc8550 tempest-VolumesActionsTest-1485152331 None] Lock "cinder-0097b101-300c-4c31-a8a1-f7fd9653db26-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:45:55 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-84b95b62-2d5d-4b00-bf7f-ddf7a1cc8550 tempest-VolumesActionsTest-1485152331 None] Acquiring lock "cinder-quobyte-0097b101-300c-4c31-a8a1-f7fd9653db26" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:45:55 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-84b95b62-2d5d-4b00-bf7f-ddf7a1cc8550 tempest-VolumesActionsTest-1485152331 None] Lock "cinder-quobyte-0097b101-300c-4c31-a8a1-f7fd9653db26" acquired by "delete_volume" :: waited 0.013s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:45:55 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[f17a7995-e439-401c-ab96-7030d28a107f]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:45:55 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-84b95b62-2d5d-4b00-bf7f-ddf7a1cc8550 tempest-VolumesActionsTest-1485152331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-0097b101-300c-4c31-a8a1-f7fd9653db26 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:45:55 devstack sudo[102823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-0097b101-300c-4c31-a8a1-f7fd9653db26 Sep 06 06:45:55 devstack sudo[102823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:45:55 devstack sudo[102821]: pam_unix(sudo:session): session closed for user root Sep 06 06:45:55 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-ba9ccef9-9862-4180-803d-876bce49cf61 tempest-TestShelveInstance-2122303240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7005ba32-ec39-44a3-88d9-ca6af0b34ea0_64t9dx8odevstack@QuobyteHD" returned: 0 in 0.356s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:45:55 devstack cinder-volume[87329]: DEBUG cinder.image.image_utils [None req-ba9ccef9-9862-4180-803d-876bce49cf61 tempest-TestShelveInstance-2122303240 None] Temporary image 7005ba32-ec39-44a3-88d9-ca6af0b34ea0 is fetched for user 105ba0eba0774a9da6a8a55a85ccadc9. {{(pid=87329) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 06 06:45:55 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5e326ec-0305-4ecf-afb2-f29231aabd02]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:45:55 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-ba9ccef9-9862-4180-803d-876bce49cf61 tempest-TestShelveInstance-2122303240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7005ba32-ec39-44a3-88d9-ca6af0b34ea0_64t9dx8odevstack@QuobyteHD {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:45:55 devstack sudo[102828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7005ba32-ec39-44a3-88d9-ca6af0b34ea0_64t9dx8odevstack@QuobyteHD Sep 06 06:45:55 devstack sudo[102828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:45:55 devstack sudo[102823]: pam_unix(sudo:session): session closed for user root Sep 06 06:45:55 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-84b95b62-2d5d-4b00-bf7f-ddf7a1cc8550 tempest-VolumesActionsTest-1485152331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-0097b101-300c-4c31-a8a1-f7fd9653db26" returned: 0 in 0.351s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:45:55 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-84b95b62-2d5d-4b00-bf7f-ddf7a1cc8550 tempest-VolumesActionsTest-1485152331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-0097b101-300c-4c31-a8a1-f7fd9653db26 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:45:55 devstack sudo[102833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-0097b101-300c-4c31-a8a1-f7fd9653db26 Sep 06 06:45:55 devstack sudo[102833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:45:55 devstack sudo[102828]: pam_unix(sudo:session): session closed for user root Sep 06 06:45:55 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-ba9ccef9-9862-4180-803d-876bce49cf61 tempest-TestShelveInstance-2122303240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7005ba32-ec39-44a3-88d9-ca6af0b34ea0_64t9dx8odevstack@QuobyteHD" returned: 0 in 0.335s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:45:55 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-ba9ccef9-9862-4180-803d-876bce49cf61 tempest-TestShelveInstance-2122303240 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:45:55 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-ba9ccef9-9862-4180-803d-876bce49cf61 tempest-TestShelveInstance-2122303240 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:45:55 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-ba9ccef9-9862-4180-803d-876bce49cf61 tempest-TestShelveInstance-2122303240 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:45:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-901044342',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f9f4f61-8db4-4e0b-9497-063182c791dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af33b39319eb41d6822a3b8ddbb7388c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:45:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:45:54Z,use_quota=True,user_id='105ba0eba0774a9da6a8a55a85ccadc9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)}" {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 06:45:55 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-ba9ccef9-9862-4180-803d-876bce49cf61 tempest-TestShelveInstance-2122303240 None] Creating volume 0f9f4f61-8db4-4e0b-9497-063182c791dd {{(pid=87329) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 06:45:55 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-ba9ccef9-9862-4180-803d-876bce49cf61 tempest-TestShelveInstance-2122303240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:45:55 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-ba9ccef9-9862-4180-803d-876bce49cf61 tempest-TestShelveInstance-2122303240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:45:55 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-ba9ccef9-9862-4180-803d-876bce49cf61 tempest-TestShelveInstance-2122303240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:45:55 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-ba9ccef9-9862-4180-803d-876bce49cf61 tempest-TestShelveInstance-2122303240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:45:55 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-ba9ccef9-9862-4180-803d-876bce49cf61 tempest-TestShelveInstance-2122303240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:45:55 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-ba9ccef9-9862-4180-803d-876bce49cf61 tempest-TestShelveInstance-2122303240 None] Selected osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 as target Quobyte volume. {{(pid=87329) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 06:45:55 devstack cinder-volume[87329]: INFO cinder.volume.drivers.remotefs [None req-ba9ccef9-9862-4180-803d-876bce49cf61 tempest-TestShelveInstance-2122303240 None] casted to osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 Sep 06 06:45:55 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-ba9ccef9-9862-4180-803d-876bce49cf61 tempest-TestShelveInstance-2122303240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-0f9f4f61-8db4-4e0b-9497-063182c791dd 1073741824 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:45:55 devstack sudo[102839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-0f9f4f61-8db4-4e0b-9497-063182c791dd 1073741824 Sep 06 06:45:55 devstack sudo[102839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:45:55 devstack sudo[102833]: pam_unix(sudo:session): session closed for user root Sep 06 06:45:55 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-84b95b62-2d5d-4b00-bf7f-ddf7a1cc8550 tempest-VolumesActionsTest-1485152331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-0097b101-300c-4c31-a8a1-f7fd9653db26" returned: 0 in 0.242s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:45:55 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-84b95b62-2d5d-4b00-bf7f-ddf7a1cc8550 tempest-VolumesActionsTest-1485152331 None] Lock "cinder-quobyte-0097b101-300c-4c31-a8a1-f7fd9653db26" released by "delete_volume" :: held 0.643s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:45:55 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-84b95b62-2d5d-4b00-bf7f-ddf7a1cc8550 tempest-VolumesActionsTest-1485152331 None] Created reservations ['3db9a002-6880-43a6-806c-2b5303c8d988', '7be871cb-0780-40c9-a2cc-5d4b38798bd3', 'bb60ffea-96d5-45ba-a22a-77fc7d316bec', '5afcf0e8-be56-44cb-91d6-721516d71d76'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:45:55 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-84b95b62-2d5d-4b00-bf7f-ddf7a1cc8550 tempest-VolumesActionsTest-1485152331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:45:55 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-84b95b62-2d5d-4b00-bf7f-ddf7a1cc8550 tempest-VolumesActionsTest-1485152331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:45:55 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-84b95b62-2d5d-4b00-bf7f-ddf7a1cc8550 tempest-VolumesActionsTest-1485152331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:45:55 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-84b95b62-2d5d-4b00-bf7f-ddf7a1cc8550 tempest-VolumesActionsTest-1485152331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:45:55 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-84b95b62-2d5d-4b00-bf7f-ddf7a1cc8550 tempest-VolumesActionsTest-1485152331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:45:55 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-84b95b62-2d5d-4b00-bf7f-ddf7a1cc8550 tempest-VolumesActionsTest-1485152331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:45:55 devstack sudo[102841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:45:55 devstack sudo[102841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:45:56 devstack sudo[102841]: pam_unix(sudo:session): session closed for user root Sep 06 06:45:56 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-84b95b62-2d5d-4b00-bf7f-ddf7a1cc8550 tempest-VolumesActionsTest-1485152331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.260s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:45:56 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-84b95b62-2d5d-4b00-bf7f-ddf7a1cc8550 tempest-VolumesActionsTest-1485152331 None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:45:56 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-84b95b62-2d5d-4b00-bf7f-ddf7a1cc8550 tempest-VolumesActionsTest-1485152331 None] Deleted volume successfully. Sep 06 06:45:56 devstack sudo[102839]: pam_unix(sudo:session): session closed for user root Sep 06 06:45:56 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-ba9ccef9-9862-4180-803d-876bce49cf61 tempest-TestShelveInstance-2122303240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-0f9f4f61-8db4-4e0b-9497-063182c791dd 1073741824" returned: 0 in 0.456s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:45:56 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-84b95b62-2d5d-4b00-bf7f-ddf7a1cc8550 tempest-VolumesActionsTest-1485152331 None] Lock "cinder-0097b101-300c-4c31-a8a1-f7fd9653db26-delete_volume" released by "delete_volume" :: held 1.115s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:45:56 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-ba9ccef9-9862-4180-803d-876bce49cf61 tempest-TestShelveInstance-2122303240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-0f9f4f61-8db4-4e0b-9497-063182c791dd {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:45:56 devstack sudo[102848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-0f9f4f61-8db4-4e0b-9497-063182c791dd Sep 06 06:45:56 devstack sudo[102848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:45:56 devstack sudo[102848]: pam_unix(sudo:session): session closed for user root Sep 06 06:45:56 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-ba9ccef9-9862-4180-803d-876bce49cf61 tempest-TestShelveInstance-2122303240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-0f9f4f61-8db4-4e0b-9497-063182c791dd" returned: 0 in 0.245s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:45:56 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-ba9ccef9-9862-4180-803d-876bce49cf61 tempest-TestShelveInstance-2122303240 None] <== create_volume: return (748ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'} {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 06:45:56 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-ba9ccef9-9862-4180-803d-876bce49cf61 tempest-TestShelveInstance-2122303240 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.752s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:45:56 devstack cinder-volume[87329]: DEBUG cinder.volume.volume_utils [None req-ba9ccef9-9862-4180-803d-876bce49cf61 tempest-TestShelveInstance-2122303240 None] Attempting download of 7005ba32-ec39-44a3-88d9-ca6af0b34ea0 ((None, [{'url': 'file:///opt/stack/data/glance/images/7005ba32-ec39-44a3-88d9-ca6af0b34ea0', 'metadata': {}}])) to volume 0f9f4f61-8db4-4e0b-9497-063182c791dd. {{(pid=87329) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 06 06:45:56 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[2da36755-6e24-4cff-909f-c5cf911f3a03]: (4, 'raw') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:45:56 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-ba9ccef9-9862-4180-803d-876bce49cf61 tempest-TestShelveInstance-2122303240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7005ba32-ec39-44a3-88d9-ca6af0b34ea0_lemsu5gg {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:45:56 devstack sudo[102851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7005ba32-ec39-44a3-88d9-ca6af0b34ea0_lemsu5gg Sep 06 06:45:56 devstack sudo[102851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:45:56 devstack sudo[102851]: pam_unix(sudo:session): session closed for user root Sep 06 06:45:56 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-ba9ccef9-9862-4180-803d-876bce49cf61 tempest-TestShelveInstance-2122303240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7005ba32-ec39-44a3-88d9-ca6af0b34ea0_lemsu5gg" returned: 0 in 0.345s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:45:56 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-ba9ccef9-9862-4180-803d-876bce49cf61 tempest-TestShelveInstance-2122303240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7005ba32-ec39-44a3-88d9-ca6af0b34ea0_lemsu5gg {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:45:56 devstack sudo[102855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7005ba32-ec39-44a3-88d9-ca6af0b34ea0_lemsu5gg Sep 06 06:45:56 devstack sudo[102855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:45:57 devstack sudo[102855]: pam_unix(sudo:session): session closed for user root Sep 06 06:45:57 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-ba9ccef9-9862-4180-803d-876bce49cf61 tempest-TestShelveInstance-2122303240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7005ba32-ec39-44a3-88d9-ca6af0b34ea0_lemsu5gg" returned: 1 in 0.331s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:45:57 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-ba9ccef9-9862-4180-803d-876bce49cf61 tempest-TestShelveInstance-2122303240 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7005ba32-ec39-44a3-88d9-ca6af0b34ea0_lemsu5gg' failed. Not Retrying. {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 06 06:45:57 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b478214-b9ad-4262-9980-74d8861cf902]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:45:57 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-ba9ccef9-9862-4180-803d-876bce49cf61 tempest-TestShelveInstance-2122303240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7005ba32-ec39-44a3-88d9-ca6af0b34ea0_64t9dx8odevstack@QuobyteHD {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:45:57 devstack sudo[102859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7005ba32-ec39-44a3-88d9-ca6af0b34ea0_64t9dx8odevstack@QuobyteHD Sep 06 06:45:57 devstack sudo[102859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:45:57 devstack sudo[102859]: pam_unix(sudo:session): session closed for user root Sep 06 06:45:57 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-ba9ccef9-9862-4180-803d-876bce49cf61 tempest-TestShelveInstance-2122303240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7005ba32-ec39-44a3-88d9-ca6af0b34ea0_64t9dx8odevstack@QuobyteHD" returned: 0 in 0.351s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:45:57 devstack cinder-volume[87329]: DEBUG cinder.image.image_utils [None req-ba9ccef9-9862-4180-803d-876bce49cf61 tempest-TestShelveInstance-2122303240 None] 7005ba32-ec39-44a3-88d9-ca6af0b34ea0 was qcow2, converting to qcow2 {{(pid=87329) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 06 06:45:57 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-ba9ccef9-9862-4180-803d-876bce49cf61 tempest-TestShelveInstance-2122303240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7005ba32-ec39-44a3-88d9-ca6af0b34ea0_64t9dx8odevstack@QuobyteHD /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-0f9f4f61-8db4-4e0b-9497-063182c791dd {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:45:57 devstack sudo[102865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7005ba32-ec39-44a3-88d9-ca6af0b34ea0_64t9dx8odevstack@QuobyteHD /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-0f9f4f61-8db4-4e0b-9497-063182c791dd Sep 06 06:45:57 devstack sudo[102865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:45:59 devstack sudo[102865]: pam_unix(sudo:session): session closed for user root Sep 06 06:45:59 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-ba9ccef9-9862-4180-803d-876bce49cf61 tempest-TestShelveInstance-2122303240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7005ba32-ec39-44a3-88d9-ca6af0b34ea0_64t9dx8odevstack@QuobyteHD /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-0f9f4f61-8db4-4e0b-9497-063182c791dd" returned: 0 in 1.626s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:45:59 devstack cinder-volume[87329]: DEBUG cinder.image.image_utils [None req-ba9ccef9-9862-4180-803d-876bce49cf61 tempest-TestShelveInstance-2122303240 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_7005ba32-ec39-44a3-88d9-ca6af0b34ea0_64t9dx8odevstack@QuobyteHD, size 112.00 MB, duration 1.63 sec, destination /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-0f9f4f61-8db4-4e0b-9497-063182c791dd {{(pid=87329) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 06 06:45:59 devstack cinder-volume[87329]: INFO cinder.image.image_utils [None req-ba9ccef9-9862-4180-803d-876bce49cf61 tempest-TestShelveInstance-2122303240 None] Converted 112.00 MB image at 68.82 MB/s Sep 06 06:45:59 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-ba9ccef9-9862-4180-803d-876bce49cf61 tempest-TestShelveInstance-2122303240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-0f9f4f61-8db4-4e0b-9497-063182c791dd 1G {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:45:59 devstack sudo[102878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-0f9f4f61-8db4-4e0b-9497-063182c791dd 1G Sep 06 06:45:59 devstack sudo[102878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:45:59 devstack sudo[102878]: pam_unix(sudo:session): session closed for user root Sep 06 06:45:59 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-ba9ccef9-9862-4180-803d-876bce49cf61 tempest-TestShelveInstance-2122303240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-0f9f4f61-8db4-4e0b-9497-063182c791dd 1G" returned: 0 in 0.354s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:45:59 devstack cinder-volume[87329]: DEBUG cinder.volume.volume_utils [None req-ba9ccef9-9862-4180-803d-876bce49cf61 tempest-TestShelveInstance-2122303240 None] Downloaded image 7005ba32-ec39-44a3-88d9-ca6af0b34ea0 ((None, [{'url': 'file:///opt/stack/data/glance/images/7005ba32-ec39-44a3-88d9-ca6af0b34ea0', 'metadata': {}}])) to volume 0f9f4f61-8db4-4e0b-9497-063182c791dd successfully. {{(pid=87329) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 06 06:45:59 devstack cinder-volume[87329]: DEBUG cinder.image.image_utils [None req-ba9ccef9-9862-4180-803d-876bce49cf61 tempest-TestShelveInstance-2122303240 None] Temporary image 7005ba32-ec39-44a3-88d9-ca6af0b34ea0 for user 105ba0eba0774a9da6a8a55a85ccadc9 is deleted. {{(pid=87329) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 06 06:45:59 devstack cinder-volume[87329]: DEBUG cinder.volume.volume_utils [None req-ba9ccef9-9862-4180-803d-876bce49cf61 tempest-TestShelveInstance-2122303240 None] Marking volume 0f9f4f61-8db4-4e0b-9497-063182c791dd as bootable. {{(pid=87329) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 06 06:45:59 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba9ccef9-9862-4180-803d-876bce49cf61 tempest-TestShelveInstance-2122303240 None] Copying metadata from image 7005ba32-ec39-44a3-88d9-ca6af0b34ea0 to 0f9f4f61-8db4-4e0b-9497-063182c791dd. {{(pid=87329) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 06 06:45:59 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba9ccef9-9862-4180-803d-876bce49cf61 tempest-TestShelveInstance-2122303240 None] Creating volume glance metadata for volume 0f9f4f61-8db4-4e0b-9497-063182c791dd backed by image 7005ba32-ec39-44a3-88d9-ca6af0b34ea0 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '7005ba32-ec39-44a3-88d9-ca6af0b34ea0', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87329) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 06 06:45:59 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-ba9ccef9-9862-4180-803d-876bce49cf61 tempest-TestShelveInstance-2122303240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cabb6cca-eca8-4135-82da-80c4f7adffa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f9f4f61-8db4-4e0b-9497-063182c791dd', 'volume_size': 1, 'image_id': '7005ba32-ec39-44a3-88d9-ca6af0b34ea0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7005ba32-ec39-44a3-88d9-ca6af0b34ea0', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '65b0d6d605b2427d8db787d4220dbeb4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7005ba32-ec39-44a3-88d9-ca6af0b34ea0', 'created_at': datetime.datetime(2026, 9, 6, 4, 25, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 6, 4, 25, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7005ba32-ec39-44a3-88d9-ca6af0b34ea0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:45:59 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-ba9ccef9-9862-4180-803d-876bce49cf61 tempest-TestShelveInstance-2122303240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad5b31fa-9746-4732-8b48-a9c40062933f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:45:59 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-ba9ccef9-9862-4180-803d-876bce49cf61 tempest-TestShelveInstance-2122303240 None] Volume volume-0f9f4f61-8db4-4e0b-9497-063182c791dd (0f9f4f61-8db4-4e0b-9497-063182c791dd): created successfully Sep 06 06:45:59 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-ba9ccef9-9862-4180-803d-876bce49cf61 tempest-TestShelveInstance-2122303240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad5b31fa-9746-4732-8b48-a9c40062933f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:45:59 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-ba9ccef9-9862-4180-803d-876bce49cf61 tempest-TestShelveInstance-2122303240 None] Flow 'volume_create_manager' (82755d9f-3fb7-434b-be77-a5a74627092f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:45:59 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-ba9ccef9-9862-4180-803d-876bce49cf61 tempest-TestShelveInstance-2122303240 None] Created volume successfully. Sep 06 06:46:03 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [req-26c4daac-3e5d-4340-9ddd-51577a9c9834 req-621cf507-e318-4877-9109-5319344c171c tempest-TestShelveInstance-2122303240 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:46:03 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [req-26c4daac-3e5d-4340-9ddd-51577a9c9834 req-621cf507-e318-4877-9109-5319344c171c tempest-TestShelveInstance-2122303240 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:46:03 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [req-26c4daac-3e5d-4340-9ddd-51577a9c9834 req-621cf507-e318-4877-9109-5319344c171c tempest-TestShelveInstance-2122303240 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:46:03 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [req-26c4daac-3e5d-4340-9ddd-51577a9c9834 req-621cf507-e318-4877-9109-5319344c171c tempest-TestShelveInstance-2122303240 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6', 'name': 'volume-0f9f4f61-8db4-4e0b-9497-063182c791dd', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6d3a307f-c4de-48fa-91be-9b88d6ed3037', 'enforce_multipath': True} {{(pid=87329) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 06 06:46:03 devstack cinder-volume[87329]: INFO cinder.volume.manager [req-26c4daac-3e5d-4340-9ddd-51577a9c9834 req-621cf507-e318-4877-9109-5319344c171c tempest-TestShelveInstance-2122303240 None] attachment_update completed successfully. Sep 06 06:46:13 devstack cinder-volume[87329]: DEBUG dbcounter [-] [87329] Writing DB stats cinder:SELECT=68,cinder:UPDATE=77,cinder:DELETE=6,cinder:INSERT=25 {{(pid=87329) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 06:46:17 devstack cinder-volume[87329]: DEBUG dbcounter [-] [87329] Writing DB stats cinder:UPDATE=75,cinder:SELECT=64,cinder:INSERT=21,cinder:DELETE=7 {{(pid=87329) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 06:46:21 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-291b988b-12f3-486e-b673-7a86254779c5 tempest-VolumesSnapshotTestJSON-1082340868 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87329) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 06:46:21 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-291b988b-12f3-486e-b673-7a86254779c5 tempest-VolumesSnapshotTestJSON-1082340868 None] Flow 'volume_create_manager' (a95f2803-34fe-4a3d-ba3b-2f728b847fff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:46:21 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-291b988b-12f3-486e-b673-7a86254779c5 tempest-VolumesSnapshotTestJSON-1082340868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (042230da-2eca-44c7-8a5b-99cf1eb9f97c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:46:21 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-291b988b-12f3-486e-b673-7a86254779c5 tempest-VolumesSnapshotTestJSON-1082340868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (042230da-2eca-44c7-8a5b-99cf1eb9f97c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:46:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-507929058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=664fd2af-f63c-46e6-8f07-005cde51676b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8b3840bc7ae418496def1ce80fe4a5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:46:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:46:21Z,use_quota=True,user_id='9e41d548bb5d49b9b1ad894b4a46a3e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:46:21 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-291b988b-12f3-486e-b673-7a86254779c5 tempest-VolumesSnapshotTestJSON-1082340868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7fb0664-8612-43f4-87e9-8bba89b8c541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:46:21 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-291b988b-12f3-486e-b673-7a86254779c5 tempest-VolumesSnapshotTestJSON-1082340868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7fb0664-8612-43f4-87e9-8bba89b8c541) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:46:21 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-291b988b-12f3-486e-b673-7a86254779c5 tempest-VolumesSnapshotTestJSON-1082340868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d2db1c3-2df8-4bdf-91c9-b457ef789126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:46:21 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-291b988b-12f3-486e-b673-7a86254779c5 tempest-VolumesSnapshotTestJSON-1082340868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d2db1c3-2df8-4bdf-91c9-b457ef789126) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '664fd2af-f63c-46e6-8f07-005cde51676b', 'volume_name': 'volume-664fd2af-f63c-46e6-8f07-005cde51676b', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:46:21 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-291b988b-12f3-486e-b673-7a86254779c5 tempest-VolumesSnapshotTestJSON-1082340868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a61f23c-c9ee-4d1f-91b0-ce0e0cb10912) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:46:21 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-291b988b-12f3-486e-b673-7a86254779c5 tempest-VolumesSnapshotTestJSON-1082340868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a61f23c-c9ee-4d1f-91b0-ce0e0cb10912) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:46:21 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-291b988b-12f3-486e-b673-7a86254779c5 tempest-VolumesSnapshotTestJSON-1082340868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc72cc85-4414-4015-b6fa-85d569c84e01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:46:21 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-291b988b-12f3-486e-b673-7a86254779c5 tempest-VolumesSnapshotTestJSON-1082340868 None] Volume 664fd2af-f63c-46e6-8f07-005cde51676b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-664fd2af-f63c-46e6-8f07-005cde51676b', 'volume_size': 1} Sep 06 06:46:21 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-291b988b-12f3-486e-b673-7a86254779c5 tempest-VolumesSnapshotTestJSON-1082340868 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:46:21 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-291b988b-12f3-486e-b673-7a86254779c5 tempest-VolumesSnapshotTestJSON-1082340868 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:46:21 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-291b988b-12f3-486e-b673-7a86254779c5 tempest-VolumesSnapshotTestJSON-1082340868 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:46:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-507929058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=664fd2af-f63c-46e6-8f07-005cde51676b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8b3840bc7ae418496def1ce80fe4a5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:46:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:46:21Z,use_quota=True,user_id='9e41d548bb5d49b9b1ad894b4a46a3e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)}" {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 06:46:21 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-291b988b-12f3-486e-b673-7a86254779c5 tempest-VolumesSnapshotTestJSON-1082340868 None] Creating volume 664fd2af-f63c-46e6-8f07-005cde51676b {{(pid=87329) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 06:46:21 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-291b988b-12f3-486e-b673-7a86254779c5 tempest-VolumesSnapshotTestJSON-1082340868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:46:21 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-291b988b-12f3-486e-b673-7a86254779c5 tempest-VolumesSnapshotTestJSON-1082340868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:46:21 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-291b988b-12f3-486e-b673-7a86254779c5 tempest-VolumesSnapshotTestJSON-1082340868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:46:21 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-291b988b-12f3-486e-b673-7a86254779c5 tempest-VolumesSnapshotTestJSON-1082340868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:46:21 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-291b988b-12f3-486e-b673-7a86254779c5 tempest-VolumesSnapshotTestJSON-1082340868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:46:21 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-291b988b-12f3-486e-b673-7a86254779c5 tempest-VolumesSnapshotTestJSON-1082340868 None] Selected osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 as target Quobyte volume. {{(pid=87329) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 06:46:21 devstack cinder-volume[87329]: INFO cinder.volume.drivers.remotefs [None req-291b988b-12f3-486e-b673-7a86254779c5 tempest-VolumesSnapshotTestJSON-1082340868 None] casted to osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 Sep 06 06:46:21 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-291b988b-12f3-486e-b673-7a86254779c5 tempest-VolumesSnapshotTestJSON-1082340868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-664fd2af-f63c-46e6-8f07-005cde51676b 1073741824 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:46:21 devstack sudo[103354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-664fd2af-f63c-46e6-8f07-005cde51676b 1073741824 Sep 06 06:46:21 devstack sudo[103354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:46:21 devstack sudo[103354]: pam_unix(sudo:session): session closed for user root Sep 06 06:46:21 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-291b988b-12f3-486e-b673-7a86254779c5 tempest-VolumesSnapshotTestJSON-1082340868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-664fd2af-f63c-46e6-8f07-005cde51676b 1073741824" returned: 0 in 0.442s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:46:21 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-291b988b-12f3-486e-b673-7a86254779c5 tempest-VolumesSnapshotTestJSON-1082340868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-664fd2af-f63c-46e6-8f07-005cde51676b {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:46:22 devstack sudo[103360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-664fd2af-f63c-46e6-8f07-005cde51676b Sep 06 06:46:22 devstack sudo[103360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:46:22 devstack sudo[103360]: pam_unix(sudo:session): session closed for user root Sep 06 06:46:22 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-291b988b-12f3-486e-b673-7a86254779c5 tempest-VolumesSnapshotTestJSON-1082340868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-664fd2af-f63c-46e6-8f07-005cde51676b" returned: 0 in 0.260s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:46:22 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-291b988b-12f3-486e-b673-7a86254779c5 tempest-VolumesSnapshotTestJSON-1082340868 None] <== create_volume: return (752ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'} {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 06:46:22 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-291b988b-12f3-486e-b673-7a86254779c5 tempest-VolumesSnapshotTestJSON-1082340868 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.755s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:46:22 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-291b988b-12f3-486e-b673-7a86254779c5 tempest-VolumesSnapshotTestJSON-1082340868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc72cc85-4414-4015-b6fa-85d569c84e01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-664fd2af-f63c-46e6-8f07-005cde51676b', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:46:22 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-291b988b-12f3-486e-b673-7a86254779c5 tempest-VolumesSnapshotTestJSON-1082340868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (377710e4-7c21-49c3-8b20-c9f4faee7903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:46:22 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-291b988b-12f3-486e-b673-7a86254779c5 tempest-VolumesSnapshotTestJSON-1082340868 None] Volume volume-664fd2af-f63c-46e6-8f07-005cde51676b (664fd2af-f63c-46e6-8f07-005cde51676b): created successfully Sep 06 06:46:22 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-291b988b-12f3-486e-b673-7a86254779c5 tempest-VolumesSnapshotTestJSON-1082340868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (377710e4-7c21-49c3-8b20-c9f4faee7903) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:46:22 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-291b988b-12f3-486e-b673-7a86254779c5 tempest-VolumesSnapshotTestJSON-1082340868 None] Flow 'volume_create_manager' (a95f2803-34fe-4a3d-ba3b-2f728b847fff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:46:22 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-291b988b-12f3-486e-b673-7a86254779c5 tempest-VolumesSnapshotTestJSON-1082340868 None] Created volume successfully. Sep 06 06:46:22 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-cfd85f87-7529-4de6-8528-6fb8acbf9ab8 tempest-VolumesSnapshotTestJSON-1082340868 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:46:22 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-cfd85f87-7529-4de6-8528-6fb8acbf9ab8 tempest-VolumesSnapshotTestJSON-1082340868 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:46:22 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-cfd85f87-7529-4de6-8528-6fb8acbf9ab8 tempest-VolumesSnapshotTestJSON-1082340868 None] Creating offline snapshot 2217bb5c-bbbd-414d-bd69-0fc03063df6c of volume 664fd2af-f63c-46e6-8f07-005cde51676b {{(pid=87329) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 06 06:46:22 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9bbbb47-0534-4695-a03e-0365f0641b68]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:46:22 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-cfd85f87-7529-4de6-8528-6fb8acbf9ab8 tempest-VolumesSnapshotTestJSON-1082340868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-664fd2af-f63c-46e6-8f07-005cde51676b {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:46:23 devstack sudo[103366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-664fd2af-f63c-46e6-8f07-005cde51676b Sep 06 06:46:23 devstack sudo[103366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:46:23 devstack sudo[103366]: pam_unix(sudo:session): session closed for user root Sep 06 06:46:23 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-cfd85f87-7529-4de6-8528-6fb8acbf9ab8 tempest-VolumesSnapshotTestJSON-1082340868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-664fd2af-f63c-46e6-8f07-005cde51676b" returned: 0 in 0.429s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:46:23 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-cfd85f87-7529-4de6-8528-6fb8acbf9ab8 tempest-VolumesSnapshotTestJSON-1082340868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-664fd2af-f63c-46e6-8f07-005cde51676b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-664fd2af-f63c-46e6-8f07-005cde51676b.2217bb5c-bbbd-414d-bd69-0fc03063df6c 1G {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:46:23 devstack sudo[103372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-664fd2af-f63c-46e6-8f07-005cde51676b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-664fd2af-f63c-46e6-8f07-005cde51676b.2217bb5c-bbbd-414d-bd69-0fc03063df6c 1G Sep 06 06:46:23 devstack sudo[103372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:46:23 devstack sudo[103372]: pam_unix(sudo:session): session closed for user root Sep 06 06:46:23 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-cfd85f87-7529-4de6-8528-6fb8acbf9ab8 tempest-VolumesSnapshotTestJSON-1082340868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-664fd2af-f63c-46e6-8f07-005cde51676b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-664fd2af-f63c-46e6-8f07-005cde51676b.2217bb5c-bbbd-414d-bd69-0fc03063df6c 1G" returned: 0 in 0.438s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:46:23 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-cfd85f87-7529-4de6-8528-6fb8acbf9ab8 tempest-VolumesSnapshotTestJSON-1082340868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-664fd2af-f63c-46e6-8f07-005cde51676b -F qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-664fd2af-f63c-46e6-8f07-005cde51676b.2217bb5c-bbbd-414d-bd69-0fc03063df6c {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:46:23 devstack sudo[103387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-664fd2af-f63c-46e6-8f07-005cde51676b -F qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-664fd2af-f63c-46e6-8f07-005cde51676b.2217bb5c-bbbd-414d-bd69-0fc03063df6c Sep 06 06:46:23 devstack sudo[103387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:46:24 devstack sudo[103387]: pam_unix(sudo:session): session closed for user root Sep 06 06:46:24 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-cfd85f87-7529-4de6-8528-6fb8acbf9ab8 tempest-VolumesSnapshotTestJSON-1082340868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-664fd2af-f63c-46e6-8f07-005cde51676b -F qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-664fd2af-f63c-46e6-8f07-005cde51676b.2217bb5c-bbbd-414d-bd69-0fc03063df6c" returned: 0 in 0.300s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:46:24 devstack cinder-volume[87329]: WARNING cinder.volume.drivers.remotefs [None req-cfd85f87-7529-4de6-8528-6fb8acbf9ab8 tempest-VolumesSnapshotTestJSON-1082340868 None] /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-664fd2af-f63c-46e6-8f07-005cde51676b.2217bb5c-bbbd-414d-bd69-0fc03063df6c is being set with open permissions: ugo+rw Sep 06 06:46:24 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-cfd85f87-7529-4de6-8528-6fb8acbf9ab8 tempest-VolumesSnapshotTestJSON-1082340868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-664fd2af-f63c-46e6-8f07-005cde51676b.2217bb5c-bbbd-414d-bd69-0fc03063df6c {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:46:24 devstack sudo[103393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-664fd2af-f63c-46e6-8f07-005cde51676b.2217bb5c-bbbd-414d-bd69-0fc03063df6c Sep 06 06:46:24 devstack sudo[103393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:46:24 devstack sudo[103393]: pam_unix(sudo:session): session closed for user root Sep 06 06:46:24 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-cfd85f87-7529-4de6-8528-6fb8acbf9ab8 tempest-VolumesSnapshotTestJSON-1082340868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-664fd2af-f63c-46e6-8f07-005cde51676b.2217bb5c-bbbd-414d-bd69-0fc03063df6c" returned: 0 in 0.236s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:46:24 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-cfd85f87-7529-4de6-8528-6fb8acbf9ab8 tempest-VolumesSnapshotTestJSON-1082340868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-664fd2af-f63c-46e6-8f07-005cde51676b.info {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:46:24 devstack sudo[103396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-664fd2af-f63c-46e6-8f07-005cde51676b.info Sep 06 06:46:24 devstack sudo[103396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:46:24 devstack sudo[103396]: pam_unix(sudo:session): session closed for user root Sep 06 06:46:24 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-cfd85f87-7529-4de6-8528-6fb8acbf9ab8 tempest-VolumesSnapshotTestJSON-1082340868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-664fd2af-f63c-46e6-8f07-005cde51676b.info" returned: 0 in 0.246s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:46:24 devstack cinder-volume[87329]: WARNING cinder.volume.drivers.remotefs [None req-cfd85f87-7529-4de6-8528-6fb8acbf9ab8 tempest-VolumesSnapshotTestJSON-1082340868 None] /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-664fd2af-f63c-46e6-8f07-005cde51676b.info is being set with open permissions: ugo+rw Sep 06 06:46:24 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-cfd85f87-7529-4de6-8528-6fb8acbf9ab8 tempest-VolumesSnapshotTestJSON-1082340868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-664fd2af-f63c-46e6-8f07-005cde51676b.info {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:46:24 devstack sudo[103399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-664fd2af-f63c-46e6-8f07-005cde51676b.info Sep 06 06:46:24 devstack sudo[103399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:46:24 devstack sudo[103399]: pam_unix(sudo:session): session closed for user root Sep 06 06:46:24 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-cfd85f87-7529-4de6-8528-6fb8acbf9ab8 tempest-VolumesSnapshotTestJSON-1082340868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-664fd2af-f63c-46e6-8f07-005cde51676b.info" returned: 0 in 0.243s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:46:24 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-cfd85f87-7529-4de6-8528-6fb8acbf9ab8 tempest-VolumesSnapshotTestJSON-1082340868 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.991s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:46:24 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-cfd85f87-7529-4de6-8528-6fb8acbf9ab8 tempest-VolumesSnapshotTestJSON-1082340868 None] Create snapshot completed successfully Sep 06 06:46:26 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-f15a2e3e-b19a-4ee5-a20d-419d53bd3083 tempest-VolumesSnapshotTestJSON-1082340868 None] Acquiring lock "cinder-2217bb5c-bbbd-414d-bd69-0fc03063df6c-delete_snapshot" by "delete_snapshot" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:46:26 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-f15a2e3e-b19a-4ee5-a20d-419d53bd3083 tempest-VolumesSnapshotTestJSON-1082340868 None] Lock "cinder-2217bb5c-bbbd-414d-bd69-0fc03063df6c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:46:26 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-f15a2e3e-b19a-4ee5-a20d-419d53bd3083 tempest-VolumesSnapshotTestJSON-1082340868 None] Acquiring lock "cinder-quobyte-664fd2af-f63c-46e6-8f07-005cde51676b" by "delete_snapshot" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:46:26 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-f15a2e3e-b19a-4ee5-a20d-419d53bd3083 tempest-VolumesSnapshotTestJSON-1082340868 None] Lock "cinder-quobyte-664fd2af-f63c-46e6-8f07-005cde51676b" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:46:26 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-f15a2e3e-b19a-4ee5-a20d-419d53bd3083 tempest-VolumesSnapshotTestJSON-1082340868 None] Acquiring lock "cinder-quobyte-2217bb5c-bbbd-414d-bd69-0fc03063df6c" by "_delete_snapshot" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:46:26 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-f15a2e3e-b19a-4ee5-a20d-419d53bd3083 tempest-VolumesSnapshotTestJSON-1082340868 None] Lock "cinder-quobyte-2217bb5c-bbbd-414d-bd69-0fc03063df6c" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:46:26 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-f15a2e3e-b19a-4ee5-a20d-419d53bd3083 tempest-VolumesSnapshotTestJSON-1082340868 None] Deleting offline snapshot 2217bb5c-bbbd-414d-bd69-0fc03063df6c of volume 664fd2af-f63c-46e6-8f07-005cde51676b {{(pid=87329) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 06 06:46:26 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-f15a2e3e-b19a-4ee5-a20d-419d53bd3083 tempest-VolumesSnapshotTestJSON-1082340868 None] snapshot_file for this snap is: volume-664fd2af-f63c-46e6-8f07-005cde51676b.2217bb5c-bbbd-414d-bd69-0fc03063df6c {{(pid=87329) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 06 06:46:26 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[228351fa-bf4e-49aa-8716-090a7e954c7e]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:46:26 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-f15a2e3e-b19a-4ee5-a20d-419d53bd3083 tempest-VolumesSnapshotTestJSON-1082340868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-664fd2af-f63c-46e6-8f07-005cde51676b.2217bb5c-bbbd-414d-bd69-0fc03063df6c {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:46:26 devstack sudo[103426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-664fd2af-f63c-46e6-8f07-005cde51676b.2217bb5c-bbbd-414d-bd69-0fc03063df6c Sep 06 06:46:26 devstack sudo[103426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:46:26 devstack sudo[103426]: pam_unix(sudo:session): session closed for user root Sep 06 06:46:26 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-f15a2e3e-b19a-4ee5-a20d-419d53bd3083 tempest-VolumesSnapshotTestJSON-1082340868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-664fd2af-f63c-46e6-8f07-005cde51676b.2217bb5c-bbbd-414d-bd69-0fc03063df6c" returned: 0 in 0.348s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:46:26 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-f15a2e3e-b19a-4ee5-a20d-419d53bd3083 tempest-VolumesSnapshotTestJSON-1082340868 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-664fd2af-f63c-46e6-8f07-005cde51676b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87329) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 06:46:26 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[52562225-c610-4082-bec3-16d65c446a6d]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:46:26 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-f15a2e3e-b19a-4ee5-a20d-419d53bd3083 tempest-VolumesSnapshotTestJSON-1082340868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-664fd2af-f63c-46e6-8f07-005cde51676b {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:46:26 devstack sudo[103431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-664fd2af-f63c-46e6-8f07-005cde51676b Sep 06 06:46:26 devstack sudo[103431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:46:26 devstack sudo[103431]: pam_unix(sudo:session): session closed for user root Sep 06 06:46:26 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-f15a2e3e-b19a-4ee5-a20d-419d53bd3083 tempest-VolumesSnapshotTestJSON-1082340868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-664fd2af-f63c-46e6-8f07-005cde51676b" returned: 0 in 0.350s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:46:26 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-f15a2e3e-b19a-4ee5-a20d-419d53bd3083 tempest-VolumesSnapshotTestJSON-1082340868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-664fd2af-f63c-46e6-8f07-005cde51676b.2217bb5c-bbbd-414d-bd69-0fc03063df6c {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:46:26 devstack sudo[103436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-664fd2af-f63c-46e6-8f07-005cde51676b.2217bb5c-bbbd-414d-bd69-0fc03063df6c Sep 06 06:46:26 devstack sudo[103436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:46:27 devstack sudo[103436]: pam_unix(sudo:session): session closed for user root Sep 06 06:46:27 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-f15a2e3e-b19a-4ee5-a20d-419d53bd3083 tempest-VolumesSnapshotTestJSON-1082340868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-664fd2af-f63c-46e6-8f07-005cde51676b.2217bb5c-bbbd-414d-bd69-0fc03063df6c" returned: 0 in 0.323s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:46:27 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-f15a2e3e-b19a-4ee5-a20d-419d53bd3083 tempest-VolumesSnapshotTestJSON-1082340868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-664fd2af-f63c-46e6-8f07-005cde51676b.2217bb5c-bbbd-414d-bd69-0fc03063df6c {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:46:27 devstack sudo[103442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-664fd2af-f63c-46e6-8f07-005cde51676b.2217bb5c-bbbd-414d-bd69-0fc03063df6c Sep 06 06:46:27 devstack sudo[103442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:46:27 devstack sudo[103442]: pam_unix(sudo:session): session closed for user root Sep 06 06:46:27 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-f15a2e3e-b19a-4ee5-a20d-419d53bd3083 tempest-VolumesSnapshotTestJSON-1082340868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-664fd2af-f63c-46e6-8f07-005cde51676b.2217bb5c-bbbd-414d-bd69-0fc03063df6c" returned: 0 in 0.240s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:46:27 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-f15a2e3e-b19a-4ee5-a20d-419d53bd3083 tempest-VolumesSnapshotTestJSON-1082340868 None] Lock "cinder-quobyte-2217bb5c-bbbd-414d-bd69-0fc03063df6c" released by "_delete_snapshot" :: held 1.350s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:46:27 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-f15a2e3e-b19a-4ee5-a20d-419d53bd3083 tempest-VolumesSnapshotTestJSON-1082340868 None] Lock "cinder-quobyte-664fd2af-f63c-46e6-8f07-005cde51676b" released by "delete_snapshot" :: held 1.371s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:46:27 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-f15a2e3e-b19a-4ee5-a20d-419d53bd3083 tempest-VolumesSnapshotTestJSON-1082340868 None] Created reservations ['3c9b04b1-1197-4716-b51b-da98ed9c785d', 'd77c8145-a65b-43af-82c4-a9061082c876', '2fb7da80-4db4-4e34-892e-e302dad463fe', '7cd6943b-b9d2-45af-a1ab-8a405b56feba'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:46:27 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-f15a2e3e-b19a-4ee5-a20d-419d53bd3083 tempest-VolumesSnapshotTestJSON-1082340868 None] Delete snapshot completed successfully. Sep 06 06:46:27 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-f15a2e3e-b19a-4ee5-a20d-419d53bd3083 tempest-VolumesSnapshotTestJSON-1082340868 None] Lock "cinder-2217bb5c-bbbd-414d-bd69-0fc03063df6c-delete_snapshot" released by "delete_snapshot" :: held 1.521s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:46:28 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f518e62-4961-4952-830f-639dc686bfae tempest-VolumesSnapshotTestJSON-1082340868 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87329) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 06:46:28 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-8f518e62-4961-4952-830f-639dc686bfae tempest-VolumesSnapshotTestJSON-1082340868 None] Flow 'volume_create_manager' (3d6d20ca-6642-4fe8-95a7-9e1a5dd98d4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:46:28 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-8f518e62-4961-4952-830f-639dc686bfae tempest-VolumesSnapshotTestJSON-1082340868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b95c8e1a-f13e-46d1-a0eb-9a9ba211882a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:46:28 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-8f518e62-4961-4952-830f-639dc686bfae tempest-VolumesSnapshotTestJSON-1082340868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b95c8e1a-f13e-46d1-a0eb-9a9ba211882a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:46:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-550978167',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e34903c-731c-4898-94d7-9f2485dbe5eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8b3840bc7ae418496def1ce80fe4a5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:46:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:46:29Z,use_quota=True,user_id='9e41d548bb5d49b9b1ad894b4a46a3e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:46:28 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-8f518e62-4961-4952-830f-639dc686bfae tempest-VolumesSnapshotTestJSON-1082340868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58995c40-24e3-422f-8cd8-fdef729e0ecb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:46:28 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-8f518e62-4961-4952-830f-639dc686bfae tempest-VolumesSnapshotTestJSON-1082340868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58995c40-24e3-422f-8cd8-fdef729e0ecb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:46:28 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-8f518e62-4961-4952-830f-639dc686bfae tempest-VolumesSnapshotTestJSON-1082340868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1147d90-40d1-474a-bd41-963a123862ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:46:28 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-8f518e62-4961-4952-830f-639dc686bfae tempest-VolumesSnapshotTestJSON-1082340868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1147d90-40d1-474a-bd41-963a123862ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e34903c-731c-4898-94d7-9f2485dbe5eb', 'volume_name': 'volume-6e34903c-731c-4898-94d7-9f2485dbe5eb', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:46:28 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-8f518e62-4961-4952-830f-639dc686bfae tempest-VolumesSnapshotTestJSON-1082340868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2dc4dd5c-a52a-4f97-aba3-97467db2b076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:46:28 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-8f518e62-4961-4952-830f-639dc686bfae tempest-VolumesSnapshotTestJSON-1082340868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2dc4dd5c-a52a-4f97-aba3-97467db2b076) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:46:28 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-8f518e62-4961-4952-830f-639dc686bfae tempest-VolumesSnapshotTestJSON-1082340868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b606ee7-a7ce-45ed-86e7-9dfb75f47c0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:46:28 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-8f518e62-4961-4952-830f-639dc686bfae tempest-VolumesSnapshotTestJSON-1082340868 None] Volume 6e34903c-731c-4898-94d7-9f2485dbe5eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e34903c-731c-4898-94d7-9f2485dbe5eb', 'volume_size': 1} Sep 06 06:46:28 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-8f518e62-4961-4952-830f-639dc686bfae tempest-VolumesSnapshotTestJSON-1082340868 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:46:28 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-8f518e62-4961-4952-830f-639dc686bfae tempest-VolumesSnapshotTestJSON-1082340868 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:46:28 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-8f518e62-4961-4952-830f-639dc686bfae tempest-VolumesSnapshotTestJSON-1082340868 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:46:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-550978167',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e34903c-731c-4898-94d7-9f2485dbe5eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8b3840bc7ae418496def1ce80fe4a5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:46:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:46:29Z,use_quota=True,user_id='9e41d548bb5d49b9b1ad894b4a46a3e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)}" {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 06:46:28 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-8f518e62-4961-4952-830f-639dc686bfae tempest-VolumesSnapshotTestJSON-1082340868 None] Creating volume 6e34903c-731c-4898-94d7-9f2485dbe5eb {{(pid=87329) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 06:46:28 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-8f518e62-4961-4952-830f-639dc686bfae tempest-VolumesSnapshotTestJSON-1082340868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:46:28 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-8f518e62-4961-4952-830f-639dc686bfae tempest-VolumesSnapshotTestJSON-1082340868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:46:28 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-8f518e62-4961-4952-830f-639dc686bfae tempest-VolumesSnapshotTestJSON-1082340868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:46:28 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-8f518e62-4961-4952-830f-639dc686bfae tempest-VolumesSnapshotTestJSON-1082340868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:46:28 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-8f518e62-4961-4952-830f-639dc686bfae tempest-VolumesSnapshotTestJSON-1082340868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:46:28 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-8f518e62-4961-4952-830f-639dc686bfae tempest-VolumesSnapshotTestJSON-1082340868 None] Selected osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 as target Quobyte volume. {{(pid=87329) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 06:46:28 devstack cinder-volume[87329]: INFO cinder.volume.drivers.remotefs [None req-8f518e62-4961-4952-830f-639dc686bfae tempest-VolumesSnapshotTestJSON-1082340868 None] casted to osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 Sep 06 06:46:28 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-8f518e62-4961-4952-830f-639dc686bfae tempest-VolumesSnapshotTestJSON-1082340868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6e34903c-731c-4898-94d7-9f2485dbe5eb 1073741824 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:46:28 devstack sudo[103445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6e34903c-731c-4898-94d7-9f2485dbe5eb 1073741824 Sep 06 06:46:28 devstack sudo[103445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:46:29 devstack sudo[103445]: pam_unix(sudo:session): session closed for user root Sep 06 06:46:29 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-8f518e62-4961-4952-830f-639dc686bfae tempest-VolumesSnapshotTestJSON-1082340868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6e34903c-731c-4898-94d7-9f2485dbe5eb 1073741824" returned: 0 in 0.390s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:46:29 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-8f518e62-4961-4952-830f-639dc686bfae tempest-VolumesSnapshotTestJSON-1082340868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6e34903c-731c-4898-94d7-9f2485dbe5eb {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:46:29 devstack sudo[103451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6e34903c-731c-4898-94d7-9f2485dbe5eb Sep 06 06:46:29 devstack sudo[103451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:46:29 devstack sudo[103451]: pam_unix(sudo:session): session closed for user root Sep 06 06:46:29 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-8f518e62-4961-4952-830f-639dc686bfae tempest-VolumesSnapshotTestJSON-1082340868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6e34903c-731c-4898-94d7-9f2485dbe5eb" returned: 0 in 0.240s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:46:29 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-8f518e62-4961-4952-830f-639dc686bfae tempest-VolumesSnapshotTestJSON-1082340868 None] <== create_volume: return (668ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'} {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 06:46:29 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-8f518e62-4961-4952-830f-639dc686bfae tempest-VolumesSnapshotTestJSON-1082340868 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.670s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:46:29 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-8f518e62-4961-4952-830f-639dc686bfae tempest-VolumesSnapshotTestJSON-1082340868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b606ee7-a7ce-45ed-86e7-9dfb75f47c0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e34903c-731c-4898-94d7-9f2485dbe5eb', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:46:29 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-8f518e62-4961-4952-830f-639dc686bfae tempest-VolumesSnapshotTestJSON-1082340868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff58b6a2-d110-42a1-9b51-864dbc3c0e75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:46:29 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-8f518e62-4961-4952-830f-639dc686bfae tempest-VolumesSnapshotTestJSON-1082340868 None] Volume volume-6e34903c-731c-4898-94d7-9f2485dbe5eb (6e34903c-731c-4898-94d7-9f2485dbe5eb): created successfully Sep 06 06:46:29 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-8f518e62-4961-4952-830f-639dc686bfae tempest-VolumesSnapshotTestJSON-1082340868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff58b6a2-d110-42a1-9b51-864dbc3c0e75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:46:29 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-8f518e62-4961-4952-830f-639dc686bfae tempest-VolumesSnapshotTestJSON-1082340868 None] Flow 'volume_create_manager' (3d6d20ca-6642-4fe8-95a7-9e1a5dd98d4a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:46:29 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-8f518e62-4961-4952-830f-639dc686bfae tempest-VolumesSnapshotTestJSON-1082340868 None] Created volume successfully. Sep 06 06:46:29 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-125af084-c455-42c1-a6a0-dd0cadf51988 tempest-VolumesSnapshotTestJSON-1082340868 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:46:29 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-125af084-c455-42c1-a6a0-dd0cadf51988 tempest-VolumesSnapshotTestJSON-1082340868 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:46:29 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-125af084-c455-42c1-a6a0-dd0cadf51988 tempest-VolumesSnapshotTestJSON-1082340868 None] Creating offline snapshot 8859ec05-7b85-4116-9fab-0172ad843fbb of volume 6e34903c-731c-4898-94d7-9f2485dbe5eb {{(pid=87329) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 06 06:46:29 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[2569605c-48c4-4d07-85e3-8c8ac3d6f7c7]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:46:29 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-125af084-c455-42c1-a6a0-dd0cadf51988 tempest-VolumesSnapshotTestJSON-1082340868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6e34903c-731c-4898-94d7-9f2485dbe5eb {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:46:29 devstack sudo[103455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6e34903c-731c-4898-94d7-9f2485dbe5eb Sep 06 06:46:29 devstack sudo[103455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:46:30 devstack sudo[103455]: pam_unix(sudo:session): session closed for user root Sep 06 06:46:30 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-125af084-c455-42c1-a6a0-dd0cadf51988 tempest-VolumesSnapshotTestJSON-1082340868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6e34903c-731c-4898-94d7-9f2485dbe5eb" returned: 0 in 0.378s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:46:30 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-125af084-c455-42c1-a6a0-dd0cadf51988 tempest-VolumesSnapshotTestJSON-1082340868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6e34903c-731c-4898-94d7-9f2485dbe5eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6e34903c-731c-4898-94d7-9f2485dbe5eb.8859ec05-7b85-4116-9fab-0172ad843fbb 1G {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:46:30 devstack sudo[103460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6e34903c-731c-4898-94d7-9f2485dbe5eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6e34903c-731c-4898-94d7-9f2485dbe5eb.8859ec05-7b85-4116-9fab-0172ad843fbb 1G Sep 06 06:46:30 devstack sudo[103460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:46:30 devstack sudo[103460]: pam_unix(sudo:session): session closed for user root Sep 06 06:46:30 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-125af084-c455-42c1-a6a0-dd0cadf51988 tempest-VolumesSnapshotTestJSON-1082340868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6e34903c-731c-4898-94d7-9f2485dbe5eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6e34903c-731c-4898-94d7-9f2485dbe5eb.8859ec05-7b85-4116-9fab-0172ad843fbb 1G" returned: 0 in 0.371s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:46:30 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-125af084-c455-42c1-a6a0-dd0cadf51988 tempest-VolumesSnapshotTestJSON-1082340868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e34903c-731c-4898-94d7-9f2485dbe5eb -F qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6e34903c-731c-4898-94d7-9f2485dbe5eb.8859ec05-7b85-4116-9fab-0172ad843fbb {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:46:30 devstack sudo[103466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e34903c-731c-4898-94d7-9f2485dbe5eb -F qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6e34903c-731c-4898-94d7-9f2485dbe5eb.8859ec05-7b85-4116-9fab-0172ad843fbb Sep 06 06:46:30 devstack sudo[103466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:46:30 devstack sudo[103466]: pam_unix(sudo:session): session closed for user root Sep 06 06:46:30 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-125af084-c455-42c1-a6a0-dd0cadf51988 tempest-VolumesSnapshotTestJSON-1082340868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e34903c-731c-4898-94d7-9f2485dbe5eb -F qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6e34903c-731c-4898-94d7-9f2485dbe5eb.8859ec05-7b85-4116-9fab-0172ad843fbb" returned: 0 in 0.297s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:46:30 devstack cinder-volume[87329]: WARNING cinder.volume.drivers.remotefs [None req-125af084-c455-42c1-a6a0-dd0cadf51988 tempest-VolumesSnapshotTestJSON-1082340868 None] /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6e34903c-731c-4898-94d7-9f2485dbe5eb.8859ec05-7b85-4116-9fab-0172ad843fbb is being set with open permissions: ugo+rw Sep 06 06:46:30 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-125af084-c455-42c1-a6a0-dd0cadf51988 tempest-VolumesSnapshotTestJSON-1082340868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6e34903c-731c-4898-94d7-9f2485dbe5eb.8859ec05-7b85-4116-9fab-0172ad843fbb {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:46:30 devstack sudo[103471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6e34903c-731c-4898-94d7-9f2485dbe5eb.8859ec05-7b85-4116-9fab-0172ad843fbb Sep 06 06:46:30 devstack sudo[103471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:46:31 devstack sudo[103471]: pam_unix(sudo:session): session closed for user root Sep 06 06:46:31 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-125af084-c455-42c1-a6a0-dd0cadf51988 tempest-VolumesSnapshotTestJSON-1082340868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6e34903c-731c-4898-94d7-9f2485dbe5eb.8859ec05-7b85-4116-9fab-0172ad843fbb" returned: 0 in 0.237s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:46:31 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-125af084-c455-42c1-a6a0-dd0cadf51988 tempest-VolumesSnapshotTestJSON-1082340868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6e34903c-731c-4898-94d7-9f2485dbe5eb.info {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:46:31 devstack sudo[103474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6e34903c-731c-4898-94d7-9f2485dbe5eb.info Sep 06 06:46:31 devstack sudo[103474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:46:31 devstack sudo[103474]: pam_unix(sudo:session): session closed for user root Sep 06 06:46:31 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-125af084-c455-42c1-a6a0-dd0cadf51988 tempest-VolumesSnapshotTestJSON-1082340868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6e34903c-731c-4898-94d7-9f2485dbe5eb.info" returned: 0 in 0.240s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:46:31 devstack cinder-volume[87329]: WARNING cinder.volume.drivers.remotefs [None req-125af084-c455-42c1-a6a0-dd0cadf51988 tempest-VolumesSnapshotTestJSON-1082340868 None] /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6e34903c-731c-4898-94d7-9f2485dbe5eb.info is being set with open permissions: ugo+rw Sep 06 06:46:31 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-125af084-c455-42c1-a6a0-dd0cadf51988 tempest-VolumesSnapshotTestJSON-1082340868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6e34903c-731c-4898-94d7-9f2485dbe5eb.info {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:46:31 devstack sudo[103477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6e34903c-731c-4898-94d7-9f2485dbe5eb.info Sep 06 06:46:31 devstack sudo[103477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:46:31 devstack sudo[103477]: pam_unix(sudo:session): session closed for user root Sep 06 06:46:31 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-125af084-c455-42c1-a6a0-dd0cadf51988 tempest-VolumesSnapshotTestJSON-1082340868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6e34903c-731c-4898-94d7-9f2485dbe5eb.info" returned: 0 in 0.237s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:46:31 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-125af084-c455-42c1-a6a0-dd0cadf51988 tempest-VolumesSnapshotTestJSON-1082340868 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.844s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:46:31 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-125af084-c455-42c1-a6a0-dd0cadf51988 tempest-VolumesSnapshotTestJSON-1082340868 None] Create snapshot completed successfully Sep 06 06:46:32 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-09728c5f-f3c2-4f6e-87bd-c09b586b7c3a tempest-VolumesSnapshotTestJSON-1082340868 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87329) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 06:46:32 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-09728c5f-f3c2-4f6e-87bd-c09b586b7c3a tempest-VolumesSnapshotTestJSON-1082340868 None] Flow 'volume_create_manager' (cd4dd73a-7643-4c78-add5-96dc9ea0010b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:46:32 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-09728c5f-f3c2-4f6e-87bd-c09b586b7c3a tempest-VolumesSnapshotTestJSON-1082340868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b335f85b-838b-415c-99d2-ad09401fa648) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:46:32 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-09728c5f-f3c2-4f6e-87bd-c09b586b7c3a tempest-VolumesSnapshotTestJSON-1082340868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b335f85b-838b-415c-99d2-ad09401fa648) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:46:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1976536037',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f9a393f-fe78-483d-ab36-2722393fff3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8b3840bc7ae418496def1ce80fe4a5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:46:32Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=8859ec05-7b85-4116-9fab-0172ad843fbb,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:46:32Z,use_quota=True,user_id='9e41d548bb5d49b9b1ad894b4a46a3e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:46:32 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-09728c5f-f3c2-4f6e-87bd-c09b586b7c3a tempest-VolumesSnapshotTestJSON-1082340868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (462b0502-1fb3-4355-8d19-3d262329bc89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:46:32 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-09728c5f-f3c2-4f6e-87bd-c09b586b7c3a tempest-VolumesSnapshotTestJSON-1082340868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (462b0502-1fb3-4355-8d19-3d262329bc89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:46:32 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-09728c5f-f3c2-4f6e-87bd-c09b586b7c3a tempest-VolumesSnapshotTestJSON-1082340868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (682730c5-523e-48da-8357-f15b64e012cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:46:32 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-09728c5f-f3c2-4f6e-87bd-c09b586b7c3a tempest-VolumesSnapshotTestJSON-1082340868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (682730c5-523e-48da-8357-f15b64e012cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '5f9a393f-fe78-483d-ab36-2722393fff3a', 'volume_name': 'volume-5f9a393f-fe78-483d-ab36-2722393fff3a', 'volume_size': 2, 'snapshot_id': '8859ec05-7b85-4116-9fab-0172ad843fbb'}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:46:32 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-09728c5f-f3c2-4f6e-87bd-c09b586b7c3a tempest-VolumesSnapshotTestJSON-1082340868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (215b5224-c3a2-4b1d-8a75-c0e1801d0b77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:46:32 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-09728c5f-f3c2-4f6e-87bd-c09b586b7c3a tempest-VolumesSnapshotTestJSON-1082340868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (215b5224-c3a2-4b1d-8a75-c0e1801d0b77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:46:32 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-09728c5f-f3c2-4f6e-87bd-c09b586b7c3a tempest-VolumesSnapshotTestJSON-1082340868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82965e6d-8343-4185-9adc-efbe620dc495) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:46:32 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-09728c5f-f3c2-4f6e-87bd-c09b586b7c3a tempest-VolumesSnapshotTestJSON-1082340868 None] Volume 5f9a393f-fe78-483d-ab36-2722393fff3a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-5f9a393f-fe78-483d-ab36-2722393fff3a', 'volume_size': 2, 'snapshot_id': '8859ec05-7b85-4116-9fab-0172ad843fbb'} Sep 06 06:46:32 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-09728c5f-f3c2-4f6e-87bd-c09b586b7c3a tempest-VolumesSnapshotTestJSON-1082340868 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:46:32 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-09728c5f-f3c2-4f6e-87bd-c09b586b7c3a tempest-VolumesSnapshotTestJSON-1082340868 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:46:32 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-09728c5f-f3c2-4f6e-87bd-c09b586b7c3a tempest-VolumesSnapshotTestJSON-1082340868 None] Acquiring lock "cinder-quobyte-8859ec05-7b85-4116-9fab-0172ad843fbb-5f9a393f-fe78-483d-ab36-2722393fff3a" by "_create_volume_from_snapshot" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:46:32 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-09728c5f-f3c2-4f6e-87bd-c09b586b7c3a tempest-VolumesSnapshotTestJSON-1082340868 None] Lock "cinder-quobyte-8859ec05-7b85-4116-9fab-0172ad843fbb-5f9a393f-fe78-483d-ab36-2722393fff3a" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:46:32 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-09728c5f-f3c2-4f6e-87bd-c09b586b7c3a tempest-VolumesSnapshotTestJSON-1082340868 None] Creating volume 5f9a393f-fe78-483d-ab36-2722393fff3a from snapshot 8859ec05-7b85-4116-9fab-0172ad843fbb {{(pid=87329) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 06 06:46:32 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-09728c5f-f3c2-4f6e-87bd-c09b586b7c3a tempest-VolumesSnapshotTestJSON-1082340868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:46:32 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-09728c5f-f3c2-4f6e-87bd-c09b586b7c3a tempest-VolumesSnapshotTestJSON-1082340868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:46:32 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-09728c5f-f3c2-4f6e-87bd-c09b586b7c3a tempest-VolumesSnapshotTestJSON-1082340868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:46:32 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-09728c5f-f3c2-4f6e-87bd-c09b586b7c3a tempest-VolumesSnapshotTestJSON-1082340868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:46:32 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-09728c5f-f3c2-4f6e-87bd-c09b586b7c3a tempest-VolumesSnapshotTestJSON-1082340868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:46:32 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-09728c5f-f3c2-4f6e-87bd-c09b586b7c3a tempest-VolumesSnapshotTestJSON-1082340868 None] Selected osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 as target Quobyte volume. {{(pid=87329) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 06:46:32 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-09728c5f-f3c2-4f6e-87bd-c09b586b7c3a tempest-VolumesSnapshotTestJSON-1082340868 None] Acquiring lock "cinder-quobyte-5f9a393f-fe78-483d-ab36-2722393fff3a" by "_copy_volume_from_snapshot" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:46:32 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-09728c5f-f3c2-4f6e-87bd-c09b586b7c3a tempest-VolumesSnapshotTestJSON-1082340868 None] Lock "cinder-quobyte-5f9a393f-fe78-483d-ab36-2722393fff3a" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:46:32 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-09728c5f-f3c2-4f6e-87bd-c09b586b7c3a tempest-VolumesSnapshotTestJSON-1082340868 None] snapshot: 8859ec05-7b85-4116-9fab-0172ad843fbb, volume: 5f9a393f-fe78-483d-ab36-2722393fff3a, {{(pid=87329) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 06 06:46:32 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-09728c5f-f3c2-4f6e-87bd-c09b586b7c3a tempest-VolumesSnapshotTestJSON-1082340868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:46:32 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-09728c5f-f3c2-4f6e-87bd-c09b586b7c3a tempest-VolumesSnapshotTestJSON-1082340868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:46:32 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-09728c5f-f3c2-4f6e-87bd-c09b586b7c3a tempest-VolumesSnapshotTestJSON-1082340868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:46:32 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-09728c5f-f3c2-4f6e-87bd-c09b586b7c3a tempest-VolumesSnapshotTestJSON-1082340868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:46:32 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-09728c5f-f3c2-4f6e-87bd-c09b586b7c3a tempest-VolumesSnapshotTestJSON-1082340868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:46:32 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a70cddc-6500-41ab-aa6c-db375e8fdaa3]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:46:32 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-09728c5f-f3c2-4f6e-87bd-c09b586b7c3a tempest-VolumesSnapshotTestJSON-1082340868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6e34903c-731c-4898-94d7-9f2485dbe5eb.8859ec05-7b85-4116-9fab-0172ad843fbb {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:46:32 devstack sudo[103492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6e34903c-731c-4898-94d7-9f2485dbe5eb.8859ec05-7b85-4116-9fab-0172ad843fbb Sep 06 06:46:32 devstack sudo[103492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:46:33 devstack sudo[103492]: pam_unix(sudo:session): session closed for user root Sep 06 06:46:33 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-09728c5f-f3c2-4f6e-87bd-c09b586b7c3a tempest-VolumesSnapshotTestJSON-1082340868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6e34903c-731c-4898-94d7-9f2485dbe5eb.8859ec05-7b85-4116-9fab-0172ad843fbb" returned: 0 in 0.399s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:46:33 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-09728c5f-f3c2-4f6e-87bd-c09b586b7c3a tempest-VolumesSnapshotTestJSON-1082340868 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6e34903c-731c-4898-94d7-9f2485dbe5eb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87329) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 06:46:33 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[68cf6391-d5e7-42f3-95c4-e08d23edc028]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:46:33 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-09728c5f-f3c2-4f6e-87bd-c09b586b7c3a tempest-VolumesSnapshotTestJSON-1082340868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6e34903c-731c-4898-94d7-9f2485dbe5eb {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:46:33 devstack sudo[103499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6e34903c-731c-4898-94d7-9f2485dbe5eb Sep 06 06:46:33 devstack sudo[103499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:46:33 devstack sudo[103499]: pam_unix(sudo:session): session closed for user root Sep 06 06:46:33 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-09728c5f-f3c2-4f6e-87bd-c09b586b7c3a tempest-VolumesSnapshotTestJSON-1082340868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6e34903c-731c-4898-94d7-9f2485dbe5eb" returned: 0 in 0.377s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:46:33 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-09728c5f-f3c2-4f6e-87bd-c09b586b7c3a tempest-VolumesSnapshotTestJSON-1082340868 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6e34903c-731c-4898-94d7-9f2485dbe5eb {{(pid=87329) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 06 06:46:33 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-09728c5f-f3c2-4f6e-87bd-c09b586b7c3a tempest-VolumesSnapshotTestJSON-1082340868 None] Creating direct copy from snapshot {{(pid=87329) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 06 06:46:33 devstack cinder-volume[87329]: DEBUG cinder.utils [None req-09728c5f-f3c2-4f6e-87bd-c09b586b7c3a tempest-VolumesSnapshotTestJSON-1082340868 None] Path /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-5f9a393f-fe78-483d-ab36-2722393fff3a not found in is_blk_device check {{(pid=87329) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 06 06:46:33 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-09728c5f-f3c2-4f6e-87bd-c09b586b7c3a tempest-VolumesSnapshotTestJSON-1082340868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6e34903c-731c-4898-94d7-9f2485dbe5eb /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-5f9a393f-fe78-483d-ab36-2722393fff3a {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:46:33 devstack sudo[103507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6e34903c-731c-4898-94d7-9f2485dbe5eb /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-5f9a393f-fe78-483d-ab36-2722393fff3a Sep 06 06:46:33 devstack sudo[103507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:46:37 devstack cinder-volume[87329]: INFO cinder.volume.manager [req-9debe6c0-24db-4045-ba2e-2df8aaf3e971 req-e4ec43ef-3c2e-47cb-8391-f6866bc53740 tempest-TestShelveInstance-2122303240 None] Terminate volume connection completed successfully. Sep 06 06:46:37 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [req-9debe6c0-24db-4045-ba2e-2df8aaf3e971 req-e4ec43ef-3c2e-47cb-8391-f6866bc53740 tempest-TestShelveInstance-2122303240 None] Deleting attachment 6d3a307f-c4de-48fa-91be-9b88d6ed3037. {{(pid=87329) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 06 06:46:38 devstack sudo[103507]: pam_unix(sudo:session): session closed for user root Sep 06 06:46:38 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-09728c5f-f3c2-4f6e-87bd-c09b586b7c3a tempest-VolumesSnapshotTestJSON-1082340868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6e34903c-731c-4898-94d7-9f2485dbe5eb /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-5f9a393f-fe78-483d-ab36-2722393fff3a" returned: 0 in 5.179s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:46:38 devstack cinder-volume[87329]: DEBUG cinder.image.image_utils [None req-09728c5f-f3c2-4f6e-87bd-c09b586b7c3a tempest-VolumesSnapshotTestJSON-1082340868 None] Image conversion details: src /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6e34903c-731c-4898-94d7-9f2485dbe5eb, size 1024.00 MB, duration 5.18 sec, destination /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-5f9a393f-fe78-483d-ab36-2722393fff3a {{(pid=87329) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 06 06:46:38 devstack cinder-volume[87329]: INFO cinder.image.image_utils [None req-09728c5f-f3c2-4f6e-87bd-c09b586b7c3a tempest-VolumesSnapshotTestJSON-1082340868 None] Converted 1024.00 MB image at 197.68 MB/s Sep 06 06:46:38 devstack cinder-volume[87329]: WARNING cinder.volume.drivers.remotefs [None req-09728c5f-f3c2-4f6e-87bd-c09b586b7c3a tempest-VolumesSnapshotTestJSON-1082340868 None] /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-5f9a393f-fe78-483d-ab36-2722393fff3a is being set with open permissions: ugo+rw Sep 06 06:46:38 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-09728c5f-f3c2-4f6e-87bd-c09b586b7c3a tempest-VolumesSnapshotTestJSON-1082340868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-5f9a393f-fe78-483d-ab36-2722393fff3a {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:46:38 devstack sudo[103541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-5f9a393f-fe78-483d-ab36-2722393fff3a Sep 06 06:46:38 devstack sudo[103541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:46:38 devstack sudo[103541]: pam_unix(sudo:session): session closed for user root Sep 06 06:46:38 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-09728c5f-f3c2-4f6e-87bd-c09b586b7c3a tempest-VolumesSnapshotTestJSON-1082340868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-5f9a393f-fe78-483d-ab36-2722393fff3a" returned: 0 in 0.269s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:46:38 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-09728c5f-f3c2-4f6e-87bd-c09b586b7c3a tempest-VolumesSnapshotTestJSON-1082340868 None] Lock "cinder-quobyte-5f9a393f-fe78-483d-ab36-2722393fff3a" released by "_copy_volume_from_snapshot" :: held 6.307s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:46:39 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-09728c5f-f3c2-4f6e-87bd-c09b586b7c3a tempest-VolumesSnapshotTestJSON-1082340868 None] Lock "cinder-quobyte-8859ec05-7b85-4116-9fab-0172ad843fbb-5f9a393f-fe78-483d-ab36-2722393fff3a" released by "_create_volume_from_snapshot" :: held 6.421s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:46:39 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-09728c5f-f3c2-4f6e-87bd-c09b586b7c3a tempest-VolumesSnapshotTestJSON-1082340868 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.438s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:46:39 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-09728c5f-f3c2-4f6e-87bd-c09b586b7c3a tempest-VolumesSnapshotTestJSON-1082340868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82965e6d-8343-4185-9adc-efbe620dc495) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f9a393f-fe78-483d-ab36-2722393fff3a', 'volume_size': 2, 'snapshot_id': '8859ec05-7b85-4116-9fab-0172ad843fbb'}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:46:39 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-09728c5f-f3c2-4f6e-87bd-c09b586b7c3a tempest-VolumesSnapshotTestJSON-1082340868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f3ff7c3-2289-4627-ab89-1ff94ffbd694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:46:39 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-09728c5f-f3c2-4f6e-87bd-c09b586b7c3a tempest-VolumesSnapshotTestJSON-1082340868 None] Volume volume-5f9a393f-fe78-483d-ab36-2722393fff3a (5f9a393f-fe78-483d-ab36-2722393fff3a): created successfully Sep 06 06:46:39 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-09728c5f-f3c2-4f6e-87bd-c09b586b7c3a tempest-VolumesSnapshotTestJSON-1082340868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f3ff7c3-2289-4627-ab89-1ff94ffbd694) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:46:39 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-09728c5f-f3c2-4f6e-87bd-c09b586b7c3a tempest-VolumesSnapshotTestJSON-1082340868 None] Flow 'volume_create_manager' (cd4dd73a-7643-4c78-add5-96dc9ea0010b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:46:39 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-09728c5f-f3c2-4f6e-87bd-c09b586b7c3a tempest-VolumesSnapshotTestJSON-1082340868 None] Created volume successfully. Sep 06 06:46:39 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-c5bfe5a1-47fa-4053-80aa-94d5d267615c tempest-VolumesSnapshotTestJSON-1082340868 None] Acquiring lock "cinder-5f9a393f-fe78-483d-ab36-2722393fff3a-delete_volume" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:46:39 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-c5bfe5a1-47fa-4053-80aa-94d5d267615c tempest-VolumesSnapshotTestJSON-1082340868 None] Lock "cinder-5f9a393f-fe78-483d-ab36-2722393fff3a-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:46:39 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-c5bfe5a1-47fa-4053-80aa-94d5d267615c tempest-VolumesSnapshotTestJSON-1082340868 None] Acquiring lock "cinder-quobyte-5f9a393f-fe78-483d-ab36-2722393fff3a" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:46:39 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-c5bfe5a1-47fa-4053-80aa-94d5d267615c tempest-VolumesSnapshotTestJSON-1082340868 None] Lock "cinder-quobyte-5f9a393f-fe78-483d-ab36-2722393fff3a" acquired by "delete_volume" :: waited 0.018s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:46:39 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[790d11c3-aa75-4e13-9315-c5e235a89715]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:46:39 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-c5bfe5a1-47fa-4053-80aa-94d5d267615c tempest-VolumesSnapshotTestJSON-1082340868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-5f9a393f-fe78-483d-ab36-2722393fff3a {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:46:39 devstack sudo[103546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-5f9a393f-fe78-483d-ab36-2722393fff3a Sep 06 06:46:39 devstack sudo[103546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:46:39 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [req-1224b503-6a9f-4bbf-ba08-1d9646a9ef68 req-bcc5e348-8872-42d6-a83c-fc1b1fb29f29 tempest-TestShelveInstance-2122303240 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:46:39 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [req-1224b503-6a9f-4bbf-ba08-1d9646a9ef68 req-bcc5e348-8872-42d6-a83c-fc1b1fb29f29 tempest-TestShelveInstance-2122303240 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:46:39 devstack sudo[103546]: pam_unix(sudo:session): session closed for user root Sep 06 06:46:39 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-c5bfe5a1-47fa-4053-80aa-94d5d267615c tempest-VolumesSnapshotTestJSON-1082340868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-5f9a393f-fe78-483d-ab36-2722393fff3a" returned: 0 in 0.383s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:46:39 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-c5bfe5a1-47fa-4053-80aa-94d5d267615c tempest-VolumesSnapshotTestJSON-1082340868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-5f9a393f-fe78-483d-ab36-2722393fff3a {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:46:39 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [req-1224b503-6a9f-4bbf-ba08-1d9646a9ef68 req-bcc5e348-8872-42d6-a83c-fc1b1fb29f29 tempest-TestShelveInstance-2122303240 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.027s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:46:39 devstack sudo[103560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-5f9a393f-fe78-483d-ab36-2722393fff3a Sep 06 06:46:39 devstack sudo[103560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:46:39 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [req-1224b503-6a9f-4bbf-ba08-1d9646a9ef68 req-bcc5e348-8872-42d6-a83c-fc1b1fb29f29 tempest-TestShelveInstance-2122303240 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6', 'name': 'volume-0f9f4f61-8db4-4e0b-9497-063182c791dd', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd0489dc8-2423-4c61-a352-8f68ddbdc547', 'enforce_multipath': True} {{(pid=87329) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 06 06:46:39 devstack cinder-volume[87329]: INFO cinder.volume.manager [req-1224b503-6a9f-4bbf-ba08-1d9646a9ef68 req-bcc5e348-8872-42d6-a83c-fc1b1fb29f29 tempest-TestShelveInstance-2122303240 None] attachment_update completed successfully. Sep 06 06:46:40 devstack sudo[103560]: pam_unix(sudo:session): session closed for user root Sep 06 06:46:40 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-c5bfe5a1-47fa-4053-80aa-94d5d267615c tempest-VolumesSnapshotTestJSON-1082340868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-5f9a393f-fe78-483d-ab36-2722393fff3a" returned: 0 in 0.263s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:46:40 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-c5bfe5a1-47fa-4053-80aa-94d5d267615c tempest-VolumesSnapshotTestJSON-1082340868 None] Lock "cinder-quobyte-5f9a393f-fe78-483d-ab36-2722393fff3a" released by "delete_volume" :: held 0.693s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:46:40 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-c5bfe5a1-47fa-4053-80aa-94d5d267615c tempest-VolumesSnapshotTestJSON-1082340868 None] Created reservations ['9f791a10-6592-4d35-a11b-32c137dddeda', '2846a129-b397-40d9-8c92-e79e184c9838', '2fd1dc43-d43c-4a3e-8639-0cdbb3fee573', '421970e6-44ba-4439-92bc-0f4fc44e5891'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:46:40 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-c5bfe5a1-47fa-4053-80aa-94d5d267615c tempest-VolumesSnapshotTestJSON-1082340868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:46:40 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-c5bfe5a1-47fa-4053-80aa-94d5d267615c tempest-VolumesSnapshotTestJSON-1082340868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:46:40 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-c5bfe5a1-47fa-4053-80aa-94d5d267615c tempest-VolumesSnapshotTestJSON-1082340868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:46:40 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-c5bfe5a1-47fa-4053-80aa-94d5d267615c tempest-VolumesSnapshotTestJSON-1082340868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:46:40 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-c5bfe5a1-47fa-4053-80aa-94d5d267615c tempest-VolumesSnapshotTestJSON-1082340868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:46:40 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-c5bfe5a1-47fa-4053-80aa-94d5d267615c tempest-VolumesSnapshotTestJSON-1082340868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:46:40 devstack sudo[103563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:46:40 devstack sudo[103563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:46:40 devstack sudo[103563]: pam_unix(sudo:session): session closed for user root Sep 06 06:46:40 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-c5bfe5a1-47fa-4053-80aa-94d5d267615c tempest-VolumesSnapshotTestJSON-1082340868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.276s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:46:40 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-c5bfe5a1-47fa-4053-80aa-94d5d267615c tempest-VolumesSnapshotTestJSON-1082340868 None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:46:40 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-c5bfe5a1-47fa-4053-80aa-94d5d267615c tempest-VolumesSnapshotTestJSON-1082340868 None] Deleted volume successfully. Sep 06 06:46:40 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-c5bfe5a1-47fa-4053-80aa-94d5d267615c tempest-VolumesSnapshotTestJSON-1082340868 None] Lock "cinder-5f9a393f-fe78-483d-ab36-2722393fff3a-delete_volume" released by "delete_volume" :: held 1.186s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:46:40 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-22a23958-9ca3-4801-b9ce-f3c1c3467707 tempest-VolumesSnapshotTestJSON-1082340868 None] Acquiring lock "cinder-8859ec05-7b85-4116-9fab-0172ad843fbb-delete_snapshot" by "delete_snapshot" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:46:40 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-22a23958-9ca3-4801-b9ce-f3c1c3467707 tempest-VolumesSnapshotTestJSON-1082340868 None] Lock "cinder-8859ec05-7b85-4116-9fab-0172ad843fbb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:46:40 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-22a23958-9ca3-4801-b9ce-f3c1c3467707 tempest-VolumesSnapshotTestJSON-1082340868 None] Acquiring lock "cinder-quobyte-6e34903c-731c-4898-94d7-9f2485dbe5eb" by "delete_snapshot" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:46:40 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-22a23958-9ca3-4801-b9ce-f3c1c3467707 tempest-VolumesSnapshotTestJSON-1082340868 None] Lock "cinder-quobyte-6e34903c-731c-4898-94d7-9f2485dbe5eb" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:46:40 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-22a23958-9ca3-4801-b9ce-f3c1c3467707 tempest-VolumesSnapshotTestJSON-1082340868 None] Acquiring lock "cinder-quobyte-8859ec05-7b85-4116-9fab-0172ad843fbb" by "_delete_snapshot" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:46:40 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-22a23958-9ca3-4801-b9ce-f3c1c3467707 tempest-VolumesSnapshotTestJSON-1082340868 None] Lock "cinder-quobyte-8859ec05-7b85-4116-9fab-0172ad843fbb" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:46:40 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-22a23958-9ca3-4801-b9ce-f3c1c3467707 tempest-VolumesSnapshotTestJSON-1082340868 None] Deleting offline snapshot 8859ec05-7b85-4116-9fab-0172ad843fbb of volume 6e34903c-731c-4898-94d7-9f2485dbe5eb {{(pid=87329) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 06 06:46:40 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-22a23958-9ca3-4801-b9ce-f3c1c3467707 tempest-VolumesSnapshotTestJSON-1082340868 None] snapshot_file for this snap is: volume-6e34903c-731c-4898-94d7-9f2485dbe5eb.8859ec05-7b85-4116-9fab-0172ad843fbb {{(pid=87329) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 06 06:46:40 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c6b2dfe-ad4f-4c84-9301-3b1492540e05]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:46:40 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-22a23958-9ca3-4801-b9ce-f3c1c3467707 tempest-VolumesSnapshotTestJSON-1082340868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6e34903c-731c-4898-94d7-9f2485dbe5eb.8859ec05-7b85-4116-9fab-0172ad843fbb {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:46:40 devstack sudo[103566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6e34903c-731c-4898-94d7-9f2485dbe5eb.8859ec05-7b85-4116-9fab-0172ad843fbb Sep 06 06:46:40 devstack sudo[103566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:46:41 devstack sudo[103566]: pam_unix(sudo:session): session closed for user root Sep 06 06:46:41 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-22a23958-9ca3-4801-b9ce-f3c1c3467707 tempest-VolumesSnapshotTestJSON-1082340868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6e34903c-731c-4898-94d7-9f2485dbe5eb.8859ec05-7b85-4116-9fab-0172ad843fbb" returned: 0 in 0.354s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:46:41 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-22a23958-9ca3-4801-b9ce-f3c1c3467707 tempest-VolumesSnapshotTestJSON-1082340868 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6e34903c-731c-4898-94d7-9f2485dbe5eb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87329) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 06:46:41 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b981607-b148-4f81-862f-1c7d5fc2b1cc]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:46:41 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-22a23958-9ca3-4801-b9ce-f3c1c3467707 tempest-VolumesSnapshotTestJSON-1082340868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6e34903c-731c-4898-94d7-9f2485dbe5eb {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:46:41 devstack sudo[103571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6e34903c-731c-4898-94d7-9f2485dbe5eb Sep 06 06:46:41 devstack sudo[103571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:46:41 devstack sudo[103571]: pam_unix(sudo:session): session closed for user root Sep 06 06:46:41 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-22a23958-9ca3-4801-b9ce-f3c1c3467707 tempest-VolumesSnapshotTestJSON-1082340868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6e34903c-731c-4898-94d7-9f2485dbe5eb" returned: 0 in 0.541s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:46:41 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-22a23958-9ca3-4801-b9ce-f3c1c3467707 tempest-VolumesSnapshotTestJSON-1082340868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6e34903c-731c-4898-94d7-9f2485dbe5eb.8859ec05-7b85-4116-9fab-0172ad843fbb {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:46:41 devstack sudo[103577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6e34903c-731c-4898-94d7-9f2485dbe5eb.8859ec05-7b85-4116-9fab-0172ad843fbb Sep 06 06:46:41 devstack sudo[103577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:46:41 devstack sudo[103577]: pam_unix(sudo:session): session closed for user root Sep 06 06:46:41 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-22a23958-9ca3-4801-b9ce-f3c1c3467707 tempest-VolumesSnapshotTestJSON-1082340868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6e34903c-731c-4898-94d7-9f2485dbe5eb.8859ec05-7b85-4116-9fab-0172ad843fbb" returned: 0 in 0.390s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:46:41 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-22a23958-9ca3-4801-b9ce-f3c1c3467707 tempest-VolumesSnapshotTestJSON-1082340868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6e34903c-731c-4898-94d7-9f2485dbe5eb.8859ec05-7b85-4116-9fab-0172ad843fbb {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:46:41 devstack sudo[103617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6e34903c-731c-4898-94d7-9f2485dbe5eb.8859ec05-7b85-4116-9fab-0172ad843fbb Sep 06 06:46:41 devstack sudo[103617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:46:42 devstack sudo[103617]: pam_unix(sudo:session): session closed for user root Sep 06 06:46:42 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-22a23958-9ca3-4801-b9ce-f3c1c3467707 tempest-VolumesSnapshotTestJSON-1082340868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6e34903c-731c-4898-94d7-9f2485dbe5eb.8859ec05-7b85-4116-9fab-0172ad843fbb" returned: 0 in 0.335s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:46:42 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-22a23958-9ca3-4801-b9ce-f3c1c3467707 tempest-VolumesSnapshotTestJSON-1082340868 None] Lock "cinder-quobyte-8859ec05-7b85-4116-9fab-0172ad843fbb" released by "_delete_snapshot" :: held 1.726s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:46:42 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-22a23958-9ca3-4801-b9ce-f3c1c3467707 tempest-VolumesSnapshotTestJSON-1082340868 None] Lock "cinder-quobyte-6e34903c-731c-4898-94d7-9f2485dbe5eb" released by "delete_snapshot" :: held 1.755s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:46:42 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-22a23958-9ca3-4801-b9ce-f3c1c3467707 tempest-VolumesSnapshotTestJSON-1082340868 None] Created reservations ['85e03965-06e6-40f5-a9d2-c176acfbe8a1', '8ae2b270-4ae1-41f0-8fd3-28fcc374be00', 'cfad0793-de21-491d-a4e4-ebf9b2a680fc', 'ef209c82-f4ae-41ac-a70c-fb436ca2684e'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:46:42 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-22a23958-9ca3-4801-b9ce-f3c1c3467707 tempest-VolumesSnapshotTestJSON-1082340868 None] Delete snapshot completed successfully. Sep 06 06:46:42 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-22a23958-9ca3-4801-b9ce-f3c1c3467707 tempest-VolumesSnapshotTestJSON-1082340868 None] Lock "cinder-8859ec05-7b85-4116-9fab-0172ad843fbb-delete_snapshot" released by "delete_snapshot" :: held 1.943s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:46:42 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-23669b18-7c1b-44ba-8085-6c973ea2846c tempest-VolumesSnapshotTestJSON-1082340868 None] Acquiring lock "cinder-6e34903c-731c-4898-94d7-9f2485dbe5eb-delete_volume" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:46:42 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-23669b18-7c1b-44ba-8085-6c973ea2846c tempest-VolumesSnapshotTestJSON-1082340868 None] Lock "cinder-6e34903c-731c-4898-94d7-9f2485dbe5eb-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:46:42 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-23669b18-7c1b-44ba-8085-6c973ea2846c tempest-VolumesSnapshotTestJSON-1082340868 None] Acquiring lock "cinder-quobyte-6e34903c-731c-4898-94d7-9f2485dbe5eb" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:46:42 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-23669b18-7c1b-44ba-8085-6c973ea2846c tempest-VolumesSnapshotTestJSON-1082340868 None] Lock "cinder-quobyte-6e34903c-731c-4898-94d7-9f2485dbe5eb" acquired by "delete_volume" :: waited 0.026s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:46:43 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac0fdd4a-f0c5-4bc2-9ead-5a6b8449dd8b]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:46:43 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-23669b18-7c1b-44ba-8085-6c973ea2846c tempest-VolumesSnapshotTestJSON-1082340868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6e34903c-731c-4898-94d7-9f2485dbe5eb {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:46:43 devstack sudo[104041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6e34903c-731c-4898-94d7-9f2485dbe5eb Sep 06 06:46:43 devstack sudo[104041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:46:43 devstack sudo[104041]: pam_unix(sudo:session): session closed for user root Sep 06 06:46:43 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-23669b18-7c1b-44ba-8085-6c973ea2846c tempest-VolumesSnapshotTestJSON-1082340868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6e34903c-731c-4898-94d7-9f2485dbe5eb" returned: 0 in 0.498s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:46:43 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-23669b18-7c1b-44ba-8085-6c973ea2846c tempest-VolumesSnapshotTestJSON-1082340868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6e34903c-731c-4898-94d7-9f2485dbe5eb {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:46:43 devstack sudo[104072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6e34903c-731c-4898-94d7-9f2485dbe5eb Sep 06 06:46:43 devstack sudo[104072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:46:43 devstack sudo[104072]: pam_unix(sudo:session): session closed for user root Sep 06 06:46:43 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-23669b18-7c1b-44ba-8085-6c973ea2846c tempest-VolumesSnapshotTestJSON-1082340868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6e34903c-731c-4898-94d7-9f2485dbe5eb" returned: 0 in 0.252s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:46:43 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-23669b18-7c1b-44ba-8085-6c973ea2846c tempest-VolumesSnapshotTestJSON-1082340868 None] Lock "cinder-quobyte-6e34903c-731c-4898-94d7-9f2485dbe5eb" released by "delete_volume" :: held 0.863s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:46:43 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-23669b18-7c1b-44ba-8085-6c973ea2846c tempest-VolumesSnapshotTestJSON-1082340868 None] Created reservations ['1966c717-fc11-4f99-9457-7396c453f2d4', 'f1343af6-b40c-4e76-b6cc-bc73306466ed', 'c3948956-13ec-432b-9f7c-13cf1432a91f', '33cf252a-2ab9-4df0-a221-3b16ca3405c5'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:46:43 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-23669b18-7c1b-44ba-8085-6c973ea2846c tempest-VolumesSnapshotTestJSON-1082340868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:46:43 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-23669b18-7c1b-44ba-8085-6c973ea2846c tempest-VolumesSnapshotTestJSON-1082340868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:46:43 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-23669b18-7c1b-44ba-8085-6c973ea2846c tempest-VolumesSnapshotTestJSON-1082340868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:46:43 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-23669b18-7c1b-44ba-8085-6c973ea2846c tempest-VolumesSnapshotTestJSON-1082340868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:46:43 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-23669b18-7c1b-44ba-8085-6c973ea2846c tempest-VolumesSnapshotTestJSON-1082340868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:46:43 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-23669b18-7c1b-44ba-8085-6c973ea2846c tempest-VolumesSnapshotTestJSON-1082340868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:46:43 devstack sudo[104075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:46:43 devstack sudo[104075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:46:44 devstack sudo[104075]: pam_unix(sudo:session): session closed for user root Sep 06 06:46:44 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-23669b18-7c1b-44ba-8085-6c973ea2846c tempest-VolumesSnapshotTestJSON-1082340868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.255s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:46:44 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-23669b18-7c1b-44ba-8085-6c973ea2846c tempest-VolumesSnapshotTestJSON-1082340868 None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:46:44 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-23669b18-7c1b-44ba-8085-6c973ea2846c tempest-VolumesSnapshotTestJSON-1082340868 None] Deleted volume successfully. Sep 06 06:46:44 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-23669b18-7c1b-44ba-8085-6c973ea2846c tempest-VolumesSnapshotTestJSON-1082340868 None] Lock "cinder-6e34903c-731c-4898-94d7-9f2485dbe5eb-delete_volume" released by "delete_volume" :: held 1.359s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:46:44 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-259dd337-ede3-4f13-88c2-bff6869413ec tempest-VolumesSnapshotTestJSON-1082340868 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87329) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 06:46:44 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-259dd337-ede3-4f13-88c2-bff6869413ec tempest-VolumesSnapshotTestJSON-1082340868 None] Flow 'volume_create_manager' (c7bed25c-3d21-43b4-b785-513c73ca3894) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:46:44 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-259dd337-ede3-4f13-88c2-bff6869413ec tempest-VolumesSnapshotTestJSON-1082340868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3de47cd-3146-4906-aa63-8ea0bd7fd7a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:46:44 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-259dd337-ede3-4f13-88c2-bff6869413ec tempest-VolumesSnapshotTestJSON-1082340868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3de47cd-3146-4906-aa63-8ea0bd7fd7a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:46:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1820919720',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46affcaa-34b5-43bc-bd1f-97848a0ecd78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8b3840bc7ae418496def1ce80fe4a5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:46:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:46:45Z,use_quota=True,user_id='9e41d548bb5d49b9b1ad894b4a46a3e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:46:44 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-259dd337-ede3-4f13-88c2-bff6869413ec tempest-VolumesSnapshotTestJSON-1082340868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (097941bb-65ee-4dbd-9ccc-aa52bec6cd03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:46:44 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-259dd337-ede3-4f13-88c2-bff6869413ec tempest-VolumesSnapshotTestJSON-1082340868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (097941bb-65ee-4dbd-9ccc-aa52bec6cd03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:46:44 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-259dd337-ede3-4f13-88c2-bff6869413ec tempest-VolumesSnapshotTestJSON-1082340868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16366c70-2390-4acb-9516-bd3d03e98609) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:46:44 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-259dd337-ede3-4f13-88c2-bff6869413ec tempest-VolumesSnapshotTestJSON-1082340868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16366c70-2390-4acb-9516-bd3d03e98609) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46affcaa-34b5-43bc-bd1f-97848a0ecd78', 'volume_name': 'volume-46affcaa-34b5-43bc-bd1f-97848a0ecd78', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:46:44 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-259dd337-ede3-4f13-88c2-bff6869413ec tempest-VolumesSnapshotTestJSON-1082340868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7d202e4-8281-40dd-a10b-01233d340bb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:46:44 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-259dd337-ede3-4f13-88c2-bff6869413ec tempest-VolumesSnapshotTestJSON-1082340868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7d202e4-8281-40dd-a10b-01233d340bb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:46:44 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-259dd337-ede3-4f13-88c2-bff6869413ec tempest-VolumesSnapshotTestJSON-1082340868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24f32cad-e86a-4466-8cde-0e79997edf9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:46:44 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-259dd337-ede3-4f13-88c2-bff6869413ec tempest-VolumesSnapshotTestJSON-1082340868 None] Volume 46affcaa-34b5-43bc-bd1f-97848a0ecd78: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46affcaa-34b5-43bc-bd1f-97848a0ecd78', 'volume_size': 1} Sep 06 06:46:44 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-259dd337-ede3-4f13-88c2-bff6869413ec tempest-VolumesSnapshotTestJSON-1082340868 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:46:44 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-259dd337-ede3-4f13-88c2-bff6869413ec tempest-VolumesSnapshotTestJSON-1082340868 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:46:44 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-259dd337-ede3-4f13-88c2-bff6869413ec tempest-VolumesSnapshotTestJSON-1082340868 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:46:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1820919720',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46affcaa-34b5-43bc-bd1f-97848a0ecd78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8b3840bc7ae418496def1ce80fe4a5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:46:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:46:45Z,use_quota=True,user_id='9e41d548bb5d49b9b1ad894b4a46a3e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)}" {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 06:46:44 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-259dd337-ede3-4f13-88c2-bff6869413ec tempest-VolumesSnapshotTestJSON-1082340868 None] Creating volume 46affcaa-34b5-43bc-bd1f-97848a0ecd78 {{(pid=87329) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 06:46:44 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-259dd337-ede3-4f13-88c2-bff6869413ec tempest-VolumesSnapshotTestJSON-1082340868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:46:44 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-259dd337-ede3-4f13-88c2-bff6869413ec tempest-VolumesSnapshotTestJSON-1082340868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:46:44 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-259dd337-ede3-4f13-88c2-bff6869413ec tempest-VolumesSnapshotTestJSON-1082340868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:46:44 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-259dd337-ede3-4f13-88c2-bff6869413ec tempest-VolumesSnapshotTestJSON-1082340868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:46:44 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-259dd337-ede3-4f13-88c2-bff6869413ec tempest-VolumesSnapshotTestJSON-1082340868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:46:44 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-259dd337-ede3-4f13-88c2-bff6869413ec tempest-VolumesSnapshotTestJSON-1082340868 None] Selected osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 as target Quobyte volume. {{(pid=87329) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 06:46:44 devstack cinder-volume[87329]: INFO cinder.volume.drivers.remotefs [None req-259dd337-ede3-4f13-88c2-bff6869413ec tempest-VolumesSnapshotTestJSON-1082340868 None] casted to osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 Sep 06 06:46:44 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-259dd337-ede3-4f13-88c2-bff6869413ec tempest-VolumesSnapshotTestJSON-1082340868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-46affcaa-34b5-43bc-bd1f-97848a0ecd78 1073741824 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:46:44 devstack sudo[104080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-46affcaa-34b5-43bc-bd1f-97848a0ecd78 1073741824 Sep 06 06:46:44 devstack sudo[104080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:46:45 devstack sudo[104080]: pam_unix(sudo:session): session closed for user root Sep 06 06:46:45 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-259dd337-ede3-4f13-88c2-bff6869413ec tempest-VolumesSnapshotTestJSON-1082340868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-46affcaa-34b5-43bc-bd1f-97848a0ecd78 1073741824" returned: 0 in 0.452s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:46:45 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-259dd337-ede3-4f13-88c2-bff6869413ec tempest-VolumesSnapshotTestJSON-1082340868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-46affcaa-34b5-43bc-bd1f-97848a0ecd78 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:46:45 devstack sudo[104085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-46affcaa-34b5-43bc-bd1f-97848a0ecd78 Sep 06 06:46:45 devstack sudo[104085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:46:45 devstack sudo[104085]: pam_unix(sudo:session): session closed for user root Sep 06 06:46:45 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-259dd337-ede3-4f13-88c2-bff6869413ec tempest-VolumesSnapshotTestJSON-1082340868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-46affcaa-34b5-43bc-bd1f-97848a0ecd78" returned: 0 in 0.297s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:46:45 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-259dd337-ede3-4f13-88c2-bff6869413ec tempest-VolumesSnapshotTestJSON-1082340868 None] <== create_volume: return (802ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'} {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 06:46:45 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-259dd337-ede3-4f13-88c2-bff6869413ec tempest-VolumesSnapshotTestJSON-1082340868 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.805s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:46:45 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-259dd337-ede3-4f13-88c2-bff6869413ec tempest-VolumesSnapshotTestJSON-1082340868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24f32cad-e86a-4466-8cde-0e79997edf9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46affcaa-34b5-43bc-bd1f-97848a0ecd78', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:46:45 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-259dd337-ede3-4f13-88c2-bff6869413ec tempest-VolumesSnapshotTestJSON-1082340868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bbc2a13-b79b-4034-8b90-7fd9a95a4fbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:46:45 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-259dd337-ede3-4f13-88c2-bff6869413ec tempest-VolumesSnapshotTestJSON-1082340868 None] Volume volume-46affcaa-34b5-43bc-bd1f-97848a0ecd78 (46affcaa-34b5-43bc-bd1f-97848a0ecd78): created successfully Sep 06 06:46:45 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-259dd337-ede3-4f13-88c2-bff6869413ec tempest-VolumesSnapshotTestJSON-1082340868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bbc2a13-b79b-4034-8b90-7fd9a95a4fbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:46:45 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-259dd337-ede3-4f13-88c2-bff6869413ec tempest-VolumesSnapshotTestJSON-1082340868 None] Flow 'volume_create_manager' (c7bed25c-3d21-43b4-b785-513c73ca3894) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:46:45 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-259dd337-ede3-4f13-88c2-bff6869413ec tempest-VolumesSnapshotTestJSON-1082340868 None] Created volume successfully. Sep 06 06:46:47 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-2aa4fe6d-3b96-4916-9c4c-695f5358121d tempest-VolumesSnapshotTestJSON-1082340868 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:46:47 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-2aa4fe6d-3b96-4916-9c4c-695f5358121d tempest-VolumesSnapshotTestJSON-1082340868 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:46:47 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-2aa4fe6d-3b96-4916-9c4c-695f5358121d tempest-VolumesSnapshotTestJSON-1082340868 None] Creating offline snapshot 53c389b3-5a23-4634-ae90-69982bf48983 of volume 46affcaa-34b5-43bc-bd1f-97848a0ecd78 {{(pid=87329) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 06 06:46:47 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ff1a224-c36a-4162-a99a-00f27c7762dd]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:46:47 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-2aa4fe6d-3b96-4916-9c4c-695f5358121d tempest-VolumesSnapshotTestJSON-1082340868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-46affcaa-34b5-43bc-bd1f-97848a0ecd78 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:46:47 devstack sudo[104090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-46affcaa-34b5-43bc-bd1f-97848a0ecd78 Sep 06 06:46:47 devstack sudo[104090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:46:47 devstack sudo[104090]: pam_unix(sudo:session): session closed for user root Sep 06 06:46:47 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-2aa4fe6d-3b96-4916-9c4c-695f5358121d tempest-VolumesSnapshotTestJSON-1082340868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-46affcaa-34b5-43bc-bd1f-97848a0ecd78" returned: 0 in 0.360s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:46:47 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-2aa4fe6d-3b96-4916-9c4c-695f5358121d tempest-VolumesSnapshotTestJSON-1082340868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-46affcaa-34b5-43bc-bd1f-97848a0ecd78,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-46affcaa-34b5-43bc-bd1f-97848a0ecd78.53c389b3-5a23-4634-ae90-69982bf48983 1G {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:46:47 devstack sudo[104095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-46affcaa-34b5-43bc-bd1f-97848a0ecd78,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-46affcaa-34b5-43bc-bd1f-97848a0ecd78.53c389b3-5a23-4634-ae90-69982bf48983 1G Sep 06 06:46:47 devstack sudo[104095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:46:47 devstack sudo[104095]: pam_unix(sudo:session): session closed for user root Sep 06 06:46:47 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-2aa4fe6d-3b96-4916-9c4c-695f5358121d tempest-VolumesSnapshotTestJSON-1082340868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-46affcaa-34b5-43bc-bd1f-97848a0ecd78,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-46affcaa-34b5-43bc-bd1f-97848a0ecd78.53c389b3-5a23-4634-ae90-69982bf48983 1G" returned: 0 in 0.413s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:46:47 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-2aa4fe6d-3b96-4916-9c4c-695f5358121d tempest-VolumesSnapshotTestJSON-1082340868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46affcaa-34b5-43bc-bd1f-97848a0ecd78 -F qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-46affcaa-34b5-43bc-bd1f-97848a0ecd78.53c389b3-5a23-4634-ae90-69982bf48983 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:46:47 devstack sudo[104101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46affcaa-34b5-43bc-bd1f-97848a0ecd78 -F qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-46affcaa-34b5-43bc-bd1f-97848a0ecd78.53c389b3-5a23-4634-ae90-69982bf48983 Sep 06 06:46:47 devstack sudo[104101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:46:48 devstack sudo[104101]: pam_unix(sudo:session): session closed for user root Sep 06 06:46:48 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-2aa4fe6d-3b96-4916-9c4c-695f5358121d tempest-VolumesSnapshotTestJSON-1082340868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46affcaa-34b5-43bc-bd1f-97848a0ecd78 -F qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-46affcaa-34b5-43bc-bd1f-97848a0ecd78.53c389b3-5a23-4634-ae90-69982bf48983" returned: 0 in 0.292s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:46:48 devstack cinder-volume[87329]: WARNING cinder.volume.drivers.remotefs [None req-2aa4fe6d-3b96-4916-9c4c-695f5358121d tempest-VolumesSnapshotTestJSON-1082340868 None] /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-46affcaa-34b5-43bc-bd1f-97848a0ecd78.53c389b3-5a23-4634-ae90-69982bf48983 is being set with open permissions: ugo+rw Sep 06 06:46:48 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-2aa4fe6d-3b96-4916-9c4c-695f5358121d tempest-VolumesSnapshotTestJSON-1082340868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-46affcaa-34b5-43bc-bd1f-97848a0ecd78.53c389b3-5a23-4634-ae90-69982bf48983 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:46:48 devstack sudo[104106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-46affcaa-34b5-43bc-bd1f-97848a0ecd78.53c389b3-5a23-4634-ae90-69982bf48983 Sep 06 06:46:48 devstack sudo[104106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:46:48 devstack sudo[104106]: pam_unix(sudo:session): session closed for user root Sep 06 06:46:48 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-2aa4fe6d-3b96-4916-9c4c-695f5358121d tempest-VolumesSnapshotTestJSON-1082340868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-46affcaa-34b5-43bc-bd1f-97848a0ecd78.53c389b3-5a23-4634-ae90-69982bf48983" returned: 0 in 0.269s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:46:48 devstack cinder-volume[87329]: DEBUG oslo_service.periodic_task [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87329) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 06 06:46:48 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:46:48 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:46:48 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:46:48 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:46:48 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:46:48 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:46:48 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-2aa4fe6d-3b96-4916-9c4c-695f5358121d tempest-VolumesSnapshotTestJSON-1082340868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-46affcaa-34b5-43bc-bd1f-97848a0ecd78.info {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:46:48 devstack sudo[104109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:46:48 devstack sudo[104109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:46:48 devstack sudo[104110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-46affcaa-34b5-43bc-bd1f-97848a0ecd78.info Sep 06 06:46:48 devstack sudo[104110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:46:48 devstack sudo[104109]: pam_unix(sudo:session): session closed for user root Sep 06 06:46:48 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.274s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:46:48 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:46:48 devstack cinder-volume[87329]: DEBUG oslo_service.periodic_task [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Running periodic task VolumeManager._thread_info {{(pid=87329) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 06 06:46:48 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] thread count: 28 {{(pid=87329) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 06 06:46:48 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] thread info: [<_MainThread(MainThread, started 126855043821696)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87329) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 06 06:46:48 devstack sudo[104110]: pam_unix(sudo:session): session closed for user root Sep 06 06:46:48 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-2aa4fe6d-3b96-4916-9c4c-695f5358121d tempest-VolumesSnapshotTestJSON-1082340868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-46affcaa-34b5-43bc-bd1f-97848a0ecd78.info" returned: 0 in 0.278s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:46:48 devstack cinder-volume[87329]: WARNING cinder.volume.drivers.remotefs [None req-2aa4fe6d-3b96-4916-9c4c-695f5358121d tempest-VolumesSnapshotTestJSON-1082340868 None] /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-46affcaa-34b5-43bc-bd1f-97848a0ecd78.info is being set with open permissions: ugo+rw Sep 06 06:46:48 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-2aa4fe6d-3b96-4916-9c4c-695f5358121d tempest-VolumesSnapshotTestJSON-1082340868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-46affcaa-34b5-43bc-bd1f-97848a0ecd78.info {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:46:48 devstack sudo[104115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-46affcaa-34b5-43bc-bd1f-97848a0ecd78.info Sep 06 06:46:48 devstack sudo[104115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:46:48 devstack sudo[104115]: pam_unix(sudo:session): session closed for user root Sep 06 06:46:49 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-2aa4fe6d-3b96-4916-9c4c-695f5358121d tempest-VolumesSnapshotTestJSON-1082340868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-46affcaa-34b5-43bc-bd1f-97848a0ecd78.info" returned: 0 in 0.247s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:46:49 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-2aa4fe6d-3b96-4916-9c4c-695f5358121d tempest-VolumesSnapshotTestJSON-1082340868 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.969s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:46:49 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-2aa4fe6d-3b96-4916-9c4c-695f5358121d tempest-VolumesSnapshotTestJSON-1082340868 None] Create snapshot completed successfully Sep 06 06:46:49 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-c67da839-e524-4bec-a1f4-92b35b55f143 tempest-VolumesSnapshotTestJSON-1082340868 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87329) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 06:46:49 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-c67da839-e524-4bec-a1f4-92b35b55f143 tempest-VolumesSnapshotTestJSON-1082340868 None] Flow 'volume_create_manager' (43cf253d-b96a-4121-9463-0627940dcb69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:46:49 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-c67da839-e524-4bec-a1f4-92b35b55f143 tempest-VolumesSnapshotTestJSON-1082340868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (373fdf9a-d7db-43a9-90b1-673f5156c700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:46:49 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-c67da839-e524-4bec-a1f4-92b35b55f143 tempest-VolumesSnapshotTestJSON-1082340868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (373fdf9a-d7db-43a9-90b1-673f5156c700) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:46:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-405502646',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=349e67de-2bb5-4b4d-a0b3-e8c22c9c7f98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8b3840bc7ae418496def1ce80fe4a5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:46:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=53c389b3-5a23-4634-ae90-69982bf48983,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:46:50Z,use_quota=True,user_id='9e41d548bb5d49b9b1ad894b4a46a3e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:46:49 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-c67da839-e524-4bec-a1f4-92b35b55f143 tempest-VolumesSnapshotTestJSON-1082340868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4f84e42-0bee-434c-8d47-5c354cc0f61d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:46:49 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-c67da839-e524-4bec-a1f4-92b35b55f143 tempest-VolumesSnapshotTestJSON-1082340868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4f84e42-0bee-434c-8d47-5c354cc0f61d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:46:49 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-c67da839-e524-4bec-a1f4-92b35b55f143 tempest-VolumesSnapshotTestJSON-1082340868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aecc9744-461e-4513-ad2d-09be9d1e536b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:46:49 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-c67da839-e524-4bec-a1f4-92b35b55f143 tempest-VolumesSnapshotTestJSON-1082340868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aecc9744-461e-4513-ad2d-09be9d1e536b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '349e67de-2bb5-4b4d-a0b3-e8c22c9c7f98', 'volume_name': 'volume-349e67de-2bb5-4b4d-a0b3-e8c22c9c7f98', 'volume_size': 1, 'snapshot_id': '53c389b3-5a23-4634-ae90-69982bf48983'}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:46:49 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-c67da839-e524-4bec-a1f4-92b35b55f143 tempest-VolumesSnapshotTestJSON-1082340868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b7a18ec-5f59-460b-89d5-f76ee4bb6c1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:46:49 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-c67da839-e524-4bec-a1f4-92b35b55f143 tempest-VolumesSnapshotTestJSON-1082340868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b7a18ec-5f59-460b-89d5-f76ee4bb6c1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:46:49 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-c67da839-e524-4bec-a1f4-92b35b55f143 tempest-VolumesSnapshotTestJSON-1082340868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92e1b7bb-0525-4209-aecb-d50bb8096038) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:46:49 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-c67da839-e524-4bec-a1f4-92b35b55f143 tempest-VolumesSnapshotTestJSON-1082340868 None] Volume 349e67de-2bb5-4b4d-a0b3-e8c22c9c7f98: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-349e67de-2bb5-4b4d-a0b3-e8c22c9c7f98', 'volume_size': 1, 'snapshot_id': '53c389b3-5a23-4634-ae90-69982bf48983'} Sep 06 06:46:49 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-c67da839-e524-4bec-a1f4-92b35b55f143 tempest-VolumesSnapshotTestJSON-1082340868 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:46:49 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-c67da839-e524-4bec-a1f4-92b35b55f143 tempest-VolumesSnapshotTestJSON-1082340868 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:46:49 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-c67da839-e524-4bec-a1f4-92b35b55f143 tempest-VolumesSnapshotTestJSON-1082340868 None] Acquiring lock "cinder-quobyte-53c389b3-5a23-4634-ae90-69982bf48983-349e67de-2bb5-4b4d-a0b3-e8c22c9c7f98" by "_create_volume_from_snapshot" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:46:49 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-c67da839-e524-4bec-a1f4-92b35b55f143 tempest-VolumesSnapshotTestJSON-1082340868 None] Lock "cinder-quobyte-53c389b3-5a23-4634-ae90-69982bf48983-349e67de-2bb5-4b4d-a0b3-e8c22c9c7f98" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:46:49 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-c67da839-e524-4bec-a1f4-92b35b55f143 tempest-VolumesSnapshotTestJSON-1082340868 None] Creating volume 349e67de-2bb5-4b4d-a0b3-e8c22c9c7f98 from snapshot 53c389b3-5a23-4634-ae90-69982bf48983 {{(pid=87329) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 06 06:46:49 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-c67da839-e524-4bec-a1f4-92b35b55f143 tempest-VolumesSnapshotTestJSON-1082340868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:46:49 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-c67da839-e524-4bec-a1f4-92b35b55f143 tempest-VolumesSnapshotTestJSON-1082340868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:46:49 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-c67da839-e524-4bec-a1f4-92b35b55f143 tempest-VolumesSnapshotTestJSON-1082340868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:46:49 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-c67da839-e524-4bec-a1f4-92b35b55f143 tempest-VolumesSnapshotTestJSON-1082340868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:46:49 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-c67da839-e524-4bec-a1f4-92b35b55f143 tempest-VolumesSnapshotTestJSON-1082340868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:46:49 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-c67da839-e524-4bec-a1f4-92b35b55f143 tempest-VolumesSnapshotTestJSON-1082340868 None] Selected osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 as target Quobyte volume. {{(pid=87329) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 06:46:49 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-c67da839-e524-4bec-a1f4-92b35b55f143 tempest-VolumesSnapshotTestJSON-1082340868 None] Acquiring lock "cinder-quobyte-349e67de-2bb5-4b4d-a0b3-e8c22c9c7f98" by "_copy_volume_from_snapshot" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:46:49 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-c67da839-e524-4bec-a1f4-92b35b55f143 tempest-VolumesSnapshotTestJSON-1082340868 None] Lock "cinder-quobyte-349e67de-2bb5-4b4d-a0b3-e8c22c9c7f98" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:46:49 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-c67da839-e524-4bec-a1f4-92b35b55f143 tempest-VolumesSnapshotTestJSON-1082340868 None] snapshot: 53c389b3-5a23-4634-ae90-69982bf48983, volume: 349e67de-2bb5-4b4d-a0b3-e8c22c9c7f98, {{(pid=87329) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 06 06:46:49 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-c67da839-e524-4bec-a1f4-92b35b55f143 tempest-VolumesSnapshotTestJSON-1082340868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:46:49 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-c67da839-e524-4bec-a1f4-92b35b55f143 tempest-VolumesSnapshotTestJSON-1082340868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:46:49 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-c67da839-e524-4bec-a1f4-92b35b55f143 tempest-VolumesSnapshotTestJSON-1082340868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:46:49 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-c67da839-e524-4bec-a1f4-92b35b55f143 tempest-VolumesSnapshotTestJSON-1082340868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:46:49 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-c67da839-e524-4bec-a1f4-92b35b55f143 tempest-VolumesSnapshotTestJSON-1082340868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:46:49 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dde8621-7879-4d23-84e7-81ac4dc9fef5]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:46:49 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-c67da839-e524-4bec-a1f4-92b35b55f143 tempest-VolumesSnapshotTestJSON-1082340868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-46affcaa-34b5-43bc-bd1f-97848a0ecd78.53c389b3-5a23-4634-ae90-69982bf48983 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:46:49 devstack sudo[104119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-46affcaa-34b5-43bc-bd1f-97848a0ecd78.53c389b3-5a23-4634-ae90-69982bf48983 Sep 06 06:46:49 devstack sudo[104119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:46:50 devstack sudo[104119]: pam_unix(sudo:session): session closed for user root Sep 06 06:46:50 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-c67da839-e524-4bec-a1f4-92b35b55f143 tempest-VolumesSnapshotTestJSON-1082340868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-46affcaa-34b5-43bc-bd1f-97848a0ecd78.53c389b3-5a23-4634-ae90-69982bf48983" returned: 0 in 0.354s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:46:50 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-c67da839-e524-4bec-a1f4-92b35b55f143 tempest-VolumesSnapshotTestJSON-1082340868 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-46affcaa-34b5-43bc-bd1f-97848a0ecd78(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87329) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 06:46:50 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[a29a6056-1730-426c-ae01-8b4bf4700203]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:46:50 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-c67da839-e524-4bec-a1f4-92b35b55f143 tempest-VolumesSnapshotTestJSON-1082340868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-46affcaa-34b5-43bc-bd1f-97848a0ecd78 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:46:50 devstack sudo[104124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-46affcaa-34b5-43bc-bd1f-97848a0ecd78 Sep 06 06:46:50 devstack sudo[104124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:46:50 devstack sudo[104124]: pam_unix(sudo:session): session closed for user root Sep 06 06:46:50 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-c67da839-e524-4bec-a1f4-92b35b55f143 tempest-VolumesSnapshotTestJSON-1082340868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-46affcaa-34b5-43bc-bd1f-97848a0ecd78" returned: 0 in 0.357s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:46:50 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-c67da839-e524-4bec-a1f4-92b35b55f143 tempest-VolumesSnapshotTestJSON-1082340868 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-46affcaa-34b5-43bc-bd1f-97848a0ecd78 {{(pid=87329) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 06 06:46:50 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-c67da839-e524-4bec-a1f4-92b35b55f143 tempest-VolumesSnapshotTestJSON-1082340868 None] Creating direct copy from snapshot {{(pid=87329) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 06 06:46:50 devstack cinder-volume[87329]: DEBUG cinder.utils [None req-c67da839-e524-4bec-a1f4-92b35b55f143 tempest-VolumesSnapshotTestJSON-1082340868 None] Path /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-349e67de-2bb5-4b4d-a0b3-e8c22c9c7f98 not found in is_blk_device check {{(pid=87329) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 06 06:46:50 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-c67da839-e524-4bec-a1f4-92b35b55f143 tempest-VolumesSnapshotTestJSON-1082340868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-46affcaa-34b5-43bc-bd1f-97848a0ecd78 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-349e67de-2bb5-4b4d-a0b3-e8c22c9c7f98 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:46:50 devstack sudo[104129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-46affcaa-34b5-43bc-bd1f-97848a0ecd78 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-349e67de-2bb5-4b4d-a0b3-e8c22c9c7f98 Sep 06 06:46:50 devstack sudo[104129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:46:55 devstack sudo[104129]: pam_unix(sudo:session): session closed for user root Sep 06 06:46:55 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-c67da839-e524-4bec-a1f4-92b35b55f143 tempest-VolumesSnapshotTestJSON-1082340868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-46affcaa-34b5-43bc-bd1f-97848a0ecd78 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-349e67de-2bb5-4b4d-a0b3-e8c22c9c7f98" returned: 0 in 5.055s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:46:55 devstack cinder-volume[87329]: DEBUG cinder.image.image_utils [None req-c67da839-e524-4bec-a1f4-92b35b55f143 tempest-VolumesSnapshotTestJSON-1082340868 None] Image conversion details: src /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-46affcaa-34b5-43bc-bd1f-97848a0ecd78, size 1024.00 MB, duration 5.06 sec, destination /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-349e67de-2bb5-4b4d-a0b3-e8c22c9c7f98 {{(pid=87329) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 06 06:46:55 devstack cinder-volume[87329]: INFO cinder.image.image_utils [None req-c67da839-e524-4bec-a1f4-92b35b55f143 tempest-VolumesSnapshotTestJSON-1082340868 None] Converted 1024.00 MB image at 202.54 MB/s Sep 06 06:46:55 devstack cinder-volume[87329]: WARNING cinder.volume.drivers.remotefs [None req-c67da839-e524-4bec-a1f4-92b35b55f143 tempest-VolumesSnapshotTestJSON-1082340868 None] /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-349e67de-2bb5-4b4d-a0b3-e8c22c9c7f98 is being set with open permissions: ugo+rw Sep 06 06:46:55 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-c67da839-e524-4bec-a1f4-92b35b55f143 tempest-VolumesSnapshotTestJSON-1082340868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-349e67de-2bb5-4b4d-a0b3-e8c22c9c7f98 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:46:55 devstack sudo[104142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-349e67de-2bb5-4b4d-a0b3-e8c22c9c7f98 Sep 06 06:46:55 devstack sudo[104142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:46:55 devstack sudo[104142]: pam_unix(sudo:session): session closed for user root Sep 06 06:46:55 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-c67da839-e524-4bec-a1f4-92b35b55f143 tempest-VolumesSnapshotTestJSON-1082340868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-349e67de-2bb5-4b4d-a0b3-e8c22c9c7f98" returned: 0 in 0.254s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:46:55 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-c67da839-e524-4bec-a1f4-92b35b55f143 tempest-VolumesSnapshotTestJSON-1082340868 None] Lock "cinder-quobyte-349e67de-2bb5-4b4d-a0b3-e8c22c9c7f98" released by "_copy_volume_from_snapshot" :: held 6.102s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:46:55 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-c67da839-e524-4bec-a1f4-92b35b55f143 tempest-VolumesSnapshotTestJSON-1082340868 None] Lock "cinder-quobyte-53c389b3-5a23-4634-ae90-69982bf48983-349e67de-2bb5-4b4d-a0b3-e8c22c9c7f98" released by "_create_volume_from_snapshot" :: held 6.173s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:46:55 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-c67da839-e524-4bec-a1f4-92b35b55f143 tempest-VolumesSnapshotTestJSON-1082340868 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.188s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:46:56 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-c67da839-e524-4bec-a1f4-92b35b55f143 tempest-VolumesSnapshotTestJSON-1082340868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92e1b7bb-0525-4209-aecb-d50bb8096038) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-349e67de-2bb5-4b4d-a0b3-e8c22c9c7f98', 'volume_size': 1, 'snapshot_id': '53c389b3-5a23-4634-ae90-69982bf48983'}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:46:56 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-c67da839-e524-4bec-a1f4-92b35b55f143 tempest-VolumesSnapshotTestJSON-1082340868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77b724f3-6ab2-4266-9a6d-3e5eb2cf034e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:46:56 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-c67da839-e524-4bec-a1f4-92b35b55f143 tempest-VolumesSnapshotTestJSON-1082340868 None] Volume volume-349e67de-2bb5-4b4d-a0b3-e8c22c9c7f98 (349e67de-2bb5-4b4d-a0b3-e8c22c9c7f98): created successfully Sep 06 06:46:56 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-c67da839-e524-4bec-a1f4-92b35b55f143 tempest-VolumesSnapshotTestJSON-1082340868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77b724f3-6ab2-4266-9a6d-3e5eb2cf034e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:46:56 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-c67da839-e524-4bec-a1f4-92b35b55f143 tempest-VolumesSnapshotTestJSON-1082340868 None] Flow 'volume_create_manager' (43cf253d-b96a-4121-9463-0627940dcb69) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:46:56 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-c67da839-e524-4bec-a1f4-92b35b55f143 tempest-VolumesSnapshotTestJSON-1082340868 None] Created volume successfully. Sep 06 06:46:56 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-eaa6b59a-8f0c-4f65-afcd-b12720566163 tempest-VolumesSnapshotTestJSON-1082340868 None] Acquiring lock "cinder-349e67de-2bb5-4b4d-a0b3-e8c22c9c7f98-delete_volume" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:46:56 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-eaa6b59a-8f0c-4f65-afcd-b12720566163 tempest-VolumesSnapshotTestJSON-1082340868 None] Lock "cinder-349e67de-2bb5-4b4d-a0b3-e8c22c9c7f98-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:46:56 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-eaa6b59a-8f0c-4f65-afcd-b12720566163 tempest-VolumesSnapshotTestJSON-1082340868 None] Acquiring lock "cinder-quobyte-349e67de-2bb5-4b4d-a0b3-e8c22c9c7f98" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:46:56 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-eaa6b59a-8f0c-4f65-afcd-b12720566163 tempest-VolumesSnapshotTestJSON-1082340868 None] Lock "cinder-quobyte-349e67de-2bb5-4b4d-a0b3-e8c22c9c7f98" acquired by "delete_volume" :: waited 0.015s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:46:56 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dc2fe2c-f68c-4826-b3c6-d0f2967bf443]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:46:56 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-eaa6b59a-8f0c-4f65-afcd-b12720566163 tempest-VolumesSnapshotTestJSON-1082340868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-349e67de-2bb5-4b4d-a0b3-e8c22c9c7f98 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:46:56 devstack sudo[104145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-349e67de-2bb5-4b4d-a0b3-e8c22c9c7f98 Sep 06 06:46:56 devstack sudo[104145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:46:57 devstack sudo[104145]: pam_unix(sudo:session): session closed for user root Sep 06 06:46:57 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-eaa6b59a-8f0c-4f65-afcd-b12720566163 tempest-VolumesSnapshotTestJSON-1082340868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-349e67de-2bb5-4b4d-a0b3-e8c22c9c7f98" returned: 0 in 0.364s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:46:57 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-eaa6b59a-8f0c-4f65-afcd-b12720566163 tempest-VolumesSnapshotTestJSON-1082340868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-349e67de-2bb5-4b4d-a0b3-e8c22c9c7f98 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:46:57 devstack sudo[104162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-349e67de-2bb5-4b4d-a0b3-e8c22c9c7f98 Sep 06 06:46:57 devstack sudo[104162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:46:57 devstack sudo[104162]: pam_unix(sudo:session): session closed for user root Sep 06 06:46:57 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-eaa6b59a-8f0c-4f65-afcd-b12720566163 tempest-VolumesSnapshotTestJSON-1082340868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-349e67de-2bb5-4b4d-a0b3-e8c22c9c7f98" returned: 0 in 0.253s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:46:57 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-eaa6b59a-8f0c-4f65-afcd-b12720566163 tempest-VolumesSnapshotTestJSON-1082340868 None] Lock "cinder-quobyte-349e67de-2bb5-4b4d-a0b3-e8c22c9c7f98" released by "delete_volume" :: held 0.658s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:46:57 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-eaa6b59a-8f0c-4f65-afcd-b12720566163 tempest-VolumesSnapshotTestJSON-1082340868 None] Created reservations ['195b8adf-683c-4211-bad7-a81bf20667b2', '8536185b-ee28-48df-b256-d817c42230c3', '916df3a4-6919-47d6-9b7f-0107c447a13b', '857df455-2578-4dd6-be4f-0d6eb0e8b97a'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:46:57 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-eaa6b59a-8f0c-4f65-afcd-b12720566163 tempest-VolumesSnapshotTestJSON-1082340868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:46:57 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-eaa6b59a-8f0c-4f65-afcd-b12720566163 tempest-VolumesSnapshotTestJSON-1082340868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:46:57 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-eaa6b59a-8f0c-4f65-afcd-b12720566163 tempest-VolumesSnapshotTestJSON-1082340868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:46:57 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-eaa6b59a-8f0c-4f65-afcd-b12720566163 tempest-VolumesSnapshotTestJSON-1082340868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:46:57 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-eaa6b59a-8f0c-4f65-afcd-b12720566163 tempest-VolumesSnapshotTestJSON-1082340868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:46:57 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-eaa6b59a-8f0c-4f65-afcd-b12720566163 tempest-VolumesSnapshotTestJSON-1082340868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:46:57 devstack sudo[104165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:46:57 devstack sudo[104165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:46:57 devstack sudo[104165]: pam_unix(sudo:session): session closed for user root Sep 06 06:46:57 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-eaa6b59a-8f0c-4f65-afcd-b12720566163 tempest-VolumesSnapshotTestJSON-1082340868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.264s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:46:57 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-eaa6b59a-8f0c-4f65-afcd-b12720566163 tempest-VolumesSnapshotTestJSON-1082340868 None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:46:57 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-eaa6b59a-8f0c-4f65-afcd-b12720566163 tempest-VolumesSnapshotTestJSON-1082340868 None] Deleted volume successfully. Sep 06 06:46:57 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-eaa6b59a-8f0c-4f65-afcd-b12720566163 tempest-VolumesSnapshotTestJSON-1082340868 None] Lock "cinder-349e67de-2bb5-4b4d-a0b3-e8c22c9c7f98-delete_volume" released by "delete_volume" :: held 1.132s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:46:57 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-882ddb7c-668c-4c33-a6d1-2b82fa67ee12 tempest-VolumesSnapshotTestJSON-1082340868 None] Acquiring lock "cinder-53c389b3-5a23-4634-ae90-69982bf48983-delete_snapshot" by "delete_snapshot" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:46:57 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-882ddb7c-668c-4c33-a6d1-2b82fa67ee12 tempest-VolumesSnapshotTestJSON-1082340868 None] Lock "cinder-53c389b3-5a23-4634-ae90-69982bf48983-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:46:57 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-882ddb7c-668c-4c33-a6d1-2b82fa67ee12 tempest-VolumesSnapshotTestJSON-1082340868 None] Acquiring lock "cinder-quobyte-46affcaa-34b5-43bc-bd1f-97848a0ecd78" by "delete_snapshot" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:46:57 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-882ddb7c-668c-4c33-a6d1-2b82fa67ee12 tempest-VolumesSnapshotTestJSON-1082340868 None] Lock "cinder-quobyte-46affcaa-34b5-43bc-bd1f-97848a0ecd78" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:46:57 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-882ddb7c-668c-4c33-a6d1-2b82fa67ee12 tempest-VolumesSnapshotTestJSON-1082340868 None] Acquiring lock "cinder-quobyte-53c389b3-5a23-4634-ae90-69982bf48983" by "_delete_snapshot" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:46:57 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-882ddb7c-668c-4c33-a6d1-2b82fa67ee12 tempest-VolumesSnapshotTestJSON-1082340868 None] Lock "cinder-quobyte-53c389b3-5a23-4634-ae90-69982bf48983" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:46:57 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-882ddb7c-668c-4c33-a6d1-2b82fa67ee12 tempest-VolumesSnapshotTestJSON-1082340868 None] Deleting offline snapshot 53c389b3-5a23-4634-ae90-69982bf48983 of volume 46affcaa-34b5-43bc-bd1f-97848a0ecd78 {{(pid=87329) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 06 06:46:57 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-882ddb7c-668c-4c33-a6d1-2b82fa67ee12 tempest-VolumesSnapshotTestJSON-1082340868 None] snapshot_file for this snap is: volume-46affcaa-34b5-43bc-bd1f-97848a0ecd78.53c389b3-5a23-4634-ae90-69982bf48983 {{(pid=87329) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 06 06:46:57 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d05ac4f-caa5-4f05-9c69-a06632499c06]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:46:57 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-882ddb7c-668c-4c33-a6d1-2b82fa67ee12 tempest-VolumesSnapshotTestJSON-1082340868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-46affcaa-34b5-43bc-bd1f-97848a0ecd78.53c389b3-5a23-4634-ae90-69982bf48983 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:46:58 devstack sudo[104168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-46affcaa-34b5-43bc-bd1f-97848a0ecd78.53c389b3-5a23-4634-ae90-69982bf48983 Sep 06 06:46:58 devstack sudo[104168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:46:58 devstack sudo[104168]: pam_unix(sudo:session): session closed for user root Sep 06 06:46:58 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-882ddb7c-668c-4c33-a6d1-2b82fa67ee12 tempest-VolumesSnapshotTestJSON-1082340868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-46affcaa-34b5-43bc-bd1f-97848a0ecd78.53c389b3-5a23-4634-ae90-69982bf48983" returned: 0 in 0.351s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:46:58 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-882ddb7c-668c-4c33-a6d1-2b82fa67ee12 tempest-VolumesSnapshotTestJSON-1082340868 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-46affcaa-34b5-43bc-bd1f-97848a0ecd78(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87329) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 06:46:58 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcdb920b-98cb-4e9d-857a-f5d21c0cf375]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:46:58 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-882ddb7c-668c-4c33-a6d1-2b82fa67ee12 tempest-VolumesSnapshotTestJSON-1082340868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-46affcaa-34b5-43bc-bd1f-97848a0ecd78 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:46:58 devstack sudo[104179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-46affcaa-34b5-43bc-bd1f-97848a0ecd78 Sep 06 06:46:58 devstack sudo[104179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:46:58 devstack sudo[104179]: pam_unix(sudo:session): session closed for user root Sep 06 06:46:58 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-882ddb7c-668c-4c33-a6d1-2b82fa67ee12 tempest-VolumesSnapshotTestJSON-1082340868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-46affcaa-34b5-43bc-bd1f-97848a0ecd78" returned: 0 in 0.486s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:46:58 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-882ddb7c-668c-4c33-a6d1-2b82fa67ee12 tempest-VolumesSnapshotTestJSON-1082340868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-46affcaa-34b5-43bc-bd1f-97848a0ecd78.53c389b3-5a23-4634-ae90-69982bf48983 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:46:58 devstack sudo[104184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-46affcaa-34b5-43bc-bd1f-97848a0ecd78.53c389b3-5a23-4634-ae90-69982bf48983 Sep 06 06:46:58 devstack sudo[104184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:46:59 devstack sudo[104184]: pam_unix(sudo:session): session closed for user root Sep 06 06:46:59 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-882ddb7c-668c-4c33-a6d1-2b82fa67ee12 tempest-VolumesSnapshotTestJSON-1082340868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-46affcaa-34b5-43bc-bd1f-97848a0ecd78.53c389b3-5a23-4634-ae90-69982bf48983" returned: 0 in 0.315s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:46:59 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-882ddb7c-668c-4c33-a6d1-2b82fa67ee12 tempest-VolumesSnapshotTestJSON-1082340868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-46affcaa-34b5-43bc-bd1f-97848a0ecd78.53c389b3-5a23-4634-ae90-69982bf48983 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:46:59 devstack sudo[104189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-46affcaa-34b5-43bc-bd1f-97848a0ecd78.53c389b3-5a23-4634-ae90-69982bf48983 Sep 06 06:46:59 devstack sudo[104189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:46:59 devstack sudo[104189]: pam_unix(sudo:session): session closed for user root Sep 06 06:46:59 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-882ddb7c-668c-4c33-a6d1-2b82fa67ee12 tempest-VolumesSnapshotTestJSON-1082340868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-46affcaa-34b5-43bc-bd1f-97848a0ecd78.53c389b3-5a23-4634-ae90-69982bf48983" returned: 0 in 0.232s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:46:59 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-882ddb7c-668c-4c33-a6d1-2b82fa67ee12 tempest-VolumesSnapshotTestJSON-1082340868 None] Lock "cinder-quobyte-53c389b3-5a23-4634-ae90-69982bf48983" released by "_delete_snapshot" :: held 1.471s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:46:59 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-882ddb7c-668c-4c33-a6d1-2b82fa67ee12 tempest-VolumesSnapshotTestJSON-1082340868 None] Lock "cinder-quobyte-46affcaa-34b5-43bc-bd1f-97848a0ecd78" released by "delete_snapshot" :: held 1.492s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:46:59 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-882ddb7c-668c-4c33-a6d1-2b82fa67ee12 tempest-VolumesSnapshotTestJSON-1082340868 None] Created reservations ['6b06372d-1167-4a93-aecd-5cc38bfc905c', 'd498d9cc-59a1-45c5-916e-db4a55c2ab01', 'f6b7a07a-fb0f-4d17-b8df-cd8c4e7f41ea', 'b6c467eb-41b2-4ed7-8be9-6cd02516e2b3'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:46:59 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-882ddb7c-668c-4c33-a6d1-2b82fa67ee12 tempest-VolumesSnapshotTestJSON-1082340868 None] Delete snapshot completed successfully. Sep 06 06:46:59 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-882ddb7c-668c-4c33-a6d1-2b82fa67ee12 tempest-VolumesSnapshotTestJSON-1082340868 None] Lock "cinder-53c389b3-5a23-4634-ae90-69982bf48983-delete_snapshot" released by "delete_snapshot" :: held 1.613s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:47:00 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-37564c03-f078-4a7d-9e6f-ce7fbdf5248e tempest-VolumesSnapshotTestJSON-1082340868 None] Acquiring lock "cinder-46affcaa-34b5-43bc-bd1f-97848a0ecd78-delete_volume" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:47:00 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-37564c03-f078-4a7d-9e6f-ce7fbdf5248e tempest-VolumesSnapshotTestJSON-1082340868 None] Lock "cinder-46affcaa-34b5-43bc-bd1f-97848a0ecd78-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:47:00 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-37564c03-f078-4a7d-9e6f-ce7fbdf5248e tempest-VolumesSnapshotTestJSON-1082340868 None] Acquiring lock "cinder-quobyte-46affcaa-34b5-43bc-bd1f-97848a0ecd78" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:47:00 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-37564c03-f078-4a7d-9e6f-ce7fbdf5248e tempest-VolumesSnapshotTestJSON-1082340868 None] Lock "cinder-quobyte-46affcaa-34b5-43bc-bd1f-97848a0ecd78" acquired by "delete_volume" :: waited 0.013s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:47:00 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a780b95-c52c-47c5-b656-cce5dce639f9]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:47:00 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-37564c03-f078-4a7d-9e6f-ce7fbdf5248e tempest-VolumesSnapshotTestJSON-1082340868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-46affcaa-34b5-43bc-bd1f-97848a0ecd78 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:47:00 devstack sudo[104193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-46affcaa-34b5-43bc-bd1f-97848a0ecd78 Sep 06 06:47:00 devstack sudo[104193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:47:00 devstack sudo[104193]: pam_unix(sudo:session): session closed for user root Sep 06 06:47:00 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-37564c03-f078-4a7d-9e6f-ce7fbdf5248e tempest-VolumesSnapshotTestJSON-1082340868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-46affcaa-34b5-43bc-bd1f-97848a0ecd78" returned: 0 in 0.353s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:47:00 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-37564c03-f078-4a7d-9e6f-ce7fbdf5248e tempest-VolumesSnapshotTestJSON-1082340868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-46affcaa-34b5-43bc-bd1f-97848a0ecd78 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:47:00 devstack sudo[104198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-46affcaa-34b5-43bc-bd1f-97848a0ecd78 Sep 06 06:47:00 devstack sudo[104198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:47:00 devstack sudo[104198]: pam_unix(sudo:session): session closed for user root Sep 06 06:47:00 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-37564c03-f078-4a7d-9e6f-ce7fbdf5248e tempest-VolumesSnapshotTestJSON-1082340868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-46affcaa-34b5-43bc-bd1f-97848a0ecd78" returned: 0 in 0.235s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:47:00 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-37564c03-f078-4a7d-9e6f-ce7fbdf5248e tempest-VolumesSnapshotTestJSON-1082340868 None] Lock "cinder-quobyte-46affcaa-34b5-43bc-bd1f-97848a0ecd78" released by "delete_volume" :: held 0.639s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:47:00 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-37564c03-f078-4a7d-9e6f-ce7fbdf5248e tempest-VolumesSnapshotTestJSON-1082340868 None] Created reservations ['80fa1591-5e05-44da-9f99-2a431456e8a5', '03816c65-865e-48ce-b2c5-3657dd79f57f', '6cedf905-3752-461e-8da2-e2508a01101a', '68d94fd9-5e84-4d8f-861b-c234e4923b7c'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:47:00 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-37564c03-f078-4a7d-9e6f-ce7fbdf5248e tempest-VolumesSnapshotTestJSON-1082340868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:47:00 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-37564c03-f078-4a7d-9e6f-ce7fbdf5248e tempest-VolumesSnapshotTestJSON-1082340868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:47:00 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-37564c03-f078-4a7d-9e6f-ce7fbdf5248e tempest-VolumesSnapshotTestJSON-1082340868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:47:00 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-37564c03-f078-4a7d-9e6f-ce7fbdf5248e tempest-VolumesSnapshotTestJSON-1082340868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:47:00 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-37564c03-f078-4a7d-9e6f-ce7fbdf5248e tempest-VolumesSnapshotTestJSON-1082340868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:47:00 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-37564c03-f078-4a7d-9e6f-ce7fbdf5248e tempest-VolumesSnapshotTestJSON-1082340868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:47:00 devstack sudo[104201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:47:00 devstack sudo[104201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:47:01 devstack sudo[104201]: pam_unix(sudo:session): session closed for user root Sep 06 06:47:01 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-37564c03-f078-4a7d-9e6f-ce7fbdf5248e tempest-VolumesSnapshotTestJSON-1082340868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.243s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:47:01 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-37564c03-f078-4a7d-9e6f-ce7fbdf5248e tempest-VolumesSnapshotTestJSON-1082340868 None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:47:01 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-37564c03-f078-4a7d-9e6f-ce7fbdf5248e tempest-VolumesSnapshotTestJSON-1082340868 None] Deleted volume successfully. Sep 06 06:47:01 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-37564c03-f078-4a7d-9e6f-ce7fbdf5248e tempest-VolumesSnapshotTestJSON-1082340868 None] Lock "cinder-46affcaa-34b5-43bc-bd1f-97848a0ecd78-delete_volume" released by "delete_volume" :: held 1.063s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:47:01 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-1198a7ce-b70b-4d05-9194-bd6b65fd8019 tempest-VolumesSnapshotTestJSON-1082340868 None] Acquiring lock "cinder-664fd2af-f63c-46e6-8f07-005cde51676b-delete_volume" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:47:01 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-1198a7ce-b70b-4d05-9194-bd6b65fd8019 tempest-VolumesSnapshotTestJSON-1082340868 None] Lock "cinder-664fd2af-f63c-46e6-8f07-005cde51676b-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:47:01 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-1198a7ce-b70b-4d05-9194-bd6b65fd8019 tempest-VolumesSnapshotTestJSON-1082340868 None] Acquiring lock "cinder-quobyte-664fd2af-f63c-46e6-8f07-005cde51676b" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:47:01 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-1198a7ce-b70b-4d05-9194-bd6b65fd8019 tempest-VolumesSnapshotTestJSON-1082340868 None] Lock "cinder-quobyte-664fd2af-f63c-46e6-8f07-005cde51676b" acquired by "delete_volume" :: waited 0.016s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:47:01 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[88644dda-1d59-4e8b-bd70-1dc4b5b7dde6]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:47:01 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-1198a7ce-b70b-4d05-9194-bd6b65fd8019 tempest-VolumesSnapshotTestJSON-1082340868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-664fd2af-f63c-46e6-8f07-005cde51676b {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:47:01 devstack sudo[104204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-664fd2af-f63c-46e6-8f07-005cde51676b Sep 06 06:47:01 devstack sudo[104204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:47:01 devstack sudo[104204]: pam_unix(sudo:session): session closed for user root Sep 06 06:47:01 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-1198a7ce-b70b-4d05-9194-bd6b65fd8019 tempest-VolumesSnapshotTestJSON-1082340868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-664fd2af-f63c-46e6-8f07-005cde51676b" returned: 0 in 0.353s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:47:01 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-1198a7ce-b70b-4d05-9194-bd6b65fd8019 tempest-VolumesSnapshotTestJSON-1082340868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-664fd2af-f63c-46e6-8f07-005cde51676b {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:47:01 devstack sudo[104213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-664fd2af-f63c-46e6-8f07-005cde51676b Sep 06 06:47:01 devstack sudo[104213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:47:01 devstack sudo[104213]: pam_unix(sudo:session): session closed for user root Sep 06 06:47:01 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-1198a7ce-b70b-4d05-9194-bd6b65fd8019 tempest-VolumesSnapshotTestJSON-1082340868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-664fd2af-f63c-46e6-8f07-005cde51676b" returned: 0 in 0.245s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:47:01 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-1198a7ce-b70b-4d05-9194-bd6b65fd8019 tempest-VolumesSnapshotTestJSON-1082340868 None] Lock "cinder-quobyte-664fd2af-f63c-46e6-8f07-005cde51676b" released by "delete_volume" :: held 0.651s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:47:01 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-1198a7ce-b70b-4d05-9194-bd6b65fd8019 tempest-VolumesSnapshotTestJSON-1082340868 None] Created reservations ['3478df4a-6229-4522-a0a2-87e9933fb4b7', '690f42f0-e78c-47eb-8396-ca6864b99bf8', 'be5770ac-0c45-474c-aec2-4166958df721', 'ef6ad949-5122-42ce-9d19-23774cdc06a9'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:47:02 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-1198a7ce-b70b-4d05-9194-bd6b65fd8019 tempest-VolumesSnapshotTestJSON-1082340868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:47:02 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-1198a7ce-b70b-4d05-9194-bd6b65fd8019 tempest-VolumesSnapshotTestJSON-1082340868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:47:02 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-1198a7ce-b70b-4d05-9194-bd6b65fd8019 tempest-VolumesSnapshotTestJSON-1082340868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:47:02 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-1198a7ce-b70b-4d05-9194-bd6b65fd8019 tempest-VolumesSnapshotTestJSON-1082340868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:47:02 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-1198a7ce-b70b-4d05-9194-bd6b65fd8019 tempest-VolumesSnapshotTestJSON-1082340868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:47:02 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-1198a7ce-b70b-4d05-9194-bd6b65fd8019 tempest-VolumesSnapshotTestJSON-1082340868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:47:02 devstack sudo[104217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:47:02 devstack sudo[104217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:47:02 devstack sudo[104217]: pam_unix(sudo:session): session closed for user root Sep 06 06:47:02 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-1198a7ce-b70b-4d05-9194-bd6b65fd8019 tempest-VolumesSnapshotTestJSON-1082340868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.233s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:47:02 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-1198a7ce-b70b-4d05-9194-bd6b65fd8019 tempest-VolumesSnapshotTestJSON-1082340868 None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:47:02 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-1198a7ce-b70b-4d05-9194-bd6b65fd8019 tempest-VolumesSnapshotTestJSON-1082340868 None] Deleted volume successfully. Sep 06 06:47:02 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-1198a7ce-b70b-4d05-9194-bd6b65fd8019 tempest-VolumesSnapshotTestJSON-1082340868 None] Lock "cinder-664fd2af-f63c-46e6-8f07-005cde51676b-delete_volume" released by "delete_volume" :: held 1.071s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:47:07 devstack cinder-volume[87329]: INFO cinder.volume.manager [req-29d0dc8b-c6ca-404b-b54f-c3465736609f req-1cf6d39b-8b6b-4a73-bd73-50f29ff88093 tempest-TestShelveInstance-2122303240 None] Terminate volume connection completed successfully. Sep 06 06:47:07 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [req-29d0dc8b-c6ca-404b-b54f-c3465736609f req-1cf6d39b-8b6b-4a73-bd73-50f29ff88093 tempest-TestShelveInstance-2122303240 None] Deleting attachment d0489dc8-2423-4c61-a352-8f68ddbdc547. {{(pid=87329) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 06 06:47:07 devstack cinder-volume[87329]: DEBUG cinder.coordination [req-29d0dc8b-c6ca-404b-b54f-c3465736609f req-d23374c3-387f-4dee-a3cb-f673ad700219 tempest-TestShelveInstance-2122303240 None] Acquiring lock "cinder-0f9f4f61-8db4-4e0b-9497-063182c791dd-delete_volume" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:47:07 devstack cinder-volume[87329]: DEBUG cinder.coordination [req-29d0dc8b-c6ca-404b-b54f-c3465736609f req-d23374c3-387f-4dee-a3cb-f673ad700219 tempest-TestShelveInstance-2122303240 None] Lock "cinder-0f9f4f61-8db4-4e0b-9497-063182c791dd-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:47:07 devstack cinder-volume[87329]: DEBUG cinder.coordination [req-29d0dc8b-c6ca-404b-b54f-c3465736609f req-d23374c3-387f-4dee-a3cb-f673ad700219 tempest-TestShelveInstance-2122303240 None] Acquiring lock "cinder-quobyte-0f9f4f61-8db4-4e0b-9497-063182c791dd" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:47:07 devstack cinder-volume[87329]: DEBUG cinder.coordination [req-29d0dc8b-c6ca-404b-b54f-c3465736609f req-d23374c3-387f-4dee-a3cb-f673ad700219 tempest-TestShelveInstance-2122303240 None] Lock "cinder-quobyte-0f9f4f61-8db4-4e0b-9497-063182c791dd" acquired by "delete_volume" :: waited 0.016s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:47:07 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[93e7ea56-38c4-466e-aa0c-7ed6f52c7f4c]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:47:07 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [req-29d0dc8b-c6ca-404b-b54f-c3465736609f req-d23374c3-387f-4dee-a3cb-f673ad700219 tempest-TestShelveInstance-2122303240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-0f9f4f61-8db4-4e0b-9497-063182c791dd {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:47:08 devstack sudo[104279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-0f9f4f61-8db4-4e0b-9497-063182c791dd Sep 06 06:47:08 devstack sudo[104279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:47:08 devstack sudo[104279]: pam_unix(sudo:session): session closed for user root Sep 06 06:47:08 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [req-29d0dc8b-c6ca-404b-b54f-c3465736609f req-d23374c3-387f-4dee-a3cb-f673ad700219 tempest-TestShelveInstance-2122303240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-0f9f4f61-8db4-4e0b-9497-063182c791dd" returned: 0 in 0.429s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:47:08 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [req-29d0dc8b-c6ca-404b-b54f-c3465736609f req-d23374c3-387f-4dee-a3cb-f673ad700219 tempest-TestShelveInstance-2122303240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-0f9f4f61-8db4-4e0b-9497-063182c791dd {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:47:08 devstack sudo[104284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-0f9f4f61-8db4-4e0b-9497-063182c791dd Sep 06 06:47:08 devstack sudo[104284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:47:08 devstack sudo[104284]: pam_unix(sudo:session): session closed for user root Sep 06 06:47:08 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [req-29d0dc8b-c6ca-404b-b54f-c3465736609f req-d23374c3-387f-4dee-a3cb-f673ad700219 tempest-TestShelveInstance-2122303240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-0f9f4f61-8db4-4e0b-9497-063182c791dd" returned: 0 in 0.242s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:47:08 devstack cinder-volume[87329]: DEBUG cinder.coordination [req-29d0dc8b-c6ca-404b-b54f-c3465736609f req-d23374c3-387f-4dee-a3cb-f673ad700219 tempest-TestShelveInstance-2122303240 None] Lock "cinder-quobyte-0f9f4f61-8db4-4e0b-9497-063182c791dd" released by "delete_volume" :: held 0.727s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:47:08 devstack cinder-volume[87329]: DEBUG cinder.quota [req-29d0dc8b-c6ca-404b-b54f-c3465736609f req-d23374c3-387f-4dee-a3cb-f673ad700219 tempest-TestShelveInstance-2122303240 None] Created reservations ['5a44b282-0d04-4368-a87f-60682a8260f3', 'ff1f2602-e9fa-4042-a627-9cab5e8e3df1', '0369d504-efa4-4d6b-82ca-8d2b7744af42', 'c3c0c526-fb63-466d-9df6-d0533cd48881'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:47:08 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [req-29d0dc8b-c6ca-404b-b54f-c3465736609f req-d23374c3-387f-4dee-a3cb-f673ad700219 tempest-TestShelveInstance-2122303240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:47:08 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [req-29d0dc8b-c6ca-404b-b54f-c3465736609f req-d23374c3-387f-4dee-a3cb-f673ad700219 tempest-TestShelveInstance-2122303240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:47:08 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [req-29d0dc8b-c6ca-404b-b54f-c3465736609f req-d23374c3-387f-4dee-a3cb-f673ad700219 tempest-TestShelveInstance-2122303240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:47:08 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [req-29d0dc8b-c6ca-404b-b54f-c3465736609f req-d23374c3-387f-4dee-a3cb-f673ad700219 tempest-TestShelveInstance-2122303240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:47:08 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [req-29d0dc8b-c6ca-404b-b54f-c3465736609f req-d23374c3-387f-4dee-a3cb-f673ad700219 tempest-TestShelveInstance-2122303240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:47:08 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [req-29d0dc8b-c6ca-404b-b54f-c3465736609f req-d23374c3-387f-4dee-a3cb-f673ad700219 tempest-TestShelveInstance-2122303240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:47:08 devstack sudo[104287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:47:08 devstack sudo[104287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:47:08 devstack sudo[104287]: pam_unix(sudo:session): session closed for user root Sep 06 06:47:08 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [req-29d0dc8b-c6ca-404b-b54f-c3465736609f req-d23374c3-387f-4dee-a3cb-f673ad700219 tempest-TestShelveInstance-2122303240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.258s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:47:08 devstack cinder-volume[87329]: DEBUG cinder.manager [req-29d0dc8b-c6ca-404b-b54f-c3465736609f req-d23374c3-387f-4dee-a3cb-f673ad700219 tempest-TestShelveInstance-2122303240 None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:47:08 devstack cinder-volume[87329]: INFO cinder.volume.manager [req-29d0dc8b-c6ca-404b-b54f-c3465736609f req-d23374c3-387f-4dee-a3cb-f673ad700219 tempest-TestShelveInstance-2122303240 None] Deleted volume successfully. Sep 06 06:47:09 devstack cinder-volume[87329]: DEBUG cinder.coordination [req-29d0dc8b-c6ca-404b-b54f-c3465736609f req-d23374c3-387f-4dee-a3cb-f673ad700219 tempest-TestShelveInstance-2122303240 None] Lock "cinder-0f9f4f61-8db4-4e0b-9497-063182c791dd-delete_volume" released by "delete_volume" :: held 1.219s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:47:18 devstack cinder-volume[87329]: DEBUG dbcounter [-] [87329] Writing DB stats cinder:UPDATE=87,cinder:SELECT=81,cinder:INSERT=20,cinder:DELETE=4 {{(pid=87329) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 06:47:18 devstack cinder-volume[87329]: DEBUG dbcounter [-] [87329] Writing DB stats cinder:SELECT=88,cinder:INSERT=24,cinder:UPDATE=85,cinder:DELETE=10 {{(pid=87329) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 06:47:31 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-8213f034-839f-4161-9430-c78b241314b1 tempest-TestImageHashVerification-1866299605 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87329) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 06:47:31 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-8213f034-839f-4161-9430-c78b241314b1 tempest-TestImageHashVerification-1866299605 None] Flow 'volume_create_manager' (796cf529-cf59-4ef9-9c40-5490a6d35871) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:47:31 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-8213f034-839f-4161-9430-c78b241314b1 tempest-TestImageHashVerification-1866299605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b28035a-3f4f-45ec-9478-ca7181cb1780) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:47:31 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-8213f034-839f-4161-9430-c78b241314b1 tempest-TestImageHashVerification-1866299605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b28035a-3f4f-45ec-9478-ca7181cb1780) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:47:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1910234112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28796851-8801-4495-98cb-b4df182d0468,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75517b2847054ab7a6546b4101ca2c1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:47:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:47:31Z,use_quota=True,user_id='aae3819e9ae94f86b835c5efb8d03737',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:47:31 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-8213f034-839f-4161-9430-c78b241314b1 tempest-TestImageHashVerification-1866299605 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af7fdb83-0eb4-4b52-89b2-4a1c2130515d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:47:31 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-8213f034-839f-4161-9430-c78b241314b1 tempest-TestImageHashVerification-1866299605 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af7fdb83-0eb4-4b52-89b2-4a1c2130515d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:47:31 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-8213f034-839f-4161-9430-c78b241314b1 tempest-TestImageHashVerification-1866299605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f286596-b01a-4b0f-8884-4b8d6b8c8eda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:47:31 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-8213f034-839f-4161-9430-c78b241314b1 tempest-TestImageHashVerification-1866299605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f286596-b01a-4b0f-8884-4b8d6b8c8eda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28796851-8801-4495-98cb-b4df182d0468', 'volume_name': 'volume-28796851-8801-4495-98cb-b4df182d0468', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:47:31 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-8213f034-839f-4161-9430-c78b241314b1 tempest-TestImageHashVerification-1866299605 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bb9d83a-bf81-4b79-a56b-098e2246c2c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:47:31 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-8213f034-839f-4161-9430-c78b241314b1 tempest-TestImageHashVerification-1866299605 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bb9d83a-bf81-4b79-a56b-098e2246c2c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:47:31 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-8213f034-839f-4161-9430-c78b241314b1 tempest-TestImageHashVerification-1866299605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d0f57d8-57a1-402f-b5d0-ec04bf765f0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:47:31 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-8213f034-839f-4161-9430-c78b241314b1 tempest-TestImageHashVerification-1866299605 None] Volume 28796851-8801-4495-98cb-b4df182d0468: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28796851-8801-4495-98cb-b4df182d0468', 'volume_size': 1} Sep 06 06:47:31 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-8213f034-839f-4161-9430-c78b241314b1 tempest-TestImageHashVerification-1866299605 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:47:31 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-8213f034-839f-4161-9430-c78b241314b1 tempest-TestImageHashVerification-1866299605 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:47:31 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-8213f034-839f-4161-9430-c78b241314b1 tempest-TestImageHashVerification-1866299605 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:47:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1910234112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28796851-8801-4495-98cb-b4df182d0468,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75517b2847054ab7a6546b4101ca2c1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:47:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:47:31Z,use_quota=True,user_id='aae3819e9ae94f86b835c5efb8d03737',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)}" {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 06:47:31 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-8213f034-839f-4161-9430-c78b241314b1 tempest-TestImageHashVerification-1866299605 None] Creating volume 28796851-8801-4495-98cb-b4df182d0468 {{(pid=87329) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 06:47:31 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-8213f034-839f-4161-9430-c78b241314b1 tempest-TestImageHashVerification-1866299605 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:47:31 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-8213f034-839f-4161-9430-c78b241314b1 tempest-TestImageHashVerification-1866299605 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:47:31 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-8213f034-839f-4161-9430-c78b241314b1 tempest-TestImageHashVerification-1866299605 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:47:31 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-8213f034-839f-4161-9430-c78b241314b1 tempest-TestImageHashVerification-1866299605 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:47:31 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-8213f034-839f-4161-9430-c78b241314b1 tempest-TestImageHashVerification-1866299605 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:47:31 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-8213f034-839f-4161-9430-c78b241314b1 tempest-TestImageHashVerification-1866299605 None] Selected osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 as target Quobyte volume. {{(pid=87329) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 06:47:31 devstack cinder-volume[87329]: INFO cinder.volume.drivers.remotefs [None req-8213f034-839f-4161-9430-c78b241314b1 tempest-TestImageHashVerification-1866299605 None] casted to osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 Sep 06 06:47:31 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-8213f034-839f-4161-9430-c78b241314b1 tempest-TestImageHashVerification-1866299605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-28796851-8801-4495-98cb-b4df182d0468 1073741824 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:47:31 devstack sudo[104300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-28796851-8801-4495-98cb-b4df182d0468 1073741824 Sep 06 06:47:31 devstack sudo[104300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:47:31 devstack sudo[104300]: pam_unix(sudo:session): session closed for user root Sep 06 06:47:31 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-8213f034-839f-4161-9430-c78b241314b1 tempest-TestImageHashVerification-1866299605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-28796851-8801-4495-98cb-b4df182d0468 1073741824" returned: 0 in 0.438s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:47:31 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-8213f034-839f-4161-9430-c78b241314b1 tempest-TestImageHashVerification-1866299605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-28796851-8801-4495-98cb-b4df182d0468 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:47:31 devstack sudo[104305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-28796851-8801-4495-98cb-b4df182d0468 Sep 06 06:47:31 devstack sudo[104305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:47:32 devstack sudo[104305]: pam_unix(sudo:session): session closed for user root Sep 06 06:47:32 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-8213f034-839f-4161-9430-c78b241314b1 tempest-TestImageHashVerification-1866299605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-28796851-8801-4495-98cb-b4df182d0468" returned: 0 in 0.243s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:47:32 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-8213f034-839f-4161-9430-c78b241314b1 tempest-TestImageHashVerification-1866299605 None] <== create_volume: return (722ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'} {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 06:47:32 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-8213f034-839f-4161-9430-c78b241314b1 tempest-TestImageHashVerification-1866299605 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.725s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:47:32 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-8213f034-839f-4161-9430-c78b241314b1 tempest-TestImageHashVerification-1866299605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d0f57d8-57a1-402f-b5d0-ec04bf765f0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28796851-8801-4495-98cb-b4df182d0468', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:47:32 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-8213f034-839f-4161-9430-c78b241314b1 tempest-TestImageHashVerification-1866299605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (985af67a-75b9-4649-8868-c11338c2a533) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:47:32 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-8213f034-839f-4161-9430-c78b241314b1 tempest-TestImageHashVerification-1866299605 None] Volume volume-28796851-8801-4495-98cb-b4df182d0468 (28796851-8801-4495-98cb-b4df182d0468): created successfully Sep 06 06:47:32 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-8213f034-839f-4161-9430-c78b241314b1 tempest-TestImageHashVerification-1866299605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (985af67a-75b9-4649-8868-c11338c2a533) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:47:32 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-8213f034-839f-4161-9430-c78b241314b1 tempest-TestImageHashVerification-1866299605 None] Flow 'volume_create_manager' (796cf529-cf59-4ef9-9c40-5490a6d35871) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:47:32 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-8213f034-839f-4161-9430-c78b241314b1 tempest-TestImageHashVerification-1866299605 None] Created volume successfully. Sep 06 06:47:33 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-bee433cc-e9a7-49b8-9032-8c04a0499e53 tempest-TestImageHashVerification-1866299605 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:47:33 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-bee433cc-e9a7-49b8-9032-8c04a0499e53 tempest-TestImageHashVerification-1866299605 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:47:33 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffaffaf3-2452-44f0-9b86-9626aab2f07d]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:47:33 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-bee433cc-e9a7-49b8-9032-8c04a0499e53 tempest-TestImageHashVerification-1866299605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-28796851-8801-4495-98cb-b4df182d0468 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:47:33 devstack sudo[104308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-28796851-8801-4495-98cb-b4df182d0468 Sep 06 06:47:33 devstack sudo[104308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:47:33 devstack sudo[104308]: pam_unix(sudo:session): session closed for user root Sep 06 06:47:33 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-bee433cc-e9a7-49b8-9032-8c04a0499e53 tempest-TestImageHashVerification-1866299605 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-28796851-8801-4495-98cb-b4df182d0468" returned: 0 in 0.353s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:47:33 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9061e96-6513-48d4-a937-513c41e97f4e]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:47:33 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-bee433cc-e9a7-49b8-9032-8c04a0499e53 tempest-TestImageHashVerification-1866299605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-28796851-8801-4495-98cb-b4df182d0468 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:47:33 devstack sudo[104313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-28796851-8801-4495-98cb-b4df182d0468 Sep 06 06:47:33 devstack sudo[104313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:47:34 devstack sudo[104313]: pam_unix(sudo:session): session closed for user root Sep 06 06:47:34 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-bee433cc-e9a7-49b8-9032-8c04a0499e53 tempest-TestImageHashVerification-1866299605 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-28796851-8801-4495-98cb-b4df182d0468" returned: 0 in 0.349s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:47:34 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-bee433cc-e9a7-49b8-9032-8c04a0499e53 tempest-TestImageHashVerification-1866299605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-28796851-8801-4495-98cb-b4df182d0468 /opt/stack/data/cinder/conversion/28796851-8801-4495-98cb-b4df182d0468.temp_image.0b2725be-7643-40e6-8d83-f2e4222f39a6wxzy2ll4.img {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:47:34 devstack sudo[104318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-28796851-8801-4495-98cb-b4df182d0468 /opt/stack/data/cinder/conversion/28796851-8801-4495-98cb-b4df182d0468.temp_image.0b2725be-7643-40e6-8d83-f2e4222f39a6wxzy2ll4.img Sep 06 06:47:34 devstack sudo[104318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:47:37 devstack sudo[104318]: pam_unix(sudo:session): session closed for user root Sep 06 06:47:37 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-bee433cc-e9a7-49b8-9032-8c04a0499e53 tempest-TestImageHashVerification-1866299605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-28796851-8801-4495-98cb-b4df182d0468 /opt/stack/data/cinder/conversion/28796851-8801-4495-98cb-b4df182d0468.temp_image.0b2725be-7643-40e6-8d83-f2e4222f39a6wxzy2ll4.img" returned: 0 in 3.754s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:47:37 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[015ec05e-6d22-471c-8c40-998b9d5e63fd]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:47:37 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-bee433cc-e9a7-49b8-9032-8c04a0499e53 tempest-TestImageHashVerification-1866299605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-28796851-8801-4495-98cb-b4df182d0468 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:47:37 devstack sudo[104331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-28796851-8801-4495-98cb-b4df182d0468 Sep 06 06:47:37 devstack sudo[104331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:47:38 devstack sudo[104331]: pam_unix(sudo:session): session closed for user root Sep 06 06:47:38 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-bee433cc-e9a7-49b8-9032-8c04a0499e53 tempest-TestImageHashVerification-1866299605 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-28796851-8801-4495-98cb-b4df182d0468" returned: 0 in 0.502s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:47:38 devstack cinder-volume[87329]: DEBUG cinder.image.image_utils [None req-bee433cc-e9a7-49b8-9032-8c04a0499e53 tempest-TestImageHashVerification-1866299605 None] Image conversion details: src /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-28796851-8801-4495-98cb-b4df182d0468, size 1024.00 MB, duration 3.76 sec, destination /opt/stack/data/cinder/conversion/28796851-8801-4495-98cb-b4df182d0468.temp_image.0b2725be-7643-40e6-8d83-f2e4222f39a6wxzy2ll4.img {{(pid=87329) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 06 06:47:38 devstack cinder-volume[87329]: INFO cinder.image.image_utils [None req-bee433cc-e9a7-49b8-9032-8c04a0499e53 tempest-TestImageHashVerification-1866299605 None] Converted 1024.00 MB image at 272.68 MB/s Sep 06 06:47:38 devstack cinder-volume[87329]: DEBUG cinder.image.image_utils [None req-bee433cc-e9a7-49b8-9032-8c04a0499e53 tempest-TestImageHashVerification-1866299605 None] 0b2725be-7643-40e6-8d83-f2e4222f39a6 was raw, no need to convert to raw {{(pid=87329) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Sep 06 06:47:43 devstack cinder-volume[87329]: DEBUG dbcounter [-] [87329] Writing DB stats cinder:SELECT=5,cinder:INSERT=1,cinder:UPDATE=2,cinder:DELETE=1 {{(pid=87329) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 06:47:48 devstack cinder-volume[87329]: DEBUG dbcounter [-] [87329] Writing DB stats cinder:UPDATE=4,cinder:SELECT=2 {{(pid=87329) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 06:47:48 devstack cinder-volume[87329]: DEBUG oslo_service.periodic_task [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87329) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 06 06:47:48 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:47:48 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:47:48 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:47:48 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:47:48 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:47:48 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:47:48 devstack sudo[104373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:47:48 devstack sudo[104373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:47:48 devstack sudo[104373]: pam_unix(sudo:session): session closed for user root Sep 06 06:47:48 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.256s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:47:48 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:47:48 devstack cinder-volume[87329]: DEBUG oslo_service.periodic_task [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Running periodic task VolumeManager._thread_info {{(pid=87329) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 06 06:47:48 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] thread count: 28 {{(pid=87329) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 06 06:47:48 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] thread info: [<_MainThread(MainThread, started 126855043821696)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87329) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 06 06:47:56 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-bee433cc-e9a7-49b8-9032-8c04a0499e53 tempest-TestImageHashVerification-1866299605 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 23.296s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:47:56 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-bee433cc-e9a7-49b8-9032-8c04a0499e53 tempest-TestImageHashVerification-1866299605 None] Uploaded volume to glance image-id: 0b2725be-7643-40e6-8d83-f2e4222f39a6. {{(pid=87329) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 06 06:47:56 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-bee433cc-e9a7-49b8-9032-8c04a0499e53 tempest-TestImageHashVerification-1866299605 None] Copy volume to image completed successfully. Sep 06 06:47:57 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-f7b7fafe-6277-4ee2-a4e9-591e535b8ac0 tempest-TestImageHashVerification-1866299605 None] Acquiring lock "cinder-28796851-8801-4495-98cb-b4df182d0468-delete_volume" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:47:57 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-f7b7fafe-6277-4ee2-a4e9-591e535b8ac0 tempest-TestImageHashVerification-1866299605 None] Lock "cinder-28796851-8801-4495-98cb-b4df182d0468-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:47:57 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-f7b7fafe-6277-4ee2-a4e9-591e535b8ac0 tempest-TestImageHashVerification-1866299605 None] Acquiring lock "cinder-quobyte-28796851-8801-4495-98cb-b4df182d0468" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:47:57 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-f7b7fafe-6277-4ee2-a4e9-591e535b8ac0 tempest-TestImageHashVerification-1866299605 None] Lock "cinder-quobyte-28796851-8801-4495-98cb-b4df182d0468" acquired by "delete_volume" :: waited 0.015s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:47:57 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[72dbadb1-a145-4ac9-ac2b-abc27fe81d64]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:47:57 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-f7b7fafe-6277-4ee2-a4e9-591e535b8ac0 tempest-TestImageHashVerification-1866299605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-28796851-8801-4495-98cb-b4df182d0468 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:47:57 devstack sudo[104377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-28796851-8801-4495-98cb-b4df182d0468 Sep 06 06:47:57 devstack sudo[104377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:47:58 devstack sudo[104377]: pam_unix(sudo:session): session closed for user root Sep 06 06:47:58 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-f7b7fafe-6277-4ee2-a4e9-591e535b8ac0 tempest-TestImageHashVerification-1866299605 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-28796851-8801-4495-98cb-b4df182d0468" returned: 0 in 0.344s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:47:58 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-f7b7fafe-6277-4ee2-a4e9-591e535b8ac0 tempest-TestImageHashVerification-1866299605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-28796851-8801-4495-98cb-b4df182d0468 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:47:58 devstack sudo[104382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-28796851-8801-4495-98cb-b4df182d0468 Sep 06 06:47:58 devstack sudo[104382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:47:58 devstack sudo[104382]: pam_unix(sudo:session): session closed for user root Sep 06 06:47:58 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-f7b7fafe-6277-4ee2-a4e9-591e535b8ac0 tempest-TestImageHashVerification-1866299605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-28796851-8801-4495-98cb-b4df182d0468" returned: 0 in 0.234s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:47:58 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-f7b7fafe-6277-4ee2-a4e9-591e535b8ac0 tempest-TestImageHashVerification-1866299605 None] Lock "cinder-quobyte-28796851-8801-4495-98cb-b4df182d0468" released by "delete_volume" :: held 0.616s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:47:58 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-f7b7fafe-6277-4ee2-a4e9-591e535b8ac0 tempest-TestImageHashVerification-1866299605 None] Created reservations ['2f61fb85-10c4-43f5-8e06-2aeb8fd08c95', '9a9f7088-cdac-4597-9137-617f20eb9b81', 'c8855746-9bea-4f53-bd30-4edd7942f054', '17b24a7e-5635-4163-aa08-0d5223cd5a48'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:47:58 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-f7b7fafe-6277-4ee2-a4e9-591e535b8ac0 tempest-TestImageHashVerification-1866299605 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:47:58 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-f7b7fafe-6277-4ee2-a4e9-591e535b8ac0 tempest-TestImageHashVerification-1866299605 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:47:58 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-f7b7fafe-6277-4ee2-a4e9-591e535b8ac0 tempest-TestImageHashVerification-1866299605 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:47:58 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-f7b7fafe-6277-4ee2-a4e9-591e535b8ac0 tempest-TestImageHashVerification-1866299605 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:47:58 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-f7b7fafe-6277-4ee2-a4e9-591e535b8ac0 tempest-TestImageHashVerification-1866299605 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:47:58 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-f7b7fafe-6277-4ee2-a4e9-591e535b8ac0 tempest-TestImageHashVerification-1866299605 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:47:58 devstack sudo[104391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:47:58 devstack sudo[104391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:47:58 devstack sudo[104391]: pam_unix(sudo:session): session closed for user root Sep 06 06:47:58 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-f7b7fafe-6277-4ee2-a4e9-591e535b8ac0 tempest-TestImageHashVerification-1866299605 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.240s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:47:58 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-f7b7fafe-6277-4ee2-a4e9-591e535b8ac0 tempest-TestImageHashVerification-1866299605 None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:47:58 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-f7b7fafe-6277-4ee2-a4e9-591e535b8ac0 tempest-TestImageHashVerification-1866299605 None] Deleted volume successfully. Sep 06 06:47:58 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-f7b7fafe-6277-4ee2-a4e9-591e535b8ac0 tempest-TestImageHashVerification-1866299605 None] Lock "cinder-28796851-8801-4495-98cb-b4df182d0468-delete_volume" released by "delete_volume" :: held 1.030s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:48:08 devstack cinder-volume[87329]: DEBUG dbcounter [-] [87329] Writing DB stats cinder:SELECT=5,cinder:UPDATE=9,cinder:INSERT=3,cinder:DELETE=1 {{(pid=87329) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 06:48:17 devstack cinder-volume[87329]: DEBUG dbcounter [-] [87329] Writing DB stats cinder:UPDATE=9,cinder:SELECT=7,cinder:INSERT=1 {{(pid=87329) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 06:48:28 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-3395cadb-27fb-4110-a7d1-068e6022558f tempest-TestStampPattern-617916417 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87329) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 06:48:28 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-3395cadb-27fb-4110-a7d1-068e6022558f tempest-TestStampPattern-617916417 None] Flow 'volume_create_manager' (9c78bd4a-693b-43d6-9a5c-8b5a05c3363f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:48:28 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-3395cadb-27fb-4110-a7d1-068e6022558f tempest-TestStampPattern-617916417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6febdaf-0ef2-4c62-83d6-6c0e5f0d23ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:48:28 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-3395cadb-27fb-4110-a7d1-068e6022558f tempest-TestStampPattern-617916417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6febdaf-0ef2-4c62-83d6-6c0e5f0d23ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:48:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1910624398',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf5d4ef7-8a85-4aca-9028-e2a58a76ee1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='258f2362ead6491cbd20513d722037b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:48:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:48:28Z,use_quota=True,user_id='7c31d8dd0b6b417db636714c595bb740',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:48:28 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-3395cadb-27fb-4110-a7d1-068e6022558f tempest-TestStampPattern-617916417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b1c3fd1-7fa3-4d30-986f-892391119635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:48:28 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-3395cadb-27fb-4110-a7d1-068e6022558f tempest-TestStampPattern-617916417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b1c3fd1-7fa3-4d30-986f-892391119635) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:48:28 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-3395cadb-27fb-4110-a7d1-068e6022558f tempest-TestStampPattern-617916417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e003215b-3462-49a3-b08a-09383b832175) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:48:28 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-3395cadb-27fb-4110-a7d1-068e6022558f tempest-TestStampPattern-617916417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e003215b-3462-49a3-b08a-09383b832175) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf5d4ef7-8a85-4aca-9028-e2a58a76ee1e', 'volume_name': 'volume-bf5d4ef7-8a85-4aca-9028-e2a58a76ee1e', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:48:28 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-3395cadb-27fb-4110-a7d1-068e6022558f tempest-TestStampPattern-617916417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6dbfe27-803c-4dd6-8f07-3d3bbbee7fae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:48:28 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-3395cadb-27fb-4110-a7d1-068e6022558f tempest-TestStampPattern-617916417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6dbfe27-803c-4dd6-8f07-3d3bbbee7fae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:48:28 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-3395cadb-27fb-4110-a7d1-068e6022558f tempest-TestStampPattern-617916417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f19dd83-517c-4231-8a0c-c658c01ec64d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:48:28 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-3395cadb-27fb-4110-a7d1-068e6022558f tempest-TestStampPattern-617916417 None] Volume bf5d4ef7-8a85-4aca-9028-e2a58a76ee1e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf5d4ef7-8a85-4aca-9028-e2a58a76ee1e', 'volume_size': 1} Sep 06 06:48:28 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-3395cadb-27fb-4110-a7d1-068e6022558f tempest-TestStampPattern-617916417 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:48:28 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-3395cadb-27fb-4110-a7d1-068e6022558f tempest-TestStampPattern-617916417 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:48:28 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-3395cadb-27fb-4110-a7d1-068e6022558f tempest-TestStampPattern-617916417 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:48:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1910624398',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf5d4ef7-8a85-4aca-9028-e2a58a76ee1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='258f2362ead6491cbd20513d722037b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:48:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:48:28Z,use_quota=True,user_id='7c31d8dd0b6b417db636714c595bb740',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)}" {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 06:48:28 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-3395cadb-27fb-4110-a7d1-068e6022558f tempest-TestStampPattern-617916417 None] Creating volume bf5d4ef7-8a85-4aca-9028-e2a58a76ee1e {{(pid=87329) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 06:48:28 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-3395cadb-27fb-4110-a7d1-068e6022558f tempest-TestStampPattern-617916417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:48:28 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-3395cadb-27fb-4110-a7d1-068e6022558f tempest-TestStampPattern-617916417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:48:28 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-3395cadb-27fb-4110-a7d1-068e6022558f tempest-TestStampPattern-617916417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:48:28 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-3395cadb-27fb-4110-a7d1-068e6022558f tempest-TestStampPattern-617916417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:48:28 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-3395cadb-27fb-4110-a7d1-068e6022558f tempest-TestStampPattern-617916417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:48:28 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-3395cadb-27fb-4110-a7d1-068e6022558f tempest-TestStampPattern-617916417 None] Selected osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 as target Quobyte volume. {{(pid=87329) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 06:48:28 devstack cinder-volume[87329]: INFO cinder.volume.drivers.remotefs [None req-3395cadb-27fb-4110-a7d1-068e6022558f tempest-TestStampPattern-617916417 None] casted to osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 Sep 06 06:48:28 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-3395cadb-27fb-4110-a7d1-068e6022558f tempest-TestStampPattern-617916417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bf5d4ef7-8a85-4aca-9028-e2a58a76ee1e 1073741824 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:48:28 devstack sudo[104406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bf5d4ef7-8a85-4aca-9028-e2a58a76ee1e 1073741824 Sep 06 06:48:28 devstack sudo[104406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:48:28 devstack sudo[104406]: pam_unix(sudo:session): session closed for user root Sep 06 06:48:29 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-3395cadb-27fb-4110-a7d1-068e6022558f tempest-TestStampPattern-617916417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bf5d4ef7-8a85-4aca-9028-e2a58a76ee1e 1073741824" returned: 0 in 0.453s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:48:29 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-3395cadb-27fb-4110-a7d1-068e6022558f tempest-TestStampPattern-617916417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bf5d4ef7-8a85-4aca-9028-e2a58a76ee1e {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:48:29 devstack sudo[104413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bf5d4ef7-8a85-4aca-9028-e2a58a76ee1e Sep 06 06:48:29 devstack sudo[104413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:48:29 devstack sudo[104413]: pam_unix(sudo:session): session closed for user root Sep 06 06:48:29 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-3395cadb-27fb-4110-a7d1-068e6022558f tempest-TestStampPattern-617916417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bf5d4ef7-8a85-4aca-9028-e2a58a76ee1e" returned: 0 in 0.255s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:48:29 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-3395cadb-27fb-4110-a7d1-068e6022558f tempest-TestStampPattern-617916417 None] <== create_volume: return (750ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'} {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 06:48:29 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-3395cadb-27fb-4110-a7d1-068e6022558f tempest-TestStampPattern-617916417 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.753s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:48:29 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-3395cadb-27fb-4110-a7d1-068e6022558f tempest-TestStampPattern-617916417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f19dd83-517c-4231-8a0c-c658c01ec64d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf5d4ef7-8a85-4aca-9028-e2a58a76ee1e', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:48:29 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-3395cadb-27fb-4110-a7d1-068e6022558f tempest-TestStampPattern-617916417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f40d1909-41d0-445c-bf49-69648f6085e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:48:29 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-3395cadb-27fb-4110-a7d1-068e6022558f tempest-TestStampPattern-617916417 None] Volume volume-bf5d4ef7-8a85-4aca-9028-e2a58a76ee1e (bf5d4ef7-8a85-4aca-9028-e2a58a76ee1e): created successfully Sep 06 06:48:29 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-3395cadb-27fb-4110-a7d1-068e6022558f tempest-TestStampPattern-617916417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f40d1909-41d0-445c-bf49-69648f6085e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:48:29 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-3395cadb-27fb-4110-a7d1-068e6022558f tempest-TestStampPattern-617916417 None] Flow 'volume_create_manager' (9c78bd4a-693b-43d6-9a5c-8b5a05c3363f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:48:29 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-3395cadb-27fb-4110-a7d1-068e6022558f tempest-TestStampPattern-617916417 None] Created volume successfully. Sep 06 06:48:39 devstack cinder-volume[87329]: DEBUG dbcounter [-] [87329] Writing DB stats cinder:SELECT=2,cinder:UPDATE=3,cinder:INSERT=1 {{(pid=87329) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 06:48:39 devstack cinder-volume[87329]: DEBUG dbcounter [-] [87329] Writing DB stats cinder:UPDATE=3,cinder:SELECT=2,cinder:DELETE=1 {{(pid=87329) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 06:48:48 devstack cinder-volume[87329]: DEBUG oslo_service.periodic_task [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87329) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 06 06:48:48 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:48:48 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:48:48 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:48:48 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:48:48 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:48:48 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:48:48 devstack sudo[104562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:48:48 devstack sudo[104562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:48:48 devstack sudo[104562]: pam_unix(sudo:session): session closed for user root Sep 06 06:48:48 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.236s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:48:48 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:48:48 devstack cinder-volume[87329]: DEBUG oslo_service.periodic_task [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Running periodic task VolumeManager._thread_info {{(pid=87329) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 06 06:48:48 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] thread count: 28 {{(pid=87329) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 06 06:48:48 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] thread info: [<_MainThread(MainThread, started 126855043821696)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87329) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 06 06:48:58 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [req-062a2348-e5c4-4f53-bbe1-f032506221c5 req-59e80879-c2b6-4d13-a902-b6e63ece2e11 tempest-TestStampPattern-617916417 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:48:58 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [req-062a2348-e5c4-4f53-bbe1-f032506221c5 req-59e80879-c2b6-4d13-a902-b6e63ece2e11 tempest-TestStampPattern-617916417 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:48:58 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [req-062a2348-e5c4-4f53-bbe1-f032506221c5 req-59e80879-c2b6-4d13-a902-b6e63ece2e11 tempest-TestStampPattern-617916417 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:48:58 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [req-062a2348-e5c4-4f53-bbe1-f032506221c5 req-59e80879-c2b6-4d13-a902-b6e63ece2e11 tempest-TestStampPattern-617916417 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6', 'name': 'volume-bf5d4ef7-8a85-4aca-9028-e2a58a76ee1e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4e1c86df-a996-4deb-99a4-dd229694b4f6', 'enforce_multipath': True} {{(pid=87329) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 06 06:48:58 devstack cinder-volume[87329]: INFO cinder.volume.manager [req-062a2348-e5c4-4f53-bbe1-f032506221c5 req-59e80879-c2b6-4d13-a902-b6e63ece2e11 tempest-TestStampPattern-617916417 None] attachment_update completed successfully. Sep 06 06:49:01 devstack cinder-volume[87329]: INFO cinder.volume.manager [req-7347851a-1747-4a6f-84d4-99204783243e req-f78964b1-0450-4b9e-9b14-c4e5e6bbdf79 tempest-TestStampPattern-617916417 None] Terminate volume connection completed successfully. Sep 06 06:49:01 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [req-7347851a-1747-4a6f-84d4-99204783243e req-f78964b1-0450-4b9e-9b14-c4e5e6bbdf79 tempest-TestStampPattern-617916417 None] Deleting attachment 4e1c86df-a996-4deb-99a4-dd229694b4f6. {{(pid=87329) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 06 06:49:02 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-96cdd78e-dafb-467d-a2e4-c6ef67f1bba6 tempest-TestStampPattern-617916417 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:49:02 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-96cdd78e-dafb-467d-a2e4-c6ef67f1bba6 tempest-TestStampPattern-617916417 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:49:02 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-96cdd78e-dafb-467d-a2e4-c6ef67f1bba6 tempest-TestStampPattern-617916417 None] Creating offline snapshot 0be40703-5305-46e1-888b-92380c44d5d8 of volume bf5d4ef7-8a85-4aca-9028-e2a58a76ee1e {{(pid=87329) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 06 06:49:02 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aa28bfc-267c-45d0-80cd-b83210b364cf]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:49:02 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-96cdd78e-dafb-467d-a2e4-c6ef67f1bba6 tempest-TestStampPattern-617916417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bf5d4ef7-8a85-4aca-9028-e2a58a76ee1e {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:49:02 devstack sudo[105021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bf5d4ef7-8a85-4aca-9028-e2a58a76ee1e Sep 06 06:49:02 devstack sudo[105021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:49:03 devstack sudo[105021]: pam_unix(sudo:session): session closed for user root Sep 06 06:49:03 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-96cdd78e-dafb-467d-a2e4-c6ef67f1bba6 tempest-TestStampPattern-617916417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bf5d4ef7-8a85-4aca-9028-e2a58a76ee1e" returned: 0 in 0.349s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:49:03 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-96cdd78e-dafb-467d-a2e4-c6ef67f1bba6 tempest-TestStampPattern-617916417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bf5d4ef7-8a85-4aca-9028-e2a58a76ee1e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bf5d4ef7-8a85-4aca-9028-e2a58a76ee1e.0be40703-5305-46e1-888b-92380c44d5d8 1G {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:49:03 devstack sudo[105026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bf5d4ef7-8a85-4aca-9028-e2a58a76ee1e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bf5d4ef7-8a85-4aca-9028-e2a58a76ee1e.0be40703-5305-46e1-888b-92380c44d5d8 1G Sep 06 06:49:03 devstack sudo[105026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:49:03 devstack sudo[105026]: pam_unix(sudo:session): session closed for user root Sep 06 06:49:03 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-96cdd78e-dafb-467d-a2e4-c6ef67f1bba6 tempest-TestStampPattern-617916417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bf5d4ef7-8a85-4aca-9028-e2a58a76ee1e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bf5d4ef7-8a85-4aca-9028-e2a58a76ee1e.0be40703-5305-46e1-888b-92380c44d5d8 1G" returned: 0 in 0.382s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:49:03 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-96cdd78e-dafb-467d-a2e4-c6ef67f1bba6 tempest-TestStampPattern-617916417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf5d4ef7-8a85-4aca-9028-e2a58a76ee1e -F qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bf5d4ef7-8a85-4aca-9028-e2a58a76ee1e.0be40703-5305-46e1-888b-92380c44d5d8 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:49:03 devstack sudo[105031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf5d4ef7-8a85-4aca-9028-e2a58a76ee1e -F qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bf5d4ef7-8a85-4aca-9028-e2a58a76ee1e.0be40703-5305-46e1-888b-92380c44d5d8 Sep 06 06:49:03 devstack sudo[105031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:49:03 devstack sudo[105031]: pam_unix(sudo:session): session closed for user root Sep 06 06:49:03 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-96cdd78e-dafb-467d-a2e4-c6ef67f1bba6 tempest-TestStampPattern-617916417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf5d4ef7-8a85-4aca-9028-e2a58a76ee1e -F qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bf5d4ef7-8a85-4aca-9028-e2a58a76ee1e.0be40703-5305-46e1-888b-92380c44d5d8" returned: 0 in 0.290s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:49:03 devstack cinder-volume[87329]: WARNING cinder.volume.drivers.remotefs [None req-96cdd78e-dafb-467d-a2e4-c6ef67f1bba6 tempest-TestStampPattern-617916417 None] /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bf5d4ef7-8a85-4aca-9028-e2a58a76ee1e.0be40703-5305-46e1-888b-92380c44d5d8 is being set with open permissions: ugo+rw Sep 06 06:49:03 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-96cdd78e-dafb-467d-a2e4-c6ef67f1bba6 tempest-TestStampPattern-617916417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bf5d4ef7-8a85-4aca-9028-e2a58a76ee1e.0be40703-5305-46e1-888b-92380c44d5d8 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:49:03 devstack sudo[105036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bf5d4ef7-8a85-4aca-9028-e2a58a76ee1e.0be40703-5305-46e1-888b-92380c44d5d8 Sep 06 06:49:03 devstack sudo[105036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:49:04 devstack sudo[105036]: pam_unix(sudo:session): session closed for user root Sep 06 06:49:04 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-96cdd78e-dafb-467d-a2e4-c6ef67f1bba6 tempest-TestStampPattern-617916417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bf5d4ef7-8a85-4aca-9028-e2a58a76ee1e.0be40703-5305-46e1-888b-92380c44d5d8" returned: 0 in 0.241s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:49:04 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-96cdd78e-dafb-467d-a2e4-c6ef67f1bba6 tempest-TestStampPattern-617916417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bf5d4ef7-8a85-4aca-9028-e2a58a76ee1e.info {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:49:04 devstack sudo[105039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bf5d4ef7-8a85-4aca-9028-e2a58a76ee1e.info Sep 06 06:49:04 devstack sudo[105039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:49:04 devstack sudo[105039]: pam_unix(sudo:session): session closed for user root Sep 06 06:49:04 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-96cdd78e-dafb-467d-a2e4-c6ef67f1bba6 tempest-TestStampPattern-617916417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bf5d4ef7-8a85-4aca-9028-e2a58a76ee1e.info" returned: 0 in 0.238s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:49:04 devstack cinder-volume[87329]: WARNING cinder.volume.drivers.remotefs [None req-96cdd78e-dafb-467d-a2e4-c6ef67f1bba6 tempest-TestStampPattern-617916417 None] /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bf5d4ef7-8a85-4aca-9028-e2a58a76ee1e.info is being set with open permissions: ugo+rw Sep 06 06:49:04 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-96cdd78e-dafb-467d-a2e4-c6ef67f1bba6 tempest-TestStampPattern-617916417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bf5d4ef7-8a85-4aca-9028-e2a58a76ee1e.info {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:49:04 devstack sudo[105042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bf5d4ef7-8a85-4aca-9028-e2a58a76ee1e.info Sep 06 06:49:04 devstack sudo[105042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:49:04 devstack sudo[105042]: pam_unix(sudo:session): session closed for user root Sep 06 06:49:04 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-96cdd78e-dafb-467d-a2e4-c6ef67f1bba6 tempest-TestStampPattern-617916417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bf5d4ef7-8a85-4aca-9028-e2a58a76ee1e.info" returned: 0 in 0.244s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:49:04 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-96cdd78e-dafb-467d-a2e4-c6ef67f1bba6 tempest-TestStampPattern-617916417 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.821s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:49:04 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-96cdd78e-dafb-467d-a2e4-c6ef67f1bba6 tempest-TestStampPattern-617916417 None] Create snapshot completed successfully Sep 06 06:49:10 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1ed704e-967c-440d-9d04-70c83d18a4f5 tempest-TestStampPattern-617916417 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87329) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 06:49:10 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-d1ed704e-967c-440d-9d04-70c83d18a4f5 tempest-TestStampPattern-617916417 None] Flow 'volume_create_manager' (7c243c28-d4a9-4bbf-a62f-e9ab79f9cce3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:49:10 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-d1ed704e-967c-440d-9d04-70c83d18a4f5 tempest-TestStampPattern-617916417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc955c73-9e8d-48c8-82da-3d841a5d51c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:49:10 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-d1ed704e-967c-440d-9d04-70c83d18a4f5 tempest-TestStampPattern-617916417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc955c73-9e8d-48c8-82da-3d841a5d51c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:49:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-709735118',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8f08a7b-48ee-47bc-aba6-5e4ecf6a8b7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='258f2362ead6491cbd20513d722037b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:49:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=0be40703-5305-46e1-888b-92380c44d5d8,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:49:10Z,use_quota=True,user_id='7c31d8dd0b6b417db636714c595bb740',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:49:10 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-d1ed704e-967c-440d-9d04-70c83d18a4f5 tempest-TestStampPattern-617916417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c81cdc8d-8583-48cd-ad31-2c61e97d8230) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:49:10 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-d1ed704e-967c-440d-9d04-70c83d18a4f5 tempest-TestStampPattern-617916417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c81cdc8d-8583-48cd-ad31-2c61e97d8230) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:49:10 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-d1ed704e-967c-440d-9d04-70c83d18a4f5 tempest-TestStampPattern-617916417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97225a4e-c49c-40fc-990b-cc7c91dfbf48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:49:10 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-d1ed704e-967c-440d-9d04-70c83d18a4f5 tempest-TestStampPattern-617916417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97225a4e-c49c-40fc-990b-cc7c91dfbf48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c8f08a7b-48ee-47bc-aba6-5e4ecf6a8b7d', 'volume_name': 'volume-c8f08a7b-48ee-47bc-aba6-5e4ecf6a8b7d', 'volume_size': 1, 'snapshot_id': '0be40703-5305-46e1-888b-92380c44d5d8'}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:49:10 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-d1ed704e-967c-440d-9d04-70c83d18a4f5 tempest-TestStampPattern-617916417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69a6553a-25f4-420e-beb4-20e9df7697f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:49:10 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-d1ed704e-967c-440d-9d04-70c83d18a4f5 tempest-TestStampPattern-617916417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69a6553a-25f4-420e-beb4-20e9df7697f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:49:10 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-d1ed704e-967c-440d-9d04-70c83d18a4f5 tempest-TestStampPattern-617916417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27f6d7c0-cfe7-4793-bc6e-452122d11dd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:49:10 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-d1ed704e-967c-440d-9d04-70c83d18a4f5 tempest-TestStampPattern-617916417 None] Volume c8f08a7b-48ee-47bc-aba6-5e4ecf6a8b7d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c8f08a7b-48ee-47bc-aba6-5e4ecf6a8b7d', 'volume_size': 1, 'snapshot_id': '0be40703-5305-46e1-888b-92380c44d5d8'} Sep 06 06:49:10 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-d1ed704e-967c-440d-9d04-70c83d18a4f5 tempest-TestStampPattern-617916417 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:49:10 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-d1ed704e-967c-440d-9d04-70c83d18a4f5 tempest-TestStampPattern-617916417 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:49:10 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-d1ed704e-967c-440d-9d04-70c83d18a4f5 tempest-TestStampPattern-617916417 None] Acquiring lock "cinder-quobyte-0be40703-5305-46e1-888b-92380c44d5d8-c8f08a7b-48ee-47bc-aba6-5e4ecf6a8b7d" by "_create_volume_from_snapshot" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:49:10 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-d1ed704e-967c-440d-9d04-70c83d18a4f5 tempest-TestStampPattern-617916417 None] Lock "cinder-quobyte-0be40703-5305-46e1-888b-92380c44d5d8-c8f08a7b-48ee-47bc-aba6-5e4ecf6a8b7d" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:49:10 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-d1ed704e-967c-440d-9d04-70c83d18a4f5 tempest-TestStampPattern-617916417 None] Creating volume c8f08a7b-48ee-47bc-aba6-5e4ecf6a8b7d from snapshot 0be40703-5305-46e1-888b-92380c44d5d8 {{(pid=87329) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 06 06:49:10 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-d1ed704e-967c-440d-9d04-70c83d18a4f5 tempest-TestStampPattern-617916417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:49:10 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-d1ed704e-967c-440d-9d04-70c83d18a4f5 tempest-TestStampPattern-617916417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:49:10 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-d1ed704e-967c-440d-9d04-70c83d18a4f5 tempest-TestStampPattern-617916417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:49:10 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-d1ed704e-967c-440d-9d04-70c83d18a4f5 tempest-TestStampPattern-617916417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:49:10 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-d1ed704e-967c-440d-9d04-70c83d18a4f5 tempest-TestStampPattern-617916417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:49:10 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-d1ed704e-967c-440d-9d04-70c83d18a4f5 tempest-TestStampPattern-617916417 None] Selected osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 as target Quobyte volume. {{(pid=87329) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 06:49:10 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-d1ed704e-967c-440d-9d04-70c83d18a4f5 tempest-TestStampPattern-617916417 None] Acquiring lock "cinder-quobyte-c8f08a7b-48ee-47bc-aba6-5e4ecf6a8b7d" by "_copy_volume_from_snapshot" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:49:10 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-d1ed704e-967c-440d-9d04-70c83d18a4f5 tempest-TestStampPattern-617916417 None] Lock "cinder-quobyte-c8f08a7b-48ee-47bc-aba6-5e4ecf6a8b7d" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:49:10 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-d1ed704e-967c-440d-9d04-70c83d18a4f5 tempest-TestStampPattern-617916417 None] snapshot: 0be40703-5305-46e1-888b-92380c44d5d8, volume: c8f08a7b-48ee-47bc-aba6-5e4ecf6a8b7d, {{(pid=87329) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 06 06:49:10 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-d1ed704e-967c-440d-9d04-70c83d18a4f5 tempest-TestStampPattern-617916417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:49:10 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-d1ed704e-967c-440d-9d04-70c83d18a4f5 tempest-TestStampPattern-617916417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:49:10 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-d1ed704e-967c-440d-9d04-70c83d18a4f5 tempest-TestStampPattern-617916417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:49:10 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-d1ed704e-967c-440d-9d04-70c83d18a4f5 tempest-TestStampPattern-617916417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:49:10 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-d1ed704e-967c-440d-9d04-70c83d18a4f5 tempest-TestStampPattern-617916417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:49:10 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[05176e8e-2f50-4ef1-b449-1b05bd30fa29]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:49:10 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-d1ed704e-967c-440d-9d04-70c83d18a4f5 tempest-TestStampPattern-617916417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bf5d4ef7-8a85-4aca-9028-e2a58a76ee1e.0be40703-5305-46e1-888b-92380c44d5d8 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:49:10 devstack sudo[105072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bf5d4ef7-8a85-4aca-9028-e2a58a76ee1e.0be40703-5305-46e1-888b-92380c44d5d8 Sep 06 06:49:10 devstack sudo[105072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:49:10 devstack sudo[105072]: pam_unix(sudo:session): session closed for user root Sep 06 06:49:10 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-d1ed704e-967c-440d-9d04-70c83d18a4f5 tempest-TestStampPattern-617916417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bf5d4ef7-8a85-4aca-9028-e2a58a76ee1e.0be40703-5305-46e1-888b-92380c44d5d8" returned: 0 in 0.368s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:49:10 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-d1ed704e-967c-440d-9d04-70c83d18a4f5 tempest-TestStampPattern-617916417 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bf5d4ef7-8a85-4aca-9028-e2a58a76ee1e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87329) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 06:49:10 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad69fa80-8c4b-48a9-bca4-caeb1162e1df]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:49:10 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-d1ed704e-967c-440d-9d04-70c83d18a4f5 tempest-TestStampPattern-617916417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bf5d4ef7-8a85-4aca-9028-e2a58a76ee1e {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:49:11 devstack sudo[105077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bf5d4ef7-8a85-4aca-9028-e2a58a76ee1e Sep 06 06:49:11 devstack sudo[105077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:49:11 devstack sudo[105077]: pam_unix(sudo:session): session closed for user root Sep 06 06:49:11 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-d1ed704e-967c-440d-9d04-70c83d18a4f5 tempest-TestStampPattern-617916417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bf5d4ef7-8a85-4aca-9028-e2a58a76ee1e" returned: 0 in 0.387s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:49:11 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-d1ed704e-967c-440d-9d04-70c83d18a4f5 tempest-TestStampPattern-617916417 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bf5d4ef7-8a85-4aca-9028-e2a58a76ee1e {{(pid=87329) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 06 06:49:11 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-d1ed704e-967c-440d-9d04-70c83d18a4f5 tempest-TestStampPattern-617916417 None] Creating direct copy from snapshot {{(pid=87329) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 06 06:49:11 devstack cinder-volume[87329]: DEBUG cinder.utils [None req-d1ed704e-967c-440d-9d04-70c83d18a4f5 tempest-TestStampPattern-617916417 None] Path /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-c8f08a7b-48ee-47bc-aba6-5e4ecf6a8b7d not found in is_blk_device check {{(pid=87329) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 06 06:49:11 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-d1ed704e-967c-440d-9d04-70c83d18a4f5 tempest-TestStampPattern-617916417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bf5d4ef7-8a85-4aca-9028-e2a58a76ee1e /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-c8f08a7b-48ee-47bc-aba6-5e4ecf6a8b7d {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:49:11 devstack sudo[105085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bf5d4ef7-8a85-4aca-9028-e2a58a76ee1e /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-c8f08a7b-48ee-47bc-aba6-5e4ecf6a8b7d Sep 06 06:49:11 devstack sudo[105085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:49:17 devstack sudo[105085]: pam_unix(sudo:session): session closed for user root Sep 06 06:49:17 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-d1ed704e-967c-440d-9d04-70c83d18a4f5 tempest-TestStampPattern-617916417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bf5d4ef7-8a85-4aca-9028-e2a58a76ee1e /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-c8f08a7b-48ee-47bc-aba6-5e4ecf6a8b7d" returned: 0 in 5.865s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:49:17 devstack cinder-volume[87329]: DEBUG cinder.image.image_utils [None req-d1ed704e-967c-440d-9d04-70c83d18a4f5 tempest-TestStampPattern-617916417 None] Image conversion details: src /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bf5d4ef7-8a85-4aca-9028-e2a58a76ee1e, size 1024.00 MB, duration 5.87 sec, destination /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-c8f08a7b-48ee-47bc-aba6-5e4ecf6a8b7d {{(pid=87329) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 06 06:49:17 devstack cinder-volume[87329]: INFO cinder.image.image_utils [None req-d1ed704e-967c-440d-9d04-70c83d18a4f5 tempest-TestStampPattern-617916417 None] Converted 1024.00 MB image at 174.56 MB/s Sep 06 06:49:17 devstack cinder-volume[87329]: WARNING cinder.volume.drivers.remotefs [None req-d1ed704e-967c-440d-9d04-70c83d18a4f5 tempest-TestStampPattern-617916417 None] /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-c8f08a7b-48ee-47bc-aba6-5e4ecf6a8b7d is being set with open permissions: ugo+rw Sep 06 06:49:17 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-d1ed704e-967c-440d-9d04-70c83d18a4f5 tempest-TestStampPattern-617916417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-c8f08a7b-48ee-47bc-aba6-5e4ecf6a8b7d {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:49:17 devstack sudo[105121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-c8f08a7b-48ee-47bc-aba6-5e4ecf6a8b7d Sep 06 06:49:17 devstack sudo[105121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:49:17 devstack sudo[105121]: pam_unix(sudo:session): session closed for user root Sep 06 06:49:17 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-d1ed704e-967c-440d-9d04-70c83d18a4f5 tempest-TestStampPattern-617916417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-c8f08a7b-48ee-47bc-aba6-5e4ecf6a8b7d" returned: 0 in 0.271s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:49:17 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-d1ed704e-967c-440d-9d04-70c83d18a4f5 tempest-TestStampPattern-617916417 None] Lock "cinder-quobyte-c8f08a7b-48ee-47bc-aba6-5e4ecf6a8b7d" released by "_copy_volume_from_snapshot" :: held 6.971s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:49:17 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-d1ed704e-967c-440d-9d04-70c83d18a4f5 tempest-TestStampPattern-617916417 None] Lock "cinder-quobyte-0be40703-5305-46e1-888b-92380c44d5d8-c8f08a7b-48ee-47bc-aba6-5e4ecf6a8b7d" released by "_create_volume_from_snapshot" :: held 7.045s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:49:17 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-d1ed704e-967c-440d-9d04-70c83d18a4f5 tempest-TestStampPattern-617916417 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.060s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:49:17 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-d1ed704e-967c-440d-9d04-70c83d18a4f5 tempest-TestStampPattern-617916417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27f6d7c0-cfe7-4793-bc6e-452122d11dd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8f08a7b-48ee-47bc-aba6-5e4ecf6a8b7d', 'volume_size': 1, 'snapshot_id': '0be40703-5305-46e1-888b-92380c44d5d8'}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:49:17 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-d1ed704e-967c-440d-9d04-70c83d18a4f5 tempest-TestStampPattern-617916417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98cad6a6-83d7-4677-a4b5-2275b47fc1cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:49:17 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-d1ed704e-967c-440d-9d04-70c83d18a4f5 tempest-TestStampPattern-617916417 None] Volume volume-c8f08a7b-48ee-47bc-aba6-5e4ecf6a8b7d (c8f08a7b-48ee-47bc-aba6-5e4ecf6a8b7d): created successfully Sep 06 06:49:17 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-d1ed704e-967c-440d-9d04-70c83d18a4f5 tempest-TestStampPattern-617916417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98cad6a6-83d7-4677-a4b5-2275b47fc1cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:49:17 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-d1ed704e-967c-440d-9d04-70c83d18a4f5 tempest-TestStampPattern-617916417 None] Flow 'volume_create_manager' (7c243c28-d4a9-4bbf-a62f-e9ab79f9cce3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:49:17 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-d1ed704e-967c-440d-9d04-70c83d18a4f5 tempest-TestStampPattern-617916417 None] Created volume successfully. Sep 06 06:49:27 devstack cinder-volume[87329]: DEBUG dbcounter [-] [87329] Writing DB stats cinder:SELECT=16,cinder:UPDATE=4,cinder:INSERT=2 {{(pid=87329) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 06:49:27 devstack cinder-volume[87329]: DEBUG dbcounter [-] [87329] Writing DB stats cinder:SELECT=13,cinder:UPDATE=8,cinder:DELETE=2 {{(pid=87329) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 06:49:48 devstack cinder-volume[87329]: DEBUG oslo_service.periodic_task [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87329) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 06 06:49:48 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:49:48 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:49:48 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:49:48 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:49:48 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:49:48 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:49:48 devstack sudo[105240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:49:48 devstack sudo[105240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:49:48 devstack sudo[105240]: pam_unix(sudo:session): session closed for user root Sep 06 06:49:48 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.238s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:49:48 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:49:48 devstack cinder-volume[87329]: DEBUG oslo_service.periodic_task [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Running periodic task VolumeManager._thread_info {{(pid=87329) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 06 06:49:48 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] thread count: 28 {{(pid=87329) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 06 06:49:48 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] thread info: [<_MainThread(MainThread, started 126855043821696)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87329) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 06 06:49:58 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [req-4a72dd1b-1903-42f5-9a7a-f0d3539e2232 req-9b618642-842f-462e-a12f-b7a7b830b2db tempest-TestStampPattern-617916417 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:49:58 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [req-4a72dd1b-1903-42f5-9a7a-f0d3539e2232 req-9b618642-842f-462e-a12f-b7a7b830b2db tempest-TestStampPattern-617916417 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:49:58 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [req-4a72dd1b-1903-42f5-9a7a-f0d3539e2232 req-9b618642-842f-462e-a12f-b7a7b830b2db tempest-TestStampPattern-617916417 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:49:58 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [req-4a72dd1b-1903-42f5-9a7a-f0d3539e2232 req-9b618642-842f-462e-a12f-b7a7b830b2db tempest-TestStampPattern-617916417 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6', 'name': 'volume-c8f08a7b-48ee-47bc-aba6-5e4ecf6a8b7d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8491c27c-4e3b-4567-aaec-e62786a4d1c4', 'enforce_multipath': True} {{(pid=87329) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 06 06:49:58 devstack cinder-volume[87329]: INFO cinder.volume.manager [req-4a72dd1b-1903-42f5-9a7a-f0d3539e2232 req-9b618642-842f-462e-a12f-b7a7b830b2db tempest-TestStampPattern-617916417 None] attachment_update completed successfully. Sep 06 06:50:00 devstack cinder-volume[87329]: INFO cinder.volume.manager [req-3f6d8d38-d337-44f2-b171-f98c4e4d4b5a req-7522d078-ea58-45b2-b405-321ba2ea4501 tempest-TestStampPattern-617916417 None] Terminate volume connection completed successfully. Sep 06 06:50:00 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [req-3f6d8d38-d337-44f2-b171-f98c4e4d4b5a req-7522d078-ea58-45b2-b405-321ba2ea4501 tempest-TestStampPattern-617916417 None] Deleting attachment 8491c27c-4e3b-4567-aaec-e62786a4d1c4. {{(pid=87329) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 06 06:50:04 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-3f7784fb-6a7f-441e-a2d5-bc28439860bf tempest-TestStampPattern-617916417 None] Acquiring lock "cinder-c8f08a7b-48ee-47bc-aba6-5e4ecf6a8b7d-delete_volume" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:50:04 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-3f7784fb-6a7f-441e-a2d5-bc28439860bf tempest-TestStampPattern-617916417 None] Lock "cinder-c8f08a7b-48ee-47bc-aba6-5e4ecf6a8b7d-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:50:04 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-3f7784fb-6a7f-441e-a2d5-bc28439860bf tempest-TestStampPattern-617916417 None] Acquiring lock "cinder-quobyte-c8f08a7b-48ee-47bc-aba6-5e4ecf6a8b7d" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:50:04 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-3f7784fb-6a7f-441e-a2d5-bc28439860bf tempest-TestStampPattern-617916417 None] Lock "cinder-quobyte-c8f08a7b-48ee-47bc-aba6-5e4ecf6a8b7d" acquired by "delete_volume" :: waited 0.014s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:50:04 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a8fee32-db64-4705-96a5-77903e24ae66]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:50:04 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-3f7784fb-6a7f-441e-a2d5-bc28439860bf tempest-TestStampPattern-617916417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-c8f08a7b-48ee-47bc-aba6-5e4ecf6a8b7d {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:50:05 devstack sudo[105722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-c8f08a7b-48ee-47bc-aba6-5e4ecf6a8b7d Sep 06 06:50:05 devstack sudo[105722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:50:05 devstack sudo[105722]: pam_unix(sudo:session): session closed for user root Sep 06 06:50:05 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-3f7784fb-6a7f-441e-a2d5-bc28439860bf tempest-TestStampPattern-617916417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-c8f08a7b-48ee-47bc-aba6-5e4ecf6a8b7d" returned: 0 in 0.345s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:50:05 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-3f7784fb-6a7f-441e-a2d5-bc28439860bf tempest-TestStampPattern-617916417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-c8f08a7b-48ee-47bc-aba6-5e4ecf6a8b7d {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:50:05 devstack sudo[105727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-c8f08a7b-48ee-47bc-aba6-5e4ecf6a8b7d Sep 06 06:50:05 devstack sudo[105727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:50:05 devstack sudo[105727]: pam_unix(sudo:session): session closed for user root Sep 06 06:50:05 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-3f7784fb-6a7f-441e-a2d5-bc28439860bf tempest-TestStampPattern-617916417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-c8f08a7b-48ee-47bc-aba6-5e4ecf6a8b7d" returned: 0 in 0.238s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:50:05 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-3f7784fb-6a7f-441e-a2d5-bc28439860bf tempest-TestStampPattern-617916417 None] Lock "cinder-quobyte-c8f08a7b-48ee-47bc-aba6-5e4ecf6a8b7d" released by "delete_volume" :: held 0.619s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:50:05 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-3f7784fb-6a7f-441e-a2d5-bc28439860bf tempest-TestStampPattern-617916417 None] Created reservations ['30606991-3798-4f4c-8bf5-b570f721b602', '0293eeb6-2f1c-49b8-a5eb-e67021d48389', '0c0cab6c-6d66-410c-ad25-7cc3c74bcd9c', 'bd517f28-c2f4-44c4-b925-9b5c9dd9ee69'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:50:05 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-3f7784fb-6a7f-441e-a2d5-bc28439860bf tempest-TestStampPattern-617916417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:50:05 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-3f7784fb-6a7f-441e-a2d5-bc28439860bf tempest-TestStampPattern-617916417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:50:05 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-3f7784fb-6a7f-441e-a2d5-bc28439860bf tempest-TestStampPattern-617916417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:50:05 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-3f7784fb-6a7f-441e-a2d5-bc28439860bf tempest-TestStampPattern-617916417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:50:05 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-3f7784fb-6a7f-441e-a2d5-bc28439860bf tempest-TestStampPattern-617916417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:50:05 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-3f7784fb-6a7f-441e-a2d5-bc28439860bf tempest-TestStampPattern-617916417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:50:05 devstack sudo[105730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:50:05 devstack sudo[105730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:50:05 devstack sudo[105730]: pam_unix(sudo:session): session closed for user root Sep 06 06:50:05 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-3f7784fb-6a7f-441e-a2d5-bc28439860bf tempest-TestStampPattern-617916417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.236s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:50:05 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-3f7784fb-6a7f-441e-a2d5-bc28439860bf tempest-TestStampPattern-617916417 None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:50:05 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-3f7784fb-6a7f-441e-a2d5-bc28439860bf tempest-TestStampPattern-617916417 None] Deleted volume successfully. Sep 06 06:50:05 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-3f7784fb-6a7f-441e-a2d5-bc28439860bf tempest-TestStampPattern-617916417 None] Lock "cinder-c8f08a7b-48ee-47bc-aba6-5e4ecf6a8b7d-delete_volume" released by "delete_volume" :: held 1.039s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:50:06 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-caefb471-93ca-4148-818d-6d77d56f1e46 tempest-TestStampPattern-617916417 None] Acquiring lock "cinder-0be40703-5305-46e1-888b-92380c44d5d8-delete_snapshot" by "delete_snapshot" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:50:06 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-caefb471-93ca-4148-818d-6d77d56f1e46 tempest-TestStampPattern-617916417 None] Lock "cinder-0be40703-5305-46e1-888b-92380c44d5d8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:50:06 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-caefb471-93ca-4148-818d-6d77d56f1e46 tempest-TestStampPattern-617916417 None] Acquiring lock "cinder-quobyte-bf5d4ef7-8a85-4aca-9028-e2a58a76ee1e" by "delete_snapshot" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:50:06 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-caefb471-93ca-4148-818d-6d77d56f1e46 tempest-TestStampPattern-617916417 None] Lock "cinder-quobyte-bf5d4ef7-8a85-4aca-9028-e2a58a76ee1e" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:50:06 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-caefb471-93ca-4148-818d-6d77d56f1e46 tempest-TestStampPattern-617916417 None] Acquiring lock "cinder-quobyte-0be40703-5305-46e1-888b-92380c44d5d8" by "_delete_snapshot" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:50:06 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-caefb471-93ca-4148-818d-6d77d56f1e46 tempest-TestStampPattern-617916417 None] Lock "cinder-quobyte-0be40703-5305-46e1-888b-92380c44d5d8" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:50:06 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-caefb471-93ca-4148-818d-6d77d56f1e46 tempest-TestStampPattern-617916417 None] Deleting offline snapshot 0be40703-5305-46e1-888b-92380c44d5d8 of volume bf5d4ef7-8a85-4aca-9028-e2a58a76ee1e {{(pid=87329) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 06 06:50:06 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-caefb471-93ca-4148-818d-6d77d56f1e46 tempest-TestStampPattern-617916417 None] snapshot_file for this snap is: volume-bf5d4ef7-8a85-4aca-9028-e2a58a76ee1e.0be40703-5305-46e1-888b-92380c44d5d8 {{(pid=87329) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 06 06:50:06 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d84ce13-2813-4192-aa30-355a9bc9b885]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:50:06 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-caefb471-93ca-4148-818d-6d77d56f1e46 tempest-TestStampPattern-617916417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bf5d4ef7-8a85-4aca-9028-e2a58a76ee1e.0be40703-5305-46e1-888b-92380c44d5d8 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:50:06 devstack sudo[105733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bf5d4ef7-8a85-4aca-9028-e2a58a76ee1e.0be40703-5305-46e1-888b-92380c44d5d8 Sep 06 06:50:06 devstack sudo[105733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:50:06 devstack sudo[105733]: pam_unix(sudo:session): session closed for user root Sep 06 06:50:06 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-caefb471-93ca-4148-818d-6d77d56f1e46 tempest-TestStampPattern-617916417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bf5d4ef7-8a85-4aca-9028-e2a58a76ee1e.0be40703-5305-46e1-888b-92380c44d5d8" returned: 0 in 0.349s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:50:06 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-caefb471-93ca-4148-818d-6d77d56f1e46 tempest-TestStampPattern-617916417 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bf5d4ef7-8a85-4aca-9028-e2a58a76ee1e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87329) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 06:50:06 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[34f4e306-4cb6-49b7-baf9-089c0318a84c]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:50:06 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-caefb471-93ca-4148-818d-6d77d56f1e46 tempest-TestStampPattern-617916417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bf5d4ef7-8a85-4aca-9028-e2a58a76ee1e {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:50:06 devstack sudo[105738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bf5d4ef7-8a85-4aca-9028-e2a58a76ee1e Sep 06 06:50:06 devstack sudo[105738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:50:07 devstack sudo[105738]: pam_unix(sudo:session): session closed for user root Sep 06 06:50:07 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-caefb471-93ca-4148-818d-6d77d56f1e46 tempest-TestStampPattern-617916417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bf5d4ef7-8a85-4aca-9028-e2a58a76ee1e" returned: 0 in 0.497s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:50:07 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-caefb471-93ca-4148-818d-6d77d56f1e46 tempest-TestStampPattern-617916417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bf5d4ef7-8a85-4aca-9028-e2a58a76ee1e.0be40703-5305-46e1-888b-92380c44d5d8 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:50:07 devstack sudo[105743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bf5d4ef7-8a85-4aca-9028-e2a58a76ee1e.0be40703-5305-46e1-888b-92380c44d5d8 Sep 06 06:50:07 devstack sudo[105743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:50:07 devstack sudo[105743]: pam_unix(sudo:session): session closed for user root Sep 06 06:50:07 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-caefb471-93ca-4148-818d-6d77d56f1e46 tempest-TestStampPattern-617916417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bf5d4ef7-8a85-4aca-9028-e2a58a76ee1e.0be40703-5305-46e1-888b-92380c44d5d8" returned: 0 in 0.327s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:50:07 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-caefb471-93ca-4148-818d-6d77d56f1e46 tempest-TestStampPattern-617916417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bf5d4ef7-8a85-4aca-9028-e2a58a76ee1e.0be40703-5305-46e1-888b-92380c44d5d8 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:50:07 devstack sudo[105748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bf5d4ef7-8a85-4aca-9028-e2a58a76ee1e.0be40703-5305-46e1-888b-92380c44d5d8 Sep 06 06:50:07 devstack sudo[105748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:50:07 devstack sudo[105748]: pam_unix(sudo:session): session closed for user root Sep 06 06:50:07 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-caefb471-93ca-4148-818d-6d77d56f1e46 tempest-TestStampPattern-617916417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bf5d4ef7-8a85-4aca-9028-e2a58a76ee1e.0be40703-5305-46e1-888b-92380c44d5d8" returned: 0 in 0.246s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:50:07 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-caefb471-93ca-4148-818d-6d77d56f1e46 tempest-TestStampPattern-617916417 None] Lock "cinder-quobyte-0be40703-5305-46e1-888b-92380c44d5d8" released by "_delete_snapshot" :: held 1.505s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:50:07 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-caefb471-93ca-4148-818d-6d77d56f1e46 tempest-TestStampPattern-617916417 None] Lock "cinder-quobyte-bf5d4ef7-8a85-4aca-9028-e2a58a76ee1e" released by "delete_snapshot" :: held 1.528s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:50:07 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-caefb471-93ca-4148-818d-6d77d56f1e46 tempest-TestStampPattern-617916417 None] Created reservations ['60e64274-ccfe-4ade-8b69-15b5475e8ff8', '8c9ed51b-6987-445f-a1ae-5cf18f12fa60', '32159ac1-e751-4e78-8718-2c5d0fa67281', 'b294d0e8-cca3-4769-86e3-07c01709b336'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:50:07 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-caefb471-93ca-4148-818d-6d77d56f1e46 tempest-TestStampPattern-617916417 None] Delete snapshot completed successfully. Sep 06 06:50:07 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-caefb471-93ca-4148-818d-6d77d56f1e46 tempest-TestStampPattern-617916417 None] Lock "cinder-0be40703-5305-46e1-888b-92380c44d5d8-delete_snapshot" released by "delete_snapshot" :: held 1.657s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:50:11 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-2b3074e8-5150-48a2-ae0b-a218c55f0b53 tempest-TestStampPattern-617916417 None] Acquiring lock "cinder-bf5d4ef7-8a85-4aca-9028-e2a58a76ee1e-delete_volume" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:50:11 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-2b3074e8-5150-48a2-ae0b-a218c55f0b53 tempest-TestStampPattern-617916417 None] Lock "cinder-bf5d4ef7-8a85-4aca-9028-e2a58a76ee1e-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:50:11 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-2b3074e8-5150-48a2-ae0b-a218c55f0b53 tempest-TestStampPattern-617916417 None] Acquiring lock "cinder-quobyte-bf5d4ef7-8a85-4aca-9028-e2a58a76ee1e" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:50:11 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-2b3074e8-5150-48a2-ae0b-a218c55f0b53 tempest-TestStampPattern-617916417 None] Lock "cinder-quobyte-bf5d4ef7-8a85-4aca-9028-e2a58a76ee1e" acquired by "delete_volume" :: waited 0.018s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:50:11 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[67da5df3-ad4c-4a98-873e-afd80c9ac4e8]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:50:11 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-2b3074e8-5150-48a2-ae0b-a218c55f0b53 tempest-TestStampPattern-617916417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bf5d4ef7-8a85-4aca-9028-e2a58a76ee1e {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:50:12 devstack sudo[105779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bf5d4ef7-8a85-4aca-9028-e2a58a76ee1e Sep 06 06:50:12 devstack sudo[105779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:50:12 devstack sudo[105779]: pam_unix(sudo:session): session closed for user root Sep 06 06:50:12 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-2b3074e8-5150-48a2-ae0b-a218c55f0b53 tempest-TestStampPattern-617916417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bf5d4ef7-8a85-4aca-9028-e2a58a76ee1e" returned: 0 in 0.355s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:50:12 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-2b3074e8-5150-48a2-ae0b-a218c55f0b53 tempest-TestStampPattern-617916417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bf5d4ef7-8a85-4aca-9028-e2a58a76ee1e {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:50:12 devstack sudo[105784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bf5d4ef7-8a85-4aca-9028-e2a58a76ee1e Sep 06 06:50:12 devstack sudo[105784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:50:12 devstack sudo[105784]: pam_unix(sudo:session): session closed for user root Sep 06 06:50:12 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-2b3074e8-5150-48a2-ae0b-a218c55f0b53 tempest-TestStampPattern-617916417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bf5d4ef7-8a85-4aca-9028-e2a58a76ee1e" returned: 0 in 0.235s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:50:12 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-2b3074e8-5150-48a2-ae0b-a218c55f0b53 tempest-TestStampPattern-617916417 None] Lock "cinder-quobyte-bf5d4ef7-8a85-4aca-9028-e2a58a76ee1e" released by "delete_volume" :: held 0.645s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:50:12 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-2b3074e8-5150-48a2-ae0b-a218c55f0b53 tempest-TestStampPattern-617916417 None] Created reservations ['60c1e08d-1482-40f8-86cc-da1472fe52ea', '9e0c45dc-5d9c-4294-914c-e1444268c7fa', '52140af2-d31a-4e5e-8a29-354066ea7c02', '4350a254-1fde-47d0-96c7-667e2538ddeb'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:50:12 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-2b3074e8-5150-48a2-ae0b-a218c55f0b53 tempest-TestStampPattern-617916417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:50:12 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-2b3074e8-5150-48a2-ae0b-a218c55f0b53 tempest-TestStampPattern-617916417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:50:12 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-2b3074e8-5150-48a2-ae0b-a218c55f0b53 tempest-TestStampPattern-617916417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:50:12 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-2b3074e8-5150-48a2-ae0b-a218c55f0b53 tempest-TestStampPattern-617916417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:50:12 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-2b3074e8-5150-48a2-ae0b-a218c55f0b53 tempest-TestStampPattern-617916417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:50:12 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-2b3074e8-5150-48a2-ae0b-a218c55f0b53 tempest-TestStampPattern-617916417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:50:12 devstack sudo[105787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:50:12 devstack sudo[105787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:50:12 devstack sudo[105787]: pam_unix(sudo:session): session closed for user root Sep 06 06:50:12 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-2b3074e8-5150-48a2-ae0b-a218c55f0b53 tempest-TestStampPattern-617916417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.232s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:50:12 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-2b3074e8-5150-48a2-ae0b-a218c55f0b53 tempest-TestStampPattern-617916417 None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:50:12 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-2b3074e8-5150-48a2-ae0b-a218c55f0b53 tempest-TestStampPattern-617916417 None] Deleted volume successfully. Sep 06 06:50:12 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-2b3074e8-5150-48a2-ae0b-a218c55f0b53 tempest-TestStampPattern-617916417 None] Lock "cinder-bf5d4ef7-8a85-4aca-9028-e2a58a76ee1e-delete_volume" released by "delete_volume" :: held 1.073s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:50:22 devstack cinder-volume[87329]: DEBUG dbcounter [-] [87329] Writing DB stats cinder:SELECT=26,cinder:UPDATE=23,cinder:INSERT=7 {{(pid=87329) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 06:50:22 devstack cinder-volume[87329]: DEBUG dbcounter [-] [87329] Writing DB stats cinder:SELECT=21,cinder:UPDATE=24,cinder:INSERT=5,cinder:DELETE=2 {{(pid=87329) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 06:50:27 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-37b52964-3a9d-4449-aa0c-1674201794ed tempest-VolumeAndVolumeTypeFromImageTest-315422087 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87329) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 06:50:27 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-37b52964-3a9d-4449-aa0c-1674201794ed tempest-VolumeAndVolumeTypeFromImageTest-315422087 None] Flow 'volume_create_manager' (feb4c516-d9d3-4cbc-9888-e6f89c8cd41a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:50:27 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-37b52964-3a9d-4449-aa0c-1674201794ed tempest-VolumeAndVolumeTypeFromImageTest-315422087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b88fd4c-ce71-4266-85cb-3d76a66e4436) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:50:27 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-37b52964-3a9d-4449-aa0c-1674201794ed tempest-VolumeAndVolumeTypeFromImageTest-315422087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b88fd4c-ce71-4266-85cb-3d76a66e4436) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:50:27Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8efc148d-a474-4362-b785-a7e7c0cf68d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='927be01fbd3b472ca63e491de5a1ae15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:50:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:50:27Z,use_quota=True,user_id='db1a23820ba7477ba85e099a8c826986',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cebd6d8-4ef5-4fae-978b-77a286ccd1ef),volume_type_id=4cebd6d8-4ef5-4fae-978b-77a286ccd1ef)' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:50:27 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-37b52964-3a9d-4449-aa0c-1674201794ed tempest-VolumeAndVolumeTypeFromImageTest-315422087 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e98d5f60-6fb8-4266-9d15-56ff3eb5f64e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:50:27 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-37b52964-3a9d-4449-aa0c-1674201794ed tempest-VolumeAndVolumeTypeFromImageTest-315422087 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e98d5f60-6fb8-4266-9d15-56ff3eb5f64e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:50:27 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-37b52964-3a9d-4449-aa0c-1674201794ed tempest-VolumeAndVolumeTypeFromImageTest-315422087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7558dec-0b2b-40be-a95b-0efed6e17c67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:50:27 devstack cinder-volume[87329]: DEBUG cinder.image.glance [None req-37b52964-3a9d-4449-aa0c-1674201794ed tempest-VolumeAndVolumeTypeFromImageTest-315422087 None] Creating Keystone auth plugin from conf {{(pid=87329) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 06 06:50:27 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-37b52964-3a9d-4449-aa0c-1674201794ed tempest-VolumeAndVolumeTypeFromImageTest-315422087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7558dec-0b2b-40be-a95b-0efed6e17c67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8efc148d-a474-4362-b785-a7e7c0cf68d5', 'volume_name': 'volume-8efc148d-a474-4362-b785-a7e7c0cf68d5', 'volume_size': 1, 'image_id': '09ba2ed3-8966-4505-85f7-807464b32932', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/09ba2ed3-8966-4505-85f7-807464b32932', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e88a9f1007f54dd54642b191bfe7202b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '927be01fbd3b472ca63e491de5a1ae15', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '35546889b0b424f217a2ffd31419d6fd32cb1a687d7410ae2b1126dfea469e33cfb00d07b0f9ada656afa8852c609e2d1fea5061d26639d9dfccfc2856ec36ab', 'id': '09ba2ed3-8966-4505-85f7-807464b32932', 'created_at': datetime.datetime(2026, 9, 6, 4, 50, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 6, 4, 50, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/09ba2ed3-8966-4505-85f7-807464b32932/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:50:27 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-37b52964-3a9d-4449-aa0c-1674201794ed tempest-VolumeAndVolumeTypeFromImageTest-315422087 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c24a98c5-6d22-4843-8678-f69deb555ce7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:50:27 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-37b52964-3a9d-4449-aa0c-1674201794ed tempest-VolumeAndVolumeTypeFromImageTest-315422087 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c24a98c5-6d22-4843-8678-f69deb555ce7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:50:27 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-37b52964-3a9d-4449-aa0c-1674201794ed tempest-VolumeAndVolumeTypeFromImageTest-315422087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c55dc82-655f-4657-b12f-9e303134ea50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:50:27 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-37b52964-3a9d-4449-aa0c-1674201794ed tempest-VolumeAndVolumeTypeFromImageTest-315422087 None] Volume 8efc148d-a474-4362-b785-a7e7c0cf68d5: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8efc148d-a474-4362-b785-a7e7c0cf68d5', 'volume_size': 1, 'image_id': '09ba2ed3-8966-4505-85f7-807464b32932', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/09ba2ed3-8966-4505-85f7-807464b32932', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e88a9f1007f54dd54642b191bfe7202b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '927be01fbd3b472ca63e491de5a1ae15', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '35546889b0b424f217a2ffd31419d6fd32cb1a687d7410ae2b1126dfea469e33cfb00d07b0f9ada656afa8852c609e2d1fea5061d26639d9dfccfc2856ec36ab', 'id': '09ba2ed3-8966-4505-85f7-807464b32932', 'created_at': datetime.datetime(2026, 9, 6, 4, 50, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 6, 4, 50, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/09ba2ed3-8966-4505-85f7-807464b32932/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 06 06:50:27 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-37b52964-3a9d-4449-aa0c-1674201794ed tempest-VolumeAndVolumeTypeFromImageTest-315422087 None] Trying to clone 8efc148d-a474-4362-b785-a7e7c0cf68d5 from image 09ba2ed3-8966-4505-85f7-807464b32932 at location (None, [{'url': 'file:///opt/stack/data/glance/images/09ba2ed3-8966-4505-85f7-807464b32932', 'metadata': {}}]). {{(pid=87329) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 06 06:50:27 devstack cinder-volume[87329]: DEBUG cinder.image.image_utils [None req-37b52964-3a9d-4449-aa0c-1674201794ed tempest-VolumeAndVolumeTypeFromImageTest-315422087 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_09ba2ed3-8966-4505-85f7-807464b32932_s_zzba2edevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87329) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 06 06:50:27 devstack cinder-volume[87329]: INFO cinder.image.image_utils [None req-37b52964-3a9d-4449-aa0c-1674201794ed tempest-VolumeAndVolumeTypeFromImageTest-315422087 None] Image download 0.00 MB at 0.00 MB/s Sep 06 06:50:27 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[05094818-6cd2-43e2-8e63-fe928bb423f6]: (4, 'raw') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:50:27 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-37b52964-3a9d-4449-aa0c-1674201794ed tempest-VolumeAndVolumeTypeFromImageTest-315422087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_09ba2ed3-8966-4505-85f7-807464b32932_s_zzba2edevstack@QuobyteHD {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:50:27 devstack sudo[105798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_09ba2ed3-8966-4505-85f7-807464b32932_s_zzba2edevstack@QuobyteHD Sep 06 06:50:27 devstack sudo[105798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:50:28 devstack sudo[105798]: pam_unix(sudo:session): session closed for user root Sep 06 06:50:28 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-37b52964-3a9d-4449-aa0c-1674201794ed tempest-VolumeAndVolumeTypeFromImageTest-315422087 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_09ba2ed3-8966-4505-85f7-807464b32932_s_zzba2edevstack@QuobyteHD" returned: 0 in 0.317s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:50:28 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-37b52964-3a9d-4449-aa0c-1674201794ed tempest-VolumeAndVolumeTypeFromImageTest-315422087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_09ba2ed3-8966-4505-85f7-807464b32932_s_zzba2edevstack@QuobyteHD {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:50:28 devstack sudo[105802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_09ba2ed3-8966-4505-85f7-807464b32932_s_zzba2edevstack@QuobyteHD Sep 06 06:50:28 devstack sudo[105802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:50:28 devstack sudo[105802]: pam_unix(sudo:session): session closed for user root Sep 06 06:50:28 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-37b52964-3a9d-4449-aa0c-1674201794ed tempest-VolumeAndVolumeTypeFromImageTest-315422087 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_09ba2ed3-8966-4505-85f7-807464b32932_s_zzba2edevstack@QuobyteHD" returned: 1 in 0.313s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:50:28 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-37b52964-3a9d-4449-aa0c-1674201794ed tempest-VolumeAndVolumeTypeFromImageTest-315422087 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_09ba2ed3-8966-4505-85f7-807464b32932_s_zzba2edevstack@QuobyteHD' failed. Not Retrying. {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 06 06:50:28 devstack cinder-volume[87329]: DEBUG cinder.image.image_utils [None req-37b52964-3a9d-4449-aa0c-1674201794ed tempest-VolumeAndVolumeTypeFromImageTest-315422087 None] Temporary image 09ba2ed3-8966-4505-85f7-807464b32932 is fetched for user db1a23820ba7477ba85e099a8c826986. {{(pid=87329) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 06 06:50:28 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[93f5b8da-5eed-4c5a-8072-2944d2904652]: (4, 'raw') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:50:28 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-37b52964-3a9d-4449-aa0c-1674201794ed tempest-VolumeAndVolumeTypeFromImageTest-315422087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_09ba2ed3-8966-4505-85f7-807464b32932_s_zzba2edevstack@QuobyteHD {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:50:28 devstack sudo[105808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_09ba2ed3-8966-4505-85f7-807464b32932_s_zzba2edevstack@QuobyteHD Sep 06 06:50:28 devstack sudo[105808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:50:28 devstack sudo[105808]: pam_unix(sudo:session): session closed for user root Sep 06 06:50:28 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-37b52964-3a9d-4449-aa0c-1674201794ed tempest-VolumeAndVolumeTypeFromImageTest-315422087 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_09ba2ed3-8966-4505-85f7-807464b32932_s_zzba2edevstack@QuobyteHD" returned: 0 in 0.317s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:50:28 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-37b52964-3a9d-4449-aa0c-1674201794ed tempest-VolumeAndVolumeTypeFromImageTest-315422087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_09ba2ed3-8966-4505-85f7-807464b32932_s_zzba2edevstack@QuobyteHD {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:50:28 devstack sudo[105812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_09ba2ed3-8966-4505-85f7-807464b32932_s_zzba2edevstack@QuobyteHD Sep 06 06:50:28 devstack sudo[105812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:50:29 devstack sudo[105812]: pam_unix(sudo:session): session closed for user root Sep 06 06:50:29 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-37b52964-3a9d-4449-aa0c-1674201794ed tempest-VolumeAndVolumeTypeFromImageTest-315422087 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_09ba2ed3-8966-4505-85f7-807464b32932_s_zzba2edevstack@QuobyteHD" returned: 1 in 0.318s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:50:29 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-37b52964-3a9d-4449-aa0c-1674201794ed tempest-VolumeAndVolumeTypeFromImageTest-315422087 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_09ba2ed3-8966-4505-85f7-807464b32932_s_zzba2edevstack@QuobyteHD' failed. Not Retrying. {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 06 06:50:29 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-37b52964-3a9d-4449-aa0c-1674201794ed tempest-VolumeAndVolumeTypeFromImageTest-315422087 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:50:29 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-37b52964-3a9d-4449-aa0c-1674201794ed tempest-VolumeAndVolumeTypeFromImageTest-315422087 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:50:29 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-37b52964-3a9d-4449-aa0c-1674201794ed tempest-VolumeAndVolumeTypeFromImageTest-315422087 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:50:27Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8efc148d-a474-4362-b785-a7e7c0cf68d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='927be01fbd3b472ca63e491de5a1ae15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:50:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:50:27Z,use_quota=True,user_id='db1a23820ba7477ba85e099a8c826986',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4cebd6d8-4ef5-4fae-978b-77a286ccd1ef),volume_type_id=4cebd6d8-4ef5-4fae-978b-77a286ccd1ef)}" {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 06:50:29 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-37b52964-3a9d-4449-aa0c-1674201794ed tempest-VolumeAndVolumeTypeFromImageTest-315422087 None] Creating volume 8efc148d-a474-4362-b785-a7e7c0cf68d5 {{(pid=87329) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 06:50:29 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-37b52964-3a9d-4449-aa0c-1674201794ed tempest-VolumeAndVolumeTypeFromImageTest-315422087 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:50:29 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-37b52964-3a9d-4449-aa0c-1674201794ed tempest-VolumeAndVolumeTypeFromImageTest-315422087 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:50:29 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-37b52964-3a9d-4449-aa0c-1674201794ed tempest-VolumeAndVolumeTypeFromImageTest-315422087 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:50:29 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-37b52964-3a9d-4449-aa0c-1674201794ed tempest-VolumeAndVolumeTypeFromImageTest-315422087 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:50:29 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-37b52964-3a9d-4449-aa0c-1674201794ed tempest-VolumeAndVolumeTypeFromImageTest-315422087 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:50:29 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-37b52964-3a9d-4449-aa0c-1674201794ed tempest-VolumeAndVolumeTypeFromImageTest-315422087 None] Selected osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 as target Quobyte volume. {{(pid=87329) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 06:50:29 devstack cinder-volume[87329]: INFO cinder.volume.drivers.remotefs [None req-37b52964-3a9d-4449-aa0c-1674201794ed tempest-VolumeAndVolumeTypeFromImageTest-315422087 None] casted to osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 Sep 06 06:50:29 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-37b52964-3a9d-4449-aa0c-1674201794ed tempest-VolumeAndVolumeTypeFromImageTest-315422087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-8efc148d-a474-4362-b785-a7e7c0cf68d5 1073741824 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:50:29 devstack sudo[105818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-8efc148d-a474-4362-b785-a7e7c0cf68d5 1073741824 Sep 06 06:50:29 devstack sudo[105818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:50:29 devstack sudo[105818]: pam_unix(sudo:session): session closed for user root Sep 06 06:50:29 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-37b52964-3a9d-4449-aa0c-1674201794ed tempest-VolumeAndVolumeTypeFromImageTest-315422087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-8efc148d-a474-4362-b785-a7e7c0cf68d5 1073741824" returned: 0 in 0.381s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:50:29 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-37b52964-3a9d-4449-aa0c-1674201794ed tempest-VolumeAndVolumeTypeFromImageTest-315422087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-8efc148d-a474-4362-b785-a7e7c0cf68d5 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:50:29 devstack sudo[105824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-8efc148d-a474-4362-b785-a7e7c0cf68d5 Sep 06 06:50:29 devstack sudo[105824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:50:29 devstack sudo[105824]: pam_unix(sudo:session): session closed for user root Sep 06 06:50:29 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-37b52964-3a9d-4449-aa0c-1674201794ed tempest-VolumeAndVolumeTypeFromImageTest-315422087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-8efc148d-a474-4362-b785-a7e7c0cf68d5" returned: 0 in 0.237s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:50:29 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-37b52964-3a9d-4449-aa0c-1674201794ed tempest-VolumeAndVolumeTypeFromImageTest-315422087 None] <== create_volume: return (659ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'} {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 06:50:29 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-37b52964-3a9d-4449-aa0c-1674201794ed tempest-VolumeAndVolumeTypeFromImageTest-315422087 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.662s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:50:29 devstack cinder-volume[87329]: DEBUG cinder.volume.volume_utils [None req-37b52964-3a9d-4449-aa0c-1674201794ed tempest-VolumeAndVolumeTypeFromImageTest-315422087 None] Attempting download of 09ba2ed3-8966-4505-85f7-807464b32932 ((None, [{'url': 'file:///opt/stack/data/glance/images/09ba2ed3-8966-4505-85f7-807464b32932', 'metadata': {}}])) to volume 8efc148d-a474-4362-b785-a7e7c0cf68d5. {{(pid=87329) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 06 06:50:29 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ea7f1fb-ce98-4e68-8cf4-4013dc29f9bb]: (4, 'raw') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:50:29 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-37b52964-3a9d-4449-aa0c-1674201794ed tempest-VolumeAndVolumeTypeFromImageTest-315422087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_09ba2ed3-8966-4505-85f7-807464b32932_iddxs6j3 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:50:29 devstack sudo[105827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_09ba2ed3-8966-4505-85f7-807464b32932_iddxs6j3 Sep 06 06:50:29 devstack sudo[105827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:50:30 devstack sudo[105827]: pam_unix(sudo:session): session closed for user root Sep 06 06:50:30 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-37b52964-3a9d-4449-aa0c-1674201794ed tempest-VolumeAndVolumeTypeFromImageTest-315422087 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_09ba2ed3-8966-4505-85f7-807464b32932_iddxs6j3" returned: 0 in 0.323s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:50:30 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-37b52964-3a9d-4449-aa0c-1674201794ed tempest-VolumeAndVolumeTypeFromImageTest-315422087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_09ba2ed3-8966-4505-85f7-807464b32932_iddxs6j3 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:50:30 devstack sudo[105832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_09ba2ed3-8966-4505-85f7-807464b32932_iddxs6j3 Sep 06 06:50:30 devstack sudo[105832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:50:30 devstack sudo[105832]: pam_unix(sudo:session): session closed for user root Sep 06 06:50:30 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-37b52964-3a9d-4449-aa0c-1674201794ed tempest-VolumeAndVolumeTypeFromImageTest-315422087 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_09ba2ed3-8966-4505-85f7-807464b32932_iddxs6j3" returned: 1 in 0.311s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:50:30 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-37b52964-3a9d-4449-aa0c-1674201794ed tempest-VolumeAndVolumeTypeFromImageTest-315422087 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_09ba2ed3-8966-4505-85f7-807464b32932_iddxs6j3' failed. Not Retrying. {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 06 06:50:30 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4b7bdb3-410c-46f5-bdc9-6cdb0fd62e2c]: (4, 'raw') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:50:30 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-37b52964-3a9d-4449-aa0c-1674201794ed tempest-VolumeAndVolumeTypeFromImageTest-315422087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_09ba2ed3-8966-4505-85f7-807464b32932_s_zzba2edevstack@QuobyteHD {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:50:30 devstack sudo[105836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_09ba2ed3-8966-4505-85f7-807464b32932_s_zzba2edevstack@QuobyteHD Sep 06 06:50:30 devstack sudo[105836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:50:30 devstack sudo[105836]: pam_unix(sudo:session): session closed for user root Sep 06 06:50:30 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-37b52964-3a9d-4449-aa0c-1674201794ed tempest-VolumeAndVolumeTypeFromImageTest-315422087 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_09ba2ed3-8966-4505-85f7-807464b32932_s_zzba2edevstack@QuobyteHD" returned: 0 in 0.310s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:50:30 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-37b52964-3a9d-4449-aa0c-1674201794ed tempest-VolumeAndVolumeTypeFromImageTest-315422087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_09ba2ed3-8966-4505-85f7-807464b32932_s_zzba2edevstack@QuobyteHD {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:50:30 devstack sudo[105840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_09ba2ed3-8966-4505-85f7-807464b32932_s_zzba2edevstack@QuobyteHD Sep 06 06:50:30 devstack sudo[105840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:50:31 devstack sudo[105840]: pam_unix(sudo:session): session closed for user root Sep 06 06:50:31 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-37b52964-3a9d-4449-aa0c-1674201794ed tempest-VolumeAndVolumeTypeFromImageTest-315422087 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_09ba2ed3-8966-4505-85f7-807464b32932_s_zzba2edevstack@QuobyteHD" returned: 1 in 0.314s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:50:31 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-37b52964-3a9d-4449-aa0c-1674201794ed tempest-VolumeAndVolumeTypeFromImageTest-315422087 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_09ba2ed3-8966-4505-85f7-807464b32932_s_zzba2edevstack@QuobyteHD' failed. Not Retrying. {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 06 06:50:31 devstack cinder-volume[87329]: DEBUG cinder.image.image_utils [None req-37b52964-3a9d-4449-aa0c-1674201794ed tempest-VolumeAndVolumeTypeFromImageTest-315422087 None] 09ba2ed3-8966-4505-85f7-807464b32932 was raw, converting to qcow2 {{(pid=87329) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 06 06:50:31 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-37b52964-3a9d-4449-aa0c-1674201794ed tempest-VolumeAndVolumeTypeFromImageTest-315422087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_09ba2ed3-8966-4505-85f7-807464b32932_s_zzba2edevstack@QuobyteHD /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-8efc148d-a474-4362-b785-a7e7c0cf68d5 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:50:31 devstack sudo[105845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_09ba2ed3-8966-4505-85f7-807464b32932_s_zzba2edevstack@QuobyteHD /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-8efc148d-a474-4362-b785-a7e7c0cf68d5 Sep 06 06:50:31 devstack sudo[105845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:50:31 devstack sudo[105845]: pam_unix(sudo:session): session closed for user root Sep 06 06:50:31 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-37b52964-3a9d-4449-aa0c-1674201794ed tempest-VolumeAndVolumeTypeFromImageTest-315422087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_09ba2ed3-8966-4505-85f7-807464b32932_s_zzba2edevstack@QuobyteHD /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-8efc148d-a474-4362-b785-a7e7c0cf68d5" returned: 0 in 0.393s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:50:31 devstack cinder-volume[87329]: DEBUG cinder.image.image_utils [None req-37b52964-3a9d-4449-aa0c-1674201794ed tempest-VolumeAndVolumeTypeFromImageTest-315422087 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_09ba2ed3-8966-4505-85f7-807464b32932_s_zzba2edevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-8efc148d-a474-4362-b785-a7e7c0cf68d5 {{(pid=87329) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 06 06:50:31 devstack cinder-volume[87329]: INFO cinder.image.image_utils [None req-37b52964-3a9d-4449-aa0c-1674201794ed tempest-VolumeAndVolumeTypeFromImageTest-315422087 None] Converted 0.00 MB image at 0.00 MB/s Sep 06 06:50:31 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-37b52964-3a9d-4449-aa0c-1674201794ed tempest-VolumeAndVolumeTypeFromImageTest-315422087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-8efc148d-a474-4362-b785-a7e7c0cf68d5 1G {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:50:31 devstack sudo[105851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-8efc148d-a474-4362-b785-a7e7c0cf68d5 1G Sep 06 06:50:31 devstack sudo[105851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:50:31 devstack sudo[105851]: pam_unix(sudo:session): session closed for user root Sep 06 06:50:31 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-37b52964-3a9d-4449-aa0c-1674201794ed tempest-VolumeAndVolumeTypeFromImageTest-315422087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-8efc148d-a474-4362-b785-a7e7c0cf68d5 1G" returned: 0 in 0.286s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:50:31 devstack cinder-volume[87329]: DEBUG cinder.volume.volume_utils [None req-37b52964-3a9d-4449-aa0c-1674201794ed tempest-VolumeAndVolumeTypeFromImageTest-315422087 None] Downloaded image 09ba2ed3-8966-4505-85f7-807464b32932 ((None, [{'url': 'file:///opt/stack/data/glance/images/09ba2ed3-8966-4505-85f7-807464b32932', 'metadata': {}}])) to volume 8efc148d-a474-4362-b785-a7e7c0cf68d5 successfully. {{(pid=87329) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 06 06:50:31 devstack cinder-volume[87329]: DEBUG cinder.image.image_utils [None req-37b52964-3a9d-4449-aa0c-1674201794ed tempest-VolumeAndVolumeTypeFromImageTest-315422087 None] Temporary image 09ba2ed3-8966-4505-85f7-807464b32932 for user db1a23820ba7477ba85e099a8c826986 is deleted. {{(pid=87329) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 06 06:50:31 devstack cinder-volume[87329]: DEBUG cinder.volume.volume_utils [None req-37b52964-3a9d-4449-aa0c-1674201794ed tempest-VolumeAndVolumeTypeFromImageTest-315422087 None] Marking volume 8efc148d-a474-4362-b785-a7e7c0cf68d5 as bootable. {{(pid=87329) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 06 06:50:31 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-37b52964-3a9d-4449-aa0c-1674201794ed tempest-VolumeAndVolumeTypeFromImageTest-315422087 None] Copying metadata from image 09ba2ed3-8966-4505-85f7-807464b32932 to 8efc148d-a474-4362-b785-a7e7c0cf68d5. {{(pid=87329) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 06 06:50:31 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-37b52964-3a9d-4449-aa0c-1674201794ed tempest-VolumeAndVolumeTypeFromImageTest-315422087 None] Creating volume glance metadata for volume 8efc148d-a474-4362-b785-a7e7c0cf68d5 backed by image 09ba2ed3-8966-4505-85f7-807464b32932 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '09ba2ed3-8966-4505-85f7-807464b32932', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'e88a9f1007f54dd54642b191bfe7202b', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87329) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 06 06:50:31 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-37b52964-3a9d-4449-aa0c-1674201794ed tempest-VolumeAndVolumeTypeFromImageTest-315422087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c55dc82-655f-4657-b12f-9e303134ea50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8efc148d-a474-4362-b785-a7e7c0cf68d5', 'volume_size': 1, 'image_id': '09ba2ed3-8966-4505-85f7-807464b32932', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/09ba2ed3-8966-4505-85f7-807464b32932', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e88a9f1007f54dd54642b191bfe7202b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '927be01fbd3b472ca63e491de5a1ae15', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '35546889b0b424f217a2ffd31419d6fd32cb1a687d7410ae2b1126dfea469e33cfb00d07b0f9ada656afa8852c609e2d1fea5061d26639d9dfccfc2856ec36ab', 'id': '09ba2ed3-8966-4505-85f7-807464b32932', 'created_at': datetime.datetime(2026, 9, 6, 4, 50, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 6, 4, 50, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/09ba2ed3-8966-4505-85f7-807464b32932/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:50:31 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-37b52964-3a9d-4449-aa0c-1674201794ed tempest-VolumeAndVolumeTypeFromImageTest-315422087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63314f37-65c0-4075-b94a-870e70cfa59a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:50:31 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-37b52964-3a9d-4449-aa0c-1674201794ed tempest-VolumeAndVolumeTypeFromImageTest-315422087 None] Volume volume-8efc148d-a474-4362-b785-a7e7c0cf68d5 (8efc148d-a474-4362-b785-a7e7c0cf68d5): created successfully Sep 06 06:50:31 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-37b52964-3a9d-4449-aa0c-1674201794ed tempest-VolumeAndVolumeTypeFromImageTest-315422087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63314f37-65c0-4075-b94a-870e70cfa59a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:50:31 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-37b52964-3a9d-4449-aa0c-1674201794ed tempest-VolumeAndVolumeTypeFromImageTest-315422087 None] Flow 'volume_create_manager' (feb4c516-d9d3-4cbc-9888-e6f89c8cd41a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:50:31 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-37b52964-3a9d-4449-aa0c-1674201794ed tempest-VolumeAndVolumeTypeFromImageTest-315422087 None] Created volume successfully. Sep 06 06:50:32 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-7c548c71-5017-4845-8095-ada13fb97c12 tempest-VolumeAndVolumeTypeFromImageTest-315422087 None] Acquiring lock "cinder-8efc148d-a474-4362-b785-a7e7c0cf68d5-delete_volume" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:50:32 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-7c548c71-5017-4845-8095-ada13fb97c12 tempest-VolumeAndVolumeTypeFromImageTest-315422087 None] Lock "cinder-8efc148d-a474-4362-b785-a7e7c0cf68d5-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:50:32 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-7c548c71-5017-4845-8095-ada13fb97c12 tempest-VolumeAndVolumeTypeFromImageTest-315422087 None] Acquiring lock "cinder-quobyte-8efc148d-a474-4362-b785-a7e7c0cf68d5" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:50:32 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-7c548c71-5017-4845-8095-ada13fb97c12 tempest-VolumeAndVolumeTypeFromImageTest-315422087 None] Lock "cinder-quobyte-8efc148d-a474-4362-b785-a7e7c0cf68d5" acquired by "delete_volume" :: waited 0.013s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:50:32 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[670125f5-c3c3-4867-9ff4-9bac19a20e42]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:50:32 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-7c548c71-5017-4845-8095-ada13fb97c12 tempest-VolumeAndVolumeTypeFromImageTest-315422087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-8efc148d-a474-4362-b785-a7e7c0cf68d5 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:50:32 devstack sudo[105856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-8efc148d-a474-4362-b785-a7e7c0cf68d5 Sep 06 06:50:32 devstack sudo[105856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:50:32 devstack sudo[105856]: pam_unix(sudo:session): session closed for user root Sep 06 06:50:32 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-7c548c71-5017-4845-8095-ada13fb97c12 tempest-VolumeAndVolumeTypeFromImageTest-315422087 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-8efc148d-a474-4362-b785-a7e7c0cf68d5" returned: 0 in 0.346s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:50:32 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-7c548c71-5017-4845-8095-ada13fb97c12 tempest-VolumeAndVolumeTypeFromImageTest-315422087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-8efc148d-a474-4362-b785-a7e7c0cf68d5 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:50:33 devstack sudo[105861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-8efc148d-a474-4362-b785-a7e7c0cf68d5 Sep 06 06:50:33 devstack sudo[105861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:50:33 devstack sudo[105861]: pam_unix(sudo:session): session closed for user root Sep 06 06:50:33 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-7c548c71-5017-4845-8095-ada13fb97c12 tempest-VolumeAndVolumeTypeFromImageTest-315422087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-8efc148d-a474-4362-b785-a7e7c0cf68d5" returned: 0 in 0.231s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:50:33 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-7c548c71-5017-4845-8095-ada13fb97c12 tempest-VolumeAndVolumeTypeFromImageTest-315422087 None] Lock "cinder-quobyte-8efc148d-a474-4362-b785-a7e7c0cf68d5" released by "delete_volume" :: held 0.614s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:50:33 devstack cinder-volume[87329]: WARNING cinder.quota [None req-7c548c71-5017-4845-8095-ada13fb97c12 tempest-VolumeAndVolumeTypeFromImageTest-315422087 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 06 06:50:33 devstack cinder-volume[87329]: WARNING cinder.quota [None req-7c548c71-5017-4845-8095-ada13fb97c12 tempest-VolumeAndVolumeTypeFromImageTest-315422087 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 06 06:50:33 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-7c548c71-5017-4845-8095-ada13fb97c12 tempest-VolumeAndVolumeTypeFromImageTest-315422087 None] Created reservations ['ebb45eeb-23df-433a-acb4-58772ce0fea8', '0e033c91-01ca-42d5-ae64-73357ca632e2', '7f364483-3b50-4dce-951b-aec8e910ce33', '94ba5a9f-ef5a-486b-9f78-9566cce12a12'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:50:33 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-7c548c71-5017-4845-8095-ada13fb97c12 tempest-VolumeAndVolumeTypeFromImageTest-315422087 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:50:33 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-7c548c71-5017-4845-8095-ada13fb97c12 tempest-VolumeAndVolumeTypeFromImageTest-315422087 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:50:33 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-7c548c71-5017-4845-8095-ada13fb97c12 tempest-VolumeAndVolumeTypeFromImageTest-315422087 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:50:33 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-7c548c71-5017-4845-8095-ada13fb97c12 tempest-VolumeAndVolumeTypeFromImageTest-315422087 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:50:33 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-7c548c71-5017-4845-8095-ada13fb97c12 tempest-VolumeAndVolumeTypeFromImageTest-315422087 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:50:33 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-7c548c71-5017-4845-8095-ada13fb97c12 tempest-VolumeAndVolumeTypeFromImageTest-315422087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:50:33 devstack sudo[105864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:50:33 devstack sudo[105864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:50:33 devstack sudo[105864]: pam_unix(sudo:session): session closed for user root Sep 06 06:50:33 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-7c548c71-5017-4845-8095-ada13fb97c12 tempest-VolumeAndVolumeTypeFromImageTest-315422087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.240s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:50:33 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-7c548c71-5017-4845-8095-ada13fb97c12 tempest-VolumeAndVolumeTypeFromImageTest-315422087 None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:50:33 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-7c548c71-5017-4845-8095-ada13fb97c12 tempest-VolumeAndVolumeTypeFromImageTest-315422087 None] Deleted volume successfully. Sep 06 06:50:33 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-7c548c71-5017-4845-8095-ada13fb97c12 tempest-VolumeAndVolumeTypeFromImageTest-315422087 None] Lock "cinder-8efc148d-a474-4362-b785-a7e7c0cf68d5-delete_volume" released by "delete_volume" :: held 1.041s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:50:39 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c0a81d0-13c8-4efe-b23e-6d211323d64b tempest-VolumeImageDependencyTests-1821976841 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87329) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 06:50:39 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-7c0a81d0-13c8-4efe-b23e-6d211323d64b tempest-VolumeImageDependencyTests-1821976841 None] Flow 'volume_create_manager' (8e9606ca-080b-4ad3-ad48-fb19203ee192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:50:39 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-7c0a81d0-13c8-4efe-b23e-6d211323d64b tempest-VolumeImageDependencyTests-1821976841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcaf90a3-5d82-405a-aa67-b2c5db187639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:50:39 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-7c0a81d0-13c8-4efe-b23e-6d211323d64b tempest-VolumeImageDependencyTests-1821976841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcaf90a3-5d82-405a-aa67-b2c5db187639) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:50:39Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=460e365d-fd91-4b63-98fa-81fe50f3efe6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='581bb27730d24ed88b4a8c723476a421',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:50:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:50:40Z,use_quota=True,user_id='0dc0ae425439437abb896bf1a8999e89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:50:39 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-7c0a81d0-13c8-4efe-b23e-6d211323d64b tempest-VolumeImageDependencyTests-1821976841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (841777ce-f1ca-438f-8091-aac15f7744c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:50:39 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-7c0a81d0-13c8-4efe-b23e-6d211323d64b tempest-VolumeImageDependencyTests-1821976841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (841777ce-f1ca-438f-8091-aac15f7744c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:50:39 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-7c0a81d0-13c8-4efe-b23e-6d211323d64b tempest-VolumeImageDependencyTests-1821976841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4a634c8-b891-4827-b1b5-b2f18c83d979) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:50:39 devstack cinder-volume[87329]: DEBUG cinder.image.glance [None req-7c0a81d0-13c8-4efe-b23e-6d211323d64b tempest-VolumeImageDependencyTests-1821976841 None] Creating Keystone auth plugin from conf {{(pid=87329) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 06 06:50:39 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-7c0a81d0-13c8-4efe-b23e-6d211323d64b tempest-VolumeImageDependencyTests-1821976841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4a634c8-b891-4827-b1b5-b2f18c83d979) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '460e365d-fd91-4b63-98fa-81fe50f3efe6', 'volume_name': 'volume-460e365d-fd91-4b63-98fa-81fe50f3efe6', 'volume_size': 1, 'image_id': '2a52dea9-a793-46bd-b038-3f13d4fd2c87', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2a52dea9-a793-46bd-b038-3f13d4fd2c87', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5919ca1bc163253feb33adce6dcd0f8c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '581bb27730d24ed88b4a8c723476a421', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1f85fbf271707a968163319954c47768c82a12c41809b933fc98b2e7bb17d4037006fa15b2ddb0ab291378bb23daeccc45dd2e4f6ce67703b36849b04b5c6172', 'id': '2a52dea9-a793-46bd-b038-3f13d4fd2c87', 'created_at': datetime.datetime(2026, 9, 6, 4, 50, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 6, 4, 50, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2a52dea9-a793-46bd-b038-3f13d4fd2c87/file', 'properties': {}}, 'image_service': }' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:50:39 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-7c0a81d0-13c8-4efe-b23e-6d211323d64b tempest-VolumeImageDependencyTests-1821976841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (925c62fa-4176-48db-9f85-32b39eee5db3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:50:39 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-7c0a81d0-13c8-4efe-b23e-6d211323d64b tempest-VolumeImageDependencyTests-1821976841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (925c62fa-4176-48db-9f85-32b39eee5db3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:50:39 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-7c0a81d0-13c8-4efe-b23e-6d211323d64b tempest-VolumeImageDependencyTests-1821976841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (820cbef2-59f8-4c60-ae3b-11d420ab5c61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:50:39 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-7c0a81d0-13c8-4efe-b23e-6d211323d64b tempest-VolumeImageDependencyTests-1821976841 None] Volume 460e365d-fd91-4b63-98fa-81fe50f3efe6: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-460e365d-fd91-4b63-98fa-81fe50f3efe6', 'volume_size': 1, 'image_id': '2a52dea9-a793-46bd-b038-3f13d4fd2c87', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2a52dea9-a793-46bd-b038-3f13d4fd2c87', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5919ca1bc163253feb33adce6dcd0f8c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '581bb27730d24ed88b4a8c723476a421', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1f85fbf271707a968163319954c47768c82a12c41809b933fc98b2e7bb17d4037006fa15b2ddb0ab291378bb23daeccc45dd2e4f6ce67703b36849b04b5c6172', 'id': '2a52dea9-a793-46bd-b038-3f13d4fd2c87', 'created_at': datetime.datetime(2026, 9, 6, 4, 50, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 6, 4, 50, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2a52dea9-a793-46bd-b038-3f13d4fd2c87/file', 'properties': {}}, 'image_service': } Sep 06 06:50:39 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c0a81d0-13c8-4efe-b23e-6d211323d64b tempest-VolumeImageDependencyTests-1821976841 None] Trying to clone 460e365d-fd91-4b63-98fa-81fe50f3efe6 from image 2a52dea9-a793-46bd-b038-3f13d4fd2c87 at location (None, [{'url': 'file:///opt/stack/data/glance/images/2a52dea9-a793-46bd-b038-3f13d4fd2c87', 'metadata': {}}]). {{(pid=87329) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 06 06:50:40 devstack cinder-volume[87329]: DEBUG cinder.image.image_utils [None req-7c0a81d0-13c8-4efe-b23e-6d211323d64b tempest-VolumeImageDependencyTests-1821976841 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_2a52dea9-a793-46bd-b038-3f13d4fd2c87_up_x7elqdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87329) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 06 06:50:40 devstack cinder-volume[87329]: INFO cinder.image.image_utils [None req-7c0a81d0-13c8-4efe-b23e-6d211323d64b tempest-VolumeImageDependencyTests-1821976841 None] Image download 0.00 MB at 0.00 MB/s Sep 06 06:50:40 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1536839-8068-4de1-aa1b-aa339b767d9b]: (4, 'raw') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:50:40 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-7c0a81d0-13c8-4efe-b23e-6d211323d64b tempest-VolumeImageDependencyTests-1821976841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2a52dea9-a793-46bd-b038-3f13d4fd2c87_up_x7elqdevstack@QuobyteHD {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:50:40 devstack sudo[105868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2a52dea9-a793-46bd-b038-3f13d4fd2c87_up_x7elqdevstack@QuobyteHD Sep 06 06:50:40 devstack sudo[105868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:50:40 devstack sudo[105868]: pam_unix(sudo:session): session closed for user root Sep 06 06:50:40 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-7c0a81d0-13c8-4efe-b23e-6d211323d64b tempest-VolumeImageDependencyTests-1821976841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2a52dea9-a793-46bd-b038-3f13d4fd2c87_up_x7elqdevstack@QuobyteHD" returned: 0 in 0.313s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:50:40 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-7c0a81d0-13c8-4efe-b23e-6d211323d64b tempest-VolumeImageDependencyTests-1821976841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2a52dea9-a793-46bd-b038-3f13d4fd2c87_up_x7elqdevstack@QuobyteHD {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:50:40 devstack sudo[105872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2a52dea9-a793-46bd-b038-3f13d4fd2c87_up_x7elqdevstack@QuobyteHD Sep 06 06:50:40 devstack sudo[105872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:50:40 devstack sudo[105872]: pam_unix(sudo:session): session closed for user root Sep 06 06:50:40 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-7c0a81d0-13c8-4efe-b23e-6d211323d64b tempest-VolumeImageDependencyTests-1821976841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2a52dea9-a793-46bd-b038-3f13d4fd2c87_up_x7elqdevstack@QuobyteHD" returned: 1 in 0.311s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:50:40 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-7c0a81d0-13c8-4efe-b23e-6d211323d64b tempest-VolumeImageDependencyTests-1821976841 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2a52dea9-a793-46bd-b038-3f13d4fd2c87_up_x7elqdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 06 06:50:40 devstack cinder-volume[87329]: DEBUG cinder.image.image_utils [None req-7c0a81d0-13c8-4efe-b23e-6d211323d64b tempest-VolumeImageDependencyTests-1821976841 None] Temporary image 2a52dea9-a793-46bd-b038-3f13d4fd2c87 is fetched for user 0dc0ae425439437abb896bf1a8999e89. {{(pid=87329) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 06 06:50:40 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfd3e87d-04e0-4064-816c-e46519802cba]: (4, 'raw') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:50:40 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-7c0a81d0-13c8-4efe-b23e-6d211323d64b tempest-VolumeImageDependencyTests-1821976841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2a52dea9-a793-46bd-b038-3f13d4fd2c87_up_x7elqdevstack@QuobyteHD {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:50:40 devstack sudo[105877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2a52dea9-a793-46bd-b038-3f13d4fd2c87_up_x7elqdevstack@QuobyteHD Sep 06 06:50:40 devstack sudo[105877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:50:41 devstack sudo[105877]: pam_unix(sudo:session): session closed for user root Sep 06 06:50:41 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-7c0a81d0-13c8-4efe-b23e-6d211323d64b tempest-VolumeImageDependencyTests-1821976841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2a52dea9-a793-46bd-b038-3f13d4fd2c87_up_x7elqdevstack@QuobyteHD" returned: 0 in 0.331s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:50:41 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-7c0a81d0-13c8-4efe-b23e-6d211323d64b tempest-VolumeImageDependencyTests-1821976841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2a52dea9-a793-46bd-b038-3f13d4fd2c87_up_x7elqdevstack@QuobyteHD {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:50:41 devstack sudo[105881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2a52dea9-a793-46bd-b038-3f13d4fd2c87_up_x7elqdevstack@QuobyteHD Sep 06 06:50:41 devstack sudo[105881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:50:41 devstack sudo[105881]: pam_unix(sudo:session): session closed for user root Sep 06 06:50:41 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-7c0a81d0-13c8-4efe-b23e-6d211323d64b tempest-VolumeImageDependencyTests-1821976841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2a52dea9-a793-46bd-b038-3f13d4fd2c87_up_x7elqdevstack@QuobyteHD" returned: 1 in 0.316s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:50:41 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-7c0a81d0-13c8-4efe-b23e-6d211323d64b tempest-VolumeImageDependencyTests-1821976841 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2a52dea9-a793-46bd-b038-3f13d4fd2c87_up_x7elqdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 06 06:50:41 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-7c0a81d0-13c8-4efe-b23e-6d211323d64b tempest-VolumeImageDependencyTests-1821976841 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:50:41 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-7c0a81d0-13c8-4efe-b23e-6d211323d64b tempest-VolumeImageDependencyTests-1821976841 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:50:41 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-7c0a81d0-13c8-4efe-b23e-6d211323d64b tempest-VolumeImageDependencyTests-1821976841 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:50:39Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=460e365d-fd91-4b63-98fa-81fe50f3efe6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='581bb27730d24ed88b4a8c723476a421',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:50:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:50:40Z,use_quota=True,user_id='0dc0ae425439437abb896bf1a8999e89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)}" {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 06:50:41 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-7c0a81d0-13c8-4efe-b23e-6d211323d64b tempest-VolumeImageDependencyTests-1821976841 None] Creating volume 460e365d-fd91-4b63-98fa-81fe50f3efe6 {{(pid=87329) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 06:50:41 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-7c0a81d0-13c8-4efe-b23e-6d211323d64b tempest-VolumeImageDependencyTests-1821976841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:50:41 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-7c0a81d0-13c8-4efe-b23e-6d211323d64b tempest-VolumeImageDependencyTests-1821976841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:50:41 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-7c0a81d0-13c8-4efe-b23e-6d211323d64b tempest-VolumeImageDependencyTests-1821976841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:50:41 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-7c0a81d0-13c8-4efe-b23e-6d211323d64b tempest-VolumeImageDependencyTests-1821976841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:50:41 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-7c0a81d0-13c8-4efe-b23e-6d211323d64b tempest-VolumeImageDependencyTests-1821976841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:50:41 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-7c0a81d0-13c8-4efe-b23e-6d211323d64b tempest-VolumeImageDependencyTests-1821976841 None] Selected osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 as target Quobyte volume. {{(pid=87329) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 06:50:41 devstack cinder-volume[87329]: INFO cinder.volume.drivers.remotefs [None req-7c0a81d0-13c8-4efe-b23e-6d211323d64b tempest-VolumeImageDependencyTests-1821976841 None] casted to osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 Sep 06 06:50:41 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-7c0a81d0-13c8-4efe-b23e-6d211323d64b tempest-VolumeImageDependencyTests-1821976841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-460e365d-fd91-4b63-98fa-81fe50f3efe6 1073741824 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:50:41 devstack sudo[105886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-460e365d-fd91-4b63-98fa-81fe50f3efe6 1073741824 Sep 06 06:50:41 devstack sudo[105886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:50:41 devstack sudo[105886]: pam_unix(sudo:session): session closed for user root Sep 06 06:50:41 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-7c0a81d0-13c8-4efe-b23e-6d211323d64b tempest-VolumeImageDependencyTests-1821976841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-460e365d-fd91-4b63-98fa-81fe50f3efe6 1073741824" returned: 0 in 0.401s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:50:41 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-7c0a81d0-13c8-4efe-b23e-6d211323d64b tempest-VolumeImageDependencyTests-1821976841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-460e365d-fd91-4b63-98fa-81fe50f3efe6 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:50:41 devstack sudo[105891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-460e365d-fd91-4b63-98fa-81fe50f3efe6 Sep 06 06:50:41 devstack sudo[105891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:50:42 devstack sudo[105891]: pam_unix(sudo:session): session closed for user root Sep 06 06:50:42 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-7c0a81d0-13c8-4efe-b23e-6d211323d64b tempest-VolumeImageDependencyTests-1821976841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-460e365d-fd91-4b63-98fa-81fe50f3efe6" returned: 0 in 0.235s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:50:42 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-7c0a81d0-13c8-4efe-b23e-6d211323d64b tempest-VolumeImageDependencyTests-1821976841 None] <== create_volume: return (672ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'} {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 06:50:42 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-7c0a81d0-13c8-4efe-b23e-6d211323d64b tempest-VolumeImageDependencyTests-1821976841 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.675s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:50:42 devstack cinder-volume[87329]: DEBUG cinder.volume.volume_utils [None req-7c0a81d0-13c8-4efe-b23e-6d211323d64b tempest-VolumeImageDependencyTests-1821976841 None] Attempting download of 2a52dea9-a793-46bd-b038-3f13d4fd2c87 ((None, [{'url': 'file:///opt/stack/data/glance/images/2a52dea9-a793-46bd-b038-3f13d4fd2c87', 'metadata': {}}])) to volume 460e365d-fd91-4b63-98fa-81fe50f3efe6. {{(pid=87329) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 06 06:50:42 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[b94eeb9d-736b-4127-ab77-b45bb6eae1a1]: (4, 'raw') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:50:42 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-7c0a81d0-13c8-4efe-b23e-6d211323d64b tempest-VolumeImageDependencyTests-1821976841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2a52dea9-a793-46bd-b038-3f13d4fd2c87_vf5ja77f {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:50:42 devstack sudo[105894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2a52dea9-a793-46bd-b038-3f13d4fd2c87_vf5ja77f Sep 06 06:50:42 devstack sudo[105894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:50:42 devstack sudo[105894]: pam_unix(sudo:session): session closed for user root Sep 06 06:50:42 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-7c0a81d0-13c8-4efe-b23e-6d211323d64b tempest-VolumeImageDependencyTests-1821976841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2a52dea9-a793-46bd-b038-3f13d4fd2c87_vf5ja77f" returned: 0 in 0.313s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:50:42 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-7c0a81d0-13c8-4efe-b23e-6d211323d64b tempest-VolumeImageDependencyTests-1821976841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2a52dea9-a793-46bd-b038-3f13d4fd2c87_vf5ja77f {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:50:42 devstack sudo[105898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2a52dea9-a793-46bd-b038-3f13d4fd2c87_vf5ja77f Sep 06 06:50:42 devstack sudo[105898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:50:42 devstack sudo[105898]: pam_unix(sudo:session): session closed for user root Sep 06 06:50:42 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-7c0a81d0-13c8-4efe-b23e-6d211323d64b tempest-VolumeImageDependencyTests-1821976841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2a52dea9-a793-46bd-b038-3f13d4fd2c87_vf5ja77f" returned: 1 in 0.317s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:50:42 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-7c0a81d0-13c8-4efe-b23e-6d211323d64b tempest-VolumeImageDependencyTests-1821976841 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2a52dea9-a793-46bd-b038-3f13d4fd2c87_vf5ja77f' failed. Not Retrying. {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 06 06:50:42 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7452899-a058-42b6-b0db-c82238646038]: (4, 'raw') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:50:42 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-7c0a81d0-13c8-4efe-b23e-6d211323d64b tempest-VolumeImageDependencyTests-1821976841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2a52dea9-a793-46bd-b038-3f13d4fd2c87_up_x7elqdevstack@QuobyteHD {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:50:42 devstack sudo[105902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2a52dea9-a793-46bd-b038-3f13d4fd2c87_up_x7elqdevstack@QuobyteHD Sep 06 06:50:42 devstack sudo[105902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:50:43 devstack sudo[105902]: pam_unix(sudo:session): session closed for user root Sep 06 06:50:43 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-7c0a81d0-13c8-4efe-b23e-6d211323d64b tempest-VolumeImageDependencyTests-1821976841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2a52dea9-a793-46bd-b038-3f13d4fd2c87_up_x7elqdevstack@QuobyteHD" returned: 0 in 0.312s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:50:43 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-7c0a81d0-13c8-4efe-b23e-6d211323d64b tempest-VolumeImageDependencyTests-1821976841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2a52dea9-a793-46bd-b038-3f13d4fd2c87_up_x7elqdevstack@QuobyteHD {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:50:43 devstack sudo[105906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2a52dea9-a793-46bd-b038-3f13d4fd2c87_up_x7elqdevstack@QuobyteHD Sep 06 06:50:43 devstack sudo[105906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:50:43 devstack sudo[105906]: pam_unix(sudo:session): session closed for user root Sep 06 06:50:43 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-7c0a81d0-13c8-4efe-b23e-6d211323d64b tempest-VolumeImageDependencyTests-1821976841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2a52dea9-a793-46bd-b038-3f13d4fd2c87_up_x7elqdevstack@QuobyteHD" returned: 1 in 0.316s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:50:43 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-7c0a81d0-13c8-4efe-b23e-6d211323d64b tempest-VolumeImageDependencyTests-1821976841 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2a52dea9-a793-46bd-b038-3f13d4fd2c87_up_x7elqdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 06 06:50:43 devstack cinder-volume[87329]: DEBUG cinder.image.image_utils [None req-7c0a81d0-13c8-4efe-b23e-6d211323d64b tempest-VolumeImageDependencyTests-1821976841 None] 2a52dea9-a793-46bd-b038-3f13d4fd2c87 was raw, converting to qcow2 {{(pid=87329) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 06 06:50:43 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-7c0a81d0-13c8-4efe-b23e-6d211323d64b tempest-VolumeImageDependencyTests-1821976841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_2a52dea9-a793-46bd-b038-3f13d4fd2c87_up_x7elqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-460e365d-fd91-4b63-98fa-81fe50f3efe6 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:50:43 devstack sudo[105925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_2a52dea9-a793-46bd-b038-3f13d4fd2c87_up_x7elqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-460e365d-fd91-4b63-98fa-81fe50f3efe6 Sep 06 06:50:43 devstack sudo[105925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:50:43 devstack sudo[105925]: pam_unix(sudo:session): session closed for user root Sep 06 06:50:43 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-7c0a81d0-13c8-4efe-b23e-6d211323d64b tempest-VolumeImageDependencyTests-1821976841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_2a52dea9-a793-46bd-b038-3f13d4fd2c87_up_x7elqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-460e365d-fd91-4b63-98fa-81fe50f3efe6" returned: 0 in 0.433s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:50:43 devstack cinder-volume[87329]: DEBUG cinder.image.image_utils [None req-7c0a81d0-13c8-4efe-b23e-6d211323d64b tempest-VolumeImageDependencyTests-1821976841 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_2a52dea9-a793-46bd-b038-3f13d4fd2c87_up_x7elqdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-460e365d-fd91-4b63-98fa-81fe50f3efe6 {{(pid=87329) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 06 06:50:43 devstack cinder-volume[87329]: INFO cinder.image.image_utils [None req-7c0a81d0-13c8-4efe-b23e-6d211323d64b tempest-VolumeImageDependencyTests-1821976841 None] Converted 0.00 MB image at 0.00 MB/s Sep 06 06:50:43 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-7c0a81d0-13c8-4efe-b23e-6d211323d64b tempest-VolumeImageDependencyTests-1821976841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-460e365d-fd91-4b63-98fa-81fe50f3efe6 1G {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:50:43 devstack sudo[105952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-460e365d-fd91-4b63-98fa-81fe50f3efe6 1G Sep 06 06:50:43 devstack sudo[105952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:50:44 devstack sudo[105952]: pam_unix(sudo:session): session closed for user root Sep 06 06:50:44 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-7c0a81d0-13c8-4efe-b23e-6d211323d64b tempest-VolumeImageDependencyTests-1821976841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-460e365d-fd91-4b63-98fa-81fe50f3efe6 1G" returned: 0 in 0.299s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:50:44 devstack cinder-volume[87329]: DEBUG cinder.volume.volume_utils [None req-7c0a81d0-13c8-4efe-b23e-6d211323d64b tempest-VolumeImageDependencyTests-1821976841 None] Downloaded image 2a52dea9-a793-46bd-b038-3f13d4fd2c87 ((None, [{'url': 'file:///opt/stack/data/glance/images/2a52dea9-a793-46bd-b038-3f13d4fd2c87', 'metadata': {}}])) to volume 460e365d-fd91-4b63-98fa-81fe50f3efe6 successfully. {{(pid=87329) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 06 06:50:44 devstack cinder-volume[87329]: DEBUG cinder.image.image_utils [None req-7c0a81d0-13c8-4efe-b23e-6d211323d64b tempest-VolumeImageDependencyTests-1821976841 None] Temporary image 2a52dea9-a793-46bd-b038-3f13d4fd2c87 for user 0dc0ae425439437abb896bf1a8999e89 is deleted. {{(pid=87329) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 06 06:50:44 devstack cinder-volume[87329]: DEBUG cinder.volume.volume_utils [None req-7c0a81d0-13c8-4efe-b23e-6d211323d64b tempest-VolumeImageDependencyTests-1821976841 None] Marking volume 460e365d-fd91-4b63-98fa-81fe50f3efe6 as bootable. {{(pid=87329) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 06 06:50:44 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c0a81d0-13c8-4efe-b23e-6d211323d64b tempest-VolumeImageDependencyTests-1821976841 None] Copying metadata from image 2a52dea9-a793-46bd-b038-3f13d4fd2c87 to 460e365d-fd91-4b63-98fa-81fe50f3efe6. {{(pid=87329) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 06 06:50:44 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c0a81d0-13c8-4efe-b23e-6d211323d64b tempest-VolumeImageDependencyTests-1821976841 None] Creating volume glance metadata for volume 460e365d-fd91-4b63-98fa-81fe50f3efe6 backed by image 2a52dea9-a793-46bd-b038-3f13d4fd2c87 with: {'image_id': '2a52dea9-a793-46bd-b038-3f13d4fd2c87', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '5919ca1bc163253feb33adce6dcd0f8c', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87329) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 06 06:50:44 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-7c0a81d0-13c8-4efe-b23e-6d211323d64b tempest-VolumeImageDependencyTests-1821976841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (820cbef2-59f8-4c60-ae3b-11d420ab5c61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-460e365d-fd91-4b63-98fa-81fe50f3efe6', 'volume_size': 1, 'image_id': '2a52dea9-a793-46bd-b038-3f13d4fd2c87', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2a52dea9-a793-46bd-b038-3f13d4fd2c87', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5919ca1bc163253feb33adce6dcd0f8c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '581bb27730d24ed88b4a8c723476a421', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1f85fbf271707a968163319954c47768c82a12c41809b933fc98b2e7bb17d4037006fa15b2ddb0ab291378bb23daeccc45dd2e4f6ce67703b36849b04b5c6172', 'id': '2a52dea9-a793-46bd-b038-3f13d4fd2c87', 'created_at': datetime.datetime(2026, 9, 6, 4, 50, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 6, 4, 50, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2a52dea9-a793-46bd-b038-3f13d4fd2c87/file', 'properties': {}}, 'image_service': }' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:50:44 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-7c0a81d0-13c8-4efe-b23e-6d211323d64b tempest-VolumeImageDependencyTests-1821976841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c284ec6-f215-4d9e-9a10-f77b242e871e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:50:44 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-7c0a81d0-13c8-4efe-b23e-6d211323d64b tempest-VolumeImageDependencyTests-1821976841 None] Volume volume-460e365d-fd91-4b63-98fa-81fe50f3efe6 (460e365d-fd91-4b63-98fa-81fe50f3efe6): created successfully Sep 06 06:50:44 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-7c0a81d0-13c8-4efe-b23e-6d211323d64b tempest-VolumeImageDependencyTests-1821976841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c284ec6-f215-4d9e-9a10-f77b242e871e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:50:44 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-7c0a81d0-13c8-4efe-b23e-6d211323d64b tempest-VolumeImageDependencyTests-1821976841 None] Flow 'volume_create_manager' (8e9606ca-080b-4ad3-ad48-fb19203ee192) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:50:44 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-7c0a81d0-13c8-4efe-b23e-6d211323d64b tempest-VolumeImageDependencyTests-1821976841 None] Created volume successfully. Sep 06 06:50:45 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-317a8c77-0c17-48c1-8b1a-5f4b4d333251 tempest-VolumeImageDependencyTests-1821976841 None] Acquiring lock "cinder-460e365d-fd91-4b63-98fa-81fe50f3efe6-delete_volume" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:50:45 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-317a8c77-0c17-48c1-8b1a-5f4b4d333251 tempest-VolumeImageDependencyTests-1821976841 None] Lock "cinder-460e365d-fd91-4b63-98fa-81fe50f3efe6-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:50:45 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-317a8c77-0c17-48c1-8b1a-5f4b4d333251 tempest-VolumeImageDependencyTests-1821976841 None] Acquiring lock "cinder-quobyte-460e365d-fd91-4b63-98fa-81fe50f3efe6" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:50:45 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-317a8c77-0c17-48c1-8b1a-5f4b4d333251 tempest-VolumeImageDependencyTests-1821976841 None] Lock "cinder-quobyte-460e365d-fd91-4b63-98fa-81fe50f3efe6" acquired by "delete_volume" :: waited 0.015s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:50:45 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0d6e501-c831-4711-b9bc-78fe5f93257d]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:50:45 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-317a8c77-0c17-48c1-8b1a-5f4b4d333251 tempest-VolumeImageDependencyTests-1821976841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-460e365d-fd91-4b63-98fa-81fe50f3efe6 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:50:45 devstack sudo[105959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-460e365d-fd91-4b63-98fa-81fe50f3efe6 Sep 06 06:50:45 devstack sudo[105959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:50:45 devstack sudo[105959]: pam_unix(sudo:session): session closed for user root Sep 06 06:50:45 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-317a8c77-0c17-48c1-8b1a-5f4b4d333251 tempest-VolumeImageDependencyTests-1821976841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-460e365d-fd91-4b63-98fa-81fe50f3efe6" returned: 0 in 0.344s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:50:45 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-317a8c77-0c17-48c1-8b1a-5f4b4d333251 tempest-VolumeImageDependencyTests-1821976841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-460e365d-fd91-4b63-98fa-81fe50f3efe6 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:50:45 devstack sudo[105964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-460e365d-fd91-4b63-98fa-81fe50f3efe6 Sep 06 06:50:45 devstack sudo[105964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:50:45 devstack sudo[105964]: pam_unix(sudo:session): session closed for user root Sep 06 06:50:45 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-317a8c77-0c17-48c1-8b1a-5f4b4d333251 tempest-VolumeImageDependencyTests-1821976841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-460e365d-fd91-4b63-98fa-81fe50f3efe6" returned: 0 in 0.242s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:50:45 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-317a8c77-0c17-48c1-8b1a-5f4b4d333251 tempest-VolumeImageDependencyTests-1821976841 None] Lock "cinder-quobyte-460e365d-fd91-4b63-98fa-81fe50f3efe6" released by "delete_volume" :: held 0.622s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:50:45 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-317a8c77-0c17-48c1-8b1a-5f4b4d333251 tempest-VolumeImageDependencyTests-1821976841 None] Created reservations ['9bf21357-1884-485f-a730-a9298562e8c6', 'f6b5fb41-170c-495e-bff2-d9e862535530', '0ca322e6-e489-4e57-9184-29db636e59de', '751a3818-2f21-45e1-a858-532e9db3bc96'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:50:45 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-317a8c77-0c17-48c1-8b1a-5f4b4d333251 tempest-VolumeImageDependencyTests-1821976841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:50:45 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-317a8c77-0c17-48c1-8b1a-5f4b4d333251 tempest-VolumeImageDependencyTests-1821976841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:50:45 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-317a8c77-0c17-48c1-8b1a-5f4b4d333251 tempest-VolumeImageDependencyTests-1821976841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:50:45 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-317a8c77-0c17-48c1-8b1a-5f4b4d333251 tempest-VolumeImageDependencyTests-1821976841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:50:45 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-317a8c77-0c17-48c1-8b1a-5f4b4d333251 tempest-VolumeImageDependencyTests-1821976841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:50:45 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-317a8c77-0c17-48c1-8b1a-5f4b4d333251 tempest-VolumeImageDependencyTests-1821976841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:50:45 devstack sudo[105967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:50:45 devstack sudo[105967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:50:46 devstack sudo[105967]: pam_unix(sudo:session): session closed for user root Sep 06 06:50:46 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-317a8c77-0c17-48c1-8b1a-5f4b4d333251 tempest-VolumeImageDependencyTests-1821976841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.244s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:50:46 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-317a8c77-0c17-48c1-8b1a-5f4b4d333251 tempest-VolumeImageDependencyTests-1821976841 None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:50:46 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-317a8c77-0c17-48c1-8b1a-5f4b4d333251 tempest-VolumeImageDependencyTests-1821976841 None] Deleted volume successfully. Sep 06 06:50:46 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-317a8c77-0c17-48c1-8b1a-5f4b4d333251 tempest-VolumeImageDependencyTests-1821976841 None] Lock "cinder-460e365d-fd91-4b63-98fa-81fe50f3efe6-delete_volume" released by "delete_volume" :: held 1.049s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:50:48 devstack cinder-volume[87329]: DEBUG oslo_service.periodic_task [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87329) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 06 06:50:48 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:50:48 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:50:48 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:50:48 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:50:48 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:50:48 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:50:48 devstack sudo[105970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:50:48 devstack sudo[105970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:50:48 devstack sudo[105970]: pam_unix(sudo:session): session closed for user root Sep 06 06:50:48 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.247s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:50:48 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:50:48 devstack cinder-volume[87329]: DEBUG oslo_service.periodic_task [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Running periodic task VolumeManager._thread_info {{(pid=87329) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 06 06:50:48 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] thread count: 28 {{(pid=87329) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 06 06:50:48 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] thread info: [<_MainThread(MainThread, started 126855043821696)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87329) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 06 06:50:49 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc335e58-a9e0-47f9-94fd-042011e63c57 tempest-CinderUnicodeTest-568341698 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87329) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 06:50:49 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-bc335e58-a9e0-47f9-94fd-042011e63c57 tempest-CinderUnicodeTest-568341698 None] Flow 'volume_create_manager' (c5ad2804-736e-4d73-b65a-e9b3cfbd4b11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:50:49 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-bc335e58-a9e0-47f9-94fd-042011e63c57 tempest-CinderUnicodeTest-568341698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (452c8662-8740-40b5-9a8e-a7934f3759e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:50:49 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-bc335e58-a9e0-47f9-94fd-042011e63c57 tempest-CinderUnicodeTest-568341698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (452c8662-8740-40b5-9a8e-a7934f3759e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:50:49Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4461d7b8-d900-4b76-92b5-5a5f13cc0cac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd769f8f25d7476f903379c7dfd24a35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:50:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:50:49Z,use_quota=True,user_id='5d2aee50f2354d79a31830bbce90cbd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:50:49 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-bc335e58-a9e0-47f9-94fd-042011e63c57 tempest-CinderUnicodeTest-568341698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6497d103-625c-4bc9-8212-1bde810751b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:50:49 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-bc335e58-a9e0-47f9-94fd-042011e63c57 tempest-CinderUnicodeTest-568341698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6497d103-625c-4bc9-8212-1bde810751b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:50:49 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-bc335e58-a9e0-47f9-94fd-042011e63c57 tempest-CinderUnicodeTest-568341698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be074ccb-c14a-49ca-a8aa-3929fe9f7254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:50:49 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-bc335e58-a9e0-47f9-94fd-042011e63c57 tempest-CinderUnicodeTest-568341698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be074ccb-c14a-49ca-a8aa-3929fe9f7254) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4461d7b8-d900-4b76-92b5-5a5f13cc0cac', 'volume_name': 'volume-4461d7b8-d900-4b76-92b5-5a5f13cc0cac', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:50:49 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-bc335e58-a9e0-47f9-94fd-042011e63c57 tempest-CinderUnicodeTest-568341698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b54de61-3343-4f1f-88b9-c4bdf4d71367) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:50:49 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-bc335e58-a9e0-47f9-94fd-042011e63c57 tempest-CinderUnicodeTest-568341698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b54de61-3343-4f1f-88b9-c4bdf4d71367) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:50:49 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-bc335e58-a9e0-47f9-94fd-042011e63c57 tempest-CinderUnicodeTest-568341698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be192392-e78a-4a42-845e-d5113fe0b3c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:50:49 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-bc335e58-a9e0-47f9-94fd-042011e63c57 tempest-CinderUnicodeTest-568341698 None] Volume 4461d7b8-d900-4b76-92b5-5a5f13cc0cac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4461d7b8-d900-4b76-92b5-5a5f13cc0cac', 'volume_size': 1} Sep 06 06:50:49 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-bc335e58-a9e0-47f9-94fd-042011e63c57 tempest-CinderUnicodeTest-568341698 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:50:49 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-bc335e58-a9e0-47f9-94fd-042011e63c57 tempest-CinderUnicodeTest-568341698 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:50:49 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-bc335e58-a9e0-47f9-94fd-042011e63c57 tempest-CinderUnicodeTest-568341698 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:50:49Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4461d7b8-d900-4b76-92b5-5a5f13cc0cac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd769f8f25d7476f903379c7dfd24a35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:50:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:50:49Z,use_quota=True,user_id='5d2aee50f2354d79a31830bbce90cbd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)}" {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 06:50:49 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-bc335e58-a9e0-47f9-94fd-042011e63c57 tempest-CinderUnicodeTest-568341698 None] Creating volume 4461d7b8-d900-4b76-92b5-5a5f13cc0cac {{(pid=87329) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 06:50:49 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-bc335e58-a9e0-47f9-94fd-042011e63c57 tempest-CinderUnicodeTest-568341698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:50:49 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-bc335e58-a9e0-47f9-94fd-042011e63c57 tempest-CinderUnicodeTest-568341698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:50:49 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-bc335e58-a9e0-47f9-94fd-042011e63c57 tempest-CinderUnicodeTest-568341698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:50:49 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-bc335e58-a9e0-47f9-94fd-042011e63c57 tempest-CinderUnicodeTest-568341698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:50:49 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-bc335e58-a9e0-47f9-94fd-042011e63c57 tempest-CinderUnicodeTest-568341698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:50:49 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-bc335e58-a9e0-47f9-94fd-042011e63c57 tempest-CinderUnicodeTest-568341698 None] Selected osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 as target Quobyte volume. {{(pid=87329) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 06:50:49 devstack cinder-volume[87329]: INFO cinder.volume.drivers.remotefs [None req-bc335e58-a9e0-47f9-94fd-042011e63c57 tempest-CinderUnicodeTest-568341698 None] casted to osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 Sep 06 06:50:49 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-bc335e58-a9e0-47f9-94fd-042011e63c57 tempest-CinderUnicodeTest-568341698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-4461d7b8-d900-4b76-92b5-5a5f13cc0cac 1073741824 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:50:49 devstack sudo[105973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-4461d7b8-d900-4b76-92b5-5a5f13cc0cac 1073741824 Sep 06 06:50:49 devstack sudo[105973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:50:49 devstack sudo[105973]: pam_unix(sudo:session): session closed for user root Sep 06 06:50:49 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-bc335e58-a9e0-47f9-94fd-042011e63c57 tempest-CinderUnicodeTest-568341698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-4461d7b8-d900-4b76-92b5-5a5f13cc0cac 1073741824" returned: 0 in 0.392s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:50:49 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-bc335e58-a9e0-47f9-94fd-042011e63c57 tempest-CinderUnicodeTest-568341698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-4461d7b8-d900-4b76-92b5-5a5f13cc0cac {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:50:49 devstack sudo[105978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-4461d7b8-d900-4b76-92b5-5a5f13cc0cac Sep 06 06:50:49 devstack sudo[105978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:50:49 devstack sudo[105978]: pam_unix(sudo:session): session closed for user root Sep 06 06:50:49 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-bc335e58-a9e0-47f9-94fd-042011e63c57 tempest-CinderUnicodeTest-568341698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-4461d7b8-d900-4b76-92b5-5a5f13cc0cac" returned: 0 in 0.247s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:50:49 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-bc335e58-a9e0-47f9-94fd-042011e63c57 tempest-CinderUnicodeTest-568341698 None] <== create_volume: return (678ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'} {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 06:50:49 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-bc335e58-a9e0-47f9-94fd-042011e63c57 tempest-CinderUnicodeTest-568341698 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.681s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:50:49 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-bc335e58-a9e0-47f9-94fd-042011e63c57 tempest-CinderUnicodeTest-568341698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be192392-e78a-4a42-845e-d5113fe0b3c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4461d7b8-d900-4b76-92b5-5a5f13cc0cac', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:50:49 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-bc335e58-a9e0-47f9-94fd-042011e63c57 tempest-CinderUnicodeTest-568341698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (144ef731-67af-42fa-a577-c3beab2983dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:50:49 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-bc335e58-a9e0-47f9-94fd-042011e63c57 tempest-CinderUnicodeTest-568341698 None] Volume volume-4461d7b8-d900-4b76-92b5-5a5f13cc0cac (4461d7b8-d900-4b76-92b5-5a5f13cc0cac): created successfully Sep 06 06:50:49 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-bc335e58-a9e0-47f9-94fd-042011e63c57 tempest-CinderUnicodeTest-568341698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (144ef731-67af-42fa-a577-c3beab2983dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:50:49 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-bc335e58-a9e0-47f9-94fd-042011e63c57 tempest-CinderUnicodeTest-568341698 None] Flow 'volume_create_manager' (c5ad2804-736e-4d73-b65a-e9b3cfbd4b11) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:50:49 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-bc335e58-a9e0-47f9-94fd-042011e63c57 tempest-CinderUnicodeTest-568341698 None] Created volume successfully. Sep 06 06:50:50 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-f06f3abd-3c5a-4037-b76b-6266c47527ef tempest-CinderUnicodeTest-568341698 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87329) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 06:50:50 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-f06f3abd-3c5a-4037-b76b-6266c47527ef tempest-CinderUnicodeTest-568341698 None] Flow 'volume_create_manager' (b8ca6fd4-8562-4ba9-8897-dd03ca22080e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:50:50 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-f06f3abd-3c5a-4037-b76b-6266c47527ef tempest-CinderUnicodeTest-568341698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed643cb1-0cb1-4d7d-b64d-32e6c63bc868) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:50:50 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-f06f3abd-3c5a-4037-b76b-6266c47527ef tempest-CinderUnicodeTest-568341698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed643cb1-0cb1-4d7d-b64d-32e6c63bc868) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:50:50Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1354744034',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30d00df9-a58c-4c1c-8c16-d2612d3cb4f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd769f8f25d7476f903379c7dfd24a35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:50:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:50:50Z,use_quota=True,user_id='5d2aee50f2354d79a31830bbce90cbd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:50:50 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-f06f3abd-3c5a-4037-b76b-6266c47527ef tempest-CinderUnicodeTest-568341698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (055eced7-7d97-4b6f-8a9b-2d96b16d57fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:50:50 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-f06f3abd-3c5a-4037-b76b-6266c47527ef tempest-CinderUnicodeTest-568341698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (055eced7-7d97-4b6f-8a9b-2d96b16d57fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:50:50 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-f06f3abd-3c5a-4037-b76b-6266c47527ef tempest-CinderUnicodeTest-568341698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31d50359-cdee-4e9f-afe2-49630b62d598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:50:50 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-f06f3abd-3c5a-4037-b76b-6266c47527ef tempest-CinderUnicodeTest-568341698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31d50359-cdee-4e9f-afe2-49630b62d598) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30d00df9-a58c-4c1c-8c16-d2612d3cb4f1', 'volume_name': 'volume-30d00df9-a58c-4c1c-8c16-d2612d3cb4f1', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:50:50 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-f06f3abd-3c5a-4037-b76b-6266c47527ef tempest-CinderUnicodeTest-568341698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e31b4fe-7610-4330-ab64-58097588784f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:50:50 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-f06f3abd-3c5a-4037-b76b-6266c47527ef tempest-CinderUnicodeTest-568341698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e31b4fe-7610-4330-ab64-58097588784f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:50:50 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-f06f3abd-3c5a-4037-b76b-6266c47527ef tempest-CinderUnicodeTest-568341698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1f184ba-a633-45a1-8d04-620312b6a3dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:50:50 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-f06f3abd-3c5a-4037-b76b-6266c47527ef tempest-CinderUnicodeTest-568341698 None] Volume 30d00df9-a58c-4c1c-8c16-d2612d3cb4f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30d00df9-a58c-4c1c-8c16-d2612d3cb4f1', 'volume_size': 1} Sep 06 06:50:50 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-f06f3abd-3c5a-4037-b76b-6266c47527ef tempest-CinderUnicodeTest-568341698 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:50:50 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-f06f3abd-3c5a-4037-b76b-6266c47527ef tempest-CinderUnicodeTest-568341698 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:50:50 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-f06f3abd-3c5a-4037-b76b-6266c47527ef tempest-CinderUnicodeTest-568341698 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:50:50Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1354744034',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30d00df9-a58c-4c1c-8c16-d2612d3cb4f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd769f8f25d7476f903379c7dfd24a35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:50:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:50:50Z,use_quota=True,user_id='5d2aee50f2354d79a31830bbce90cbd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)}" {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 06:50:50 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-f06f3abd-3c5a-4037-b76b-6266c47527ef tempest-CinderUnicodeTest-568341698 None] Creating volume 30d00df9-a58c-4c1c-8c16-d2612d3cb4f1 {{(pid=87329) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 06:50:50 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-f06f3abd-3c5a-4037-b76b-6266c47527ef tempest-CinderUnicodeTest-568341698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:50:50 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-f06f3abd-3c5a-4037-b76b-6266c47527ef tempest-CinderUnicodeTest-568341698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:50:50 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-f06f3abd-3c5a-4037-b76b-6266c47527ef tempest-CinderUnicodeTest-568341698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:50:50 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-f06f3abd-3c5a-4037-b76b-6266c47527ef tempest-CinderUnicodeTest-568341698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:50:50 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-f06f3abd-3c5a-4037-b76b-6266c47527ef tempest-CinderUnicodeTest-568341698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:50:50 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-f06f3abd-3c5a-4037-b76b-6266c47527ef tempest-CinderUnicodeTest-568341698 None] Selected osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 as target Quobyte volume. {{(pid=87329) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 06:50:50 devstack cinder-volume[87329]: INFO cinder.volume.drivers.remotefs [None req-f06f3abd-3c5a-4037-b76b-6266c47527ef tempest-CinderUnicodeTest-568341698 None] casted to osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 Sep 06 06:50:50 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-f06f3abd-3c5a-4037-b76b-6266c47527ef tempest-CinderUnicodeTest-568341698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-30d00df9-a58c-4c1c-8c16-d2612d3cb4f1 1073741824 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:50:50 devstack sudo[105982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-30d00df9-a58c-4c1c-8c16-d2612d3cb4f1 1073741824 Sep 06 06:50:50 devstack sudo[105982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:50:50 devstack sudo[105982]: pam_unix(sudo:session): session closed for user root Sep 06 06:50:50 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-f06f3abd-3c5a-4037-b76b-6266c47527ef tempest-CinderUnicodeTest-568341698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-30d00df9-a58c-4c1c-8c16-d2612d3cb4f1 1073741824" returned: 0 in 0.398s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:50:51 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-f06f3abd-3c5a-4037-b76b-6266c47527ef tempest-CinderUnicodeTest-568341698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-30d00df9-a58c-4c1c-8c16-d2612d3cb4f1 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:50:51 devstack sudo[105987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-30d00df9-a58c-4c1c-8c16-d2612d3cb4f1 Sep 06 06:50:51 devstack sudo[105987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:50:51 devstack sudo[105987]: pam_unix(sudo:session): session closed for user root Sep 06 06:50:51 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-f06f3abd-3c5a-4037-b76b-6266c47527ef tempest-CinderUnicodeTest-568341698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-30d00df9-a58c-4c1c-8c16-d2612d3cb4f1" returned: 0 in 0.244s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:50:51 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-f06f3abd-3c5a-4037-b76b-6266c47527ef tempest-CinderUnicodeTest-568341698 None] <== create_volume: return (680ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'} {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 06:50:51 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-f06f3abd-3c5a-4037-b76b-6266c47527ef tempest-CinderUnicodeTest-568341698 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.683s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:50:51 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-f06f3abd-3c5a-4037-b76b-6266c47527ef tempest-CinderUnicodeTest-568341698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1f184ba-a633-45a1-8d04-620312b6a3dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30d00df9-a58c-4c1c-8c16-d2612d3cb4f1', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:50:51 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-f06f3abd-3c5a-4037-b76b-6266c47527ef tempest-CinderUnicodeTest-568341698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a0e65f4-0da9-4cbc-96d9-d89cec577936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:50:51 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-f06f3abd-3c5a-4037-b76b-6266c47527ef tempest-CinderUnicodeTest-568341698 None] Volume volume-30d00df9-a58c-4c1c-8c16-d2612d3cb4f1 (30d00df9-a58c-4c1c-8c16-d2612d3cb4f1): created successfully Sep 06 06:50:51 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-f06f3abd-3c5a-4037-b76b-6266c47527ef tempest-CinderUnicodeTest-568341698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a0e65f4-0da9-4cbc-96d9-d89cec577936) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:50:51 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-f06f3abd-3c5a-4037-b76b-6266c47527ef tempest-CinderUnicodeTest-568341698 None] Flow 'volume_create_manager' (b8ca6fd4-8562-4ba9-8897-dd03ca22080e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:50:51 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-f06f3abd-3c5a-4037-b76b-6266c47527ef tempest-CinderUnicodeTest-568341698 None] Created volume successfully. Sep 06 06:50:51 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-725ce3cc-209e-4199-b38b-78ad9ecb4e52 tempest-CinderUnicodeTest-568341698 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:50:51 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-725ce3cc-209e-4199-b38b-78ad9ecb4e52 tempest-CinderUnicodeTest-568341698 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:50:51 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-725ce3cc-209e-4199-b38b-78ad9ecb4e52 tempest-CinderUnicodeTest-568341698 None] Creating offline snapshot 0bdba420-7748-4ec4-ba85-acdf25f50b11 of volume 30d00df9-a58c-4c1c-8c16-d2612d3cb4f1 {{(pid=87329) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 06 06:50:51 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef88ee02-3cfc-4200-be9e-13e708ba8f03]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:50:51 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-725ce3cc-209e-4199-b38b-78ad9ecb4e52 tempest-CinderUnicodeTest-568341698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-30d00df9-a58c-4c1c-8c16-d2612d3cb4f1 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:50:51 devstack sudo[105990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-30d00df9-a58c-4c1c-8c16-d2612d3cb4f1 Sep 06 06:50:51 devstack sudo[105990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:50:52 devstack sudo[105990]: pam_unix(sudo:session): session closed for user root Sep 06 06:50:52 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-725ce3cc-209e-4199-b38b-78ad9ecb4e52 tempest-CinderUnicodeTest-568341698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-30d00df9-a58c-4c1c-8c16-d2612d3cb4f1" returned: 0 in 0.348s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:50:52 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-725ce3cc-209e-4199-b38b-78ad9ecb4e52 tempest-CinderUnicodeTest-568341698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-30d00df9-a58c-4c1c-8c16-d2612d3cb4f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-30d00df9-a58c-4c1c-8c16-d2612d3cb4f1.0bdba420-7748-4ec4-ba85-acdf25f50b11 1G {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:50:52 devstack sudo[105995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-30d00df9-a58c-4c1c-8c16-d2612d3cb4f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-30d00df9-a58c-4c1c-8c16-d2612d3cb4f1.0bdba420-7748-4ec4-ba85-acdf25f50b11 1G Sep 06 06:50:52 devstack sudo[105995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:50:52 devstack sudo[105995]: pam_unix(sudo:session): session closed for user root Sep 06 06:50:52 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-725ce3cc-209e-4199-b38b-78ad9ecb4e52 tempest-CinderUnicodeTest-568341698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-30d00df9-a58c-4c1c-8c16-d2612d3cb4f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-30d00df9-a58c-4c1c-8c16-d2612d3cb4f1.0bdba420-7748-4ec4-ba85-acdf25f50b11 1G" returned: 0 in 0.383s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:50:52 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-725ce3cc-209e-4199-b38b-78ad9ecb4e52 tempest-CinderUnicodeTest-568341698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30d00df9-a58c-4c1c-8c16-d2612d3cb4f1 -F qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-30d00df9-a58c-4c1c-8c16-d2612d3cb4f1.0bdba420-7748-4ec4-ba85-acdf25f50b11 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:50:52 devstack sudo[106000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30d00df9-a58c-4c1c-8c16-d2612d3cb4f1 -F qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-30d00df9-a58c-4c1c-8c16-d2612d3cb4f1.0bdba420-7748-4ec4-ba85-acdf25f50b11 Sep 06 06:50:52 devstack sudo[106000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:50:52 devstack sudo[106000]: pam_unix(sudo:session): session closed for user root Sep 06 06:50:52 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-725ce3cc-209e-4199-b38b-78ad9ecb4e52 tempest-CinderUnicodeTest-568341698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30d00df9-a58c-4c1c-8c16-d2612d3cb4f1 -F qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-30d00df9-a58c-4c1c-8c16-d2612d3cb4f1.0bdba420-7748-4ec4-ba85-acdf25f50b11" returned: 0 in 0.294s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:50:52 devstack cinder-volume[87329]: WARNING cinder.volume.drivers.remotefs [None req-725ce3cc-209e-4199-b38b-78ad9ecb4e52 tempest-CinderUnicodeTest-568341698 None] /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-30d00df9-a58c-4c1c-8c16-d2612d3cb4f1.0bdba420-7748-4ec4-ba85-acdf25f50b11 is being set with open permissions: ugo+rw Sep 06 06:50:52 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-725ce3cc-209e-4199-b38b-78ad9ecb4e52 tempest-CinderUnicodeTest-568341698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-30d00df9-a58c-4c1c-8c16-d2612d3cb4f1.0bdba420-7748-4ec4-ba85-acdf25f50b11 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:50:52 devstack sudo[106005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-30d00df9-a58c-4c1c-8c16-d2612d3cb4f1.0bdba420-7748-4ec4-ba85-acdf25f50b11 Sep 06 06:50:52 devstack sudo[106005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:50:53 devstack sudo[106005]: pam_unix(sudo:session): session closed for user root Sep 06 06:50:53 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-725ce3cc-209e-4199-b38b-78ad9ecb4e52 tempest-CinderUnicodeTest-568341698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-30d00df9-a58c-4c1c-8c16-d2612d3cb4f1.0bdba420-7748-4ec4-ba85-acdf25f50b11" returned: 0 in 0.246s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:50:53 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-725ce3cc-209e-4199-b38b-78ad9ecb4e52 tempest-CinderUnicodeTest-568341698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-30d00df9-a58c-4c1c-8c16-d2612d3cb4f1.info {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:50:53 devstack sudo[106008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-30d00df9-a58c-4c1c-8c16-d2612d3cb4f1.info Sep 06 06:50:53 devstack sudo[106008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:50:53 devstack sudo[106008]: pam_unix(sudo:session): session closed for user root Sep 06 06:50:53 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-725ce3cc-209e-4199-b38b-78ad9ecb4e52 tempest-CinderUnicodeTest-568341698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-30d00df9-a58c-4c1c-8c16-d2612d3cb4f1.info" returned: 0 in 0.249s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:50:53 devstack cinder-volume[87329]: WARNING cinder.volume.drivers.remotefs [None req-725ce3cc-209e-4199-b38b-78ad9ecb4e52 tempest-CinderUnicodeTest-568341698 None] /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-30d00df9-a58c-4c1c-8c16-d2612d3cb4f1.info is being set with open permissions: ugo+rw Sep 06 06:50:53 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-725ce3cc-209e-4199-b38b-78ad9ecb4e52 tempest-CinderUnicodeTest-568341698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-30d00df9-a58c-4c1c-8c16-d2612d3cb4f1.info {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:50:53 devstack sudo[106011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-30d00df9-a58c-4c1c-8c16-d2612d3cb4f1.info Sep 06 06:50:53 devstack sudo[106011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:50:53 devstack sudo[106011]: pam_unix(sudo:session): session closed for user root Sep 06 06:50:53 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-725ce3cc-209e-4199-b38b-78ad9ecb4e52 tempest-CinderUnicodeTest-568341698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-30d00df9-a58c-4c1c-8c16-d2612d3cb4f1.info" returned: 0 in 0.239s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:50:53 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-725ce3cc-209e-4199-b38b-78ad9ecb4e52 tempest-CinderUnicodeTest-568341698 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.836s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:50:53 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-725ce3cc-209e-4199-b38b-78ad9ecb4e52 tempest-CinderUnicodeTest-568341698 None] Create snapshot completed successfully Sep 06 06:50:53 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-a3e8687b-4d3c-48f0-825a-de67829775c7 tempest-CinderUnicodeTest-568341698 None] Acquiring lock "cinder-0bdba420-7748-4ec4-ba85-acdf25f50b11-delete_snapshot" by "delete_snapshot" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:50:53 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-a3e8687b-4d3c-48f0-825a-de67829775c7 tempest-CinderUnicodeTest-568341698 None] Lock "cinder-0bdba420-7748-4ec4-ba85-acdf25f50b11-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:50:53 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-a3e8687b-4d3c-48f0-825a-de67829775c7 tempest-CinderUnicodeTest-568341698 None] Acquiring lock "cinder-quobyte-30d00df9-a58c-4c1c-8c16-d2612d3cb4f1" by "delete_snapshot" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:50:53 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-a3e8687b-4d3c-48f0-825a-de67829775c7 tempest-CinderUnicodeTest-568341698 None] Lock "cinder-quobyte-30d00df9-a58c-4c1c-8c16-d2612d3cb4f1" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:50:53 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-a3e8687b-4d3c-48f0-825a-de67829775c7 tempest-CinderUnicodeTest-568341698 None] Acquiring lock "cinder-quobyte-0bdba420-7748-4ec4-ba85-acdf25f50b11" by "_delete_snapshot" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:50:53 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-a3e8687b-4d3c-48f0-825a-de67829775c7 tempest-CinderUnicodeTest-568341698 None] Lock "cinder-quobyte-0bdba420-7748-4ec4-ba85-acdf25f50b11" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:50:53 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-a3e8687b-4d3c-48f0-825a-de67829775c7 tempest-CinderUnicodeTest-568341698 None] Deleting offline snapshot 0bdba420-7748-4ec4-ba85-acdf25f50b11 of volume 30d00df9-a58c-4c1c-8c16-d2612d3cb4f1 {{(pid=87329) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 06 06:50:53 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-a3e8687b-4d3c-48f0-825a-de67829775c7 tempest-CinderUnicodeTest-568341698 None] snapshot_file for this snap is: volume-30d00df9-a58c-4c1c-8c16-d2612d3cb4f1.0bdba420-7748-4ec4-ba85-acdf25f50b11 {{(pid=87329) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 06 06:50:53 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[46f172f8-bdff-4684-a984-58519f381c14]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:50:53 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-a3e8687b-4d3c-48f0-825a-de67829775c7 tempest-CinderUnicodeTest-568341698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-30d00df9-a58c-4c1c-8c16-d2612d3cb4f1.0bdba420-7748-4ec4-ba85-acdf25f50b11 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:50:54 devstack sudo[106014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-30d00df9-a58c-4c1c-8c16-d2612d3cb4f1.0bdba420-7748-4ec4-ba85-acdf25f50b11 Sep 06 06:50:54 devstack sudo[106014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:50:54 devstack sudo[106014]: pam_unix(sudo:session): session closed for user root Sep 06 06:50:54 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-a3e8687b-4d3c-48f0-825a-de67829775c7 tempest-CinderUnicodeTest-568341698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-30d00df9-a58c-4c1c-8c16-d2612d3cb4f1.0bdba420-7748-4ec4-ba85-acdf25f50b11" returned: 0 in 0.343s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:50:54 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-a3e8687b-4d3c-48f0-825a-de67829775c7 tempest-CinderUnicodeTest-568341698 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-30d00df9-a58c-4c1c-8c16-d2612d3cb4f1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87329) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 06:50:54 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[03a26e2b-a3c2-4ba6-974f-f3a35a4021a3]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:50:54 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-a3e8687b-4d3c-48f0-825a-de67829775c7 tempest-CinderUnicodeTest-568341698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-30d00df9-a58c-4c1c-8c16-d2612d3cb4f1 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:50:54 devstack sudo[106019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-30d00df9-a58c-4c1c-8c16-d2612d3cb4f1 Sep 06 06:50:54 devstack sudo[106019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:50:54 devstack sudo[106019]: pam_unix(sudo:session): session closed for user root Sep 06 06:50:54 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-a3e8687b-4d3c-48f0-825a-de67829775c7 tempest-CinderUnicodeTest-568341698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-30d00df9-a58c-4c1c-8c16-d2612d3cb4f1" returned: 0 in 0.358s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:50:54 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-a3e8687b-4d3c-48f0-825a-de67829775c7 tempest-CinderUnicodeTest-568341698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-30d00df9-a58c-4c1c-8c16-d2612d3cb4f1.0bdba420-7748-4ec4-ba85-acdf25f50b11 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:50:54 devstack sudo[106024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-30d00df9-a58c-4c1c-8c16-d2612d3cb4f1.0bdba420-7748-4ec4-ba85-acdf25f50b11 Sep 06 06:50:54 devstack sudo[106024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:50:54 devstack sudo[106024]: pam_unix(sudo:session): session closed for user root Sep 06 06:50:54 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-a3e8687b-4d3c-48f0-825a-de67829775c7 tempest-CinderUnicodeTest-568341698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-30d00df9-a58c-4c1c-8c16-d2612d3cb4f1.0bdba420-7748-4ec4-ba85-acdf25f50b11" returned: 0 in 0.331s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:50:55 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-a3e8687b-4d3c-48f0-825a-de67829775c7 tempest-CinderUnicodeTest-568341698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-30d00df9-a58c-4c1c-8c16-d2612d3cb4f1.0bdba420-7748-4ec4-ba85-acdf25f50b11 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:50:55 devstack sudo[106030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-30d00df9-a58c-4c1c-8c16-d2612d3cb4f1.0bdba420-7748-4ec4-ba85-acdf25f50b11 Sep 06 06:50:55 devstack sudo[106030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:50:55 devstack sudo[106030]: pam_unix(sudo:session): session closed for user root Sep 06 06:50:55 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-a3e8687b-4d3c-48f0-825a-de67829775c7 tempest-CinderUnicodeTest-568341698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-30d00df9-a58c-4c1c-8c16-d2612d3cb4f1.0bdba420-7748-4ec4-ba85-acdf25f50b11" returned: 0 in 0.248s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:50:55 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-a3e8687b-4d3c-48f0-825a-de67829775c7 tempest-CinderUnicodeTest-568341698 None] Lock "cinder-quobyte-0bdba420-7748-4ec4-ba85-acdf25f50b11" released by "_delete_snapshot" :: held 1.374s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:50:55 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-a3e8687b-4d3c-48f0-825a-de67829775c7 tempest-CinderUnicodeTest-568341698 None] Lock "cinder-quobyte-30d00df9-a58c-4c1c-8c16-d2612d3cb4f1" released by "delete_snapshot" :: held 1.395s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:50:55 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-a3e8687b-4d3c-48f0-825a-de67829775c7 tempest-CinderUnicodeTest-568341698 None] Created reservations ['b5704f1f-61f5-43f8-944a-d95661795b9d', '9e6cc8c9-c989-44fd-8537-7ada5515c0d8', 'a714f422-973f-4da1-88e2-79f6a43ae462', '2b04ba30-b5b5-4a14-ab6c-287d7f9c7939'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:50:55 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-a3e8687b-4d3c-48f0-825a-de67829775c7 tempest-CinderUnicodeTest-568341698 None] Delete snapshot completed successfully. Sep 06 06:50:55 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-a3e8687b-4d3c-48f0-825a-de67829775c7 tempest-CinderUnicodeTest-568341698 None] Lock "cinder-0bdba420-7748-4ec4-ba85-acdf25f50b11-delete_snapshot" released by "delete_snapshot" :: held 1.517s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:50:56 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-e5fa0e1e-059e-4e8e-97a9-e39c63b52f47 tempest-CinderUnicodeTest-568341698 None] Acquiring lock "cinder-30d00df9-a58c-4c1c-8c16-d2612d3cb4f1-delete_volume" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:50:56 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-e5fa0e1e-059e-4e8e-97a9-e39c63b52f47 tempest-CinderUnicodeTest-568341698 None] Lock "cinder-30d00df9-a58c-4c1c-8c16-d2612d3cb4f1-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:50:56 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-e5fa0e1e-059e-4e8e-97a9-e39c63b52f47 tempest-CinderUnicodeTest-568341698 None] Acquiring lock "cinder-quobyte-30d00df9-a58c-4c1c-8c16-d2612d3cb4f1" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:50:56 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-e5fa0e1e-059e-4e8e-97a9-e39c63b52f47 tempest-CinderUnicodeTest-568341698 None] Lock "cinder-quobyte-30d00df9-a58c-4c1c-8c16-d2612d3cb4f1" acquired by "delete_volume" :: waited 0.014s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:50:56 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c418933-2502-4bcc-9c6f-b4e324c4712d]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:50:56 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-e5fa0e1e-059e-4e8e-97a9-e39c63b52f47 tempest-CinderUnicodeTest-568341698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-30d00df9-a58c-4c1c-8c16-d2612d3cb4f1 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:50:56 devstack sudo[106033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-30d00df9-a58c-4c1c-8c16-d2612d3cb4f1 Sep 06 06:50:56 devstack sudo[106033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:50:56 devstack sudo[106033]: pam_unix(sudo:session): session closed for user root Sep 06 06:50:56 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-e5fa0e1e-059e-4e8e-97a9-e39c63b52f47 tempest-CinderUnicodeTest-568341698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-30d00df9-a58c-4c1c-8c16-d2612d3cb4f1" returned: 0 in 0.346s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:50:56 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-e5fa0e1e-059e-4e8e-97a9-e39c63b52f47 tempest-CinderUnicodeTest-568341698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-30d00df9-a58c-4c1c-8c16-d2612d3cb4f1 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:50:56 devstack sudo[106038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-30d00df9-a58c-4c1c-8c16-d2612d3cb4f1 Sep 06 06:50:56 devstack sudo[106038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:50:56 devstack sudo[106038]: pam_unix(sudo:session): session closed for user root Sep 06 06:50:56 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-e5fa0e1e-059e-4e8e-97a9-e39c63b52f47 tempest-CinderUnicodeTest-568341698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-30d00df9-a58c-4c1c-8c16-d2612d3cb4f1" returned: 0 in 0.242s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:50:56 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-e5fa0e1e-059e-4e8e-97a9-e39c63b52f47 tempest-CinderUnicodeTest-568341698 None] Lock "cinder-quobyte-30d00df9-a58c-4c1c-8c16-d2612d3cb4f1" released by "delete_volume" :: held 0.642s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:50:56 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-e5fa0e1e-059e-4e8e-97a9-e39c63b52f47 tempest-CinderUnicodeTest-568341698 None] Created reservations ['6bbb6c4e-73f0-403a-90e4-153a525ec0d0', 'bc22d3b0-37fc-4635-8a58-36e0a7df7848', '5e311bed-7363-4fef-a101-c1af671c827f', '67d6fe45-036c-4dd9-a88f-c57955bb9b8a'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:50:56 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-e5fa0e1e-059e-4e8e-97a9-e39c63b52f47 tempest-CinderUnicodeTest-568341698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:50:56 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-e5fa0e1e-059e-4e8e-97a9-e39c63b52f47 tempest-CinderUnicodeTest-568341698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:50:56 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-e5fa0e1e-059e-4e8e-97a9-e39c63b52f47 tempest-CinderUnicodeTest-568341698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:50:56 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-e5fa0e1e-059e-4e8e-97a9-e39c63b52f47 tempest-CinderUnicodeTest-568341698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:50:56 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-e5fa0e1e-059e-4e8e-97a9-e39c63b52f47 tempest-CinderUnicodeTest-568341698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:50:56 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-e5fa0e1e-059e-4e8e-97a9-e39c63b52f47 tempest-CinderUnicodeTest-568341698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:50:56 devstack sudo[106041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:50:56 devstack sudo[106041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:50:57 devstack sudo[106041]: pam_unix(sudo:session): session closed for user root Sep 06 06:50:57 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-e5fa0e1e-059e-4e8e-97a9-e39c63b52f47 tempest-CinderUnicodeTest-568341698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.241s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:50:57 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-e5fa0e1e-059e-4e8e-97a9-e39c63b52f47 tempest-CinderUnicodeTest-568341698 None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:50:57 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-e5fa0e1e-059e-4e8e-97a9-e39c63b52f47 tempest-CinderUnicodeTest-568341698 None] Deleted volume successfully. Sep 06 06:50:57 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-e5fa0e1e-059e-4e8e-97a9-e39c63b52f47 tempest-CinderUnicodeTest-568341698 None] Lock "cinder-30d00df9-a58c-4c1c-8c16-d2612d3cb4f1-delete_volume" released by "delete_volume" :: held 1.073s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:50:57 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-2b866547-857d-4181-a19b-59d737d4077b tempest-CinderUnicodeTest-568341698 None] Acquiring lock "cinder-4461d7b8-d900-4b76-92b5-5a5f13cc0cac-delete_volume" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:50:57 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-2b866547-857d-4181-a19b-59d737d4077b tempest-CinderUnicodeTest-568341698 None] Lock "cinder-4461d7b8-d900-4b76-92b5-5a5f13cc0cac-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:50:57 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-2b866547-857d-4181-a19b-59d737d4077b tempest-CinderUnicodeTest-568341698 None] Acquiring lock "cinder-quobyte-4461d7b8-d900-4b76-92b5-5a5f13cc0cac" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:50:57 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-2b866547-857d-4181-a19b-59d737d4077b tempest-CinderUnicodeTest-568341698 None] Lock "cinder-quobyte-4461d7b8-d900-4b76-92b5-5a5f13cc0cac" acquired by "delete_volume" :: waited 0.015s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:50:57 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[03edf1e2-98f0-4f61-86e8-058aca6f2673]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:50:57 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-2b866547-857d-4181-a19b-59d737d4077b tempest-CinderUnicodeTest-568341698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-4461d7b8-d900-4b76-92b5-5a5f13cc0cac {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:50:57 devstack sudo[106044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-4461d7b8-d900-4b76-92b5-5a5f13cc0cac Sep 06 06:50:57 devstack sudo[106044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:50:57 devstack sudo[106044]: pam_unix(sudo:session): session closed for user root Sep 06 06:50:57 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-2b866547-857d-4181-a19b-59d737d4077b tempest-CinderUnicodeTest-568341698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-4461d7b8-d900-4b76-92b5-5a5f13cc0cac" returned: 0 in 0.344s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:50:57 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-2b866547-857d-4181-a19b-59d737d4077b tempest-CinderUnicodeTest-568341698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-4461d7b8-d900-4b76-92b5-5a5f13cc0cac {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:50:57 devstack sudo[106049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-4461d7b8-d900-4b76-92b5-5a5f13cc0cac Sep 06 06:50:57 devstack sudo[106049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:50:57 devstack sudo[106049]: pam_unix(sudo:session): session closed for user root Sep 06 06:50:57 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-2b866547-857d-4181-a19b-59d737d4077b tempest-CinderUnicodeTest-568341698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-4461d7b8-d900-4b76-92b5-5a5f13cc0cac" returned: 0 in 0.243s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:50:57 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-2b866547-857d-4181-a19b-59d737d4077b tempest-CinderUnicodeTest-568341698 None] Lock "cinder-quobyte-4461d7b8-d900-4b76-92b5-5a5f13cc0cac" released by "delete_volume" :: held 0.622s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:50:57 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-2b866547-857d-4181-a19b-59d737d4077b tempest-CinderUnicodeTest-568341698 None] Created reservations ['bf2bd20d-b5ab-481e-99e2-6aaa817f0e2e', '0566a86a-b928-44d7-b376-305ad4e545f3', 'e8b94054-7130-4b79-b4a4-f3d0c77f881d', '972707fc-e7b6-4c8f-8d72-47c9b825643c'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:50:57 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-2b866547-857d-4181-a19b-59d737d4077b tempest-CinderUnicodeTest-568341698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:50:57 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-2b866547-857d-4181-a19b-59d737d4077b tempest-CinderUnicodeTest-568341698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:50:57 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-2b866547-857d-4181-a19b-59d737d4077b tempest-CinderUnicodeTest-568341698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:50:57 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-2b866547-857d-4181-a19b-59d737d4077b tempest-CinderUnicodeTest-568341698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:50:57 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-2b866547-857d-4181-a19b-59d737d4077b tempest-CinderUnicodeTest-568341698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:50:57 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-2b866547-857d-4181-a19b-59d737d4077b tempest-CinderUnicodeTest-568341698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:50:57 devstack sudo[106052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:50:57 devstack sudo[106052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:50:58 devstack sudo[106052]: pam_unix(sudo:session): session closed for user root Sep 06 06:50:58 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-2b866547-857d-4181-a19b-59d737d4077b tempest-CinderUnicodeTest-568341698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.243s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:50:58 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-2b866547-857d-4181-a19b-59d737d4077b tempest-CinderUnicodeTest-568341698 None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:50:58 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-2b866547-857d-4181-a19b-59d737d4077b tempest-CinderUnicodeTest-568341698 None] Deleted volume successfully. Sep 06 06:50:58 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-2b866547-857d-4181-a19b-59d737d4077b tempest-CinderUnicodeTest-568341698 None] Lock "cinder-4461d7b8-d900-4b76-92b5-5a5f13cc0cac-delete_volume" released by "delete_volume" :: held 1.046s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:51:01 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-09245eb3-4a89-4d56-982e-ebb0ad7822b7 tempest-ProjectReaderTests-1874834851 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87329) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 06:51:01 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-09245eb3-4a89-4d56-982e-ebb0ad7822b7 tempest-ProjectReaderTests-1874834851 None] Flow 'volume_create_manager' (ba82e8d9-6ef7-4ab9-b194-5df501729ee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:51:01 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-09245eb3-4a89-4d56-982e-ebb0ad7822b7 tempest-ProjectReaderTests-1874834851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1eaf059e-2e71-424b-9d20-44319372ce57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:51:01 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-09245eb3-4a89-4d56-982e-ebb0ad7822b7 tempest-ProjectReaderTests-1874834851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1eaf059e-2e71-424b-9d20-44319372ce57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:51:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2124834341',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b3d0f77-547c-47d8-8281-aa724d3c33c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d2643faf214440d9738694066ceb8ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:51:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:51:01Z,use_quota=True,user_id='d8e5fa76693d49089852065a338ecab7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:51:01 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-09245eb3-4a89-4d56-982e-ebb0ad7822b7 tempest-ProjectReaderTests-1874834851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b446cad-6c4f-4502-b2ea-9b183c31cf6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:51:01 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-09245eb3-4a89-4d56-982e-ebb0ad7822b7 tempest-ProjectReaderTests-1874834851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b446cad-6c4f-4502-b2ea-9b183c31cf6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:51:01 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-09245eb3-4a89-4d56-982e-ebb0ad7822b7 tempest-ProjectReaderTests-1874834851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5436bf5c-af88-498e-a544-98cde8c4b311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:51:01 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-09245eb3-4a89-4d56-982e-ebb0ad7822b7 tempest-ProjectReaderTests-1874834851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5436bf5c-af88-498e-a544-98cde8c4b311) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b3d0f77-547c-47d8-8281-aa724d3c33c6', 'volume_name': 'volume-6b3d0f77-547c-47d8-8281-aa724d3c33c6', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:51:01 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-09245eb3-4a89-4d56-982e-ebb0ad7822b7 tempest-ProjectReaderTests-1874834851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fa37147-94cb-44a2-9d6d-892aa1fa04c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:51:01 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-09245eb3-4a89-4d56-982e-ebb0ad7822b7 tempest-ProjectReaderTests-1874834851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fa37147-94cb-44a2-9d6d-892aa1fa04c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:51:01 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-09245eb3-4a89-4d56-982e-ebb0ad7822b7 tempest-ProjectReaderTests-1874834851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c201903-bb3d-4cfb-86e1-69ad559c7696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:51:01 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-09245eb3-4a89-4d56-982e-ebb0ad7822b7 tempest-ProjectReaderTests-1874834851 None] Volume 6b3d0f77-547c-47d8-8281-aa724d3c33c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b3d0f77-547c-47d8-8281-aa724d3c33c6', 'volume_size': 1} Sep 06 06:51:01 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-09245eb3-4a89-4d56-982e-ebb0ad7822b7 tempest-ProjectReaderTests-1874834851 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:51:01 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-09245eb3-4a89-4d56-982e-ebb0ad7822b7 tempest-ProjectReaderTests-1874834851 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:51:01 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-09245eb3-4a89-4d56-982e-ebb0ad7822b7 tempest-ProjectReaderTests-1874834851 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:51:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2124834341',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b3d0f77-547c-47d8-8281-aa724d3c33c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d2643faf214440d9738694066ceb8ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:51:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:51:01Z,use_quota=True,user_id='d8e5fa76693d49089852065a338ecab7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)}" {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 06:51:01 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-09245eb3-4a89-4d56-982e-ebb0ad7822b7 tempest-ProjectReaderTests-1874834851 None] Creating volume 6b3d0f77-547c-47d8-8281-aa724d3c33c6 {{(pid=87329) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 06:51:01 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-09245eb3-4a89-4d56-982e-ebb0ad7822b7 tempest-ProjectReaderTests-1874834851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:51:01 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-09245eb3-4a89-4d56-982e-ebb0ad7822b7 tempest-ProjectReaderTests-1874834851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:51:01 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-09245eb3-4a89-4d56-982e-ebb0ad7822b7 tempest-ProjectReaderTests-1874834851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:51:01 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-09245eb3-4a89-4d56-982e-ebb0ad7822b7 tempest-ProjectReaderTests-1874834851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:51:01 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-09245eb3-4a89-4d56-982e-ebb0ad7822b7 tempest-ProjectReaderTests-1874834851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:51:01 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-09245eb3-4a89-4d56-982e-ebb0ad7822b7 tempest-ProjectReaderTests-1874834851 None] Selected osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 as target Quobyte volume. {{(pid=87329) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 06:51:01 devstack cinder-volume[87329]: INFO cinder.volume.drivers.remotefs [None req-09245eb3-4a89-4d56-982e-ebb0ad7822b7 tempest-ProjectReaderTests-1874834851 None] casted to osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 Sep 06 06:51:01 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-09245eb3-4a89-4d56-982e-ebb0ad7822b7 tempest-ProjectReaderTests-1874834851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6b3d0f77-547c-47d8-8281-aa724d3c33c6 1073741824 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:51:01 devstack sudo[106062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6b3d0f77-547c-47d8-8281-aa724d3c33c6 1073741824 Sep 06 06:51:01 devstack sudo[106062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:51:01 devstack sudo[106062]: pam_unix(sudo:session): session closed for user root Sep 06 06:51:01 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-09245eb3-4a89-4d56-982e-ebb0ad7822b7 tempest-ProjectReaderTests-1874834851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6b3d0f77-547c-47d8-8281-aa724d3c33c6 1073741824" returned: 0 in 0.387s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:51:01 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-09245eb3-4a89-4d56-982e-ebb0ad7822b7 tempest-ProjectReaderTests-1874834851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6b3d0f77-547c-47d8-8281-aa724d3c33c6 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:51:01 devstack sudo[106068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6b3d0f77-547c-47d8-8281-aa724d3c33c6 Sep 06 06:51:01 devstack sudo[106068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:51:02 devstack sudo[106068]: pam_unix(sudo:session): session closed for user root Sep 06 06:51:02 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-09245eb3-4a89-4d56-982e-ebb0ad7822b7 tempest-ProjectReaderTests-1874834851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6b3d0f77-547c-47d8-8281-aa724d3c33c6" returned: 0 in 0.234s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:51:02 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-09245eb3-4a89-4d56-982e-ebb0ad7822b7 tempest-ProjectReaderTests-1874834851 None] <== create_volume: return (658ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'} {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 06:51:02 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-09245eb3-4a89-4d56-982e-ebb0ad7822b7 tempest-ProjectReaderTests-1874834851 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.661s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:51:02 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-09245eb3-4a89-4d56-982e-ebb0ad7822b7 tempest-ProjectReaderTests-1874834851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c201903-bb3d-4cfb-86e1-69ad559c7696) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b3d0f77-547c-47d8-8281-aa724d3c33c6', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:51:02 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-09245eb3-4a89-4d56-982e-ebb0ad7822b7 tempest-ProjectReaderTests-1874834851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7153939-d013-4285-98f6-daf8b68e5123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:51:02 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-09245eb3-4a89-4d56-982e-ebb0ad7822b7 tempest-ProjectReaderTests-1874834851 None] Volume volume-6b3d0f77-547c-47d8-8281-aa724d3c33c6 (6b3d0f77-547c-47d8-8281-aa724d3c33c6): created successfully Sep 06 06:51:02 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-09245eb3-4a89-4d56-982e-ebb0ad7822b7 tempest-ProjectReaderTests-1874834851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7153939-d013-4285-98f6-daf8b68e5123) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:51:02 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-09245eb3-4a89-4d56-982e-ebb0ad7822b7 tempest-ProjectReaderTests-1874834851 None] Flow 'volume_create_manager' (ba82e8d9-6ef7-4ab9-b194-5df501729ee7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:51:02 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-09245eb3-4a89-4d56-982e-ebb0ad7822b7 tempest-ProjectReaderTests-1874834851 None] Created volume successfully. Sep 06 06:51:02 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-dab9ae20-4bc3-4e37-b194-bb06c4ee20a2 tempest-ProjectReaderTests-1874834851 None] Acquiring lock "cinder-6b3d0f77-547c-47d8-8281-aa724d3c33c6-delete_volume" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:51:02 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-dab9ae20-4bc3-4e37-b194-bb06c4ee20a2 tempest-ProjectReaderTests-1874834851 None] Lock "cinder-6b3d0f77-547c-47d8-8281-aa724d3c33c6-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:51:02 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-dab9ae20-4bc3-4e37-b194-bb06c4ee20a2 tempest-ProjectReaderTests-1874834851 None] Acquiring lock "cinder-quobyte-6b3d0f77-547c-47d8-8281-aa724d3c33c6" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:51:02 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-dab9ae20-4bc3-4e37-b194-bb06c4ee20a2 tempest-ProjectReaderTests-1874834851 None] Lock "cinder-quobyte-6b3d0f77-547c-47d8-8281-aa724d3c33c6" acquired by "delete_volume" :: waited 0.016s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:51:02 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9080588-8358-4119-bae6-06c4bcef3196]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:51:02 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-dab9ae20-4bc3-4e37-b194-bb06c4ee20a2 tempest-ProjectReaderTests-1874834851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6b3d0f77-547c-47d8-8281-aa724d3c33c6 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:51:02 devstack sudo[106072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6b3d0f77-547c-47d8-8281-aa724d3c33c6 Sep 06 06:51:02 devstack sudo[106072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:51:02 devstack sudo[106072]: pam_unix(sudo:session): session closed for user root Sep 06 06:51:02 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-dab9ae20-4bc3-4e37-b194-bb06c4ee20a2 tempest-ProjectReaderTests-1874834851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6b3d0f77-547c-47d8-8281-aa724d3c33c6" returned: 0 in 0.352s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:51:02 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-dab9ae20-4bc3-4e37-b194-bb06c4ee20a2 tempest-ProjectReaderTests-1874834851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6b3d0f77-547c-47d8-8281-aa724d3c33c6 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:51:02 devstack sudo[106077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6b3d0f77-547c-47d8-8281-aa724d3c33c6 Sep 06 06:51:02 devstack sudo[106077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:51:03 devstack sudo[106077]: pam_unix(sudo:session): session closed for user root Sep 06 06:51:03 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-dab9ae20-4bc3-4e37-b194-bb06c4ee20a2 tempest-ProjectReaderTests-1874834851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6b3d0f77-547c-47d8-8281-aa724d3c33c6" returned: 0 in 0.238s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:51:03 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-dab9ae20-4bc3-4e37-b194-bb06c4ee20a2 tempest-ProjectReaderTests-1874834851 None] Lock "cinder-quobyte-6b3d0f77-547c-47d8-8281-aa724d3c33c6" released by "delete_volume" :: held 0.625s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:51:03 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-dab9ae20-4bc3-4e37-b194-bb06c4ee20a2 tempest-ProjectReaderTests-1874834851 None] Created reservations ['82ebb74d-2031-4b86-a849-853d6b4a35bd', '36a6853b-52d9-4956-bbc2-87242c1e2a02', '94b2580a-3d6c-46a9-94df-003c41aa9cdd', '0784622c-55c4-47b1-a7c8-e78f7668e329'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:51:03 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-dab9ae20-4bc3-4e37-b194-bb06c4ee20a2 tempest-ProjectReaderTests-1874834851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:51:03 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-dab9ae20-4bc3-4e37-b194-bb06c4ee20a2 tempest-ProjectReaderTests-1874834851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:51:03 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-dab9ae20-4bc3-4e37-b194-bb06c4ee20a2 tempest-ProjectReaderTests-1874834851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:51:03 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-dab9ae20-4bc3-4e37-b194-bb06c4ee20a2 tempest-ProjectReaderTests-1874834851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:51:03 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-dab9ae20-4bc3-4e37-b194-bb06c4ee20a2 tempest-ProjectReaderTests-1874834851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:51:03 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-dab9ae20-4bc3-4e37-b194-bb06c4ee20a2 tempest-ProjectReaderTests-1874834851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:51:03 devstack sudo[106080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:51:03 devstack sudo[106080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:51:03 devstack sudo[106080]: pam_unix(sudo:session): session closed for user root Sep 06 06:51:03 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-dab9ae20-4bc3-4e37-b194-bb06c4ee20a2 tempest-ProjectReaderTests-1874834851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.236s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:51:03 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-dab9ae20-4bc3-4e37-b194-bb06c4ee20a2 tempest-ProjectReaderTests-1874834851 None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:51:03 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-dab9ae20-4bc3-4e37-b194-bb06c4ee20a2 tempest-ProjectReaderTests-1874834851 None] Deleted volume successfully. Sep 06 06:51:03 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-dab9ae20-4bc3-4e37-b194-bb06c4ee20a2 tempest-ProjectReaderTests-1874834851 None] Lock "cinder-6b3d0f77-547c-47d8-8281-aa724d3c33c6-delete_volume" released by "delete_volume" :: held 1.039s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:51:04 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-570540cc-f3a8-4897-82b4-2c419827f2bc tempest-ProjectReaderTests-1874834851 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87329) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 06:51:04 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-570540cc-f3a8-4897-82b4-2c419827f2bc tempest-ProjectReaderTests-1874834851 None] Flow 'volume_create_manager' (88350658-7306-46b6-b59d-e6bb1b63d256) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:51:04 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-570540cc-f3a8-4897-82b4-2c419827f2bc tempest-ProjectReaderTests-1874834851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a14ea9d9-1e24-475d-8468-ae37a1d2960a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:51:04 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-570540cc-f3a8-4897-82b4-2c419827f2bc tempest-ProjectReaderTests-1874834851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a14ea9d9-1e24-475d-8468-ae37a1d2960a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:51:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-376418483',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb676c2e-bbd6-463e-8022-078816ba9261,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d2643faf214440d9738694066ceb8ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:51:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:51:04Z,use_quota=True,user_id='d8e5fa76693d49089852065a338ecab7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:51:04 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-570540cc-f3a8-4897-82b4-2c419827f2bc tempest-ProjectReaderTests-1874834851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8224f79-6141-4099-83af-68415e2113e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:51:04 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-570540cc-f3a8-4897-82b4-2c419827f2bc tempest-ProjectReaderTests-1874834851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8224f79-6141-4099-83af-68415e2113e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:51:04 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-570540cc-f3a8-4897-82b4-2c419827f2bc tempest-ProjectReaderTests-1874834851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90b04677-eec2-4f73-9a8c-8e4ce84baae4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:51:04 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-570540cc-f3a8-4897-82b4-2c419827f2bc tempest-ProjectReaderTests-1874834851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90b04677-eec2-4f73-9a8c-8e4ce84baae4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb676c2e-bbd6-463e-8022-078816ba9261', 'volume_name': 'volume-bb676c2e-bbd6-463e-8022-078816ba9261', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:51:04 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-570540cc-f3a8-4897-82b4-2c419827f2bc tempest-ProjectReaderTests-1874834851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67693b3a-49cc-4474-ad9a-e5c6b2ec31dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:51:04 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-570540cc-f3a8-4897-82b4-2c419827f2bc tempest-ProjectReaderTests-1874834851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67693b3a-49cc-4474-ad9a-e5c6b2ec31dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:51:04 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-570540cc-f3a8-4897-82b4-2c419827f2bc tempest-ProjectReaderTests-1874834851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5b96762-f774-4205-af5e-e08501c8a8ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:51:04 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-570540cc-f3a8-4897-82b4-2c419827f2bc tempest-ProjectReaderTests-1874834851 None] Volume bb676c2e-bbd6-463e-8022-078816ba9261: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb676c2e-bbd6-463e-8022-078816ba9261', 'volume_size': 1} Sep 06 06:51:04 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-570540cc-f3a8-4897-82b4-2c419827f2bc tempest-ProjectReaderTests-1874834851 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:51:04 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-570540cc-f3a8-4897-82b4-2c419827f2bc tempest-ProjectReaderTests-1874834851 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:51:04 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-570540cc-f3a8-4897-82b4-2c419827f2bc tempest-ProjectReaderTests-1874834851 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:51:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-376418483',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb676c2e-bbd6-463e-8022-078816ba9261,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d2643faf214440d9738694066ceb8ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:51:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:51:04Z,use_quota=True,user_id='d8e5fa76693d49089852065a338ecab7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)}" {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 06:51:04 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-570540cc-f3a8-4897-82b4-2c419827f2bc tempest-ProjectReaderTests-1874834851 None] Creating volume bb676c2e-bbd6-463e-8022-078816ba9261 {{(pid=87329) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 06:51:04 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-570540cc-f3a8-4897-82b4-2c419827f2bc tempest-ProjectReaderTests-1874834851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:51:04 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-570540cc-f3a8-4897-82b4-2c419827f2bc tempest-ProjectReaderTests-1874834851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:51:04 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-570540cc-f3a8-4897-82b4-2c419827f2bc tempest-ProjectReaderTests-1874834851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:51:04 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-570540cc-f3a8-4897-82b4-2c419827f2bc tempest-ProjectReaderTests-1874834851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:51:04 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-570540cc-f3a8-4897-82b4-2c419827f2bc tempest-ProjectReaderTests-1874834851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:51:04 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-570540cc-f3a8-4897-82b4-2c419827f2bc tempest-ProjectReaderTests-1874834851 None] Selected osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 as target Quobyte volume. {{(pid=87329) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 06:51:04 devstack cinder-volume[87329]: INFO cinder.volume.drivers.remotefs [None req-570540cc-f3a8-4897-82b4-2c419827f2bc tempest-ProjectReaderTests-1874834851 None] casted to osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 Sep 06 06:51:04 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-570540cc-f3a8-4897-82b4-2c419827f2bc tempest-ProjectReaderTests-1874834851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bb676c2e-bbd6-463e-8022-078816ba9261 1073741824 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:51:04 devstack sudo[106083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bb676c2e-bbd6-463e-8022-078816ba9261 1073741824 Sep 06 06:51:04 devstack sudo[106083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:51:04 devstack sudo[106083]: pam_unix(sudo:session): session closed for user root Sep 06 06:51:04 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-570540cc-f3a8-4897-82b4-2c419827f2bc tempest-ProjectReaderTests-1874834851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bb676c2e-bbd6-463e-8022-078816ba9261 1073741824" returned: 0 in 0.398s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:51:04 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-570540cc-f3a8-4897-82b4-2c419827f2bc tempest-ProjectReaderTests-1874834851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bb676c2e-bbd6-463e-8022-078816ba9261 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:51:04 devstack sudo[106090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bb676c2e-bbd6-463e-8022-078816ba9261 Sep 06 06:51:04 devstack sudo[106090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:51:04 devstack sudo[106090]: pam_unix(sudo:session): session closed for user root Sep 06 06:51:04 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-570540cc-f3a8-4897-82b4-2c419827f2bc tempest-ProjectReaderTests-1874834851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bb676c2e-bbd6-463e-8022-078816ba9261" returned: 0 in 0.236s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:51:04 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-570540cc-f3a8-4897-82b4-2c419827f2bc tempest-ProjectReaderTests-1874834851 None] <== create_volume: return (678ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'} {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 06:51:04 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-570540cc-f3a8-4897-82b4-2c419827f2bc tempest-ProjectReaderTests-1874834851 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.682s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:51:04 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-570540cc-f3a8-4897-82b4-2c419827f2bc tempest-ProjectReaderTests-1874834851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5b96762-f774-4205-af5e-e08501c8a8ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb676c2e-bbd6-463e-8022-078816ba9261', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:51:04 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-570540cc-f3a8-4897-82b4-2c419827f2bc tempest-ProjectReaderTests-1874834851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68d6f45d-1d3a-4f0b-82bf-89a328333f8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:51:04 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-570540cc-f3a8-4897-82b4-2c419827f2bc tempest-ProjectReaderTests-1874834851 None] Volume volume-bb676c2e-bbd6-463e-8022-078816ba9261 (bb676c2e-bbd6-463e-8022-078816ba9261): created successfully Sep 06 06:51:04 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-570540cc-f3a8-4897-82b4-2c419827f2bc tempest-ProjectReaderTests-1874834851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68d6f45d-1d3a-4f0b-82bf-89a328333f8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:51:04 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-570540cc-f3a8-4897-82b4-2c419827f2bc tempest-ProjectReaderTests-1874834851 None] Flow 'volume_create_manager' (88350658-7306-46b6-b59d-e6bb1b63d256) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:51:04 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-570540cc-f3a8-4897-82b4-2c419827f2bc tempest-ProjectReaderTests-1874834851 None] Created volume successfully. Sep 06 06:51:05 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-e81f654c-d363-40e5-bf5e-ed7ac862aa11 tempest-ProjectReaderTests-1874834851 None] Acquiring lock "cinder-bb676c2e-bbd6-463e-8022-078816ba9261-delete_volume" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:51:05 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-e81f654c-d363-40e5-bf5e-ed7ac862aa11 tempest-ProjectReaderTests-1874834851 None] Lock "cinder-bb676c2e-bbd6-463e-8022-078816ba9261-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:51:05 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-e81f654c-d363-40e5-bf5e-ed7ac862aa11 tempest-ProjectReaderTests-1874834851 None] Acquiring lock "cinder-quobyte-bb676c2e-bbd6-463e-8022-078816ba9261" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:51:05 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-e81f654c-d363-40e5-bf5e-ed7ac862aa11 tempest-ProjectReaderTests-1874834851 None] Lock "cinder-quobyte-bb676c2e-bbd6-463e-8022-078816ba9261" acquired by "delete_volume" :: waited 0.013s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:51:05 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[06d1335c-20a8-4d50-88ca-791818cad351]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:51:05 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-e81f654c-d363-40e5-bf5e-ed7ac862aa11 tempest-ProjectReaderTests-1874834851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bb676c2e-bbd6-463e-8022-078816ba9261 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:51:05 devstack sudo[106094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bb676c2e-bbd6-463e-8022-078816ba9261 Sep 06 06:51:05 devstack sudo[106094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:51:05 devstack sudo[106094]: pam_unix(sudo:session): session closed for user root Sep 06 06:51:05 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-e81f654c-d363-40e5-bf5e-ed7ac862aa11 tempest-ProjectReaderTests-1874834851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bb676c2e-bbd6-463e-8022-078816ba9261" returned: 0 in 0.342s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:51:05 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-e81f654c-d363-40e5-bf5e-ed7ac862aa11 tempest-ProjectReaderTests-1874834851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bb676c2e-bbd6-463e-8022-078816ba9261 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:51:05 devstack sudo[106100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bb676c2e-bbd6-463e-8022-078816ba9261 Sep 06 06:51:05 devstack sudo[106100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:51:05 devstack sudo[106100]: pam_unix(sudo:session): session closed for user root Sep 06 06:51:05 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-e81f654c-d363-40e5-bf5e-ed7ac862aa11 tempest-ProjectReaderTests-1874834851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-bb676c2e-bbd6-463e-8022-078816ba9261" returned: 0 in 0.238s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:51:05 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-e81f654c-d363-40e5-bf5e-ed7ac862aa11 tempest-ProjectReaderTests-1874834851 None] Lock "cinder-quobyte-bb676c2e-bbd6-463e-8022-078816ba9261" released by "delete_volume" :: held 0.616s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:51:05 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-e81f654c-d363-40e5-bf5e-ed7ac862aa11 tempest-ProjectReaderTests-1874834851 None] Created reservations ['58ddbfe4-ae4c-4819-adb4-cb41c5a336b6', '9bb390b0-c898-48f0-87c4-7469e63021ab', '2125775e-9c84-4f44-a1ca-a9d9e0ebd7e9', '2ef9a411-c5cc-42d2-9746-a4574e5d44d8'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:51:05 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-e81f654c-d363-40e5-bf5e-ed7ac862aa11 tempest-ProjectReaderTests-1874834851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:51:05 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-e81f654c-d363-40e5-bf5e-ed7ac862aa11 tempest-ProjectReaderTests-1874834851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:51:05 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-e81f654c-d363-40e5-bf5e-ed7ac862aa11 tempest-ProjectReaderTests-1874834851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:51:05 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-e81f654c-d363-40e5-bf5e-ed7ac862aa11 tempest-ProjectReaderTests-1874834851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:51:05 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-e81f654c-d363-40e5-bf5e-ed7ac862aa11 tempest-ProjectReaderTests-1874834851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:51:05 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-e81f654c-d363-40e5-bf5e-ed7ac862aa11 tempest-ProjectReaderTests-1874834851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:51:05 devstack sudo[106103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:51:05 devstack sudo[106103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:51:06 devstack sudo[106103]: pam_unix(sudo:session): session closed for user root Sep 06 06:51:06 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-e81f654c-d363-40e5-bf5e-ed7ac862aa11 tempest-ProjectReaderTests-1874834851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.239s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:51:06 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-e81f654c-d363-40e5-bf5e-ed7ac862aa11 tempest-ProjectReaderTests-1874834851 None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:51:06 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-e81f654c-d363-40e5-bf5e-ed7ac862aa11 tempest-ProjectReaderTests-1874834851 None] Deleted volume successfully. Sep 06 06:51:06 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-e81f654c-d363-40e5-bf5e-ed7ac862aa11 tempest-ProjectReaderTests-1874834851 None] Lock "cinder-bb676c2e-bbd6-463e-8022-078816ba9261-delete_volume" released by "delete_volume" :: held 1.032s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:51:15 devstack cinder-volume[87329]: DEBUG dbcounter [-] [87329] Writing DB stats cinder:UPDATE=82,cinder:SELECT=62,cinder:INSERT=26,cinder:DELETE=6 {{(pid=87329) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 06:51:16 devstack cinder-volume[87329]: DEBUG dbcounter [-] [87329] Writing DB stats cinder:SELECT=63,cinder:INSERT=28,cinder:UPDATE=70,cinder:DELETE=7 {{(pid=87329) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 06:51:17 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-2bbe1774-5980-49b0-b262-aa9ac2456fa0 tempest-CreateVolumesFromSnapshotTest-499441882 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87329) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 06:51:17 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-2bbe1774-5980-49b0-b262-aa9ac2456fa0 tempest-CreateVolumesFromSnapshotTest-499441882 None] Flow 'volume_create_manager' (c6e31ebe-df88-4c94-8cd0-9358599cb0ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:51:17 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-2bbe1774-5980-49b0-b262-aa9ac2456fa0 tempest-CreateVolumesFromSnapshotTest-499441882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a18d03d-2639-463c-9dd0-bcb15d111a8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:51:17 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-2bbe1774-5980-49b0-b262-aa9ac2456fa0 tempest-CreateVolumesFromSnapshotTest-499441882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a18d03d-2639-463c-9dd0-bcb15d111a8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:51:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-619675991',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=494f33c8-6091-4f8c-b766-dca143277075,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2de6bc06e3f64a14896af2f97faf9f4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:51:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:51:18Z,use_quota=True,user_id='980ea4c91fca44ea8cff75dd4148f201',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:51:17 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-2bbe1774-5980-49b0-b262-aa9ac2456fa0 tempest-CreateVolumesFromSnapshotTest-499441882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48979aed-7187-48f6-bf94-91fe67a018cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:51:17 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-2bbe1774-5980-49b0-b262-aa9ac2456fa0 tempest-CreateVolumesFromSnapshotTest-499441882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48979aed-7187-48f6-bf94-91fe67a018cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:51:17 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-2bbe1774-5980-49b0-b262-aa9ac2456fa0 tempest-CreateVolumesFromSnapshotTest-499441882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f21f40c6-21f1-4136-8a4f-adff7b5c3756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:51:17 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-2bbe1774-5980-49b0-b262-aa9ac2456fa0 tempest-CreateVolumesFromSnapshotTest-499441882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f21f40c6-21f1-4136-8a4f-adff7b5c3756) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '494f33c8-6091-4f8c-b766-dca143277075', 'volume_name': 'volume-494f33c8-6091-4f8c-b766-dca143277075', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:51:17 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-2bbe1774-5980-49b0-b262-aa9ac2456fa0 tempest-CreateVolumesFromSnapshotTest-499441882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96b007f1-c202-4806-9c40-94fd04037a54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:51:17 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-2bbe1774-5980-49b0-b262-aa9ac2456fa0 tempest-CreateVolumesFromSnapshotTest-499441882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96b007f1-c202-4806-9c40-94fd04037a54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:51:17 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-2bbe1774-5980-49b0-b262-aa9ac2456fa0 tempest-CreateVolumesFromSnapshotTest-499441882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65631bc1-74ab-46f9-8e43-7cbdf70aede5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:51:17 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-2bbe1774-5980-49b0-b262-aa9ac2456fa0 tempest-CreateVolumesFromSnapshotTest-499441882 None] Volume 494f33c8-6091-4f8c-b766-dca143277075: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-494f33c8-6091-4f8c-b766-dca143277075', 'volume_size': 1} Sep 06 06:51:17 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-2bbe1774-5980-49b0-b262-aa9ac2456fa0 tempest-CreateVolumesFromSnapshotTest-499441882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:51:17 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-2bbe1774-5980-49b0-b262-aa9ac2456fa0 tempest-CreateVolumesFromSnapshotTest-499441882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:51:17 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-2bbe1774-5980-49b0-b262-aa9ac2456fa0 tempest-CreateVolumesFromSnapshotTest-499441882 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:51:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-619675991',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=494f33c8-6091-4f8c-b766-dca143277075,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2de6bc06e3f64a14896af2f97faf9f4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:51:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:51:18Z,use_quota=True,user_id='980ea4c91fca44ea8cff75dd4148f201',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)}" {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 06:51:17 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-2bbe1774-5980-49b0-b262-aa9ac2456fa0 tempest-CreateVolumesFromSnapshotTest-499441882 None] Creating volume 494f33c8-6091-4f8c-b766-dca143277075 {{(pid=87329) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 06:51:17 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-2bbe1774-5980-49b0-b262-aa9ac2456fa0 tempest-CreateVolumesFromSnapshotTest-499441882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:51:17 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-2bbe1774-5980-49b0-b262-aa9ac2456fa0 tempest-CreateVolumesFromSnapshotTest-499441882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:51:17 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-2bbe1774-5980-49b0-b262-aa9ac2456fa0 tempest-CreateVolumesFromSnapshotTest-499441882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:51:17 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-2bbe1774-5980-49b0-b262-aa9ac2456fa0 tempest-CreateVolumesFromSnapshotTest-499441882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:51:17 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-2bbe1774-5980-49b0-b262-aa9ac2456fa0 tempest-CreateVolumesFromSnapshotTest-499441882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:51:17 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-2bbe1774-5980-49b0-b262-aa9ac2456fa0 tempest-CreateVolumesFromSnapshotTest-499441882 None] Selected osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 as target Quobyte volume. {{(pid=87329) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 06:51:17 devstack cinder-volume[87329]: INFO cinder.volume.drivers.remotefs [None req-2bbe1774-5980-49b0-b262-aa9ac2456fa0 tempest-CreateVolumesFromSnapshotTest-499441882 None] casted to osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 Sep 06 06:51:17 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-2bbe1774-5980-49b0-b262-aa9ac2456fa0 tempest-CreateVolumesFromSnapshotTest-499441882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-494f33c8-6091-4f8c-b766-dca143277075 1073741824 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:51:18 devstack sudo[106143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-494f33c8-6091-4f8c-b766-dca143277075 1073741824 Sep 06 06:51:18 devstack sudo[106143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:51:18 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-964479a6-55dd-4042-bfa1-152d60e98a82 tempest-VolumeDependencyTests-1618338243 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87329) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 06:51:18 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-964479a6-55dd-4042-bfa1-152d60e98a82 tempest-VolumeDependencyTests-1618338243 None] Flow 'volume_create_manager' (b0a8b8dd-e267-4809-b396-c6a657d6f410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:51:18 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-964479a6-55dd-4042-bfa1-152d60e98a82 tempest-VolumeDependencyTests-1618338243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ac788d5-1e57-4750-9119-97c1e564330d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:51:18 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-964479a6-55dd-4042-bfa1-152d60e98a82 tempest-VolumeDependencyTests-1618338243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ac788d5-1e57-4750-9119-97c1e564330d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:51:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1375829617',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa5460fe-3c45-4eaf-98bf-cad81902db55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2152e75764254dbb9e0e6eaa9ae4fcbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:51:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:51:18Z,use_quota=True,user_id='d0d4144314c04ff99b54caf53a2e5031',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:51:18 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-964479a6-55dd-4042-bfa1-152d60e98a82 tempest-VolumeDependencyTests-1618338243 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3fbd5d1-8a64-43c0-a545-516620c9b5c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:51:18 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-964479a6-55dd-4042-bfa1-152d60e98a82 tempest-VolumeDependencyTests-1618338243 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3fbd5d1-8a64-43c0-a545-516620c9b5c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:51:18 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-964479a6-55dd-4042-bfa1-152d60e98a82 tempest-VolumeDependencyTests-1618338243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cdf90640-7b89-42f5-84d5-a05f4baa4225) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:51:18 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-964479a6-55dd-4042-bfa1-152d60e98a82 tempest-VolumeDependencyTests-1618338243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cdf90640-7b89-42f5-84d5-a05f4baa4225) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa5460fe-3c45-4eaf-98bf-cad81902db55', 'volume_name': 'volume-fa5460fe-3c45-4eaf-98bf-cad81902db55', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:51:18 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-964479a6-55dd-4042-bfa1-152d60e98a82 tempest-VolumeDependencyTests-1618338243 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9789877e-16cf-4e9b-a3a3-e082ed01af3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:51:18 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-964479a6-55dd-4042-bfa1-152d60e98a82 tempest-VolumeDependencyTests-1618338243 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9789877e-16cf-4e9b-a3a3-e082ed01af3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:51:18 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-964479a6-55dd-4042-bfa1-152d60e98a82 tempest-VolumeDependencyTests-1618338243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (169cc7bd-b203-46c2-af7d-e08048aee367) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:51:18 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-964479a6-55dd-4042-bfa1-152d60e98a82 tempest-VolumeDependencyTests-1618338243 None] Volume fa5460fe-3c45-4eaf-98bf-cad81902db55: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa5460fe-3c45-4eaf-98bf-cad81902db55', 'volume_size': 1} Sep 06 06:51:18 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-964479a6-55dd-4042-bfa1-152d60e98a82 tempest-VolumeDependencyTests-1618338243 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:51:18 devstack sudo[106143]: pam_unix(sudo:session): session closed for user root Sep 06 06:51:18 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-2bbe1774-5980-49b0-b262-aa9ac2456fa0 tempest-CreateVolumesFromSnapshotTest-499441882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-494f33c8-6091-4f8c-b766-dca143277075 1073741824" returned: 0 in 0.629s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:51:18 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6a792c8-295e-4dab-b4e4-16428e4110f3 tempest-CreateVolumesFromImageTest-786532930 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87329) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 06:51:18 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-f6a792c8-295e-4dab-b4e4-16428e4110f3 tempest-CreateVolumesFromImageTest-786532930 None] Flow 'volume_create_manager' (9706f339-afb4-4cd4-a81d-fd29071ca7f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:51:18 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-f6a792c8-295e-4dab-b4e4-16428e4110f3 tempest-CreateVolumesFromImageTest-786532930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbf96608-534f-4854-9185-a5bea681dd00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:51:18 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-2bbe1774-5980-49b0-b262-aa9ac2456fa0 tempest-CreateVolumesFromSnapshotTest-499441882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-494f33c8-6091-4f8c-b766-dca143277075 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:51:18 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-f6a792c8-295e-4dab-b4e4-16428e4110f3 tempest-CreateVolumesFromImageTest-786532930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbf96608-534f-4854-9185-a5bea681dd00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:51:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1558752043',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11732edd-d0b0-4922-9408-ee6ad3e01e39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fad9f6ef6e8149fa89e3fc5649d78a78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:51:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:51:19Z,use_quota=True,user_id='c030e05dd0ea4b1a978f441a4ad1c888',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:51:18 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-f6a792c8-295e-4dab-b4e4-16428e4110f3 tempest-CreateVolumesFromImageTest-786532930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4c5a2e3-0540-49b8-aab8-5a31ce939ae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:51:18 devstack sudo[106149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-494f33c8-6091-4f8c-b766-dca143277075 Sep 06 06:51:18 devstack sudo[106149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:51:18 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-f6a792c8-295e-4dab-b4e4-16428e4110f3 tempest-CreateVolumesFromImageTest-786532930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4c5a2e3-0540-49b8-aab8-5a31ce939ae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:51:18 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-f6a792c8-295e-4dab-b4e4-16428e4110f3 tempest-CreateVolumesFromImageTest-786532930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdc19633-d378-41fc-a531-08e818bbc092) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:51:18 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-f6a792c8-295e-4dab-b4e4-16428e4110f3 tempest-CreateVolumesFromImageTest-786532930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdc19633-d378-41fc-a531-08e818bbc092) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11732edd-d0b0-4922-9408-ee6ad3e01e39', 'volume_name': 'volume-11732edd-d0b0-4922-9408-ee6ad3e01e39', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:51:18 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-f6a792c8-295e-4dab-b4e4-16428e4110f3 tempest-CreateVolumesFromImageTest-786532930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fb773ab-2f3d-4e56-a00a-1ac684cb9b13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:51:18 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-f6a792c8-295e-4dab-b4e4-16428e4110f3 tempest-CreateVolumesFromImageTest-786532930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fb773ab-2f3d-4e56-a00a-1ac684cb9b13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:51:18 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-f6a792c8-295e-4dab-b4e4-16428e4110f3 tempest-CreateVolumesFromImageTest-786532930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef575822-f5e8-4b92-b190-867e8af74744) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:51:18 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-f6a792c8-295e-4dab-b4e4-16428e4110f3 tempest-CreateVolumesFromImageTest-786532930 None] Volume 11732edd-d0b0-4922-9408-ee6ad3e01e39: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11732edd-d0b0-4922-9408-ee6ad3e01e39', 'volume_size': 1} Sep 06 06:51:18 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-f6a792c8-295e-4dab-b4e4-16428e4110f3 tempest-CreateVolumesFromImageTest-786532930 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:51:19 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-28548a33-f9c4-42da-a920-706bf2faef60 tempest-CreateVolumesFromImageTest-786532930 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87329) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 06:51:19 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-28548a33-f9c4-42da-a920-706bf2faef60 tempest-CreateVolumesFromImageTest-786532930 None] Flow 'volume_create_manager' (0809fca9-28ef-44b8-a646-276a64beda6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:51:19 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-28548a33-f9c4-42da-a920-706bf2faef60 tempest-CreateVolumesFromImageTest-786532930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9919b723-f8fb-4eb0-bdf4-0f8c3df310f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:51:19 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-28548a33-f9c4-42da-a920-706bf2faef60 tempest-CreateVolumesFromImageTest-786532930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9919b723-f8fb-4eb0-bdf4-0f8c3df310f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:51:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-662131363',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cd1fa30-99fc-4ca1-9288-02d5d6d99d5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fad9f6ef6e8149fa89e3fc5649d78a78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:51:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:51:19Z,use_quota=True,user_id='c030e05dd0ea4b1a978f441a4ad1c888',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:51:19 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-28548a33-f9c4-42da-a920-706bf2faef60 tempest-CreateVolumesFromImageTest-786532930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2896eac5-7c17-41c5-87c2-94aa5b3d4936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:51:19 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-28548a33-f9c4-42da-a920-706bf2faef60 tempest-CreateVolumesFromImageTest-786532930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2896eac5-7c17-41c5-87c2-94aa5b3d4936) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:51:19 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-28548a33-f9c4-42da-a920-706bf2faef60 tempest-CreateVolumesFromImageTest-786532930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfd1292b-ac36-4b76-b863-8995d9426fd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:51:19 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-28548a33-f9c4-42da-a920-706bf2faef60 tempest-CreateVolumesFromImageTest-786532930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfd1292b-ac36-4b76-b863-8995d9426fd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2cd1fa30-99fc-4ca1-9288-02d5d6d99d5e', 'volume_name': 'volume-2cd1fa30-99fc-4ca1-9288-02d5d6d99d5e', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:51:19 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-28548a33-f9c4-42da-a920-706bf2faef60 tempest-CreateVolumesFromImageTest-786532930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (852f0418-45b5-45c3-af22-94f329f95237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:51:19 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-28548a33-f9c4-42da-a920-706bf2faef60 tempest-CreateVolumesFromImageTest-786532930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (852f0418-45b5-45c3-af22-94f329f95237) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:51:19 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-28548a33-f9c4-42da-a920-706bf2faef60 tempest-CreateVolumesFromImageTest-786532930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2018444c-967d-4ad6-ad87-8fb310ab67e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:51:19 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-28548a33-f9c4-42da-a920-706bf2faef60 tempest-CreateVolumesFromImageTest-786532930 None] Volume 2cd1fa30-99fc-4ca1-9288-02d5d6d99d5e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2cd1fa30-99fc-4ca1-9288-02d5d6d99d5e', 'volume_size': 1} Sep 06 06:51:19 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-28548a33-f9c4-42da-a920-706bf2faef60 tempest-CreateVolumesFromImageTest-786532930 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:51:19 devstack sudo[106149]: pam_unix(sudo:session): session closed for user root Sep 06 06:51:19 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-2bbe1774-5980-49b0-b262-aa9ac2456fa0 tempest-CreateVolumesFromSnapshotTest-499441882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-494f33c8-6091-4f8c-b766-dca143277075" returned: 0 in 0.399s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:51:19 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-2bbe1774-5980-49b0-b262-aa9ac2456fa0 tempest-CreateVolumesFromSnapshotTest-499441882 None] <== create_volume: return (1181ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'} {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 06:51:19 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-2bbe1774-5980-49b0-b262-aa9ac2456fa0 tempest-CreateVolumesFromSnapshotTest-499441882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.184s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:51:19 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-964479a6-55dd-4042-bfa1-152d60e98a82 tempest-VolumeDependencyTests-1618338243 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.919s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:51:19 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-964479a6-55dd-4042-bfa1-152d60e98a82 tempest-VolumeDependencyTests-1618338243 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:51:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1375829617',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa5460fe-3c45-4eaf-98bf-cad81902db55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2152e75764254dbb9e0e6eaa9ae4fcbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:51:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:51:18Z,use_quota=True,user_id='d0d4144314c04ff99b54caf53a2e5031',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)}" {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 06:51:19 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-964479a6-55dd-4042-bfa1-152d60e98a82 tempest-VolumeDependencyTests-1618338243 None] Creating volume fa5460fe-3c45-4eaf-98bf-cad81902db55 {{(pid=87329) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 06:51:19 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-964479a6-55dd-4042-bfa1-152d60e98a82 tempest-VolumeDependencyTests-1618338243 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:51:19 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-964479a6-55dd-4042-bfa1-152d60e98a82 tempest-VolumeDependencyTests-1618338243 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:51:19 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-964479a6-55dd-4042-bfa1-152d60e98a82 tempest-VolumeDependencyTests-1618338243 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:51:19 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-964479a6-55dd-4042-bfa1-152d60e98a82 tempest-VolumeDependencyTests-1618338243 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:51:19 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-964479a6-55dd-4042-bfa1-152d60e98a82 tempest-VolumeDependencyTests-1618338243 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:51:19 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-964479a6-55dd-4042-bfa1-152d60e98a82 tempest-VolumeDependencyTests-1618338243 None] Selected osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 as target Quobyte volume. {{(pid=87329) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 06:51:19 devstack cinder-volume[87329]: INFO cinder.volume.drivers.remotefs [None req-964479a6-55dd-4042-bfa1-152d60e98a82 tempest-VolumeDependencyTests-1618338243 None] casted to osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 Sep 06 06:51:19 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-964479a6-55dd-4042-bfa1-152d60e98a82 tempest-VolumeDependencyTests-1618338243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-fa5460fe-3c45-4eaf-98bf-cad81902db55 1073741824 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:51:19 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-2bbe1774-5980-49b0-b262-aa9ac2456fa0 tempest-CreateVolumesFromSnapshotTest-499441882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65631bc1-74ab-46f9-8e43-7cbdf70aede5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-494f33c8-6091-4f8c-b766-dca143277075', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:51:19 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-2bbe1774-5980-49b0-b262-aa9ac2456fa0 tempest-CreateVolumesFromSnapshotTest-499441882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed404f4a-12e5-409b-97dc-04d854fdcb34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:51:19 devstack sudo[106152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-fa5460fe-3c45-4eaf-98bf-cad81902db55 1073741824 Sep 06 06:51:19 devstack sudo[106152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:51:19 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-2bbe1774-5980-49b0-b262-aa9ac2456fa0 tempest-CreateVolumesFromSnapshotTest-499441882 None] Volume volume-494f33c8-6091-4f8c-b766-dca143277075 (494f33c8-6091-4f8c-b766-dca143277075): created successfully Sep 06 06:51:19 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-2bbe1774-5980-49b0-b262-aa9ac2456fa0 tempest-CreateVolumesFromSnapshotTest-499441882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed404f4a-12e5-409b-97dc-04d854fdcb34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:51:19 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-2bbe1774-5980-49b0-b262-aa9ac2456fa0 tempest-CreateVolumesFromSnapshotTest-499441882 None] Flow 'volume_create_manager' (c6e31ebe-df88-4c94-8cd0-9358599cb0ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:51:19 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-2bbe1774-5980-49b0-b262-aa9ac2456fa0 tempest-CreateVolumesFromSnapshotTest-499441882 None] Created volume successfully. Sep 06 06:51:19 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-d56ed4e4-141c-4080-8f73-36eac7ebdf8e tempest-CreateVolumesFromImageTest-786532930 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87329) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 06:51:19 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-d56ed4e4-141c-4080-8f73-36eac7ebdf8e tempest-CreateVolumesFromImageTest-786532930 None] Flow 'volume_create_manager' (e40ecf4b-d60e-4985-93b8-64fb70b34b43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:51:19 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-d56ed4e4-141c-4080-8f73-36eac7ebdf8e tempest-CreateVolumesFromImageTest-786532930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb79ffa0-a148-42e5-abb8-ae347a5a31cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:51:19 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-d56ed4e4-141c-4080-8f73-36eac7ebdf8e tempest-CreateVolumesFromImageTest-786532930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb79ffa0-a148-42e5-abb8-ae347a5a31cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:51:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-504159591',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5c5b18d-99cc-4b56-9b99-f109d46a5eec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fad9f6ef6e8149fa89e3fc5649d78a78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:51:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:51:19Z,use_quota=True,user_id='c030e05dd0ea4b1a978f441a4ad1c888',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:51:19 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-d56ed4e4-141c-4080-8f73-36eac7ebdf8e tempest-CreateVolumesFromImageTest-786532930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc8a0791-5903-4e0a-986a-44869f12ccd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:51:19 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-d56ed4e4-141c-4080-8f73-36eac7ebdf8e tempest-CreateVolumesFromImageTest-786532930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc8a0791-5903-4e0a-986a-44869f12ccd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:51:19 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-d56ed4e4-141c-4080-8f73-36eac7ebdf8e tempest-CreateVolumesFromImageTest-786532930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68c664c2-d538-4929-bd36-65bed06be22d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:51:19 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-d56ed4e4-141c-4080-8f73-36eac7ebdf8e tempest-CreateVolumesFromImageTest-786532930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68c664c2-d538-4929-bd36-65bed06be22d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd5c5b18d-99cc-4b56-9b99-f109d46a5eec', 'volume_name': 'volume-d5c5b18d-99cc-4b56-9b99-f109d46a5eec', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:51:19 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-d56ed4e4-141c-4080-8f73-36eac7ebdf8e tempest-CreateVolumesFromImageTest-786532930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d232a31-1589-4b8b-8b05-313449271a97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:51:19 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-d56ed4e4-141c-4080-8f73-36eac7ebdf8e tempest-CreateVolumesFromImageTest-786532930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d232a31-1589-4b8b-8b05-313449271a97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:51:19 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-d56ed4e4-141c-4080-8f73-36eac7ebdf8e tempest-CreateVolumesFromImageTest-786532930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (700d9a69-0f77-4364-80e0-1c53a4255bfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:51:19 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-d56ed4e4-141c-4080-8f73-36eac7ebdf8e tempest-CreateVolumesFromImageTest-786532930 None] Volume d5c5b18d-99cc-4b56-9b99-f109d46a5eec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d5c5b18d-99cc-4b56-9b99-f109d46a5eec', 'volume_size': 1} Sep 06 06:51:19 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-d56ed4e4-141c-4080-8f73-36eac7ebdf8e tempest-CreateVolumesFromImageTest-786532930 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:51:19 devstack sudo[106152]: pam_unix(sudo:session): session closed for user root Sep 06 06:51:19 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-964479a6-55dd-4042-bfa1-152d60e98a82 tempest-VolumeDependencyTests-1618338243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-fa5460fe-3c45-4eaf-98bf-cad81902db55 1073741824" returned: 0 in 0.520s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:51:19 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-964479a6-55dd-4042-bfa1-152d60e98a82 tempest-VolumeDependencyTests-1618338243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-fa5460fe-3c45-4eaf-98bf-cad81902db55 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:51:19 devstack sudo[106158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-fa5460fe-3c45-4eaf-98bf-cad81902db55 Sep 06 06:51:19 devstack sudo[106158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:51:19 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-11e579c1-3080-40a0-b6ad-986bc1bae30e tempest-CreateVolumesFromImageTest-786532930 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87329) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 06:51:19 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-11e579c1-3080-40a0-b6ad-986bc1bae30e tempest-CreateVolumesFromImageTest-786532930 None] Flow 'volume_create_manager' (22ba3db1-2c7e-4b8e-98d4-8fddf693ec9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:51:20 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-11e579c1-3080-40a0-b6ad-986bc1bae30e tempest-CreateVolumesFromImageTest-786532930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1aa9d284-59c7-4d41-aebb-fb484975d283) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:51:20 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-11e579c1-3080-40a0-b6ad-986bc1bae30e tempest-CreateVolumesFromImageTest-786532930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1aa9d284-59c7-4d41-aebb-fb484975d283) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:51:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1460188440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d675c7c-2290-42a4-8df4-95541821dc5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fad9f6ef6e8149fa89e3fc5649d78a78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:51:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:51:20Z,use_quota=True,user_id='c030e05dd0ea4b1a978f441a4ad1c888',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:51:20 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-11e579c1-3080-40a0-b6ad-986bc1bae30e tempest-CreateVolumesFromImageTest-786532930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18e907f5-0792-472d-9be1-787e78549f72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:51:20 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-11e579c1-3080-40a0-b6ad-986bc1bae30e tempest-CreateVolumesFromImageTest-786532930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18e907f5-0792-472d-9be1-787e78549f72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:51:20 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-11e579c1-3080-40a0-b6ad-986bc1bae30e tempest-CreateVolumesFromImageTest-786532930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9533a027-c44b-453b-a825-357add007a74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:51:20 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-11e579c1-3080-40a0-b6ad-986bc1bae30e tempest-CreateVolumesFromImageTest-786532930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9533a027-c44b-453b-a825-357add007a74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d675c7c-2290-42a4-8df4-95541821dc5c', 'volume_name': 'volume-4d675c7c-2290-42a4-8df4-95541821dc5c', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:51:20 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-11e579c1-3080-40a0-b6ad-986bc1bae30e tempest-CreateVolumesFromImageTest-786532930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb0b8b1a-1248-4a2e-8593-ea5bfd16fbe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:51:20 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-11e579c1-3080-40a0-b6ad-986bc1bae30e tempest-CreateVolumesFromImageTest-786532930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb0b8b1a-1248-4a2e-8593-ea5bfd16fbe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:51:20 devstack sudo[106158]: pam_unix(sudo:session): session closed for user root Sep 06 06:51:20 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-11e579c1-3080-40a0-b6ad-986bc1bae30e tempest-CreateVolumesFromImageTest-786532930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2fa69ab-02ca-4325-b389-dbca055eec5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:51:20 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-11e579c1-3080-40a0-b6ad-986bc1bae30e tempest-CreateVolumesFromImageTest-786532930 None] Volume 4d675c7c-2290-42a4-8df4-95541821dc5c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d675c7c-2290-42a4-8df4-95541821dc5c', 'volume_size': 1} Sep 06 06:51:20 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-11e579c1-3080-40a0-b6ad-986bc1bae30e tempest-CreateVolumesFromImageTest-786532930 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:51:20 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-964479a6-55dd-4042-bfa1-152d60e98a82 tempest-VolumeDependencyTests-1618338243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-fa5460fe-3c45-4eaf-98bf-cad81902db55" returned: 0 in 0.400s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:51:20 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-964479a6-55dd-4042-bfa1-152d60e98a82 tempest-VolumeDependencyTests-1618338243 None] <== create_volume: return (972ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'} {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 06:51:20 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-964479a6-55dd-4042-bfa1-152d60e98a82 tempest-VolumeDependencyTests-1618338243 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.975s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:51:20 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-f6a792c8-295e-4dab-b4e4-16428e4110f3 tempest-CreateVolumesFromImageTest-786532930 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.258s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:51:20 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-f6a792c8-295e-4dab-b4e4-16428e4110f3 tempest-CreateVolumesFromImageTest-786532930 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:51:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1558752043',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11732edd-d0b0-4922-9408-ee6ad3e01e39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fad9f6ef6e8149fa89e3fc5649d78a78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:51:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:51:19Z,use_quota=True,user_id='c030e05dd0ea4b1a978f441a4ad1c888',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)}" {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 06:51:20 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-f6a792c8-295e-4dab-b4e4-16428e4110f3 tempest-CreateVolumesFromImageTest-786532930 None] Creating volume 11732edd-d0b0-4922-9408-ee6ad3e01e39 {{(pid=87329) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 06:51:20 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-f6a792c8-295e-4dab-b4e4-16428e4110f3 tempest-CreateVolumesFromImageTest-786532930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:51:20 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-f6a792c8-295e-4dab-b4e4-16428e4110f3 tempest-CreateVolumesFromImageTest-786532930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:51:20 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-f6a792c8-295e-4dab-b4e4-16428e4110f3 tempest-CreateVolumesFromImageTest-786532930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:51:20 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-f6a792c8-295e-4dab-b4e4-16428e4110f3 tempest-CreateVolumesFromImageTest-786532930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:51:20 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-f6a792c8-295e-4dab-b4e4-16428e4110f3 tempest-CreateVolumesFromImageTest-786532930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:51:20 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-f6a792c8-295e-4dab-b4e4-16428e4110f3 tempest-CreateVolumesFromImageTest-786532930 None] Selected osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 as target Quobyte volume. {{(pid=87329) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 06:51:20 devstack cinder-volume[87329]: INFO cinder.volume.drivers.remotefs [None req-f6a792c8-295e-4dab-b4e4-16428e4110f3 tempest-CreateVolumesFromImageTest-786532930 None] casted to osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 Sep 06 06:51:20 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-f6a792c8-295e-4dab-b4e4-16428e4110f3 tempest-CreateVolumesFromImageTest-786532930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-11732edd-d0b0-4922-9408-ee6ad3e01e39 1073741824 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:51:20 devstack sudo[106162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-11732edd-d0b0-4922-9408-ee6ad3e01e39 1073741824 Sep 06 06:51:20 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-964479a6-55dd-4042-bfa1-152d60e98a82 tempest-VolumeDependencyTests-1618338243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (169cc7bd-b203-46c2-af7d-e08048aee367) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa5460fe-3c45-4eaf-98bf-cad81902db55', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:51:20 devstack sudo[106162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:51:20 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-964479a6-55dd-4042-bfa1-152d60e98a82 tempest-VolumeDependencyTests-1618338243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a39ab5a6-8fb1-4323-9086-96d541203068) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:51:20 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-964479a6-55dd-4042-bfa1-152d60e98a82 tempest-VolumeDependencyTests-1618338243 None] Volume volume-fa5460fe-3c45-4eaf-98bf-cad81902db55 (fa5460fe-3c45-4eaf-98bf-cad81902db55): created successfully Sep 06 06:51:20 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-964479a6-55dd-4042-bfa1-152d60e98a82 tempest-VolumeDependencyTests-1618338243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a39ab5a6-8fb1-4323-9086-96d541203068) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:51:20 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-964479a6-55dd-4042-bfa1-152d60e98a82 tempest-VolumeDependencyTests-1618338243 None] Flow 'volume_create_manager' (b0a8b8dd-e267-4809-b396-c6a657d6f410) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:51:20 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-964479a6-55dd-4042-bfa1-152d60e98a82 tempest-VolumeDependencyTests-1618338243 None] Created volume successfully. Sep 06 06:51:20 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-b6aecaf4-c5cb-49d6-8aee-1d8565784387 tempest-CreateVolumesFromSnapshotTest-499441882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:51:20 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9228f5a-dcde-4a77-b876-25ce7640f6cf tempest-CreateVolumesFromImageTest-786532930 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87329) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 06:51:20 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-e9228f5a-dcde-4a77-b876-25ce7640f6cf tempest-CreateVolumesFromImageTest-786532930 None] Flow 'volume_create_manager' (60f492d1-adab-492d-942e-4046cf3d40d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:51:20 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-e9228f5a-dcde-4a77-b876-25ce7640f6cf tempest-CreateVolumesFromImageTest-786532930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8439afae-7993-4d40-a055-5cac9d017c90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:51:20 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-e9228f5a-dcde-4a77-b876-25ce7640f6cf tempest-CreateVolumesFromImageTest-786532930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8439afae-7993-4d40-a055-5cac9d017c90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:51:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1017567264',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a70773ae-8706-4726-901c-551e2675dff0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fad9f6ef6e8149fa89e3fc5649d78a78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:51:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:51:20Z,use_quota=True,user_id='c030e05dd0ea4b1a978f441a4ad1c888',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:51:20 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-e9228f5a-dcde-4a77-b876-25ce7640f6cf tempest-CreateVolumesFromImageTest-786532930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (654995c6-29e9-4fbc-bbe5-36e91271260b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:51:20 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-e9228f5a-dcde-4a77-b876-25ce7640f6cf tempest-CreateVolumesFromImageTest-786532930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (654995c6-29e9-4fbc-bbe5-36e91271260b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:51:20 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-e9228f5a-dcde-4a77-b876-25ce7640f6cf tempest-CreateVolumesFromImageTest-786532930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22b4cf71-115c-4c59-add2-2ea4abfb822f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:51:20 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-e9228f5a-dcde-4a77-b876-25ce7640f6cf tempest-CreateVolumesFromImageTest-786532930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22b4cf71-115c-4c59-add2-2ea4abfb822f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a70773ae-8706-4726-901c-551e2675dff0', 'volume_name': 'volume-a70773ae-8706-4726-901c-551e2675dff0', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:51:20 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-e9228f5a-dcde-4a77-b876-25ce7640f6cf tempest-CreateVolumesFromImageTest-786532930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18edfd7f-f15f-4a8c-a9f3-3340cc13d68d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:51:20 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-e9228f5a-dcde-4a77-b876-25ce7640f6cf tempest-CreateVolumesFromImageTest-786532930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18edfd7f-f15f-4a8c-a9f3-3340cc13d68d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:51:20 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-e9228f5a-dcde-4a77-b876-25ce7640f6cf tempest-CreateVolumesFromImageTest-786532930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cef2c81-6a37-4731-bfe5-4252484f3a85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:51:20 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-e9228f5a-dcde-4a77-b876-25ce7640f6cf tempest-CreateVolumesFromImageTest-786532930 None] Volume a70773ae-8706-4726-901c-551e2675dff0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a70773ae-8706-4726-901c-551e2675dff0', 'volume_size': 1} Sep 06 06:51:20 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-e9228f5a-dcde-4a77-b876-25ce7640f6cf tempest-CreateVolumesFromImageTest-786532930 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:51:20 devstack sudo[106162]: pam_unix(sudo:session): session closed for user root Sep 06 06:51:20 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-f6a792c8-295e-4dab-b4e4-16428e4110f3 tempest-CreateVolumesFromImageTest-786532930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-11732edd-d0b0-4922-9408-ee6ad3e01e39 1073741824" returned: 0 in 0.505s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:51:20 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-f6a792c8-295e-4dab-b4e4-16428e4110f3 tempest-CreateVolumesFromImageTest-786532930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-11732edd-d0b0-4922-9408-ee6ad3e01e39 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:51:20 devstack sudo[106168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-11732edd-d0b0-4922-9408-ee6ad3e01e39 Sep 06 06:51:20 devstack sudo[106168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:51:20 devstack sudo[106168]: pam_unix(sudo:session): session closed for user root Sep 06 06:51:20 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-f6a792c8-295e-4dab-b4e4-16428e4110f3 tempest-CreateVolumesFromImageTest-786532930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-11732edd-d0b0-4922-9408-ee6ad3e01e39" returned: 0 in 0.262s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:51:20 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-f6a792c8-295e-4dab-b4e4-16428e4110f3 tempest-CreateVolumesFromImageTest-786532930 None] <== create_volume: return (820ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'} {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 06:51:20 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-f6a792c8-295e-4dab-b4e4-16428e4110f3 tempest-CreateVolumesFromImageTest-786532930 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.825s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:51:20 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-28548a33-f9c4-42da-a920-706bf2faef60 tempest-CreateVolumesFromImageTest-786532930 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.876s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:51:20 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-28548a33-f9c4-42da-a920-706bf2faef60 tempest-CreateVolumesFromImageTest-786532930 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:51:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-662131363',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cd1fa30-99fc-4ca1-9288-02d5d6d99d5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fad9f6ef6e8149fa89e3fc5649d78a78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:51:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:51:19Z,use_quota=True,user_id='c030e05dd0ea4b1a978f441a4ad1c888',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)}" {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 06:51:20 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-28548a33-f9c4-42da-a920-706bf2faef60 tempest-CreateVolumesFromImageTest-786532930 None] Creating volume 2cd1fa30-99fc-4ca1-9288-02d5d6d99d5e {{(pid=87329) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 06:51:20 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-28548a33-f9c4-42da-a920-706bf2faef60 tempest-CreateVolumesFromImageTest-786532930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:51:20 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-28548a33-f9c4-42da-a920-706bf2faef60 tempest-CreateVolumesFromImageTest-786532930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:51:20 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-28548a33-f9c4-42da-a920-706bf2faef60 tempest-CreateVolumesFromImageTest-786532930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:51:21 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-28548a33-f9c4-42da-a920-706bf2faef60 tempest-CreateVolumesFromImageTest-786532930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:51:21 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-28548a33-f9c4-42da-a920-706bf2faef60 tempest-CreateVolumesFromImageTest-786532930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:51:21 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-28548a33-f9c4-42da-a920-706bf2faef60 tempest-CreateVolumesFromImageTest-786532930 None] Selected osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 as target Quobyte volume. {{(pid=87329) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 06:51:21 devstack cinder-volume[87329]: INFO cinder.volume.drivers.remotefs [None req-28548a33-f9c4-42da-a920-706bf2faef60 tempest-CreateVolumesFromImageTest-786532930 None] casted to osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 Sep 06 06:51:21 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-28548a33-f9c4-42da-a920-706bf2faef60 tempest-CreateVolumesFromImageTest-786532930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-2cd1fa30-99fc-4ca1-9288-02d5d6d99d5e 1073741824 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:51:21 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-f6a792c8-295e-4dab-b4e4-16428e4110f3 tempest-CreateVolumesFromImageTest-786532930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef575822-f5e8-4b92-b190-867e8af74744) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11732edd-d0b0-4922-9408-ee6ad3e01e39', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:51:21 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-f6a792c8-295e-4dab-b4e4-16428e4110f3 tempest-CreateVolumesFromImageTest-786532930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45434e1f-cbcd-425f-8f0a-82df5680cf0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:51:21 devstack sudo[106171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-2cd1fa30-99fc-4ca1-9288-02d5d6d99d5e 1073741824 Sep 06 06:51:21 devstack sudo[106171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:51:21 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-f6a792c8-295e-4dab-b4e4-16428e4110f3 tempest-CreateVolumesFromImageTest-786532930 None] Volume volume-11732edd-d0b0-4922-9408-ee6ad3e01e39 (11732edd-d0b0-4922-9408-ee6ad3e01e39): created successfully Sep 06 06:51:21 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-f6a792c8-295e-4dab-b4e4-16428e4110f3 tempest-CreateVolumesFromImageTest-786532930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45434e1f-cbcd-425f-8f0a-82df5680cf0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:51:21 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-f6a792c8-295e-4dab-b4e4-16428e4110f3 tempest-CreateVolumesFromImageTest-786532930 None] Flow 'volume_create_manager' (9706f339-afb4-4cd4-a81d-fd29071ca7f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:51:21 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-f6a792c8-295e-4dab-b4e4-16428e4110f3 tempest-CreateVolumesFromImageTest-786532930 None] Created volume successfully. Sep 06 06:51:21 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-1020fc57-e3eb-4462-bc36-b0ac7e087a9e tempest-VolumeDependencyTests-1618338243 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:51:21 devstack sudo[106171]: pam_unix(sudo:session): session closed for user root Sep 06 06:51:21 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-28548a33-f9c4-42da-a920-706bf2faef60 tempest-CreateVolumesFromImageTest-786532930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-2cd1fa30-99fc-4ca1-9288-02d5d6d99d5e 1073741824" returned: 0 in 0.512s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:51:21 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-28548a33-f9c4-42da-a920-706bf2faef60 tempest-CreateVolumesFromImageTest-786532930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-2cd1fa30-99fc-4ca1-9288-02d5d6d99d5e {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:51:21 devstack sudo[106177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-2cd1fa30-99fc-4ca1-9288-02d5d6d99d5e Sep 06 06:51:21 devstack sudo[106177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:51:21 devstack sudo[106177]: pam_unix(sudo:session): session closed for user root Sep 06 06:51:21 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-28548a33-f9c4-42da-a920-706bf2faef60 tempest-CreateVolumesFromImageTest-786532930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-2cd1fa30-99fc-4ca1-9288-02d5d6d99d5e" returned: 0 in 0.245s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:51:21 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-28548a33-f9c4-42da-a920-706bf2faef60 tempest-CreateVolumesFromImageTest-786532930 None] <== create_volume: return (801ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'} {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 06:51:21 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-28548a33-f9c4-42da-a920-706bf2faef60 tempest-CreateVolumesFromImageTest-786532930 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.803s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:51:21 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-d56ed4e4-141c-4080-8f73-36eac7ebdf8e tempest-CreateVolumesFromImageTest-786532930 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.217s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:51:21 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-d56ed4e4-141c-4080-8f73-36eac7ebdf8e tempest-CreateVolumesFromImageTest-786532930 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:51:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-504159591',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5c5b18d-99cc-4b56-9b99-f109d46a5eec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fad9f6ef6e8149fa89e3fc5649d78a78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:51:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:51:19Z,use_quota=True,user_id='c030e05dd0ea4b1a978f441a4ad1c888',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)}" {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 06:51:21 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-d56ed4e4-141c-4080-8f73-36eac7ebdf8e tempest-CreateVolumesFromImageTest-786532930 None] Creating volume d5c5b18d-99cc-4b56-9b99-f109d46a5eec {{(pid=87329) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 06:51:21 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-d56ed4e4-141c-4080-8f73-36eac7ebdf8e tempest-CreateVolumesFromImageTest-786532930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:51:21 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-d56ed4e4-141c-4080-8f73-36eac7ebdf8e tempest-CreateVolumesFromImageTest-786532930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:51:21 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-d56ed4e4-141c-4080-8f73-36eac7ebdf8e tempest-CreateVolumesFromImageTest-786532930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:51:21 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-d56ed4e4-141c-4080-8f73-36eac7ebdf8e tempest-CreateVolumesFromImageTest-786532930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:51:21 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-d56ed4e4-141c-4080-8f73-36eac7ebdf8e tempest-CreateVolumesFromImageTest-786532930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:51:21 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-d56ed4e4-141c-4080-8f73-36eac7ebdf8e tempest-CreateVolumesFromImageTest-786532930 None] Selected osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 as target Quobyte volume. {{(pid=87329) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 06:51:21 devstack cinder-volume[87329]: INFO cinder.volume.drivers.remotefs [None req-d56ed4e4-141c-4080-8f73-36eac7ebdf8e tempest-CreateVolumesFromImageTest-786532930 None] casted to osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 Sep 06 06:51:21 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-d56ed4e4-141c-4080-8f73-36eac7ebdf8e tempest-CreateVolumesFromImageTest-786532930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-d5c5b18d-99cc-4b56-9b99-f109d46a5eec 1073741824 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:51:21 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-28548a33-f9c4-42da-a920-706bf2faef60 tempest-CreateVolumesFromImageTest-786532930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2018444c-967d-4ad6-ad87-8fb310ab67e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2cd1fa30-99fc-4ca1-9288-02d5d6d99d5e', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:51:21 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-28548a33-f9c4-42da-a920-706bf2faef60 tempest-CreateVolumesFromImageTest-786532930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f3d3284-fdbe-4921-aecd-ab19822c5ffb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:51:21 devstack sudo[106180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-d5c5b18d-99cc-4b56-9b99-f109d46a5eec 1073741824 Sep 06 06:51:21 devstack sudo[106180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:51:21 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-28548a33-f9c4-42da-a920-706bf2faef60 tempest-CreateVolumesFromImageTest-786532930 None] Volume volume-2cd1fa30-99fc-4ca1-9288-02d5d6d99d5e (2cd1fa30-99fc-4ca1-9288-02d5d6d99d5e): created successfully Sep 06 06:51:21 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-28548a33-f9c4-42da-a920-706bf2faef60 tempest-CreateVolumesFromImageTest-786532930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f3d3284-fdbe-4921-aecd-ab19822c5ffb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:51:21 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-28548a33-f9c4-42da-a920-706bf2faef60 tempest-CreateVolumesFromImageTest-786532930 None] Flow 'volume_create_manager' (0809fca9-28ef-44b8-a646-276a64beda6d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:51:21 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-28548a33-f9c4-42da-a920-706bf2faef60 tempest-CreateVolumesFromImageTest-786532930 None] Created volume successfully. Sep 06 06:51:22 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b05a556-fde0-4cc9-9acc-aefbf52d54df tempest-VolumeAndVolumeTypeFromImageTest-1507622826 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87329) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 06:51:22 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-1b05a556-fde0-4cc9-9acc-aefbf52d54df tempest-VolumeAndVolumeTypeFromImageTest-1507622826 None] Flow 'volume_create_manager' (82592174-56a7-4a2f-b621-27942f44e61c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:51:22 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-1b05a556-fde0-4cc9-9acc-aefbf52d54df tempest-VolumeAndVolumeTypeFromImageTest-1507622826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bef5e6a2-b5a5-40c2-b7f5-387ed55e7e80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:51:22 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-1b05a556-fde0-4cc9-9acc-aefbf52d54df tempest-VolumeAndVolumeTypeFromImageTest-1507622826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bef5e6a2-b5a5-40c2-b7f5-387ed55e7e80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:51:22Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffd0e062-6ba3-47ea-9a0f-d7d8406d273f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4b75cec633343eabc4bb5d5836ccd1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:51:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:51:22Z,use_quota=True,user_id='713da993514c4f329dc56b30d22a157b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99fd5ec1-f9b8-4bab-ba16-7fb72f320b10),volume_type_id=99fd5ec1-f9b8-4bab-ba16-7fb72f320b10)' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:51:22 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-1b05a556-fde0-4cc9-9acc-aefbf52d54df tempest-VolumeAndVolumeTypeFromImageTest-1507622826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ee79f1d-b2eb-44e3-bce2-47349602ecc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:51:22 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-1b05a556-fde0-4cc9-9acc-aefbf52d54df tempest-VolumeAndVolumeTypeFromImageTest-1507622826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ee79f1d-b2eb-44e3-bce2-47349602ecc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:51:22 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-1b05a556-fde0-4cc9-9acc-aefbf52d54df tempest-VolumeAndVolumeTypeFromImageTest-1507622826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4003ead7-52e9-4622-91d2-6eac632f0652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:51:22 devstack cinder-volume[87329]: DEBUG cinder.image.glance [None req-1b05a556-fde0-4cc9-9acc-aefbf52d54df tempest-VolumeAndVolumeTypeFromImageTest-1507622826 None] Creating Keystone auth plugin from conf {{(pid=87329) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 06 06:51:22 devstack sudo[106180]: pam_unix(sudo:session): session closed for user root Sep 06 06:51:22 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-d56ed4e4-141c-4080-8f73-36eac7ebdf8e tempest-CreateVolumesFromImageTest-786532930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-d5c5b18d-99cc-4b56-9b99-f109d46a5eec 1073741824" returned: 0 in 0.450s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:51:22 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-d56ed4e4-141c-4080-8f73-36eac7ebdf8e tempest-CreateVolumesFromImageTest-786532930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-d5c5b18d-99cc-4b56-9b99-f109d46a5eec {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:51:22 devstack sudo[106186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-d5c5b18d-99cc-4b56-9b99-f109d46a5eec Sep 06 06:51:22 devstack sudo[106186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:51:22 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-1b05a556-fde0-4cc9-9acc-aefbf52d54df tempest-VolumeAndVolumeTypeFromImageTest-1507622826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4003ead7-52e9-4622-91d2-6eac632f0652) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ffd0e062-6ba3-47ea-9a0f-d7d8406d273f', 'volume_name': 'volume-ffd0e062-6ba3-47ea-9a0f-d7d8406d273f', 'volume_size': 1, 'image_id': '1255f0f5-40a6-485b-9604-068ac8269d65', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1255f0f5-40a6-485b-9604-068ac8269d65', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '771a7bf12ad20cf3a1cd6c990461d19e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f4b75cec633343eabc4bb5d5836ccd1d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e855f9ae3fd13e9caaa65572a58abfc7b1ad119a7b9ce1f1b05aafd76545699c8b8dadd55d8978d01e1febd80ef217f2ac7e106189a3ec0d42929030cc66d3c7', 'id': '1255f0f5-40a6-485b-9604-068ac8269d65', 'created_at': datetime.datetime(2026, 9, 6, 4, 51, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 6, 4, 51, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1255f0f5-40a6-485b-9604-068ac8269d65/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:51:22 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-1b05a556-fde0-4cc9-9acc-aefbf52d54df tempest-VolumeAndVolumeTypeFromImageTest-1507622826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82765230-5053-4fea-bd1b-7a82d5a0b4a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:51:22 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-1b05a556-fde0-4cc9-9acc-aefbf52d54df tempest-VolumeAndVolumeTypeFromImageTest-1507622826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82765230-5053-4fea-bd1b-7a82d5a0b4a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:51:22 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-1b05a556-fde0-4cc9-9acc-aefbf52d54df tempest-VolumeAndVolumeTypeFromImageTest-1507622826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78b9e48d-ce73-4772-81ea-a59861da1040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:51:22 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-1b05a556-fde0-4cc9-9acc-aefbf52d54df tempest-VolumeAndVolumeTypeFromImageTest-1507622826 None] Volume ffd0e062-6ba3-47ea-9a0f-d7d8406d273f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ffd0e062-6ba3-47ea-9a0f-d7d8406d273f', 'volume_size': 1, 'image_id': '1255f0f5-40a6-485b-9604-068ac8269d65', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1255f0f5-40a6-485b-9604-068ac8269d65', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '771a7bf12ad20cf3a1cd6c990461d19e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f4b75cec633343eabc4bb5d5836ccd1d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e855f9ae3fd13e9caaa65572a58abfc7b1ad119a7b9ce1f1b05aafd76545699c8b8dadd55d8978d01e1febd80ef217f2ac7e106189a3ec0d42929030cc66d3c7', 'id': '1255f0f5-40a6-485b-9604-068ac8269d65', 'created_at': datetime.datetime(2026, 9, 6, 4, 51, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 6, 4, 51, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1255f0f5-40a6-485b-9604-068ac8269d65/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 06 06:51:22 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b05a556-fde0-4cc9-9acc-aefbf52d54df tempest-VolumeAndVolumeTypeFromImageTest-1507622826 None] Trying to clone ffd0e062-6ba3-47ea-9a0f-d7d8406d273f from image 1255f0f5-40a6-485b-9604-068ac8269d65 at location (None, [{'url': 'file:///opt/stack/data/glance/images/1255f0f5-40a6-485b-9604-068ac8269d65', 'metadata': {}}]). {{(pid=87329) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 06 06:51:22 devstack cinder-volume[87329]: DEBUG cinder.image.image_utils [None req-1b05a556-fde0-4cc9-9acc-aefbf52d54df tempest-VolumeAndVolumeTypeFromImageTest-1507622826 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1255f0f5-40a6-485b-9604-068ac8269d65_f_huronydevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87329) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 06 06:51:22 devstack cinder-volume[87329]: INFO cinder.image.image_utils [None req-1b05a556-fde0-4cc9-9acc-aefbf52d54df tempest-VolumeAndVolumeTypeFromImageTest-1507622826 None] Image download 0.00 MB at 0.00 MB/s Sep 06 06:51:22 devstack sudo[106186]: pam_unix(sudo:session): session closed for user root Sep 06 06:51:22 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-d56ed4e4-141c-4080-8f73-36eac7ebdf8e tempest-CreateVolumesFromImageTest-786532930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-d5c5b18d-99cc-4b56-9b99-f109d46a5eec" returned: 0 in 0.257s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:51:22 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-d56ed4e4-141c-4080-8f73-36eac7ebdf8e tempest-CreateVolumesFromImageTest-786532930 None] <== create_volume: return (746ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'} {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 06:51:22 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-d56ed4e4-141c-4080-8f73-36eac7ebdf8e tempest-CreateVolumesFromImageTest-786532930 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.749s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:51:22 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-11e579c1-3080-40a0-b6ad-986bc1bae30e tempest-CreateVolumesFromImageTest-786532930 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.447s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:51:22 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-11e579c1-3080-40a0-b6ad-986bc1bae30e tempest-CreateVolumesFromImageTest-786532930 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:51:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1460188440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d675c7c-2290-42a4-8df4-95541821dc5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fad9f6ef6e8149fa89e3fc5649d78a78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:51:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:51:20Z,use_quota=True,user_id='c030e05dd0ea4b1a978f441a4ad1c888',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)}" {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 06:51:22 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-11e579c1-3080-40a0-b6ad-986bc1bae30e tempest-CreateVolumesFromImageTest-786532930 None] Creating volume 4d675c7c-2290-42a4-8df4-95541821dc5c {{(pid=87329) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 06:51:22 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-11e579c1-3080-40a0-b6ad-986bc1bae30e tempest-CreateVolumesFromImageTest-786532930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:51:22 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-11e579c1-3080-40a0-b6ad-986bc1bae30e tempest-CreateVolumesFromImageTest-786532930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:51:22 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-11e579c1-3080-40a0-b6ad-986bc1bae30e tempest-CreateVolumesFromImageTest-786532930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:51:22 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-11e579c1-3080-40a0-b6ad-986bc1bae30e tempest-CreateVolumesFromImageTest-786532930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:51:22 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-11e579c1-3080-40a0-b6ad-986bc1bae30e tempest-CreateVolumesFromImageTest-786532930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:51:22 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-11e579c1-3080-40a0-b6ad-986bc1bae30e tempest-CreateVolumesFromImageTest-786532930 None] Selected osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 as target Quobyte volume. {{(pid=87329) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 06:51:22 devstack cinder-volume[87329]: INFO cinder.volume.drivers.remotefs [None req-11e579c1-3080-40a0-b6ad-986bc1bae30e tempest-CreateVolumesFromImageTest-786532930 None] casted to osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 Sep 06 06:51:22 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-11e579c1-3080-40a0-b6ad-986bc1bae30e tempest-CreateVolumesFromImageTest-786532930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-4d675c7c-2290-42a4-8df4-95541821dc5c 1073741824 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:51:22 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[46e126a5-9fbb-4597-ba7d-07a10411b7df]: (4, 'raw') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:51:22 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-1b05a556-fde0-4cc9-9acc-aefbf52d54df tempest-VolumeAndVolumeTypeFromImageTest-1507622826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1255f0f5-40a6-485b-9604-068ac8269d65_f_huronydevstack@QuobyteHD {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:51:22 devstack sudo[106189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-4d675c7c-2290-42a4-8df4-95541821dc5c 1073741824 Sep 06 06:51:22 devstack sudo[106189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:51:22 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-d56ed4e4-141c-4080-8f73-36eac7ebdf8e tempest-CreateVolumesFromImageTest-786532930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (700d9a69-0f77-4364-80e0-1c53a4255bfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5c5b18d-99cc-4b56-9b99-f109d46a5eec', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:51:22 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-d56ed4e4-141c-4080-8f73-36eac7ebdf8e tempest-CreateVolumesFromImageTest-786532930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4104d8c2-0fb2-4cca-9983-1a25d93c7d2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:51:22 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-d56ed4e4-141c-4080-8f73-36eac7ebdf8e tempest-CreateVolumesFromImageTest-786532930 None] Volume volume-d5c5b18d-99cc-4b56-9b99-f109d46a5eec (d5c5b18d-99cc-4b56-9b99-f109d46a5eec): created successfully Sep 06 06:51:22 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-d56ed4e4-141c-4080-8f73-36eac7ebdf8e tempest-CreateVolumesFromImageTest-786532930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4104d8c2-0fb2-4cca-9983-1a25d93c7d2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:51:22 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-d56ed4e4-141c-4080-8f73-36eac7ebdf8e tempest-CreateVolumesFromImageTest-786532930 None] Flow 'volume_create_manager' (e40ecf4b-d60e-4985-93b8-64fb70b34b43) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:51:22 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-d56ed4e4-141c-4080-8f73-36eac7ebdf8e tempest-CreateVolumesFromImageTest-786532930 None] Created volume successfully. Sep 06 06:51:22 devstack sudo[106191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1255f0f5-40a6-485b-9604-068ac8269d65_f_huronydevstack@QuobyteHD Sep 06 06:51:22 devstack sudo[106191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:51:22 devstack sudo[106191]: pam_unix(sudo:session): session closed for user root Sep 06 06:51:22 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-1b05a556-fde0-4cc9-9acc-aefbf52d54df tempest-VolumeAndVolumeTypeFromImageTest-1507622826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1255f0f5-40a6-485b-9604-068ac8269d65_f_huronydevstack@QuobyteHD" returned: 0 in 0.346s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:51:22 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-1b05a556-fde0-4cc9-9acc-aefbf52d54df tempest-VolumeAndVolumeTypeFromImageTest-1507622826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1255f0f5-40a6-485b-9604-068ac8269d65_f_huronydevstack@QuobyteHD {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:51:22 devstack sudo[106189]: pam_unix(sudo:session): session closed for user root Sep 06 06:51:22 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-11e579c1-3080-40a0-b6ad-986bc1bae30e tempest-CreateVolumesFromImageTest-786532930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-4d675c7c-2290-42a4-8df4-95541821dc5c 1073741824" returned: 0 in 0.428s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:51:23 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-11e579c1-3080-40a0-b6ad-986bc1bae30e tempest-CreateVolumesFromImageTest-786532930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-4d675c7c-2290-42a4-8df4-95541821dc5c {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:51:23 devstack sudo[106200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-4d675c7c-2290-42a4-8df4-95541821dc5c Sep 06 06:51:23 devstack sudo[106200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:51:23 devstack sudo[106198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1255f0f5-40a6-485b-9604-068ac8269d65_f_huronydevstack@QuobyteHD Sep 06 06:51:23 devstack sudo[106198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:51:23 devstack sudo[106198]: pam_unix(sudo:session): session closed for user root Sep 06 06:51:23 devstack sudo[106200]: pam_unix(sudo:session): session closed for user root Sep 06 06:51:23 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-1b05a556-fde0-4cc9-9acc-aefbf52d54df tempest-VolumeAndVolumeTypeFromImageTest-1507622826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1255f0f5-40a6-485b-9604-068ac8269d65_f_huronydevstack@QuobyteHD" returned: 1 in 0.354s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:51:23 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-1b05a556-fde0-4cc9-9acc-aefbf52d54df tempest-VolumeAndVolumeTypeFromImageTest-1507622826 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1255f0f5-40a6-485b-9604-068ac8269d65_f_huronydevstack@QuobyteHD' failed. Not Retrying. {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 06 06:51:23 devstack cinder-volume[87329]: DEBUG cinder.image.image_utils [None req-1b05a556-fde0-4cc9-9acc-aefbf52d54df tempest-VolumeAndVolumeTypeFromImageTest-1507622826 None] Temporary image 1255f0f5-40a6-485b-9604-068ac8269d65 is fetched for user 713da993514c4f329dc56b30d22a157b. {{(pid=87329) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 06 06:51:23 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-11e579c1-3080-40a0-b6ad-986bc1bae30e tempest-CreateVolumesFromImageTest-786532930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-4d675c7c-2290-42a4-8df4-95541821dc5c" returned: 0 in 0.261s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:51:23 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-11e579c1-3080-40a0-b6ad-986bc1bae30e tempest-CreateVolumesFromImageTest-786532930 None] <== create_volume: return (740ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'} {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 06:51:23 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-11e579c1-3080-40a0-b6ad-986bc1bae30e tempest-CreateVolumesFromImageTest-786532930 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.744s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:51:23 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-b6aecaf4-c5cb-49d6-8aee-1d8565784387 tempest-CreateVolumesFromSnapshotTest-499441882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.874s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:51:23 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-11e579c1-3080-40a0-b6ad-986bc1bae30e tempest-CreateVolumesFromImageTest-786532930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2fa69ab-02ca-4325-b389-dbca055eec5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d675c7c-2290-42a4-8df4-95541821dc5c', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:51:23 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-11e579c1-3080-40a0-b6ad-986bc1bae30e tempest-CreateVolumesFromImageTest-786532930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b368fc5c-9e14-4bcd-9500-75b01f852cea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:51:23 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-b6aecaf4-c5cb-49d6-8aee-1d8565784387 tempest-CreateVolumesFromSnapshotTest-499441882 None] Creating offline snapshot efceaee3-00a9-47fd-8c9e-979338f93da5 of volume 494f33c8-6091-4f8c-b766-dca143277075 {{(pid=87329) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 06 06:51:23 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-11e579c1-3080-40a0-b6ad-986bc1bae30e tempest-CreateVolumesFromImageTest-786532930 None] Volume volume-4d675c7c-2290-42a4-8df4-95541821dc5c (4d675c7c-2290-42a4-8df4-95541821dc5c): created successfully Sep 06 06:51:23 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-11e579c1-3080-40a0-b6ad-986bc1bae30e tempest-CreateVolumesFromImageTest-786532930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b368fc5c-9e14-4bcd-9500-75b01f852cea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:51:23 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-11e579c1-3080-40a0-b6ad-986bc1bae30e tempest-CreateVolumesFromImageTest-786532930 None] Flow 'volume_create_manager' (22ba3db1-2c7e-4b8e-98d4-8fddf693ec9c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:51:23 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[04e78790-19fd-47cb-a63e-aa2f26c1725a]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:51:23 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-b6aecaf4-c5cb-49d6-8aee-1d8565784387 tempest-CreateVolumesFromSnapshotTest-499441882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-494f33c8-6091-4f8c-b766-dca143277075 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:51:23 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-11e579c1-3080-40a0-b6ad-986bc1bae30e tempest-CreateVolumesFromImageTest-786532930 None] Created volume successfully. Sep 06 06:51:23 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0ced4bd-251e-4f0b-a361-86b96b796442]: (4, 'raw') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:51:23 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-1b05a556-fde0-4cc9-9acc-aefbf52d54df tempest-VolumeAndVolumeTypeFromImageTest-1507622826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1255f0f5-40a6-485b-9604-068ac8269d65_f_huronydevstack@QuobyteHD {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:51:23 devstack sudo[106207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-494f33c8-6091-4f8c-b766-dca143277075 Sep 06 06:51:23 devstack sudo[106207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:51:23 devstack sudo[106208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1255f0f5-40a6-485b-9604-068ac8269d65_f_huronydevstack@QuobyteHD Sep 06 06:51:23 devstack sudo[106208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:51:23 devstack sudo[106207]: pam_unix(sudo:session): session closed for user root Sep 06 06:51:23 devstack sudo[106208]: pam_unix(sudo:session): session closed for user root Sep 06 06:51:23 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-b6aecaf4-c5cb-49d6-8aee-1d8565784387 tempest-CreateVolumesFromSnapshotTest-499441882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-494f33c8-6091-4f8c-b766-dca143277075" returned: 0 in 0.371s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:51:23 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-b6aecaf4-c5cb-49d6-8aee-1d8565784387 tempest-CreateVolumesFromSnapshotTest-499441882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-494f33c8-6091-4f8c-b766-dca143277075,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-494f33c8-6091-4f8c-b766-dca143277075.efceaee3-00a9-47fd-8c9e-979338f93da5 1G {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:51:23 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-1b05a556-fde0-4cc9-9acc-aefbf52d54df tempest-VolumeAndVolumeTypeFromImageTest-1507622826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1255f0f5-40a6-485b-9604-068ac8269d65_f_huronydevstack@QuobyteHD" returned: 0 in 0.349s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:51:23 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-1b05a556-fde0-4cc9-9acc-aefbf52d54df tempest-VolumeAndVolumeTypeFromImageTest-1507622826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1255f0f5-40a6-485b-9604-068ac8269d65_f_huronydevstack@QuobyteHD {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:51:23 devstack sudo[106216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-494f33c8-6091-4f8c-b766-dca143277075,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-494f33c8-6091-4f8c-b766-dca143277075.efceaee3-00a9-47fd-8c9e-979338f93da5 1G Sep 06 06:51:23 devstack sudo[106216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:51:23 devstack sudo[106217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1255f0f5-40a6-485b-9604-068ac8269d65_f_huronydevstack@QuobyteHD Sep 06 06:51:23 devstack sudo[106217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:51:24 devstack sudo[106217]: pam_unix(sudo:session): session closed for user root Sep 06 06:51:24 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-1b05a556-fde0-4cc9-9acc-aefbf52d54df tempest-VolumeAndVolumeTypeFromImageTest-1507622826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1255f0f5-40a6-485b-9604-068ac8269d65_f_huronydevstack@QuobyteHD" returned: 1 in 0.338s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:51:24 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-1b05a556-fde0-4cc9-9acc-aefbf52d54df tempest-VolumeAndVolumeTypeFromImageTest-1507622826 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1255f0f5-40a6-485b-9604-068ac8269d65_f_huronydevstack@QuobyteHD' failed. Not Retrying. {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 06 06:51:24 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-1b05a556-fde0-4cc9-9acc-aefbf52d54df tempest-VolumeAndVolumeTypeFromImageTest-1507622826 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:51:24 devstack sudo[106216]: pam_unix(sudo:session): session closed for user root Sep 06 06:51:24 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-b6aecaf4-c5cb-49d6-8aee-1d8565784387 tempest-CreateVolumesFromSnapshotTest-499441882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-494f33c8-6091-4f8c-b766-dca143277075,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-494f33c8-6091-4f8c-b766-dca143277075.efceaee3-00a9-47fd-8c9e-979338f93da5 1G" returned: 0 in 0.397s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:51:24 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-b6aecaf4-c5cb-49d6-8aee-1d8565784387 tempest-CreateVolumesFromSnapshotTest-499441882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-494f33c8-6091-4f8c-b766-dca143277075 -F qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-494f33c8-6091-4f8c-b766-dca143277075.efceaee3-00a9-47fd-8c9e-979338f93da5 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:51:24 devstack sudo[106226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-494f33c8-6091-4f8c-b766-dca143277075 -F qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-494f33c8-6091-4f8c-b766-dca143277075.efceaee3-00a9-47fd-8c9e-979338f93da5 Sep 06 06:51:24 devstack sudo[106226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:51:24 devstack sudo[106226]: pam_unix(sudo:session): session closed for user root Sep 06 06:51:24 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-b6aecaf4-c5cb-49d6-8aee-1d8565784387 tempest-CreateVolumesFromSnapshotTest-499441882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-494f33c8-6091-4f8c-b766-dca143277075 -F qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-494f33c8-6091-4f8c-b766-dca143277075.efceaee3-00a9-47fd-8c9e-979338f93da5" returned: 0 in 0.281s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:51:24 devstack cinder-volume[87329]: WARNING cinder.volume.drivers.remotefs [None req-b6aecaf4-c5cb-49d6-8aee-1d8565784387 tempest-CreateVolumesFromSnapshotTest-499441882 None] /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-494f33c8-6091-4f8c-b766-dca143277075.efceaee3-00a9-47fd-8c9e-979338f93da5 is being set with open permissions: ugo+rw Sep 06 06:51:24 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-b6aecaf4-c5cb-49d6-8aee-1d8565784387 tempest-CreateVolumesFromSnapshotTest-499441882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-494f33c8-6091-4f8c-b766-dca143277075.efceaee3-00a9-47fd-8c9e-979338f93da5 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:51:24 devstack sudo[106231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-494f33c8-6091-4f8c-b766-dca143277075.efceaee3-00a9-47fd-8c9e-979338f93da5 Sep 06 06:51:24 devstack sudo[106231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:51:24 devstack sudo[106231]: pam_unix(sudo:session): session closed for user root Sep 06 06:51:24 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-b6aecaf4-c5cb-49d6-8aee-1d8565784387 tempest-CreateVolumesFromSnapshotTest-499441882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-494f33c8-6091-4f8c-b766-dca143277075.efceaee3-00a9-47fd-8c9e-979338f93da5" returned: 0 in 0.239s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:51:24 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-b6aecaf4-c5cb-49d6-8aee-1d8565784387 tempest-CreateVolumesFromSnapshotTest-499441882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-494f33c8-6091-4f8c-b766-dca143277075.info {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:51:24 devstack sudo[106234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-494f33c8-6091-4f8c-b766-dca143277075.info Sep 06 06:51:24 devstack sudo[106234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:51:24 devstack sudo[106234]: pam_unix(sudo:session): session closed for user root Sep 06 06:51:24 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-b6aecaf4-c5cb-49d6-8aee-1d8565784387 tempest-CreateVolumesFromSnapshotTest-499441882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-494f33c8-6091-4f8c-b766-dca143277075.info" returned: 0 in 0.235s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:51:24 devstack cinder-volume[87329]: WARNING cinder.volume.drivers.remotefs [None req-b6aecaf4-c5cb-49d6-8aee-1d8565784387 tempest-CreateVolumesFromSnapshotTest-499441882 None] /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-494f33c8-6091-4f8c-b766-dca143277075.info is being set with open permissions: ugo+rw Sep 06 06:51:24 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-b6aecaf4-c5cb-49d6-8aee-1d8565784387 tempest-CreateVolumesFromSnapshotTest-499441882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-494f33c8-6091-4f8c-b766-dca143277075.info {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:51:24 devstack sudo[106237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-494f33c8-6091-4f8c-b766-dca143277075.info Sep 06 06:51:24 devstack sudo[106237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:51:25 devstack sudo[106237]: pam_unix(sudo:session): session closed for user root Sep 06 06:51:25 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-b6aecaf4-c5cb-49d6-8aee-1d8565784387 tempest-CreateVolumesFromSnapshotTest-499441882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-494f33c8-6091-4f8c-b766-dca143277075.info" returned: 0 in 0.237s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:51:25 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-b6aecaf4-c5cb-49d6-8aee-1d8565784387 tempest-CreateVolumesFromSnapshotTest-499441882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.875s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:51:25 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-e9228f5a-dcde-4a77-b876-25ce7640f6cf tempest-CreateVolumesFromImageTest-786532930 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.648s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:51:25 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-e9228f5a-dcde-4a77-b876-25ce7640f6cf tempest-CreateVolumesFromImageTest-786532930 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:51:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1017567264',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a70773ae-8706-4726-901c-551e2675dff0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fad9f6ef6e8149fa89e3fc5649d78a78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:51:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:51:20Z,use_quota=True,user_id='c030e05dd0ea4b1a978f441a4ad1c888',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)}" {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 06:51:25 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-e9228f5a-dcde-4a77-b876-25ce7640f6cf tempest-CreateVolumesFromImageTest-786532930 None] Creating volume a70773ae-8706-4726-901c-551e2675dff0 {{(pid=87329) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 06:51:25 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-e9228f5a-dcde-4a77-b876-25ce7640f6cf tempest-CreateVolumesFromImageTest-786532930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:51:25 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-e9228f5a-dcde-4a77-b876-25ce7640f6cf tempest-CreateVolumesFromImageTest-786532930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:51:25 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-e9228f5a-dcde-4a77-b876-25ce7640f6cf tempest-CreateVolumesFromImageTest-786532930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:51:25 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-e9228f5a-dcde-4a77-b876-25ce7640f6cf tempest-CreateVolumesFromImageTest-786532930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:51:25 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-e9228f5a-dcde-4a77-b876-25ce7640f6cf tempest-CreateVolumesFromImageTest-786532930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:51:25 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-e9228f5a-dcde-4a77-b876-25ce7640f6cf tempest-CreateVolumesFromImageTest-786532930 None] Selected osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 as target Quobyte volume. {{(pid=87329) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 06:51:25 devstack cinder-volume[87329]: INFO cinder.volume.drivers.remotefs [None req-e9228f5a-dcde-4a77-b876-25ce7640f6cf tempest-CreateVolumesFromImageTest-786532930 None] casted to osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 Sep 06 06:51:25 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-e9228f5a-dcde-4a77-b876-25ce7640f6cf tempest-CreateVolumesFromImageTest-786532930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-a70773ae-8706-4726-901c-551e2675dff0 1073741824 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:51:25 devstack sudo[106240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-a70773ae-8706-4726-901c-551e2675dff0 1073741824 Sep 06 06:51:25 devstack sudo[106240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:51:25 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-b6aecaf4-c5cb-49d6-8aee-1d8565784387 tempest-CreateVolumesFromSnapshotTest-499441882 None] Create snapshot completed successfully Sep 06 06:51:25 devstack sudo[106240]: pam_unix(sudo:session): session closed for user root Sep 06 06:51:25 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-e9228f5a-dcde-4a77-b876-25ce7640f6cf tempest-CreateVolumesFromImageTest-786532930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-a70773ae-8706-4726-901c-551e2675dff0 1073741824" returned: 0 in 0.396s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:51:25 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-e9228f5a-dcde-4a77-b876-25ce7640f6cf tempest-CreateVolumesFromImageTest-786532930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-a70773ae-8706-4726-901c-551e2675dff0 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:51:25 devstack sudo[106246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-a70773ae-8706-4726-901c-551e2675dff0 Sep 06 06:51:25 devstack sudo[106246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:51:25 devstack sudo[106246]: pam_unix(sudo:session): session closed for user root Sep 06 06:51:25 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-e9228f5a-dcde-4a77-b876-25ce7640f6cf tempest-CreateVolumesFromImageTest-786532930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-a70773ae-8706-4726-901c-551e2675dff0" returned: 0 in 0.273s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:51:25 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-e9228f5a-dcde-4a77-b876-25ce7640f6cf tempest-CreateVolumesFromImageTest-786532930 None] <== create_volume: return (713ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'} {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 06:51:25 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-e9228f5a-dcde-4a77-b876-25ce7640f6cf tempest-CreateVolumesFromImageTest-786532930 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.717s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:51:25 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-1020fc57-e3eb-4462-bc36-b0ac7e087a9e tempest-VolumeDependencyTests-1618338243 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.615s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:51:25 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-e9228f5a-dcde-4a77-b876-25ce7640f6cf tempest-CreateVolumesFromImageTest-786532930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cef2c81-6a37-4731-bfe5-4252484f3a85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a70773ae-8706-4726-901c-551e2675dff0', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:51:25 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-e9228f5a-dcde-4a77-b876-25ce7640f6cf tempest-CreateVolumesFromImageTest-786532930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e9bd720-aef4-4fa3-996d-b1472660befe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:51:25 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-1020fc57-e3eb-4462-bc36-b0ac7e087a9e tempest-VolumeDependencyTests-1618338243 None] Creating offline snapshot 32c09ec4-10a8-4e63-8cc2-93be13c0aeac of volume fa5460fe-3c45-4eaf-98bf-cad81902db55 {{(pid=87329) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 06 06:51:25 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[273dd92e-6a10-40e3-ae4e-3bec11fdd922]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:51:25 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-1020fc57-e3eb-4462-bc36-b0ac7e087a9e tempest-VolumeDependencyTests-1618338243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-fa5460fe-3c45-4eaf-98bf-cad81902db55 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:51:25 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-a48ab1a1-1bb4-4db8-9c4e-c542c5834a9a tempest-CreateVolumesFromSnapshotTest-499441882 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87329) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 06:51:26 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-a48ab1a1-1bb4-4db8-9c4e-c542c5834a9a tempest-CreateVolumesFromSnapshotTest-499441882 None] Flow 'volume_create_manager' (987c3d0e-5df8-4835-b85d-f44740d7f63d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:51:26 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-a48ab1a1-1bb4-4db8-9c4e-c542c5834a9a tempest-CreateVolumesFromSnapshotTest-499441882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a931d72-3d2b-425d-9655-559293cd1e5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:51:26 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-e9228f5a-dcde-4a77-b876-25ce7640f6cf tempest-CreateVolumesFromImageTest-786532930 None] Volume volume-a70773ae-8706-4726-901c-551e2675dff0 (a70773ae-8706-4726-901c-551e2675dff0): created successfully Sep 06 06:51:26 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-e9228f5a-dcde-4a77-b876-25ce7640f6cf tempest-CreateVolumesFromImageTest-786532930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e9bd720-aef4-4fa3-996d-b1472660befe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:51:26 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-e9228f5a-dcde-4a77-b876-25ce7640f6cf tempest-CreateVolumesFromImageTest-786532930 None] Flow 'volume_create_manager' (60f492d1-adab-492d-942e-4046cf3d40d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:51:26 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-a48ab1a1-1bb4-4db8-9c4e-c542c5834a9a tempest-CreateVolumesFromSnapshotTest-499441882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a931d72-3d2b-425d-9655-559293cd1e5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:51:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1238134130',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=202822af-3551-4789-a3d9-ac6b8e38416a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2de6bc06e3f64a14896af2f97faf9f4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:51:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:51:26Z,use_quota=True,user_id='980ea4c91fca44ea8cff75dd4148f201',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:51:26 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-a48ab1a1-1bb4-4db8-9c4e-c542c5834a9a tempest-CreateVolumesFromSnapshotTest-499441882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b9cac4b-8d4a-4c1e-927e-be3a829c93c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:51:26 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-a48ab1a1-1bb4-4db8-9c4e-c542c5834a9a tempest-CreateVolumesFromSnapshotTest-499441882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b9cac4b-8d4a-4c1e-927e-be3a829c93c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:51:26 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-a48ab1a1-1bb4-4db8-9c4e-c542c5834a9a tempest-CreateVolumesFromSnapshotTest-499441882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a5dcc19-56bf-4785-aa55-2ecc9a905cdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:51:26 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-a48ab1a1-1bb4-4db8-9c4e-c542c5834a9a tempest-CreateVolumesFromSnapshotTest-499441882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a5dcc19-56bf-4785-aa55-2ecc9a905cdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '202822af-3551-4789-a3d9-ac6b8e38416a', 'volume_name': 'volume-202822af-3551-4789-a3d9-ac6b8e38416a', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:51:26 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-a48ab1a1-1bb4-4db8-9c4e-c542c5834a9a tempest-CreateVolumesFromSnapshotTest-499441882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1018d398-ac25-4681-9182-73d7ceb4c5a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:51:26 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-a48ab1a1-1bb4-4db8-9c4e-c542c5834a9a tempest-CreateVolumesFromSnapshotTest-499441882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1018d398-ac25-4681-9182-73d7ceb4c5a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:51:26 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-a48ab1a1-1bb4-4db8-9c4e-c542c5834a9a tempest-CreateVolumesFromSnapshotTest-499441882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b3e091b-4a47-45bd-9d68-bc631663b0f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:51:26 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-a48ab1a1-1bb4-4db8-9c4e-c542c5834a9a tempest-CreateVolumesFromSnapshotTest-499441882 None] Volume 202822af-3551-4789-a3d9-ac6b8e38416a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-202822af-3551-4789-a3d9-ac6b8e38416a', 'volume_size': 1} Sep 06 06:51:26 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-a48ab1a1-1bb4-4db8-9c4e-c542c5834a9a tempest-CreateVolumesFromSnapshotTest-499441882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:51:26 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-e9228f5a-dcde-4a77-b876-25ce7640f6cf tempest-CreateVolumesFromImageTest-786532930 None] Created volume successfully. Sep 06 06:51:26 devstack sudo[106249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-fa5460fe-3c45-4eaf-98bf-cad81902db55 Sep 06 06:51:26 devstack sudo[106249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:51:26 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4612a04-f46c-4d02-a562-4a0d365512cc tempest-CreateVolumesFromSnapshotTest-499441882 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87329) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 06:51:26 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-c4612a04-f46c-4d02-a562-4a0d365512cc tempest-CreateVolumesFromSnapshotTest-499441882 None] Flow 'volume_create_manager' (54c7c6e4-f1c1-43fa-a3bc-e182724afae6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:51:26 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-c4612a04-f46c-4d02-a562-4a0d365512cc tempest-CreateVolumesFromSnapshotTest-499441882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (048c7042-4f70-4e35-bcf6-9bbd6ff1782f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:51:26 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-c4612a04-f46c-4d02-a562-4a0d365512cc tempest-CreateVolumesFromSnapshotTest-499441882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (048c7042-4f70-4e35-bcf6-9bbd6ff1782f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:51:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-28049190',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e55bcb32-3a06-4e03-adef-30f86de1793b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2de6bc06e3f64a14896af2f97faf9f4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:51:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:51:26Z,use_quota=True,user_id='980ea4c91fca44ea8cff75dd4148f201',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:51:26 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-c4612a04-f46c-4d02-a562-4a0d365512cc tempest-CreateVolumesFromSnapshotTest-499441882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a34d538f-47fd-48a9-a6c4-2f96d3cd876c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:51:26 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-c4612a04-f46c-4d02-a562-4a0d365512cc tempest-CreateVolumesFromSnapshotTest-499441882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a34d538f-47fd-48a9-a6c4-2f96d3cd876c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:51:26 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-c4612a04-f46c-4d02-a562-4a0d365512cc tempest-CreateVolumesFromSnapshotTest-499441882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (442e50a3-0858-4900-86d3-fec7399324f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:51:26 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-c4612a04-f46c-4d02-a562-4a0d365512cc tempest-CreateVolumesFromSnapshotTest-499441882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (442e50a3-0858-4900-86d3-fec7399324f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e55bcb32-3a06-4e03-adef-30f86de1793b', 'volume_name': 'volume-e55bcb32-3a06-4e03-adef-30f86de1793b', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:51:26 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-c4612a04-f46c-4d02-a562-4a0d365512cc tempest-CreateVolumesFromSnapshotTest-499441882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9c13a3c-3ca0-422f-9910-e2b2af7bbbfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:51:26 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-c4612a04-f46c-4d02-a562-4a0d365512cc tempest-CreateVolumesFromSnapshotTest-499441882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9c13a3c-3ca0-422f-9910-e2b2af7bbbfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:51:26 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-c4612a04-f46c-4d02-a562-4a0d365512cc tempest-CreateVolumesFromSnapshotTest-499441882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e458cb98-fa10-46d4-b673-9b3b21992bda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:51:26 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-c4612a04-f46c-4d02-a562-4a0d365512cc tempest-CreateVolumesFromSnapshotTest-499441882 None] Volume e55bcb32-3a06-4e03-adef-30f86de1793b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e55bcb32-3a06-4e03-adef-30f86de1793b', 'volume_size': 1} Sep 06 06:51:26 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-c4612a04-f46c-4d02-a562-4a0d365512cc tempest-CreateVolumesFromSnapshotTest-499441882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:51:26 devstack sudo[106249]: pam_unix(sudo:session): session closed for user root Sep 06 06:51:26 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-1020fc57-e3eb-4462-bc36-b0ac7e087a9e tempest-VolumeDependencyTests-1618338243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-fa5460fe-3c45-4eaf-98bf-cad81902db55" returned: 0 in 0.426s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:51:26 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-1020fc57-e3eb-4462-bc36-b0ac7e087a9e tempest-VolumeDependencyTests-1618338243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-fa5460fe-3c45-4eaf-98bf-cad81902db55,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-fa5460fe-3c45-4eaf-98bf-cad81902db55.32c09ec4-10a8-4e63-8cc2-93be13c0aeac 1G {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:51:26 devstack sudo[106254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-fa5460fe-3c45-4eaf-98bf-cad81902db55,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-fa5460fe-3c45-4eaf-98bf-cad81902db55.32c09ec4-10a8-4e63-8cc2-93be13c0aeac 1G Sep 06 06:51:26 devstack sudo[106254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:51:26 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-48999078-cacf-4dde-8f7e-4cf340f87c1c tempest-CreateVolumesFromSnapshotTest-499441882 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87329) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 06:51:26 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-48999078-cacf-4dde-8f7e-4cf340f87c1c tempest-CreateVolumesFromSnapshotTest-499441882 None] Flow 'volume_create_manager' (a0d623f5-362b-44d2-ba49-333a17779809) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:51:26 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-48999078-cacf-4dde-8f7e-4cf340f87c1c tempest-CreateVolumesFromSnapshotTest-499441882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d30de87b-4f60-4f4c-9668-20313db744e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:51:26 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-48999078-cacf-4dde-8f7e-4cf340f87c1c tempest-CreateVolumesFromSnapshotTest-499441882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d30de87b-4f60-4f4c-9668-20313db744e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:51:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1687605050',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=510c6730-6a62-4a12-b6af-4699e5bdfb9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2de6bc06e3f64a14896af2f97faf9f4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:51:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:51:27Z,use_quota=True,user_id='980ea4c91fca44ea8cff75dd4148f201',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:51:26 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-48999078-cacf-4dde-8f7e-4cf340f87c1c tempest-CreateVolumesFromSnapshotTest-499441882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f89adf10-3cb4-43a3-9df9-94f322286317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:51:26 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-48999078-cacf-4dde-8f7e-4cf340f87c1c tempest-CreateVolumesFromSnapshotTest-499441882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f89adf10-3cb4-43a3-9df9-94f322286317) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:51:26 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-48999078-cacf-4dde-8f7e-4cf340f87c1c tempest-CreateVolumesFromSnapshotTest-499441882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a9b6541-4303-4125-b807-56f14d9cf5a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:51:26 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-48999078-cacf-4dde-8f7e-4cf340f87c1c tempest-CreateVolumesFromSnapshotTest-499441882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a9b6541-4303-4125-b807-56f14d9cf5a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '510c6730-6a62-4a12-b6af-4699e5bdfb9e', 'volume_name': 'volume-510c6730-6a62-4a12-b6af-4699e5bdfb9e', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:51:26 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-48999078-cacf-4dde-8f7e-4cf340f87c1c tempest-CreateVolumesFromSnapshotTest-499441882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (722f01ce-db35-47e2-8419-f96594746b11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:51:26 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-48999078-cacf-4dde-8f7e-4cf340f87c1c tempest-CreateVolumesFromSnapshotTest-499441882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (722f01ce-db35-47e2-8419-f96594746b11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:51:26 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-48999078-cacf-4dde-8f7e-4cf340f87c1c tempest-CreateVolumesFromSnapshotTest-499441882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03945d8c-3002-487d-bfce-ad4276720b9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:51:26 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-48999078-cacf-4dde-8f7e-4cf340f87c1c tempest-CreateVolumesFromSnapshotTest-499441882 None] Volume 510c6730-6a62-4a12-b6af-4699e5bdfb9e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-510c6730-6a62-4a12-b6af-4699e5bdfb9e', 'volume_size': 1} Sep 06 06:51:26 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-48999078-cacf-4dde-8f7e-4cf340f87c1c tempest-CreateVolumesFromSnapshotTest-499441882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:51:26 devstack sudo[106254]: pam_unix(sudo:session): session closed for user root Sep 06 06:51:26 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-1020fc57-e3eb-4462-bc36-b0ac7e087a9e tempest-VolumeDependencyTests-1618338243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-fa5460fe-3c45-4eaf-98bf-cad81902db55,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-fa5460fe-3c45-4eaf-98bf-cad81902db55.32c09ec4-10a8-4e63-8cc2-93be13c0aeac 1G" returned: 0 in 0.471s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:51:26 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-1020fc57-e3eb-4462-bc36-b0ac7e087a9e tempest-VolumeDependencyTests-1618338243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa5460fe-3c45-4eaf-98bf-cad81902db55 -F qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-fa5460fe-3c45-4eaf-98bf-cad81902db55.32c09ec4-10a8-4e63-8cc2-93be13c0aeac {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:51:26 devstack sudo[106260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa5460fe-3c45-4eaf-98bf-cad81902db55 -F qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-fa5460fe-3c45-4eaf-98bf-cad81902db55.32c09ec4-10a8-4e63-8cc2-93be13c0aeac Sep 06 06:51:26 devstack sudo[106260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:51:26 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-7d2c273a-e889-463f-84ed-6941216bee3a tempest-CreateVolumesFromImageTest-786532930 None] Acquiring lock "cinder-a70773ae-8706-4726-901c-551e2675dff0-delete_volume" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:51:26 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-7d2c273a-e889-463f-84ed-6941216bee3a tempest-CreateVolumesFromImageTest-786532930 None] Lock "cinder-a70773ae-8706-4726-901c-551e2675dff0-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:51:27 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-7d2c273a-e889-463f-84ed-6941216bee3a tempest-CreateVolumesFromImageTest-786532930 None] Acquiring lock "cinder-quobyte-a70773ae-8706-4726-901c-551e2675dff0" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:51:27 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-706cb5c4-b9a7-4efd-afe6-95c81c6c09e3 tempest-CreateVolumesFromSnapshotTest-499441882 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87329) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 06:51:27 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-706cb5c4-b9a7-4efd-afe6-95c81c6c09e3 tempest-CreateVolumesFromSnapshotTest-499441882 None] Flow 'volume_create_manager' (20236ee4-681f-45e3-a0f6-68ac95d48479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:51:27 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-706cb5c4-b9a7-4efd-afe6-95c81c6c09e3 tempest-CreateVolumesFromSnapshotTest-499441882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9712cd26-b67d-49f4-bf5d-abd98786051c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:51:27 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-7d2c273a-e889-463f-84ed-6941216bee3a tempest-CreateVolumesFromImageTest-786532930 None] Lock "cinder-quobyte-a70773ae-8706-4726-901c-551e2675dff0" acquired by "delete_volume" :: waited 0.052s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:51:27 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-706cb5c4-b9a7-4efd-afe6-95c81c6c09e3 tempest-CreateVolumesFromSnapshotTest-499441882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9712cd26-b67d-49f4-bf5d-abd98786051c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:51:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-505788924',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4eae1be3-f28d-4929-9c94-9939377f9f4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2de6bc06e3f64a14896af2f97faf9f4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:51:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:51:27Z,use_quota=True,user_id='980ea4c91fca44ea8cff75dd4148f201',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:51:27 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-706cb5c4-b9a7-4efd-afe6-95c81c6c09e3 tempest-CreateVolumesFromSnapshotTest-499441882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75054a20-1938-4b22-8a75-439efd6d7a69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:51:27 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-706cb5c4-b9a7-4efd-afe6-95c81c6c09e3 tempest-CreateVolumesFromSnapshotTest-499441882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75054a20-1938-4b22-8a75-439efd6d7a69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:51:27 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-706cb5c4-b9a7-4efd-afe6-95c81c6c09e3 tempest-CreateVolumesFromSnapshotTest-499441882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fabfba63-83b5-4de1-8e9f-b5d619732cc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:51:27 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-706cb5c4-b9a7-4efd-afe6-95c81c6c09e3 tempest-CreateVolumesFromSnapshotTest-499441882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fabfba63-83b5-4de1-8e9f-b5d619732cc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4eae1be3-f28d-4929-9c94-9939377f9f4f', 'volume_name': 'volume-4eae1be3-f28d-4929-9c94-9939377f9f4f', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:51:27 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-706cb5c4-b9a7-4efd-afe6-95c81c6c09e3 tempest-CreateVolumesFromSnapshotTest-499441882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a09ab2dc-a5cc-4e0d-9cab-8fc4590d5cf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:51:27 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-706cb5c4-b9a7-4efd-afe6-95c81c6c09e3 tempest-CreateVolumesFromSnapshotTest-499441882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a09ab2dc-a5cc-4e0d-9cab-8fc4590d5cf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:51:27 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-706cb5c4-b9a7-4efd-afe6-95c81c6c09e3 tempest-CreateVolumesFromSnapshotTest-499441882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94c219d6-62bb-4989-b4dc-a8a692457f32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:51:27 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-706cb5c4-b9a7-4efd-afe6-95c81c6c09e3 tempest-CreateVolumesFromSnapshotTest-499441882 None] Volume 4eae1be3-f28d-4929-9c94-9939377f9f4f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4eae1be3-f28d-4929-9c94-9939377f9f4f', 'volume_size': 1} Sep 06 06:51:27 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-706cb5c4-b9a7-4efd-afe6-95c81c6c09e3 tempest-CreateVolumesFromSnapshotTest-499441882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:51:27 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ec6e999-0843-4396-9575-402f115bba51]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:51:27 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-7d2c273a-e889-463f-84ed-6941216bee3a tempest-CreateVolumesFromImageTest-786532930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-a70773ae-8706-4726-901c-551e2675dff0 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:51:27 devstack sudo[106260]: pam_unix(sudo:session): session closed for user root Sep 06 06:51:27 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-1020fc57-e3eb-4462-bc36-b0ac7e087a9e tempest-VolumeDependencyTests-1618338243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa5460fe-3c45-4eaf-98bf-cad81902db55 -F qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-fa5460fe-3c45-4eaf-98bf-cad81902db55.32c09ec4-10a8-4e63-8cc2-93be13c0aeac" returned: 0 in 0.390s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:51:27 devstack cinder-volume[87329]: WARNING cinder.volume.drivers.remotefs [None req-1020fc57-e3eb-4462-bc36-b0ac7e087a9e tempest-VolumeDependencyTests-1618338243 None] /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-fa5460fe-3c45-4eaf-98bf-cad81902db55.32c09ec4-10a8-4e63-8cc2-93be13c0aeac is being set with open permissions: ugo+rw Sep 06 06:51:27 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-1020fc57-e3eb-4462-bc36-b0ac7e087a9e tempest-VolumeDependencyTests-1618338243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-fa5460fe-3c45-4eaf-98bf-cad81902db55.32c09ec4-10a8-4e63-8cc2-93be13c0aeac {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:51:27 devstack sudo[106266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-fa5460fe-3c45-4eaf-98bf-cad81902db55.32c09ec4-10a8-4e63-8cc2-93be13c0aeac Sep 06 06:51:27 devstack sudo[106266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:51:27 devstack sudo[106263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-a70773ae-8706-4726-901c-551e2675dff0 Sep 06 06:51:27 devstack sudo[106263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:51:27 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-f38b6033-4540-4bc9-bbf3-972a6e0b83c4 tempest-CreateVolumesFromSnapshotTest-499441882 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87329) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 06:51:27 devstack sudo[106266]: pam_unix(sudo:session): session closed for user root Sep 06 06:51:27 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-f38b6033-4540-4bc9-bbf3-972a6e0b83c4 tempest-CreateVolumesFromSnapshotTest-499441882 None] Flow 'volume_create_manager' (1641193f-fa27-4cfb-9dd5-2812a38c9411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:51:27 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-f38b6033-4540-4bc9-bbf3-972a6e0b83c4 tempest-CreateVolumesFromSnapshotTest-499441882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4bdcdfe-76c0-459e-9625-54d13320ce15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:51:27 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-1020fc57-e3eb-4462-bc36-b0ac7e087a9e tempest-VolumeDependencyTests-1618338243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-fa5460fe-3c45-4eaf-98bf-cad81902db55.32c09ec4-10a8-4e63-8cc2-93be13c0aeac" returned: 0 in 0.265s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:51:27 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-f38b6033-4540-4bc9-bbf3-972a6e0b83c4 tempest-CreateVolumesFromSnapshotTest-499441882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4bdcdfe-76c0-459e-9625-54d13320ce15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:51:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-330448649',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9e47d17-a989-4b52-a194-af981168b071,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2de6bc06e3f64a14896af2f97faf9f4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:51:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:51:27Z,use_quota=True,user_id='980ea4c91fca44ea8cff75dd4148f201',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:51:27 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-f38b6033-4540-4bc9-bbf3-972a6e0b83c4 tempest-CreateVolumesFromSnapshotTest-499441882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20a42198-c93a-4f82-9a5a-1e49996bb349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:51:27 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-f38b6033-4540-4bc9-bbf3-972a6e0b83c4 tempest-CreateVolumesFromSnapshotTest-499441882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20a42198-c93a-4f82-9a5a-1e49996bb349) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:51:27 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-f38b6033-4540-4bc9-bbf3-972a6e0b83c4 tempest-CreateVolumesFromSnapshotTest-499441882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94742484-00c2-4514-94aa-3574d1dcc8f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:51:27 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-f38b6033-4540-4bc9-bbf3-972a6e0b83c4 tempest-CreateVolumesFromSnapshotTest-499441882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94742484-00c2-4514-94aa-3574d1dcc8f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9e47d17-a989-4b52-a194-af981168b071', 'volume_name': 'volume-a9e47d17-a989-4b52-a194-af981168b071', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:51:27 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-f38b6033-4540-4bc9-bbf3-972a6e0b83c4 tempest-CreateVolumesFromSnapshotTest-499441882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21ee7457-e6b7-4cfb-bcab-93a6d98bf334) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:51:27 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-f38b6033-4540-4bc9-bbf3-972a6e0b83c4 tempest-CreateVolumesFromSnapshotTest-499441882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21ee7457-e6b7-4cfb-bcab-93a6d98bf334) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:51:27 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-f38b6033-4540-4bc9-bbf3-972a6e0b83c4 tempest-CreateVolumesFromSnapshotTest-499441882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56ce8f59-7c89-47a7-a8fc-ac494be6e89e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:51:27 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-f38b6033-4540-4bc9-bbf3-972a6e0b83c4 tempest-CreateVolumesFromSnapshotTest-499441882 None] Volume a9e47d17-a989-4b52-a194-af981168b071: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9e47d17-a989-4b52-a194-af981168b071', 'volume_size': 1} Sep 06 06:51:27 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-f38b6033-4540-4bc9-bbf3-972a6e0b83c4 tempest-CreateVolumesFromSnapshotTest-499441882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:51:27 devstack sudo[106263]: pam_unix(sudo:session): session closed for user root Sep 06 06:51:27 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-7d2c273a-e889-463f-84ed-6941216bee3a tempest-CreateVolumesFromImageTest-786532930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-a70773ae-8706-4726-901c-551e2675dff0" returned: 0 in 0.434s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:51:27 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-7d2c273a-e889-463f-84ed-6941216bee3a tempest-CreateVolumesFromImageTest-786532930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-a70773ae-8706-4726-901c-551e2675dff0 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:51:27 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-1020fc57-e3eb-4462-bc36-b0ac7e087a9e tempest-VolumeDependencyTests-1618338243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-fa5460fe-3c45-4eaf-98bf-cad81902db55.info {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:51:27 devstack sudo[106273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-a70773ae-8706-4726-901c-551e2675dff0 Sep 06 06:51:27 devstack sudo[106273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:51:27 devstack sudo[106274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-fa5460fe-3c45-4eaf-98bf-cad81902db55.info Sep 06 06:51:27 devstack sudo[106274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:51:27 devstack sudo[106273]: pam_unix(sudo:session): session closed for user root Sep 06 06:51:27 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-7d2c273a-e889-463f-84ed-6941216bee3a tempest-CreateVolumesFromImageTest-786532930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-a70773ae-8706-4726-901c-551e2675dff0" returned: 0 in 0.255s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:51:27 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-7d2c273a-e889-463f-84ed-6941216bee3a tempest-CreateVolumesFromImageTest-786532930 None] Lock "cinder-quobyte-a70773ae-8706-4726-901c-551e2675dff0" released by "delete_volume" :: held 0.763s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:51:27 devstack sudo[106274]: pam_unix(sudo:session): session closed for user root Sep 06 06:51:27 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-1020fc57-e3eb-4462-bc36-b0ac7e087a9e tempest-VolumeDependencyTests-1618338243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-fa5460fe-3c45-4eaf-98bf-cad81902db55.info" returned: 0 in 0.269s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:51:27 devstack cinder-volume[87329]: WARNING cinder.volume.drivers.remotefs [None req-1020fc57-e3eb-4462-bc36-b0ac7e087a9e tempest-VolumeDependencyTests-1618338243 None] /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-fa5460fe-3c45-4eaf-98bf-cad81902db55.info is being set with open permissions: ugo+rw Sep 06 06:51:27 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-1020fc57-e3eb-4462-bc36-b0ac7e087a9e tempest-VolumeDependencyTests-1618338243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-fa5460fe-3c45-4eaf-98bf-cad81902db55.info {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:51:27 devstack sudo[106279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-fa5460fe-3c45-4eaf-98bf-cad81902db55.info Sep 06 06:51:27 devstack sudo[106279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:51:27 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-7d2c273a-e889-463f-84ed-6941216bee3a tempest-CreateVolumesFromImageTest-786532930 None] Created reservations ['1fcc0c66-60d2-4e75-965f-b88bfeb32d21', 'b07dd6b2-6c9f-413a-9136-2eeadae132d9', 'd069c93d-0558-48d3-b8fc-69789b62f680', 'be80dc5c-68a7-41e5-9be2-2029273ab982'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:51:27 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-7d2c273a-e889-463f-84ed-6941216bee3a tempest-CreateVolumesFromImageTest-786532930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:51:27 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-7d2c273a-e889-463f-84ed-6941216bee3a tempest-CreateVolumesFromImageTest-786532930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:51:27 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-7d2c273a-e889-463f-84ed-6941216bee3a tempest-CreateVolumesFromImageTest-786532930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:51:27 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-7d2c273a-e889-463f-84ed-6941216bee3a tempest-CreateVolumesFromImageTest-786532930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:51:27 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-7d2c273a-e889-463f-84ed-6941216bee3a tempest-CreateVolumesFromImageTest-786532930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:51:27 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-7d2c273a-e889-463f-84ed-6941216bee3a tempest-CreateVolumesFromImageTest-786532930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:51:28 devstack sudo[106281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:51:28 devstack sudo[106281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:51:28 devstack sudo[106279]: pam_unix(sudo:session): session closed for user root Sep 06 06:51:28 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-1020fc57-e3eb-4462-bc36-b0ac7e087a9e tempest-VolumeDependencyTests-1618338243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-fa5460fe-3c45-4eaf-98bf-cad81902db55.info" returned: 0 in 0.249s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:51:28 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-1020fc57-e3eb-4462-bc36-b0ac7e087a9e tempest-VolumeDependencyTests-1618338243 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.253s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:51:28 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-1b05a556-fde0-4cc9-9acc-aefbf52d54df tempest-VolumeAndVolumeTypeFromImageTest-1507622826 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.081s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:51:28 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-1b05a556-fde0-4cc9-9acc-aefbf52d54df tempest-VolumeAndVolumeTypeFromImageTest-1507622826 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:51:22Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffd0e062-6ba3-47ea-9a0f-d7d8406d273f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4b75cec633343eabc4bb5d5836ccd1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:51:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:51:22Z,use_quota=True,user_id='713da993514c4f329dc56b30d22a157b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(99fd5ec1-f9b8-4bab-ba16-7fb72f320b10),volume_type_id=99fd5ec1-f9b8-4bab-ba16-7fb72f320b10)}" {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 06:51:28 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-1b05a556-fde0-4cc9-9acc-aefbf52d54df tempest-VolumeAndVolumeTypeFromImageTest-1507622826 None] Creating volume ffd0e062-6ba3-47ea-9a0f-d7d8406d273f {{(pid=87329) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 06:51:28 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-1b05a556-fde0-4cc9-9acc-aefbf52d54df tempest-VolumeAndVolumeTypeFromImageTest-1507622826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:51:28 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-1b05a556-fde0-4cc9-9acc-aefbf52d54df tempest-VolumeAndVolumeTypeFromImageTest-1507622826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:51:28 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-1b05a556-fde0-4cc9-9acc-aefbf52d54df tempest-VolumeAndVolumeTypeFromImageTest-1507622826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:51:28 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-1b05a556-fde0-4cc9-9acc-aefbf52d54df tempest-VolumeAndVolumeTypeFromImageTest-1507622826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:51:28 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-1b05a556-fde0-4cc9-9acc-aefbf52d54df tempest-VolumeAndVolumeTypeFromImageTest-1507622826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:51:28 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-1b05a556-fde0-4cc9-9acc-aefbf52d54df tempest-VolumeAndVolumeTypeFromImageTest-1507622826 None] Selected osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 as target Quobyte volume. {{(pid=87329) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 06:51:28 devstack cinder-volume[87329]: INFO cinder.volume.drivers.remotefs [None req-1b05a556-fde0-4cc9-9acc-aefbf52d54df tempest-VolumeAndVolumeTypeFromImageTest-1507622826 None] casted to osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 Sep 06 06:51:28 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-1b05a556-fde0-4cc9-9acc-aefbf52d54df tempest-VolumeAndVolumeTypeFromImageTest-1507622826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-ffd0e062-6ba3-47ea-9a0f-d7d8406d273f 1073741824 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:51:28 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-6ebebe25-5ab3-42d3-9126-5f83db0d7faa tempest-CreateVolumesFromImageTest-786532930 None] Acquiring lock "cinder-4d675c7c-2290-42a4-8df4-95541821dc5c-delete_volume" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:51:28 devstack sudo[106284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-ffd0e062-6ba3-47ea-9a0f-d7d8406d273f 1073741824 Sep 06 06:51:28 devstack sudo[106284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:51:28 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-6ebebe25-5ab3-42d3-9126-5f83db0d7faa tempest-CreateVolumesFromImageTest-786532930 None] Lock "cinder-4d675c7c-2290-42a4-8df4-95541821dc5c-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:51:28 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-1020fc57-e3eb-4462-bc36-b0ac7e087a9e tempest-VolumeDependencyTests-1618338243 None] Create snapshot completed successfully Sep 06 06:51:28 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-6ebebe25-5ab3-42d3-9126-5f83db0d7faa tempest-CreateVolumesFromImageTest-786532930 None] Acquiring lock "cinder-quobyte-4d675c7c-2290-42a4-8df4-95541821dc5c" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:51:28 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-6ebebe25-5ab3-42d3-9126-5f83db0d7faa tempest-CreateVolumesFromImageTest-786532930 None] Lock "cinder-quobyte-4d675c7c-2290-42a4-8df4-95541821dc5c" acquired by "delete_volume" :: waited 0.013s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:51:28 devstack sudo[106281]: pam_unix(sudo:session): session closed for user root Sep 06 06:51:28 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-7d2c273a-e889-463f-84ed-6941216bee3a tempest-CreateVolumesFromImageTest-786532930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.293s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:51:28 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-7d2c273a-e889-463f-84ed-6941216bee3a tempest-CreateVolumesFromImageTest-786532930 None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:51:28 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-7d2c273a-e889-463f-84ed-6941216bee3a tempest-CreateVolumesFromImageTest-786532930 None] Deleted volume successfully. Sep 06 06:51:28 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[616c1d5c-9ed2-4308-b47d-7c329d7b8d4a]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:51:28 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-6ebebe25-5ab3-42d3-9126-5f83db0d7faa tempest-CreateVolumesFromImageTest-786532930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-4d675c7c-2290-42a4-8df4-95541821dc5c {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:51:28 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-7d2c273a-e889-463f-84ed-6941216bee3a tempest-CreateVolumesFromImageTest-786532930 None] Lock "cinder-a70773ae-8706-4726-901c-551e2675dff0-delete_volume" released by "delete_volume" :: held 1.344s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:51:28 devstack sudo[106287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-4d675c7c-2290-42a4-8df4-95541821dc5c Sep 06 06:51:28 devstack sudo[106287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:51:28 devstack sudo[106284]: pam_unix(sudo:session): session closed for user root Sep 06 06:51:28 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-1b05a556-fde0-4cc9-9acc-aefbf52d54df tempest-VolumeAndVolumeTypeFromImageTest-1507622826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-ffd0e062-6ba3-47ea-9a0f-d7d8406d273f 1073741824" returned: 0 in 0.480s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:51:28 devstack sudo[106287]: pam_unix(sudo:session): session closed for user root Sep 06 06:51:28 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-6ebebe25-5ab3-42d3-9126-5f83db0d7faa tempest-CreateVolumesFromImageTest-786532930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-4d675c7c-2290-42a4-8df4-95541821dc5c" returned: 0 in 0.385s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:51:28 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-6ebebe25-5ab3-42d3-9126-5f83db0d7faa tempest-CreateVolumesFromImageTest-786532930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-4d675c7c-2290-42a4-8df4-95541821dc5c {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:51:28 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-1b05a556-fde0-4cc9-9acc-aefbf52d54df tempest-VolumeAndVolumeTypeFromImageTest-1507622826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-ffd0e062-6ba3-47ea-9a0f-d7d8406d273f {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:51:28 devstack sudo[106296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-4d675c7c-2290-42a4-8df4-95541821dc5c Sep 06 06:51:28 devstack sudo[106296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:51:28 devstack sudo[106297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-ffd0e062-6ba3-47ea-9a0f-d7d8406d273f Sep 06 06:51:28 devstack sudo[106297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:51:28 devstack sudo[106296]: pam_unix(sudo:session): session closed for user root Sep 06 06:51:28 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-6ebebe25-5ab3-42d3-9126-5f83db0d7faa tempest-CreateVolumesFromImageTest-786532930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-4d675c7c-2290-42a4-8df4-95541821dc5c" returned: 0 in 0.296s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:51:28 devstack sudo[106297]: pam_unix(sudo:session): session closed for user root Sep 06 06:51:29 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-1b05a556-fde0-4cc9-9acc-aefbf52d54df tempest-VolumeAndVolumeTypeFromImageTest-1507622826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-ffd0e062-6ba3-47ea-9a0f-d7d8406d273f" returned: 0 in 0.288s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:51:29 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-1b05a556-fde0-4cc9-9acc-aefbf52d54df tempest-VolumeAndVolumeTypeFromImageTest-1507622826 None] <== create_volume: return (832ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'} {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 06:51:29 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-1b05a556-fde0-4cc9-9acc-aefbf52d54df tempest-VolumeAndVolumeTypeFromImageTest-1507622826 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.835s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:51:29 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-6ebebe25-5ab3-42d3-9126-5f83db0d7faa tempest-CreateVolumesFromImageTest-786532930 None] Lock "cinder-quobyte-4d675c7c-2290-42a4-8df4-95541821dc5c" released by "delete_volume" :: held 0.729s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:51:29 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-a48ab1a1-1bb4-4db8-9c4e-c542c5834a9a tempest-CreateVolumesFromSnapshotTest-499441882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.912s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:51:29 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-a48ab1a1-1bb4-4db8-9c4e-c542c5834a9a tempest-CreateVolumesFromSnapshotTest-499441882 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:51:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1238134130',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=202822af-3551-4789-a3d9-ac6b8e38416a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2de6bc06e3f64a14896af2f97faf9f4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:51:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:51:26Z,use_quota=True,user_id='980ea4c91fca44ea8cff75dd4148f201',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)}" {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 06:51:29 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-a48ab1a1-1bb4-4db8-9c4e-c542c5834a9a tempest-CreateVolumesFromSnapshotTest-499441882 None] Creating volume 202822af-3551-4789-a3d9-ac6b8e38416a {{(pid=87329) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 06:51:29 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-a48ab1a1-1bb4-4db8-9c4e-c542c5834a9a tempest-CreateVolumesFromSnapshotTest-499441882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:51:29 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-a48ab1a1-1bb4-4db8-9c4e-c542c5834a9a tempest-CreateVolumesFromSnapshotTest-499441882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:51:29 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-a48ab1a1-1bb4-4db8-9c4e-c542c5834a9a tempest-CreateVolumesFromSnapshotTest-499441882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:51:29 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-a48ab1a1-1bb4-4db8-9c4e-c542c5834a9a tempest-CreateVolumesFromSnapshotTest-499441882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:51:29 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-a48ab1a1-1bb4-4db8-9c4e-c542c5834a9a tempest-CreateVolumesFromSnapshotTest-499441882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:51:29 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-a48ab1a1-1bb4-4db8-9c4e-c542c5834a9a tempest-CreateVolumesFromSnapshotTest-499441882 None] Selected osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 as target Quobyte volume. {{(pid=87329) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 06:51:29 devstack cinder-volume[87329]: INFO cinder.volume.drivers.remotefs [None req-a48ab1a1-1bb4-4db8-9c4e-c542c5834a9a tempest-CreateVolumesFromSnapshotTest-499441882 None] casted to osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 Sep 06 06:51:29 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-a48ab1a1-1bb4-4db8-9c4e-c542c5834a9a tempest-CreateVolumesFromSnapshotTest-499441882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-202822af-3551-4789-a3d9-ac6b8e38416a 1073741824 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:51:29 devstack sudo[106302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-202822af-3551-4789-a3d9-ac6b8e38416a 1073741824 Sep 06 06:51:29 devstack sudo[106302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:51:29 devstack cinder-volume[87329]: DEBUG cinder.volume.volume_utils [None req-1b05a556-fde0-4cc9-9acc-aefbf52d54df tempest-VolumeAndVolumeTypeFromImageTest-1507622826 None] Attempting download of 1255f0f5-40a6-485b-9604-068ac8269d65 ((None, [{'url': 'file:///opt/stack/data/glance/images/1255f0f5-40a6-485b-9604-068ac8269d65', 'metadata': {}}])) to volume ffd0e062-6ba3-47ea-9a0f-d7d8406d273f. {{(pid=87329) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 06 06:51:29 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-db0770ad-39d6-4107-a2e1-346d7a266849 tempest-VolumeDependencyTests-1618338243 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87329) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 06:51:29 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-6ebebe25-5ab3-42d3-9126-5f83db0d7faa tempest-CreateVolumesFromImageTest-786532930 None] Created reservations ['169e063f-d3fa-4df3-86f6-ec8fdeeb8e02', 'f28322d1-dfa4-4d55-acd2-cfa1169d2794', '817a0e65-04db-4fb4-9c33-3b0748d999a2', '5339b301-8800-4d5c-8566-ff2f8f0b36c5'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:51:29 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-db0770ad-39d6-4107-a2e1-346d7a266849 tempest-VolumeDependencyTests-1618338243 None] Flow 'volume_create_manager' (d86fdcce-dbd4-4756-a844-fafadb15990c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:51:29 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-db0770ad-39d6-4107-a2e1-346d7a266849 tempest-VolumeDependencyTests-1618338243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b152768-2d02-4a90-9b95-a2db75a16f9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:51:29 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5e93d6d-30fb-4eeb-a4de-20b8fde78ae4]: (4, 'raw') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:51:29 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-1b05a556-fde0-4cc9-9acc-aefbf52d54df tempest-VolumeAndVolumeTypeFromImageTest-1507622826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1255f0f5-40a6-485b-9604-068ac8269d65_50m6izri {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:51:29 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-db0770ad-39d6-4107-a2e1-346d7a266849 tempest-VolumeDependencyTests-1618338243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b152768-2d02-4a90-9b95-a2db75a16f9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:51:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-223391645',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=115496dd-f46d-4766-8fcd-c28f99191df8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2152e75764254dbb9e0e6eaa9ae4fcbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:51:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=32c09ec4-10a8-4e63-8cc2-93be13c0aeac,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:51:29Z,use_quota=True,user_id='d0d4144314c04ff99b54caf53a2e5031',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:51:29 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-db0770ad-39d6-4107-a2e1-346d7a266849 tempest-VolumeDependencyTests-1618338243 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41435a71-35c4-46fb-80a3-17358836da1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:51:29 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-db0770ad-39d6-4107-a2e1-346d7a266849 tempest-VolumeDependencyTests-1618338243 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41435a71-35c4-46fb-80a3-17358836da1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:51:29 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-db0770ad-39d6-4107-a2e1-346d7a266849 tempest-VolumeDependencyTests-1618338243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be47d58a-aede-41b6-95d8-2b0e86f50bbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:51:29 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-db0770ad-39d6-4107-a2e1-346d7a266849 tempest-VolumeDependencyTests-1618338243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be47d58a-aede-41b6-95d8-2b0e86f50bbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '115496dd-f46d-4766-8fcd-c28f99191df8', 'volume_name': 'volume-115496dd-f46d-4766-8fcd-c28f99191df8', 'volume_size': 1, 'snapshot_id': '32c09ec4-10a8-4e63-8cc2-93be13c0aeac'}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:51:29 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-db0770ad-39d6-4107-a2e1-346d7a266849 tempest-VolumeDependencyTests-1618338243 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fe54a60-06dd-4d66-b5be-6ed92c3eb674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:51:29 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-db0770ad-39d6-4107-a2e1-346d7a266849 tempest-VolumeDependencyTests-1618338243 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fe54a60-06dd-4d66-b5be-6ed92c3eb674) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:51:29 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-db0770ad-39d6-4107-a2e1-346d7a266849 tempest-VolumeDependencyTests-1618338243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08ead5b1-af64-4d91-b681-d198d909d0b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:51:29 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-db0770ad-39d6-4107-a2e1-346d7a266849 tempest-VolumeDependencyTests-1618338243 None] Volume 115496dd-f46d-4766-8fcd-c28f99191df8: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-115496dd-f46d-4766-8fcd-c28f99191df8', 'volume_size': 1, 'snapshot_id': '32c09ec4-10a8-4e63-8cc2-93be13c0aeac'} Sep 06 06:51:29 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-db0770ad-39d6-4107-a2e1-346d7a266849 tempest-VolumeDependencyTests-1618338243 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:51:29 devstack sudo[106304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1255f0f5-40a6-485b-9604-068ac8269d65_50m6izri Sep 06 06:51:29 devstack sudo[106304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:51:29 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-6ebebe25-5ab3-42d3-9126-5f83db0d7faa tempest-CreateVolumesFromImageTest-786532930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:51:29 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-6ebebe25-5ab3-42d3-9126-5f83db0d7faa tempest-CreateVolumesFromImageTest-786532930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:51:29 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-6ebebe25-5ab3-42d3-9126-5f83db0d7faa tempest-CreateVolumesFromImageTest-786532930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:51:29 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-6ebebe25-5ab3-42d3-9126-5f83db0d7faa tempest-CreateVolumesFromImageTest-786532930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:51:29 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-6ebebe25-5ab3-42d3-9126-5f83db0d7faa tempest-CreateVolumesFromImageTest-786532930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:51:29 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-6ebebe25-5ab3-42d3-9126-5f83db0d7faa tempest-CreateVolumesFromImageTest-786532930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:51:29 devstack sudo[106309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:51:29 devstack sudo[106309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:51:29 devstack sudo[106302]: pam_unix(sudo:session): session closed for user root Sep 06 06:51:29 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-a48ab1a1-1bb4-4db8-9c4e-c542c5834a9a tempest-CreateVolumesFromSnapshotTest-499441882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-202822af-3551-4789-a3d9-ac6b8e38416a 1073741824" returned: 0 in 0.496s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:51:29 devstack sudo[106304]: pam_unix(sudo:session): session closed for user root Sep 06 06:51:29 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-a48ab1a1-1bb4-4db8-9c4e-c542c5834a9a tempest-CreateVolumesFromSnapshotTest-499441882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-202822af-3551-4789-a3d9-ac6b8e38416a {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:51:29 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-1b05a556-fde0-4cc9-9acc-aefbf52d54df tempest-VolumeAndVolumeTypeFromImageTest-1507622826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1255f0f5-40a6-485b-9604-068ac8269d65_50m6izri" returned: 0 in 0.387s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:51:29 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-1b05a556-fde0-4cc9-9acc-aefbf52d54df tempest-VolumeAndVolumeTypeFromImageTest-1507622826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1255f0f5-40a6-485b-9604-068ac8269d65_50m6izri {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:51:29 devstack sudo[106314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-202822af-3551-4789-a3d9-ac6b8e38416a Sep 06 06:51:29 devstack sudo[106314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:51:29 devstack sudo[106309]: pam_unix(sudo:session): session closed for user root Sep 06 06:51:29 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-6ebebe25-5ab3-42d3-9126-5f83db0d7faa tempest-CreateVolumesFromImageTest-786532930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.277s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:51:29 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-6ebebe25-5ab3-42d3-9126-5f83db0d7faa tempest-CreateVolumesFromImageTest-786532930 None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:51:29 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-6ebebe25-5ab3-42d3-9126-5f83db0d7faa tempest-CreateVolumesFromImageTest-786532930 None] Deleted volume successfully. Sep 06 06:51:29 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-6ebebe25-5ab3-42d3-9126-5f83db0d7faa tempest-CreateVolumesFromImageTest-786532930 None] Lock "cinder-4d675c7c-2290-42a4-8df4-95541821dc5c-delete_volume" released by "delete_volume" :: held 1.422s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:51:29 devstack sudo[106316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1255f0f5-40a6-485b-9604-068ac8269d65_50m6izri Sep 06 06:51:29 devstack sudo[106316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:51:29 devstack sudo[106314]: pam_unix(sudo:session): session closed for user root Sep 06 06:51:29 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-a48ab1a1-1bb4-4db8-9c4e-c542c5834a9a tempest-CreateVolumesFromSnapshotTest-499441882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-202822af-3551-4789-a3d9-ac6b8e38416a" returned: 0 in 0.252s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:51:29 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-a48ab1a1-1bb4-4db8-9c4e-c542c5834a9a tempest-CreateVolumesFromSnapshotTest-499441882 None] <== create_volume: return (789ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'} {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 06:51:29 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-a48ab1a1-1bb4-4db8-9c4e-c542c5834a9a tempest-CreateVolumesFromSnapshotTest-499441882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.794s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:51:29 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-c4612a04-f46c-4d02-a562-4a0d365512cc tempest-CreateVolumesFromSnapshotTest-499441882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.431s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:51:29 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-c4612a04-f46c-4d02-a562-4a0d365512cc tempest-CreateVolumesFromSnapshotTest-499441882 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:51:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-28049190',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e55bcb32-3a06-4e03-adef-30f86de1793b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2de6bc06e3f64a14896af2f97faf9f4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:51:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:51:26Z,use_quota=True,user_id='980ea4c91fca44ea8cff75dd4148f201',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)}" {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 06:51:29 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-c4612a04-f46c-4d02-a562-4a0d365512cc tempest-CreateVolumesFromSnapshotTest-499441882 None] Creating volume e55bcb32-3a06-4e03-adef-30f86de1793b {{(pid=87329) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 06:51:29 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-c4612a04-f46c-4d02-a562-4a0d365512cc tempest-CreateVolumesFromSnapshotTest-499441882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:51:29 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-c4612a04-f46c-4d02-a562-4a0d365512cc tempest-CreateVolumesFromSnapshotTest-499441882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:51:29 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-c4612a04-f46c-4d02-a562-4a0d365512cc tempest-CreateVolumesFromSnapshotTest-499441882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:51:29 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-c4612a04-f46c-4d02-a562-4a0d365512cc tempest-CreateVolumesFromSnapshotTest-499441882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:51:29 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-c4612a04-f46c-4d02-a562-4a0d365512cc tempest-CreateVolumesFromSnapshotTest-499441882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:51:29 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-c4612a04-f46c-4d02-a562-4a0d365512cc tempest-CreateVolumesFromSnapshotTest-499441882 None] Selected osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 as target Quobyte volume. {{(pid=87329) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 06:51:29 devstack cinder-volume[87329]: INFO cinder.volume.drivers.remotefs [None req-c4612a04-f46c-4d02-a562-4a0d365512cc tempest-CreateVolumesFromSnapshotTest-499441882 None] casted to osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 Sep 06 06:51:29 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-c4612a04-f46c-4d02-a562-4a0d365512cc tempest-CreateVolumesFromSnapshotTest-499441882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e55bcb32-3a06-4e03-adef-30f86de1793b 1073741824 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:51:29 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-a48ab1a1-1bb4-4db8-9c4e-c542c5834a9a tempest-CreateVolumesFromSnapshotTest-499441882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b3e091b-4a47-45bd-9d68-bc631663b0f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-202822af-3551-4789-a3d9-ac6b8e38416a', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:51:29 devstack sudo[106320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e55bcb32-3a06-4e03-adef-30f86de1793b 1073741824 Sep 06 06:51:29 devstack sudo[106320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:51:29 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-a48ab1a1-1bb4-4db8-9c4e-c542c5834a9a tempest-CreateVolumesFromSnapshotTest-499441882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85759850-fa46-413a-b131-aa791464b10c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:51:29 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-a48ab1a1-1bb4-4db8-9c4e-c542c5834a9a tempest-CreateVolumesFromSnapshotTest-499441882 None] Volume volume-202822af-3551-4789-a3d9-ac6b8e38416a (202822af-3551-4789-a3d9-ac6b8e38416a): created successfully Sep 06 06:51:29 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-a48ab1a1-1bb4-4db8-9c4e-c542c5834a9a tempest-CreateVolumesFromSnapshotTest-499441882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85759850-fa46-413a-b131-aa791464b10c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:51:29 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-a48ab1a1-1bb4-4db8-9c4e-c542c5834a9a tempest-CreateVolumesFromSnapshotTest-499441882 None] Flow 'volume_create_manager' (987c3d0e-5df8-4835-b85d-f44740d7f63d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:51:29 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-a48ab1a1-1bb4-4db8-9c4e-c542c5834a9a tempest-CreateVolumesFromSnapshotTest-499441882 None] Created volume successfully. Sep 06 06:51:29 devstack sudo[106316]: pam_unix(sudo:session): session closed for user root Sep 06 06:51:29 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-1b05a556-fde0-4cc9-9acc-aefbf52d54df tempest-VolumeAndVolumeTypeFromImageTest-1507622826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1255f0f5-40a6-485b-9604-068ac8269d65_50m6izri" returned: 1 in 0.357s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:51:29 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-1b05a556-fde0-4cc9-9acc-aefbf52d54df tempest-VolumeAndVolumeTypeFromImageTest-1507622826 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1255f0f5-40a6-485b-9604-068ac8269d65_50m6izri' failed. Not Retrying. {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 06 06:51:29 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[e29c7846-a287-4c0f-b3cb-113a10ddfcf9]: (4, 'raw') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:51:29 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-1b05a556-fde0-4cc9-9acc-aefbf52d54df tempest-VolumeAndVolumeTypeFromImageTest-1507622826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1255f0f5-40a6-485b-9604-068ac8269d65_f_huronydevstack@QuobyteHD {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:51:30 devstack sudo[106324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1255f0f5-40a6-485b-9604-068ac8269d65_f_huronydevstack@QuobyteHD Sep 06 06:51:30 devstack sudo[106324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:51:30 devstack sudo[106320]: pam_unix(sudo:session): session closed for user root Sep 06 06:51:30 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-c4612a04-f46c-4d02-a562-4a0d365512cc tempest-CreateVolumesFromSnapshotTest-499441882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e55bcb32-3a06-4e03-adef-30f86de1793b 1073741824" returned: 0 in 0.422s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:51:30 devstack sudo[106324]: pam_unix(sudo:session): session closed for user root Sep 06 06:51:30 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-1b05a556-fde0-4cc9-9acc-aefbf52d54df tempest-VolumeAndVolumeTypeFromImageTest-1507622826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1255f0f5-40a6-485b-9604-068ac8269d65_f_huronydevstack@QuobyteHD" returned: 0 in 0.349s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:51:30 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-1b05a556-fde0-4cc9-9acc-aefbf52d54df tempest-VolumeAndVolumeTypeFromImageTest-1507622826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1255f0f5-40a6-485b-9604-068ac8269d65_f_huronydevstack@QuobyteHD {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:51:30 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-c4612a04-f46c-4d02-a562-4a0d365512cc tempest-CreateVolumesFromSnapshotTest-499441882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e55bcb32-3a06-4e03-adef-30f86de1793b {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:51:30 devstack sudo[106333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e55bcb32-3a06-4e03-adef-30f86de1793b Sep 06 06:51:30 devstack sudo[106333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:51:30 devstack sudo[106332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1255f0f5-40a6-485b-9604-068ac8269d65_f_huronydevstack@QuobyteHD Sep 06 06:51:30 devstack sudo[106332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:51:30 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-717902d2-3887-4adb-b8d3-1dcc4209912a tempest-CreateVolumesFromImageTest-786532930 None] Acquiring lock "cinder-d5c5b18d-99cc-4b56-9b99-f109d46a5eec-delete_volume" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:51:30 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-717902d2-3887-4adb-b8d3-1dcc4209912a tempest-CreateVolumesFromImageTest-786532930 None] Lock "cinder-d5c5b18d-99cc-4b56-9b99-f109d46a5eec-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:51:30 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-717902d2-3887-4adb-b8d3-1dcc4209912a tempest-CreateVolumesFromImageTest-786532930 None] Acquiring lock "cinder-quobyte-d5c5b18d-99cc-4b56-9b99-f109d46a5eec" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:51:30 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-717902d2-3887-4adb-b8d3-1dcc4209912a tempest-CreateVolumesFromImageTest-786532930 None] Lock "cinder-quobyte-d5c5b18d-99cc-4b56-9b99-f109d46a5eec" acquired by "delete_volume" :: waited 0.019s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:51:30 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[16ab5685-a210-45fe-b439-37afd9d12387]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:51:30 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-717902d2-3887-4adb-b8d3-1dcc4209912a tempest-CreateVolumesFromImageTest-786532930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-d5c5b18d-99cc-4b56-9b99-f109d46a5eec {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:51:30 devstack sudo[106333]: pam_unix(sudo:session): session closed for user root Sep 06 06:51:30 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-c4612a04-f46c-4d02-a562-4a0d365512cc tempest-CreateVolumesFromSnapshotTest-499441882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e55bcb32-3a06-4e03-adef-30f86de1793b" returned: 0 in 0.274s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:51:30 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-c4612a04-f46c-4d02-a562-4a0d365512cc tempest-CreateVolumesFromSnapshotTest-499441882 None] <== create_volume: return (751ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'} {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 06:51:30 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-c4612a04-f46c-4d02-a562-4a0d365512cc tempest-CreateVolumesFromSnapshotTest-499441882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.754s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:51:30 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-48999078-cacf-4dde-8f7e-4cf340f87c1c tempest-CreateVolumesFromSnapshotTest-499441882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.850s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:51:30 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-48999078-cacf-4dde-8f7e-4cf340f87c1c tempest-CreateVolumesFromSnapshotTest-499441882 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:51:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1687605050',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=510c6730-6a62-4a12-b6af-4699e5bdfb9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2de6bc06e3f64a14896af2f97faf9f4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:51:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:51:27Z,use_quota=True,user_id='980ea4c91fca44ea8cff75dd4148f201',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)}" {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 06:51:30 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-48999078-cacf-4dde-8f7e-4cf340f87c1c tempest-CreateVolumesFromSnapshotTest-499441882 None] Creating volume 510c6730-6a62-4a12-b6af-4699e5bdfb9e {{(pid=87329) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 06:51:30 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-48999078-cacf-4dde-8f7e-4cf340f87c1c tempest-CreateVolumesFromSnapshotTest-499441882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:51:30 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-48999078-cacf-4dde-8f7e-4cf340f87c1c tempest-CreateVolumesFromSnapshotTest-499441882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:51:30 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-48999078-cacf-4dde-8f7e-4cf340f87c1c tempest-CreateVolumesFromSnapshotTest-499441882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:51:30 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-48999078-cacf-4dde-8f7e-4cf340f87c1c tempest-CreateVolumesFromSnapshotTest-499441882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:51:30 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-48999078-cacf-4dde-8f7e-4cf340f87c1c tempest-CreateVolumesFromSnapshotTest-499441882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:51:30 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-48999078-cacf-4dde-8f7e-4cf340f87c1c tempest-CreateVolumesFromSnapshotTest-499441882 None] Selected osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 as target Quobyte volume. {{(pid=87329) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 06:51:30 devstack cinder-volume[87329]: INFO cinder.volume.drivers.remotefs [None req-48999078-cacf-4dde-8f7e-4cf340f87c1c tempest-CreateVolumesFromSnapshotTest-499441882 None] casted to osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 Sep 06 06:51:30 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-48999078-cacf-4dde-8f7e-4cf340f87c1c tempest-CreateVolumesFromSnapshotTest-499441882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-510c6730-6a62-4a12-b6af-4699e5bdfb9e 1073741824 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:51:30 devstack sudo[106338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-510c6730-6a62-4a12-b6af-4699e5bdfb9e 1073741824 Sep 06 06:51:30 devstack sudo[106338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:51:30 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-c4612a04-f46c-4d02-a562-4a0d365512cc tempest-CreateVolumesFromSnapshotTest-499441882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e458cb98-fa10-46d4-b673-9b3b21992bda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e55bcb32-3a06-4e03-adef-30f86de1793b', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:51:30 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-c4612a04-f46c-4d02-a562-4a0d365512cc tempest-CreateVolumesFromSnapshotTest-499441882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62b290ac-bb5e-4250-911a-e75822848d3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:51:30 devstack sudo[106332]: pam_unix(sudo:session): session closed for user root Sep 06 06:51:30 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-c4612a04-f46c-4d02-a562-4a0d365512cc tempest-CreateVolumesFromSnapshotTest-499441882 None] Volume volume-e55bcb32-3a06-4e03-adef-30f86de1793b (e55bcb32-3a06-4e03-adef-30f86de1793b): created successfully Sep 06 06:51:30 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-c4612a04-f46c-4d02-a562-4a0d365512cc tempest-CreateVolumesFromSnapshotTest-499441882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62b290ac-bb5e-4250-911a-e75822848d3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:51:30 devstack sudo[106337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-d5c5b18d-99cc-4b56-9b99-f109d46a5eec Sep 06 06:51:30 devstack sudo[106337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:51:30 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-c4612a04-f46c-4d02-a562-4a0d365512cc tempest-CreateVolumesFromSnapshotTest-499441882 None] Flow 'volume_create_manager' (54c7c6e4-f1c1-43fa-a3bc-e182724afae6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:51:30 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-1b05a556-fde0-4cc9-9acc-aefbf52d54df tempest-VolumeAndVolumeTypeFromImageTest-1507622826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1255f0f5-40a6-485b-9604-068ac8269d65_f_huronydevstack@QuobyteHD" returned: 1 in 0.414s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:51:30 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-1b05a556-fde0-4cc9-9acc-aefbf52d54df tempest-VolumeAndVolumeTypeFromImageTest-1507622826 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1255f0f5-40a6-485b-9604-068ac8269d65_f_huronydevstack@QuobyteHD' failed. Not Retrying. {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 06 06:51:30 devstack cinder-volume[87329]: DEBUG cinder.image.image_utils [None req-1b05a556-fde0-4cc9-9acc-aefbf52d54df tempest-VolumeAndVolumeTypeFromImageTest-1507622826 None] 1255f0f5-40a6-485b-9604-068ac8269d65 was raw, converting to qcow2 {{(pid=87329) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 06 06:51:30 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-1b05a556-fde0-4cc9-9acc-aefbf52d54df tempest-VolumeAndVolumeTypeFromImageTest-1507622826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_1255f0f5-40a6-485b-9604-068ac8269d65_f_huronydevstack@QuobyteHD /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-ffd0e062-6ba3-47ea-9a0f-d7d8406d273f {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:51:30 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-c4612a04-f46c-4d02-a562-4a0d365512cc tempest-CreateVolumesFromSnapshotTest-499441882 None] Created volume successfully. Sep 06 06:51:30 devstack sudo[106344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_1255f0f5-40a6-485b-9604-068ac8269d65_f_huronydevstack@QuobyteHD /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-ffd0e062-6ba3-47ea-9a0f-d7d8406d273f Sep 06 06:51:30 devstack sudo[106344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:51:30 devstack sudo[106337]: pam_unix(sudo:session): session closed for user root Sep 06 06:51:30 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-717902d2-3887-4adb-b8d3-1dcc4209912a tempest-CreateVolumesFromImageTest-786532930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-d5c5b18d-99cc-4b56-9b99-f109d46a5eec" returned: 0 in 0.427s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:51:30 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-717902d2-3887-4adb-b8d3-1dcc4209912a tempest-CreateVolumesFromImageTest-786532930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-d5c5b18d-99cc-4b56-9b99-f109d46a5eec {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:51:30 devstack sudo[106356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-d5c5b18d-99cc-4b56-9b99-f109d46a5eec Sep 06 06:51:30 devstack sudo[106356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:51:31 devstack sudo[106338]: pam_unix(sudo:session): session closed for user root Sep 06 06:51:31 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-48999078-cacf-4dde-8f7e-4cf340f87c1c tempest-CreateVolumesFromSnapshotTest-499441882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-510c6730-6a62-4a12-b6af-4699e5bdfb9e 1073741824" returned: 0 in 0.446s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:51:31 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-48999078-cacf-4dde-8f7e-4cf340f87c1c tempest-CreateVolumesFromSnapshotTest-499441882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-510c6730-6a62-4a12-b6af-4699e5bdfb9e {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:51:31 devstack sudo[106359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-510c6730-6a62-4a12-b6af-4699e5bdfb9e Sep 06 06:51:31 devstack sudo[106359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:51:31 devstack sudo[106344]: pam_unix(sudo:session): session closed for user root Sep 06 06:51:31 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-1b05a556-fde0-4cc9-9acc-aefbf52d54df tempest-VolumeAndVolumeTypeFromImageTest-1507622826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_1255f0f5-40a6-485b-9604-068ac8269d65_f_huronydevstack@QuobyteHD /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-ffd0e062-6ba3-47ea-9a0f-d7d8406d273f" returned: 0 in 0.503s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:51:31 devstack cinder-volume[87329]: DEBUG cinder.image.image_utils [None req-1b05a556-fde0-4cc9-9acc-aefbf52d54df tempest-VolumeAndVolumeTypeFromImageTest-1507622826 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1255f0f5-40a6-485b-9604-068ac8269d65_f_huronydevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-ffd0e062-6ba3-47ea-9a0f-d7d8406d273f {{(pid=87329) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 06 06:51:31 devstack cinder-volume[87329]: INFO cinder.image.image_utils [None req-1b05a556-fde0-4cc9-9acc-aefbf52d54df tempest-VolumeAndVolumeTypeFromImageTest-1507622826 None] Converted 0.00 MB image at 0.00 MB/s Sep 06 06:51:31 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-1b05a556-fde0-4cc9-9acc-aefbf52d54df tempest-VolumeAndVolumeTypeFromImageTest-1507622826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-ffd0e062-6ba3-47ea-9a0f-d7d8406d273f 1G {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:51:31 devstack sudo[106356]: pam_unix(sudo:session): session closed for user root Sep 06 06:51:31 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-717902d2-3887-4adb-b8d3-1dcc4209912a tempest-CreateVolumesFromImageTest-786532930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-d5c5b18d-99cc-4b56-9b99-f109d46a5eec" returned: 0 in 0.269s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:51:31 devstack sudo[106362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-ffd0e062-6ba3-47ea-9a0f-d7d8406d273f 1G Sep 06 06:51:31 devstack sudo[106362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:51:31 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-717902d2-3887-4adb-b8d3-1dcc4209912a tempest-CreateVolumesFromImageTest-786532930 None] Lock "cinder-quobyte-d5c5b18d-99cc-4b56-9b99-f109d46a5eec" released by "delete_volume" :: held 0.746s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:51:31 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-717902d2-3887-4adb-b8d3-1dcc4209912a tempest-CreateVolumesFromImageTest-786532930 None] Created reservations ['d218dfae-d2a4-4b24-92d2-4ca03b9ee9fb', '05ff7c2f-b83a-4376-bcd7-5c50f229684b', '6143bea3-b585-4968-8fe6-99842e814ee4', 'c269b19e-e068-4395-8e94-e87256241ef8'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:51:31 devstack sudo[106359]: pam_unix(sudo:session): session closed for user root Sep 06 06:51:31 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-48999078-cacf-4dde-8f7e-4cf340f87c1c tempest-CreateVolumesFromSnapshotTest-499441882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-510c6730-6a62-4a12-b6af-4699e5bdfb9e" returned: 0 in 0.278s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:51:31 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-48999078-cacf-4dde-8f7e-4cf340f87c1c tempest-CreateVolumesFromSnapshotTest-499441882 None] <== create_volume: return (774ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'} {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 06:51:31 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-48999078-cacf-4dde-8f7e-4cf340f87c1c tempest-CreateVolumesFromSnapshotTest-499441882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.778s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:51:31 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-706cb5c4-b9a7-4efd-afe6-95c81c6c09e3 tempest-CreateVolumesFromSnapshotTest-499441882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.185s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:51:31 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-706cb5c4-b9a7-4efd-afe6-95c81c6c09e3 tempest-CreateVolumesFromSnapshotTest-499441882 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:51:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-505788924',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4eae1be3-f28d-4929-9c94-9939377f9f4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2de6bc06e3f64a14896af2f97faf9f4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:51:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:51:27Z,use_quota=True,user_id='980ea4c91fca44ea8cff75dd4148f201',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)}" {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 06:51:31 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-706cb5c4-b9a7-4efd-afe6-95c81c6c09e3 tempest-CreateVolumesFromSnapshotTest-499441882 None] Creating volume 4eae1be3-f28d-4929-9c94-9939377f9f4f {{(pid=87329) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 06:51:31 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-706cb5c4-b9a7-4efd-afe6-95c81c6c09e3 tempest-CreateVolumesFromSnapshotTest-499441882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:51:31 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-706cb5c4-b9a7-4efd-afe6-95c81c6c09e3 tempest-CreateVolumesFromSnapshotTest-499441882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:51:31 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-706cb5c4-b9a7-4efd-afe6-95c81c6c09e3 tempest-CreateVolumesFromSnapshotTest-499441882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:51:31 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-706cb5c4-b9a7-4efd-afe6-95c81c6c09e3 tempest-CreateVolumesFromSnapshotTest-499441882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:51:31 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-706cb5c4-b9a7-4efd-afe6-95c81c6c09e3 tempest-CreateVolumesFromSnapshotTest-499441882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:51:31 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-706cb5c4-b9a7-4efd-afe6-95c81c6c09e3 tempest-CreateVolumesFromSnapshotTest-499441882 None] Selected osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 as target Quobyte volume. {{(pid=87329) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 06:51:31 devstack cinder-volume[87329]: INFO cinder.volume.drivers.remotefs [None req-706cb5c4-b9a7-4efd-afe6-95c81c6c09e3 tempest-CreateVolumesFromSnapshotTest-499441882 None] casted to osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 Sep 06 06:51:31 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-706cb5c4-b9a7-4efd-afe6-95c81c6c09e3 tempest-CreateVolumesFromSnapshotTest-499441882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-4eae1be3-f28d-4929-9c94-9939377f9f4f 1073741824 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:51:31 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-48999078-cacf-4dde-8f7e-4cf340f87c1c tempest-CreateVolumesFromSnapshotTest-499441882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03945d8c-3002-487d-bfce-ad4276720b9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-510c6730-6a62-4a12-b6af-4699e5bdfb9e', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:51:31 devstack sudo[106365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-4eae1be3-f28d-4929-9c94-9939377f9f4f 1073741824 Sep 06 06:51:31 devstack sudo[106365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:51:31 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-48999078-cacf-4dde-8f7e-4cf340f87c1c tempest-CreateVolumesFromSnapshotTest-499441882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (947687c3-9854-470a-a2df-c5f60accf4df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:51:31 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-717902d2-3887-4adb-b8d3-1dcc4209912a tempest-CreateVolumesFromImageTest-786532930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:51:31 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-717902d2-3887-4adb-b8d3-1dcc4209912a tempest-CreateVolumesFromImageTest-786532930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:51:31 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-717902d2-3887-4adb-b8d3-1dcc4209912a tempest-CreateVolumesFromImageTest-786532930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:51:31 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-717902d2-3887-4adb-b8d3-1dcc4209912a tempest-CreateVolumesFromImageTest-786532930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:51:31 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-717902d2-3887-4adb-b8d3-1dcc4209912a tempest-CreateVolumesFromImageTest-786532930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:51:31 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-717902d2-3887-4adb-b8d3-1dcc4209912a tempest-CreateVolumesFromImageTest-786532930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:51:31 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-48999078-cacf-4dde-8f7e-4cf340f87c1c tempest-CreateVolumesFromSnapshotTest-499441882 None] Volume volume-510c6730-6a62-4a12-b6af-4699e5bdfb9e (510c6730-6a62-4a12-b6af-4699e5bdfb9e): created successfully Sep 06 06:51:31 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-48999078-cacf-4dde-8f7e-4cf340f87c1c tempest-CreateVolumesFromSnapshotTest-499441882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (947687c3-9854-470a-a2df-c5f60accf4df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:51:31 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-48999078-cacf-4dde-8f7e-4cf340f87c1c tempest-CreateVolumesFromSnapshotTest-499441882 None] Flow 'volume_create_manager' (a0d623f5-362b-44d2-ba49-333a17779809) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:51:31 devstack sudo[106367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:51:31 devstack sudo[106367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:51:31 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-48999078-cacf-4dde-8f7e-4cf340f87c1c tempest-CreateVolumesFromSnapshotTest-499441882 None] Created volume successfully. Sep 06 06:51:31 devstack sudo[106362]: pam_unix(sudo:session): session closed for user root Sep 06 06:51:31 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-1b05a556-fde0-4cc9-9acc-aefbf52d54df tempest-VolumeAndVolumeTypeFromImageTest-1507622826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-ffd0e062-6ba3-47ea-9a0f-d7d8406d273f 1G" returned: 0 in 0.365s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:51:31 devstack cinder-volume[87329]: DEBUG cinder.volume.volume_utils [None req-1b05a556-fde0-4cc9-9acc-aefbf52d54df tempest-VolumeAndVolumeTypeFromImageTest-1507622826 None] Downloaded image 1255f0f5-40a6-485b-9604-068ac8269d65 ((None, [{'url': 'file:///opt/stack/data/glance/images/1255f0f5-40a6-485b-9604-068ac8269d65', 'metadata': {}}])) to volume ffd0e062-6ba3-47ea-9a0f-d7d8406d273f successfully. {{(pid=87329) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 06 06:51:31 devstack cinder-volume[87329]: DEBUG cinder.image.image_utils [None req-1b05a556-fde0-4cc9-9acc-aefbf52d54df tempest-VolumeAndVolumeTypeFromImageTest-1507622826 None] Temporary image 1255f0f5-40a6-485b-9604-068ac8269d65 for user 713da993514c4f329dc56b30d22a157b is deleted. {{(pid=87329) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 06 06:51:31 devstack cinder-volume[87329]: DEBUG cinder.volume.volume_utils [None req-1b05a556-fde0-4cc9-9acc-aefbf52d54df tempest-VolumeAndVolumeTypeFromImageTest-1507622826 None] Marking volume ffd0e062-6ba3-47ea-9a0f-d7d8406d273f as bootable. {{(pid=87329) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 06 06:51:31 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b05a556-fde0-4cc9-9acc-aefbf52d54df tempest-VolumeAndVolumeTypeFromImageTest-1507622826 None] Copying metadata from image 1255f0f5-40a6-485b-9604-068ac8269d65 to ffd0e062-6ba3-47ea-9a0f-d7d8406d273f. {{(pid=87329) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 06 06:51:31 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b05a556-fde0-4cc9-9acc-aefbf52d54df tempest-VolumeAndVolumeTypeFromImageTest-1507622826 None] Creating volume glance metadata for volume ffd0e062-6ba3-47ea-9a0f-d7d8406d273f backed by image 1255f0f5-40a6-485b-9604-068ac8269d65 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '1255f0f5-40a6-485b-9604-068ac8269d65', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '771a7bf12ad20cf3a1cd6c990461d19e', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87329) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 06 06:51:31 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-4e41c0dc-1e8f-4b42-a127-3a2b5e155038 tempest-CreateVolumesFromImageTest-786532930 None] Acquiring lock "cinder-2cd1fa30-99fc-4ca1-9288-02d5d6d99d5e-delete_volume" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:51:31 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-4e41c0dc-1e8f-4b42-a127-3a2b5e155038 tempest-CreateVolumesFromImageTest-786532930 None] Lock "cinder-2cd1fa30-99fc-4ca1-9288-02d5d6d99d5e-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:51:31 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-4e41c0dc-1e8f-4b42-a127-3a2b5e155038 tempest-CreateVolumesFromImageTest-786532930 None] Acquiring lock "cinder-quobyte-2cd1fa30-99fc-4ca1-9288-02d5d6d99d5e" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:51:31 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-1b05a556-fde0-4cc9-9acc-aefbf52d54df tempest-VolumeAndVolumeTypeFromImageTest-1507622826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78b9e48d-ce73-4772-81ea-a59861da1040) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ffd0e062-6ba3-47ea-9a0f-d7d8406d273f', 'volume_size': 1, 'image_id': '1255f0f5-40a6-485b-9604-068ac8269d65', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1255f0f5-40a6-485b-9604-068ac8269d65', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '771a7bf12ad20cf3a1cd6c990461d19e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f4b75cec633343eabc4bb5d5836ccd1d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e855f9ae3fd13e9caaa65572a58abfc7b1ad119a7b9ce1f1b05aafd76545699c8b8dadd55d8978d01e1febd80ef217f2ac7e106189a3ec0d42929030cc66d3c7', 'id': '1255f0f5-40a6-485b-9604-068ac8269d65', 'created_at': datetime.datetime(2026, 9, 6, 4, 51, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 6, 4, 51, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1255f0f5-40a6-485b-9604-068ac8269d65/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:51:31 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-1b05a556-fde0-4cc9-9acc-aefbf52d54df tempest-VolumeAndVolumeTypeFromImageTest-1507622826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0477826-a18b-4bad-9902-c350bd055dcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:51:31 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-4e41c0dc-1e8f-4b42-a127-3a2b5e155038 tempest-CreateVolumesFromImageTest-786532930 None] Lock "cinder-quobyte-2cd1fa30-99fc-4ca1-9288-02d5d6d99d5e" acquired by "delete_volume" :: waited 0.038s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:51:31 devstack sudo[106367]: pam_unix(sudo:session): session closed for user root Sep 06 06:51:31 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-717902d2-3887-4adb-b8d3-1dcc4209912a tempest-CreateVolumesFromImageTest-786532930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.347s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:51:31 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-717902d2-3887-4adb-b8d3-1dcc4209912a tempest-CreateVolumesFromImageTest-786532930 None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:51:31 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-717902d2-3887-4adb-b8d3-1dcc4209912a tempest-CreateVolumesFromImageTest-786532930 None] Deleted volume successfully. Sep 06 06:51:31 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ef849b4-2b25-4a01-9ed7-b4a569c8a2d6]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:51:31 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-4e41c0dc-1e8f-4b42-a127-3a2b5e155038 tempest-CreateVolumesFromImageTest-786532930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-2cd1fa30-99fc-4ca1-9288-02d5d6d99d5e {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:51:31 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-1b05a556-fde0-4cc9-9acc-aefbf52d54df tempest-VolumeAndVolumeTypeFromImageTest-1507622826 None] Volume volume-ffd0e062-6ba3-47ea-9a0f-d7d8406d273f (ffd0e062-6ba3-47ea-9a0f-d7d8406d273f): created successfully Sep 06 06:51:31 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-1b05a556-fde0-4cc9-9acc-aefbf52d54df tempest-VolumeAndVolumeTypeFromImageTest-1507622826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0477826-a18b-4bad-9902-c350bd055dcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:51:31 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-1b05a556-fde0-4cc9-9acc-aefbf52d54df tempest-VolumeAndVolumeTypeFromImageTest-1507622826 None] Flow 'volume_create_manager' (82592174-56a7-4a2f-b621-27942f44e61c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:51:31 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-717902d2-3887-4adb-b8d3-1dcc4209912a tempest-CreateVolumesFromImageTest-786532930 None] Lock "cinder-d5c5b18d-99cc-4b56-9b99-f109d46a5eec-delete_volume" released by "delete_volume" :: held 1.402s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:51:31 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-1b05a556-fde0-4cc9-9acc-aefbf52d54df tempest-VolumeAndVolumeTypeFromImageTest-1507622826 None] Created volume successfully. Sep 06 06:51:31 devstack sudo[106365]: pam_unix(sudo:session): session closed for user root Sep 06 06:51:31 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-706cb5c4-b9a7-4efd-afe6-95c81c6c09e3 tempest-CreateVolumesFromSnapshotTest-499441882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-4eae1be3-f28d-4929-9c94-9939377f9f4f 1073741824" returned: 0 in 0.541s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:51:31 devstack sudo[106377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-2cd1fa30-99fc-4ca1-9288-02d5d6d99d5e Sep 06 06:51:31 devstack sudo[106377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:51:31 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-706cb5c4-b9a7-4efd-afe6-95c81c6c09e3 tempest-CreateVolumesFromSnapshotTest-499441882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-4eae1be3-f28d-4929-9c94-9939377f9f4f {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:51:31 devstack sudo[106380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-4eae1be3-f28d-4929-9c94-9939377f9f4f Sep 06 06:51:31 devstack sudo[106380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:51:32 devstack sudo[106377]: pam_unix(sudo:session): session closed for user root Sep 06 06:51:32 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-4e41c0dc-1e8f-4b42-a127-3a2b5e155038 tempest-CreateVolumesFromImageTest-786532930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-2cd1fa30-99fc-4ca1-9288-02d5d6d99d5e" returned: 0 in 0.378s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:51:32 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-4e41c0dc-1e8f-4b42-a127-3a2b5e155038 tempest-CreateVolumesFromImageTest-786532930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-2cd1fa30-99fc-4ca1-9288-02d5d6d99d5e {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:51:32 devstack sudo[106380]: pam_unix(sudo:session): session closed for user root Sep 06 06:51:32 devstack sudo[106386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-2cd1fa30-99fc-4ca1-9288-02d5d6d99d5e Sep 06 06:51:32 devstack sudo[106386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:51:32 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-706cb5c4-b9a7-4efd-afe6-95c81c6c09e3 tempest-CreateVolumesFromSnapshotTest-499441882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-4eae1be3-f28d-4929-9c94-9939377f9f4f" returned: 0 in 0.253s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:51:32 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-706cb5c4-b9a7-4efd-afe6-95c81c6c09e3 tempest-CreateVolumesFromSnapshotTest-499441882 None] <== create_volume: return (839ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'} {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 06:51:32 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-706cb5c4-b9a7-4efd-afe6-95c81c6c09e3 tempest-CreateVolumesFromSnapshotTest-499441882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.843s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:51:32 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-f38b6033-4540-4bc9-bbf3-972a6e0b83c4 tempest-CreateVolumesFromSnapshotTest-499441882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.611s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:51:32 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-f38b6033-4540-4bc9-bbf3-972a6e0b83c4 tempest-CreateVolumesFromSnapshotTest-499441882 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:51:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-330448649',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9e47d17-a989-4b52-a194-af981168b071,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2de6bc06e3f64a14896af2f97faf9f4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:51:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:51:27Z,use_quota=True,user_id='980ea4c91fca44ea8cff75dd4148f201',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)}" {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 06:51:32 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-f38b6033-4540-4bc9-bbf3-972a6e0b83c4 tempest-CreateVolumesFromSnapshotTest-499441882 None] Creating volume a9e47d17-a989-4b52-a194-af981168b071 {{(pid=87329) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 06:51:32 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-f38b6033-4540-4bc9-bbf3-972a6e0b83c4 tempest-CreateVolumesFromSnapshotTest-499441882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:51:32 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-f38b6033-4540-4bc9-bbf3-972a6e0b83c4 tempest-CreateVolumesFromSnapshotTest-499441882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:51:32 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-f38b6033-4540-4bc9-bbf3-972a6e0b83c4 tempest-CreateVolumesFromSnapshotTest-499441882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:51:32 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-f38b6033-4540-4bc9-bbf3-972a6e0b83c4 tempest-CreateVolumesFromSnapshotTest-499441882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:51:32 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-f38b6033-4540-4bc9-bbf3-972a6e0b83c4 tempest-CreateVolumesFromSnapshotTest-499441882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:51:32 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-f38b6033-4540-4bc9-bbf3-972a6e0b83c4 tempest-CreateVolumesFromSnapshotTest-499441882 None] Selected osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 as target Quobyte volume. {{(pid=87329) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 06:51:32 devstack cinder-volume[87329]: INFO cinder.volume.drivers.remotefs [None req-f38b6033-4540-4bc9-bbf3-972a6e0b83c4 tempest-CreateVolumesFromSnapshotTest-499441882 None] casted to osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 Sep 06 06:51:32 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-f38b6033-4540-4bc9-bbf3-972a6e0b83c4 tempest-CreateVolumesFromSnapshotTest-499441882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-a9e47d17-a989-4b52-a194-af981168b071 1073741824 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:51:32 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-706cb5c4-b9a7-4efd-afe6-95c81c6c09e3 tempest-CreateVolumesFromSnapshotTest-499441882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94c219d6-62bb-4989-b4dc-a8a692457f32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4eae1be3-f28d-4929-9c94-9939377f9f4f', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:51:32 devstack sudo[106388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-a9e47d17-a989-4b52-a194-af981168b071 1073741824 Sep 06 06:51:32 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-706cb5c4-b9a7-4efd-afe6-95c81c6c09e3 tempest-CreateVolumesFromSnapshotTest-499441882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e655e20-00d3-4382-bd2d-a4f26295e249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:51:32 devstack sudo[106388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:51:32 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-706cb5c4-b9a7-4efd-afe6-95c81c6c09e3 tempest-CreateVolumesFromSnapshotTest-499441882 None] Volume volume-4eae1be3-f28d-4929-9c94-9939377f9f4f (4eae1be3-f28d-4929-9c94-9939377f9f4f): created successfully Sep 06 06:51:32 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-706cb5c4-b9a7-4efd-afe6-95c81c6c09e3 tempest-CreateVolumesFromSnapshotTest-499441882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e655e20-00d3-4382-bd2d-a4f26295e249) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:51:32 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-706cb5c4-b9a7-4efd-afe6-95c81c6c09e3 tempest-CreateVolumesFromSnapshotTest-499441882 None] Flow 'volume_create_manager' (20236ee4-681f-45e3-a0f6-68ac95d48479) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:51:32 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-706cb5c4-b9a7-4efd-afe6-95c81c6c09e3 tempest-CreateVolumesFromSnapshotTest-499441882 None] Created volume successfully. Sep 06 06:51:32 devstack sudo[106386]: pam_unix(sudo:session): session closed for user root Sep 06 06:51:32 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-4e41c0dc-1e8f-4b42-a127-3a2b5e155038 tempest-CreateVolumesFromImageTest-786532930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-2cd1fa30-99fc-4ca1-9288-02d5d6d99d5e" returned: 0 in 0.248s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:51:32 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-4e41c0dc-1e8f-4b42-a127-3a2b5e155038 tempest-CreateVolumesFromImageTest-786532930 None] Lock "cinder-quobyte-2cd1fa30-99fc-4ca1-9288-02d5d6d99d5e" released by "delete_volume" :: held 0.675s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:51:32 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-4e41c0dc-1e8f-4b42-a127-3a2b5e155038 tempest-CreateVolumesFromImageTest-786532930 None] Created reservations ['2cdb1a81-6560-49a5-b9c4-a393c599a122', 'e950ed5a-97ca-498e-89d7-db3c167bf8bc', '2fa08fe5-789e-458d-b10a-c4a916b157bb', '28e977cc-043a-4c05-9cfa-a76715b0b1f0'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:51:32 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-4e41c0dc-1e8f-4b42-a127-3a2b5e155038 tempest-CreateVolumesFromImageTest-786532930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:51:32 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-4e41c0dc-1e8f-4b42-a127-3a2b5e155038 tempest-CreateVolumesFromImageTest-786532930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:51:32 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-4e41c0dc-1e8f-4b42-a127-3a2b5e155038 tempest-CreateVolumesFromImageTest-786532930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:51:32 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-4e41c0dc-1e8f-4b42-a127-3a2b5e155038 tempest-CreateVolumesFromImageTest-786532930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:51:32 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-4e41c0dc-1e8f-4b42-a127-3a2b5e155038 tempest-CreateVolumesFromImageTest-786532930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:51:32 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-4e41c0dc-1e8f-4b42-a127-3a2b5e155038 tempest-CreateVolumesFromImageTest-786532930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:51:32 devstack sudo[106394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:51:32 devstack sudo[106394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:51:32 devstack sudo[106388]: pam_unix(sudo:session): session closed for user root Sep 06 06:51:32 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-f38b6033-4540-4bc9-bbf3-972a6e0b83c4 tempest-CreateVolumesFromSnapshotTest-499441882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-a9e47d17-a989-4b52-a194-af981168b071 1073741824" returned: 0 in 0.458s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:51:32 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-f38b6033-4540-4bc9-bbf3-972a6e0b83c4 tempest-CreateVolumesFromSnapshotTest-499441882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-a9e47d17-a989-4b52-a194-af981168b071 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:51:32 devstack sudo[106396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-a9e47d17-a989-4b52-a194-af981168b071 Sep 06 06:51:32 devstack sudo[106396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:51:32 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-2448de27-f28f-4bb2-923b-ac8783300fd3 tempest-CreateVolumesFromImageTest-786532930 None] Acquiring lock "cinder-11732edd-d0b0-4922-9408-ee6ad3e01e39-delete_volume" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:51:32 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-d76003b9-eeee-4726-8032-c13d18c2d1eb tempest-VolumeAndVolumeTypeFromImageTest-1507622826 None] Acquiring lock "cinder-ffd0e062-6ba3-47ea-9a0f-d7d8406d273f-delete_volume" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:51:32 devstack sudo[106394]: pam_unix(sudo:session): session closed for user root Sep 06 06:51:32 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-2448de27-f28f-4bb2-923b-ac8783300fd3 tempest-CreateVolumesFromImageTest-786532930 None] Lock "cinder-11732edd-d0b0-4922-9408-ee6ad3e01e39-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:51:32 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-4e41c0dc-1e8f-4b42-a127-3a2b5e155038 tempest-CreateVolumesFromImageTest-786532930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.313s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:51:32 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-4e41c0dc-1e8f-4b42-a127-3a2b5e155038 tempest-CreateVolumesFromImageTest-786532930 None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:51:32 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-4e41c0dc-1e8f-4b42-a127-3a2b5e155038 tempest-CreateVolumesFromImageTest-786532930 None] Deleted volume successfully. Sep 06 06:51:32 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-d76003b9-eeee-4726-8032-c13d18c2d1eb tempest-VolumeAndVolumeTypeFromImageTest-1507622826 None] Lock "cinder-ffd0e062-6ba3-47ea-9a0f-d7d8406d273f-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:51:32 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-4e41c0dc-1e8f-4b42-a127-3a2b5e155038 tempest-CreateVolumesFromImageTest-786532930 None] Lock "cinder-2cd1fa30-99fc-4ca1-9288-02d5d6d99d5e-delete_volume" released by "delete_volume" :: held 1.252s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:51:32 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-2448de27-f28f-4bb2-923b-ac8783300fd3 tempest-CreateVolumesFromImageTest-786532930 None] Acquiring lock "cinder-quobyte-11732edd-d0b0-4922-9408-ee6ad3e01e39" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:51:32 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-d76003b9-eeee-4726-8032-c13d18c2d1eb tempest-VolumeAndVolumeTypeFromImageTest-1507622826 None] Acquiring lock "cinder-quobyte-ffd0e062-6ba3-47ea-9a0f-d7d8406d273f" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:51:32 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-2448de27-f28f-4bb2-923b-ac8783300fd3 tempest-CreateVolumesFromImageTest-786532930 None] Lock "cinder-quobyte-11732edd-d0b0-4922-9408-ee6ad3e01e39" acquired by "delete_volume" :: waited 0.029s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:51:32 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-d76003b9-eeee-4726-8032-c13d18c2d1eb tempest-VolumeAndVolumeTypeFromImageTest-1507622826 None] Lock "cinder-quobyte-ffd0e062-6ba3-47ea-9a0f-d7d8406d273f" acquired by "delete_volume" :: waited 0.038s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:51:32 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[83619390-fa4c-40fa-bc7e-65d81f604641]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:51:32 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-2448de27-f28f-4bb2-923b-ac8783300fd3 tempest-CreateVolumesFromImageTest-786532930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-11732edd-d0b0-4922-9408-ee6ad3e01e39 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:51:33 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8299b2c-db8d-48c3-ad40-2b3e113c559c]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:51:33 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-d76003b9-eeee-4726-8032-c13d18c2d1eb tempest-VolumeAndVolumeTypeFromImageTest-1507622826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-ffd0e062-6ba3-47ea-9a0f-d7d8406d273f {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:51:33 devstack sudo[106396]: pam_unix(sudo:session): session closed for user root Sep 06 06:51:33 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-f38b6033-4540-4bc9-bbf3-972a6e0b83c4 tempest-CreateVolumesFromSnapshotTest-499441882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-a9e47d17-a989-4b52-a194-af981168b071" returned: 0 in 0.319s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:51:33 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-f38b6033-4540-4bc9-bbf3-972a6e0b83c4 tempest-CreateVolumesFromSnapshotTest-499441882 None] <== create_volume: return (844ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'} {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 06:51:33 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-f38b6033-4540-4bc9-bbf3-972a6e0b83c4 tempest-CreateVolumesFromSnapshotTest-499441882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.847s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:51:33 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-db0770ad-39d6-4107-a2e1-346d7a266849 tempest-VolumeDependencyTests-1618338243 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 3.775s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:51:33 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-db0770ad-39d6-4107-a2e1-346d7a266849 tempest-VolumeDependencyTests-1618338243 None] Acquiring lock "cinder-quobyte-32c09ec4-10a8-4e63-8cc2-93be13c0aeac-115496dd-f46d-4766-8fcd-c28f99191df8" by "_create_volume_from_snapshot" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:51:33 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-f38b6033-4540-4bc9-bbf3-972a6e0b83c4 tempest-CreateVolumesFromSnapshotTest-499441882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56ce8f59-7c89-47a7-a8fc-ac494be6e89e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9e47d17-a989-4b52-a194-af981168b071', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:51:33 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-f38b6033-4540-4bc9-bbf3-972a6e0b83c4 tempest-CreateVolumesFromSnapshotTest-499441882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0d96aeb-15a3-405d-aa14-477d81cf8580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:51:33 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-f38b6033-4540-4bc9-bbf3-972a6e0b83c4 tempest-CreateVolumesFromSnapshotTest-499441882 None] Volume volume-a9e47d17-a989-4b52-a194-af981168b071 (a9e47d17-a989-4b52-a194-af981168b071): created successfully Sep 06 06:51:33 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-f38b6033-4540-4bc9-bbf3-972a6e0b83c4 tempest-CreateVolumesFromSnapshotTest-499441882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0d96aeb-15a3-405d-aa14-477d81cf8580) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:51:33 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-f38b6033-4540-4bc9-bbf3-972a6e0b83c4 tempest-CreateVolumesFromSnapshotTest-499441882 None] Flow 'volume_create_manager' (1641193f-fa27-4cfb-9dd5-2812a38c9411) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:51:33 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-db0770ad-39d6-4107-a2e1-346d7a266849 tempest-VolumeDependencyTests-1618338243 None] Lock "cinder-quobyte-32c09ec4-10a8-4e63-8cc2-93be13c0aeac-115496dd-f46d-4766-8fcd-c28f99191df8" acquired by "_create_volume_from_snapshot" :: waited 0.050s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:51:33 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-db0770ad-39d6-4107-a2e1-346d7a266849 tempest-VolumeDependencyTests-1618338243 None] Creating volume 115496dd-f46d-4766-8fcd-c28f99191df8 from snapshot 32c09ec4-10a8-4e63-8cc2-93be13c0aeac {{(pid=87329) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 06 06:51:33 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-db0770ad-39d6-4107-a2e1-346d7a266849 tempest-VolumeDependencyTests-1618338243 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:51:33 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-db0770ad-39d6-4107-a2e1-346d7a266849 tempest-VolumeDependencyTests-1618338243 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:51:33 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-db0770ad-39d6-4107-a2e1-346d7a266849 tempest-VolumeDependencyTests-1618338243 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:51:33 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-db0770ad-39d6-4107-a2e1-346d7a266849 tempest-VolumeDependencyTests-1618338243 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:51:33 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-db0770ad-39d6-4107-a2e1-346d7a266849 tempest-VolumeDependencyTests-1618338243 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:51:33 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-db0770ad-39d6-4107-a2e1-346d7a266849 tempest-VolumeDependencyTests-1618338243 None] Selected osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 as target Quobyte volume. {{(pid=87329) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 06:51:33 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-db0770ad-39d6-4107-a2e1-346d7a266849 tempest-VolumeDependencyTests-1618338243 None] Acquiring lock "cinder-quobyte-115496dd-f46d-4766-8fcd-c28f99191df8" by "_copy_volume_from_snapshot" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:51:33 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-f38b6033-4540-4bc9-bbf3-972a6e0b83c4 tempest-CreateVolumesFromSnapshotTest-499441882 None] Created volume successfully. Sep 06 06:51:33 devstack sudo[106400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-11732edd-d0b0-4922-9408-ee6ad3e01e39 Sep 06 06:51:33 devstack sudo[106400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:51:33 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-db0770ad-39d6-4107-a2e1-346d7a266849 tempest-VolumeDependencyTests-1618338243 None] Lock "cinder-quobyte-115496dd-f46d-4766-8fcd-c28f99191df8" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:51:33 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-db0770ad-39d6-4107-a2e1-346d7a266849 tempest-VolumeDependencyTests-1618338243 None] snapshot: 32c09ec4-10a8-4e63-8cc2-93be13c0aeac, volume: 115496dd-f46d-4766-8fcd-c28f99191df8, {{(pid=87329) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 06 06:51:33 devstack sudo[106401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-ffd0e062-6ba3-47ea-9a0f-d7d8406d273f Sep 06 06:51:33 devstack sudo[106401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:51:33 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-db0770ad-39d6-4107-a2e1-346d7a266849 tempest-VolumeDependencyTests-1618338243 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:51:33 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-db0770ad-39d6-4107-a2e1-346d7a266849 tempest-VolumeDependencyTests-1618338243 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:51:33 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-db0770ad-39d6-4107-a2e1-346d7a266849 tempest-VolumeDependencyTests-1618338243 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:51:33 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-db0770ad-39d6-4107-a2e1-346d7a266849 tempest-VolumeDependencyTests-1618338243 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:51:33 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-db0770ad-39d6-4107-a2e1-346d7a266849 tempest-VolumeDependencyTests-1618338243 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:51:33 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb86b527-52be-43c6-9458-11c5b8309bbe]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:51:33 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-db0770ad-39d6-4107-a2e1-346d7a266849 tempest-VolumeDependencyTests-1618338243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-fa5460fe-3c45-4eaf-98bf-cad81902db55.32c09ec4-10a8-4e63-8cc2-93be13c0aeac {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:51:33 devstack sudo[106404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-fa5460fe-3c45-4eaf-98bf-cad81902db55.32c09ec4-10a8-4e63-8cc2-93be13c0aeac Sep 06 06:51:33 devstack sudo[106404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:51:33 devstack sudo[106400]: pam_unix(sudo:session): session closed for user root Sep 06 06:51:33 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-2448de27-f28f-4bb2-923b-ac8783300fd3 tempest-CreateVolumesFromImageTest-786532930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-11732edd-d0b0-4922-9408-ee6ad3e01e39" returned: 0 in 0.422s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:51:33 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-2448de27-f28f-4bb2-923b-ac8783300fd3 tempest-CreateVolumesFromImageTest-786532930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-11732edd-d0b0-4922-9408-ee6ad3e01e39 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:51:33 devstack sudo[106401]: pam_unix(sudo:session): session closed for user root Sep 06 06:51:33 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-d76003b9-eeee-4726-8032-c13d18c2d1eb tempest-VolumeAndVolumeTypeFromImageTest-1507622826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-ffd0e062-6ba3-47ea-9a0f-d7d8406d273f" returned: 0 in 0.415s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:51:33 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-d76003b9-eeee-4726-8032-c13d18c2d1eb tempest-VolumeAndVolumeTypeFromImageTest-1507622826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-ffd0e062-6ba3-47ea-9a0f-d7d8406d273f {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:51:33 devstack sudo[106412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-11732edd-d0b0-4922-9408-ee6ad3e01e39 Sep 06 06:51:33 devstack sudo[106412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:51:33 devstack sudo[106413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-ffd0e062-6ba3-47ea-9a0f-d7d8406d273f Sep 06 06:51:33 devstack sudo[106413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:51:33 devstack sudo[106404]: pam_unix(sudo:session): session closed for user root Sep 06 06:51:33 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-db0770ad-39d6-4107-a2e1-346d7a266849 tempest-VolumeDependencyTests-1618338243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-fa5460fe-3c45-4eaf-98bf-cad81902db55.32c09ec4-10a8-4e63-8cc2-93be13c0aeac" returned: 0 in 0.365s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:51:33 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-db0770ad-39d6-4107-a2e1-346d7a266849 tempest-VolumeDependencyTests-1618338243 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fa5460fe-3c45-4eaf-98bf-cad81902db55(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87329) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 06:51:33 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc994a5d-3f4d-4874-b201-f743f7ba6e82]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:51:33 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-db0770ad-39d6-4107-a2e1-346d7a266849 tempest-VolumeDependencyTests-1618338243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-fa5460fe-3c45-4eaf-98bf-cad81902db55 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:51:33 devstack sudo[106412]: pam_unix(sudo:session): session closed for user root Sep 06 06:51:33 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-2448de27-f28f-4bb2-923b-ac8783300fd3 tempest-CreateVolumesFromImageTest-786532930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-11732edd-d0b0-4922-9408-ee6ad3e01e39" returned: 0 in 0.262s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:51:33 devstack sudo[106419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-fa5460fe-3c45-4eaf-98bf-cad81902db55 Sep 06 06:51:33 devstack sudo[106419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:51:33 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-2448de27-f28f-4bb2-923b-ac8783300fd3 tempest-CreateVolumesFromImageTest-786532930 None] Lock "cinder-quobyte-11732edd-d0b0-4922-9408-ee6ad3e01e39" released by "delete_volume" :: held 0.742s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:51:33 devstack sudo[106413]: pam_unix(sudo:session): session closed for user root Sep 06 06:51:33 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-d76003b9-eeee-4726-8032-c13d18c2d1eb tempest-VolumeAndVolumeTypeFromImageTest-1507622826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-ffd0e062-6ba3-47ea-9a0f-d7d8406d273f" returned: 0 in 0.284s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:51:33 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-d76003b9-eeee-4726-8032-c13d18c2d1eb tempest-VolumeAndVolumeTypeFromImageTest-1507622826 None] Lock "cinder-quobyte-ffd0e062-6ba3-47ea-9a0f-d7d8406d273f" released by "delete_volume" :: held 0.754s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:51:33 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-2448de27-f28f-4bb2-923b-ac8783300fd3 tempest-CreateVolumesFromImageTest-786532930 None] Created reservations ['f8e4076b-6bc5-4ed3-9475-ebf2aac56a12', '4ce223b5-f18a-42ed-bc5b-c731dff8c583', '60b4fb56-11bd-4373-8e97-cf5d7337574a', 'f42c781d-ba32-4b3b-9185-05582b7c4f1f'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:51:33 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-d76003b9-eeee-4726-8032-c13d18c2d1eb tempest-VolumeAndVolumeTypeFromImageTest-1507622826 None] Created reservations ['667a14d1-4de9-473d-a160-3f9228ef3019', 'be4372d6-7231-4b68-9562-03c045e7d94f', '7dda4534-263a-4341-854c-eb8ad60704b6', 'f5c3dccb-ce50-4994-9358-ece5931d2300'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:51:33 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-2448de27-f28f-4bb2-923b-ac8783300fd3 tempest-CreateVolumesFromImageTest-786532930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:51:33 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-2448de27-f28f-4bb2-923b-ac8783300fd3 tempest-CreateVolumesFromImageTest-786532930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:51:33 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-2448de27-f28f-4bb2-923b-ac8783300fd3 tempest-CreateVolumesFromImageTest-786532930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:51:33 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-2448de27-f28f-4bb2-923b-ac8783300fd3 tempest-CreateVolumesFromImageTest-786532930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:51:33 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-2448de27-f28f-4bb2-923b-ac8783300fd3 tempest-CreateVolumesFromImageTest-786532930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:51:33 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-2448de27-f28f-4bb2-923b-ac8783300fd3 tempest-CreateVolumesFromImageTest-786532930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:51:33 devstack sudo[106424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:51:33 devstack sudo[106424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:51:33 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-d76003b9-eeee-4726-8032-c13d18c2d1eb tempest-VolumeAndVolumeTypeFromImageTest-1507622826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:51:33 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-d76003b9-eeee-4726-8032-c13d18c2d1eb tempest-VolumeAndVolumeTypeFromImageTest-1507622826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:51:33 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-d76003b9-eeee-4726-8032-c13d18c2d1eb tempest-VolumeAndVolumeTypeFromImageTest-1507622826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:51:33 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-d76003b9-eeee-4726-8032-c13d18c2d1eb tempest-VolumeAndVolumeTypeFromImageTest-1507622826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:51:33 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-d76003b9-eeee-4726-8032-c13d18c2d1eb tempest-VolumeAndVolumeTypeFromImageTest-1507622826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:51:33 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-d76003b9-eeee-4726-8032-c13d18c2d1eb tempest-VolumeAndVolumeTypeFromImageTest-1507622826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:51:33 devstack sudo[106428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:51:33 devstack sudo[106428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:51:34 devstack sudo[106419]: pam_unix(sudo:session): session closed for user root Sep 06 06:51:34 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-db0770ad-39d6-4107-a2e1-346d7a266849 tempest-VolumeDependencyTests-1618338243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-fa5460fe-3c45-4eaf-98bf-cad81902db55" returned: 0 in 0.466s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:51:34 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-db0770ad-39d6-4107-a2e1-346d7a266849 tempest-VolumeDependencyTests-1618338243 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-fa5460fe-3c45-4eaf-98bf-cad81902db55 {{(pid=87329) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 06 06:51:34 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-db0770ad-39d6-4107-a2e1-346d7a266849 tempest-VolumeDependencyTests-1618338243 None] Creating direct copy from snapshot {{(pid=87329) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 06 06:51:34 devstack cinder-volume[87329]: DEBUG cinder.utils [None req-db0770ad-39d6-4107-a2e1-346d7a266849 tempest-VolumeDependencyTests-1618338243 None] Path /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-115496dd-f46d-4766-8fcd-c28f99191df8 not found in is_blk_device check {{(pid=87329) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 06 06:51:34 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-db0770ad-39d6-4107-a2e1-346d7a266849 tempest-VolumeDependencyTests-1618338243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-fa5460fe-3c45-4eaf-98bf-cad81902db55 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-115496dd-f46d-4766-8fcd-c28f99191df8 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:51:34 devstack sudo[106430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-fa5460fe-3c45-4eaf-98bf-cad81902db55 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-115496dd-f46d-4766-8fcd-c28f99191df8 Sep 06 06:51:34 devstack sudo[106430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:51:34 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-c14a26eb-35fa-4fc0-b7e4-0c835568550c tempest-CreateVolumesFromSnapshotTest-499441882 None] Acquiring lock "cinder-a9e47d17-a989-4b52-a194-af981168b071-delete_volume" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:51:34 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-c14a26eb-35fa-4fc0-b7e4-0c835568550c tempest-CreateVolumesFromSnapshotTest-499441882 None] Lock "cinder-a9e47d17-a989-4b52-a194-af981168b071-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:51:34 devstack sudo[106424]: pam_unix(sudo:session): session closed for user root Sep 06 06:51:34 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-2448de27-f28f-4bb2-923b-ac8783300fd3 tempest-CreateVolumesFromImageTest-786532930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.447s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:51:34 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-2448de27-f28f-4bb2-923b-ac8783300fd3 tempest-CreateVolumesFromImageTest-786532930 None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:51:34 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-2448de27-f28f-4bb2-923b-ac8783300fd3 tempest-CreateVolumesFromImageTest-786532930 None] Deleted volume successfully. Sep 06 06:51:34 devstack sudo[106428]: pam_unix(sudo:session): session closed for user root Sep 06 06:51:34 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-2448de27-f28f-4bb2-923b-ac8783300fd3 tempest-CreateVolumesFromImageTest-786532930 None] Lock "cinder-11732edd-d0b0-4922-9408-ee6ad3e01e39-delete_volume" released by "delete_volume" :: held 1.567s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:51:34 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-d76003b9-eeee-4726-8032-c13d18c2d1eb tempest-VolumeAndVolumeTypeFromImageTest-1507622826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.477s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:51:34 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-d76003b9-eeee-4726-8032-c13d18c2d1eb tempest-VolumeAndVolumeTypeFromImageTest-1507622826 None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:51:34 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-c14a26eb-35fa-4fc0-b7e4-0c835568550c tempest-CreateVolumesFromSnapshotTest-499441882 None] Acquiring lock "cinder-quobyte-a9e47d17-a989-4b52-a194-af981168b071" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:51:34 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-d76003b9-eeee-4726-8032-c13d18c2d1eb tempest-VolumeAndVolumeTypeFromImageTest-1507622826 None] Deleted volume successfully. Sep 06 06:51:34 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-c14a26eb-35fa-4fc0-b7e4-0c835568550c tempest-CreateVolumesFromSnapshotTest-499441882 None] Lock "cinder-quobyte-a9e47d17-a989-4b52-a194-af981168b071" acquired by "delete_volume" :: waited 0.024s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:51:34 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-d76003b9-eeee-4726-8032-c13d18c2d1eb tempest-VolumeAndVolumeTypeFromImageTest-1507622826 None] Lock "cinder-ffd0e062-6ba3-47ea-9a0f-d7d8406d273f-delete_volume" released by "delete_volume" :: held 1.581s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:51:34 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc25de15-e101-4f8d-b195-8f8cbcfe0cf9]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:51:34 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-c14a26eb-35fa-4fc0-b7e4-0c835568550c tempest-CreateVolumesFromSnapshotTest-499441882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-a9e47d17-a989-4b52-a194-af981168b071 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:51:34 devstack sudo[106438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-a9e47d17-a989-4b52-a194-af981168b071 Sep 06 06:51:34 devstack sudo[106438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:51:35 devstack sudo[106438]: pam_unix(sudo:session): session closed for user root Sep 06 06:51:35 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-c14a26eb-35fa-4fc0-b7e4-0c835568550c tempest-CreateVolumesFromSnapshotTest-499441882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-a9e47d17-a989-4b52-a194-af981168b071" returned: 0 in 0.795s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:51:35 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-c14a26eb-35fa-4fc0-b7e4-0c835568550c tempest-CreateVolumesFromSnapshotTest-499441882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-a9e47d17-a989-4b52-a194-af981168b071 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:51:35 devstack sudo[106449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-a9e47d17-a989-4b52-a194-af981168b071 Sep 06 06:51:35 devstack sudo[106449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:51:36 devstack sudo[106449]: pam_unix(sudo:session): session closed for user root Sep 06 06:51:36 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-c14a26eb-35fa-4fc0-b7e4-0c835568550c tempest-CreateVolumesFromSnapshotTest-499441882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-a9e47d17-a989-4b52-a194-af981168b071" returned: 0 in 0.716s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:51:36 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-c14a26eb-35fa-4fc0-b7e4-0c835568550c tempest-CreateVolumesFromSnapshotTest-499441882 None] Lock "cinder-quobyte-a9e47d17-a989-4b52-a194-af981168b071" released by "delete_volume" :: held 1.605s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:51:36 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-c14a26eb-35fa-4fc0-b7e4-0c835568550c tempest-CreateVolumesFromSnapshotTest-499441882 None] Created reservations ['76dbc3ab-b09a-4c88-92cb-ab939f73b443', 'a17124df-4578-4c80-951b-47372a56334a', '1f18c5bf-a81a-4e04-a370-11012dc09b1a', '334e3184-8920-48ef-846e-2a1c3eb0728b'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:51:36 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-c14a26eb-35fa-4fc0-b7e4-0c835568550c tempest-CreateVolumesFromSnapshotTest-499441882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:51:36 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-c14a26eb-35fa-4fc0-b7e4-0c835568550c tempest-CreateVolumesFromSnapshotTest-499441882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:51:36 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-c14a26eb-35fa-4fc0-b7e4-0c835568550c tempest-CreateVolumesFromSnapshotTest-499441882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:51:36 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-c14a26eb-35fa-4fc0-b7e4-0c835568550c tempest-CreateVolumesFromSnapshotTest-499441882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:51:36 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-c14a26eb-35fa-4fc0-b7e4-0c835568550c tempest-CreateVolumesFromSnapshotTest-499441882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:51:36 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-c14a26eb-35fa-4fc0-b7e4-0c835568550c tempest-CreateVolumesFromSnapshotTest-499441882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:51:36 devstack sudo[106453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:51:36 devstack sudo[106453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:51:36 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-4dad5e39-bc70-47e2-a41e-9e2ef53017f2 tempest-CreateVolumesFromSnapshotTest-499441882 None] Acquiring lock "cinder-4eae1be3-f28d-4929-9c94-9939377f9f4f-delete_volume" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:51:36 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-4dad5e39-bc70-47e2-a41e-9e2ef53017f2 tempest-CreateVolumesFromSnapshotTest-499441882 None] Lock "cinder-4eae1be3-f28d-4929-9c94-9939377f9f4f-delete_volume" acquired by "delete_volume" :: waited 0.077s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:51:37 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-4dad5e39-bc70-47e2-a41e-9e2ef53017f2 tempest-CreateVolumesFromSnapshotTest-499441882 None] Acquiring lock "cinder-quobyte-4eae1be3-f28d-4929-9c94-9939377f9f4f" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:51:37 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-4dad5e39-bc70-47e2-a41e-9e2ef53017f2 tempest-CreateVolumesFromSnapshotTest-499441882 None] Lock "cinder-quobyte-4eae1be3-f28d-4929-9c94-9939377f9f4f" acquired by "delete_volume" :: waited 0.065s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:51:37 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cd6933f-4fc3-4f45-91d9-7a859a776bfe]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:51:37 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-4dad5e39-bc70-47e2-a41e-9e2ef53017f2 tempest-CreateVolumesFromSnapshotTest-499441882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-4eae1be3-f28d-4929-9c94-9939377f9f4f {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:51:37 devstack sudo[106453]: pam_unix(sudo:session): session closed for user root Sep 06 06:51:37 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-c14a26eb-35fa-4fc0-b7e4-0c835568550c tempest-CreateVolumesFromSnapshotTest-499441882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.936s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:51:37 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-c14a26eb-35fa-4fc0-b7e4-0c835568550c tempest-CreateVolumesFromSnapshotTest-499441882 None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:51:37 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-c14a26eb-35fa-4fc0-b7e4-0c835568550c tempest-CreateVolumesFromSnapshotTest-499441882 None] Deleted volume successfully. Sep 06 06:51:37 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-c14a26eb-35fa-4fc0-b7e4-0c835568550c tempest-CreateVolumesFromSnapshotTest-499441882 None] Lock "cinder-a9e47d17-a989-4b52-a194-af981168b071-delete_volume" released by "delete_volume" :: held 3.242s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:51:37 devstack sudo[106455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-4eae1be3-f28d-4929-9c94-9939377f9f4f Sep 06 06:51:37 devstack sudo[106455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:51:38 devstack sudo[106455]: pam_unix(sudo:session): session closed for user root Sep 06 06:51:38 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-4dad5e39-bc70-47e2-a41e-9e2ef53017f2 tempest-CreateVolumesFromSnapshotTest-499441882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-4eae1be3-f28d-4929-9c94-9939377f9f4f" returned: 0 in 1.165s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:51:38 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-4dad5e39-bc70-47e2-a41e-9e2ef53017f2 tempest-CreateVolumesFromSnapshotTest-499441882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-4eae1be3-f28d-4929-9c94-9939377f9f4f {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:51:38 devstack sudo[106461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-4eae1be3-f28d-4929-9c94-9939377f9f4f Sep 06 06:51:38 devstack sudo[106461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:51:38 devstack sudo[106461]: pam_unix(sudo:session): session closed for user root Sep 06 06:51:38 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-4dad5e39-bc70-47e2-a41e-9e2ef53017f2 tempest-CreateVolumesFromSnapshotTest-499441882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-4eae1be3-f28d-4929-9c94-9939377f9f4f" returned: 0 in 0.510s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:51:38 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-4dad5e39-bc70-47e2-a41e-9e2ef53017f2 tempest-CreateVolumesFromSnapshotTest-499441882 None] Lock "cinder-quobyte-4eae1be3-f28d-4929-9c94-9939377f9f4f" released by "delete_volume" :: held 1.816s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:51:39 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-4dad5e39-bc70-47e2-a41e-9e2ef53017f2 tempest-CreateVolumesFromSnapshotTest-499441882 None] Created reservations ['c1904bb1-0f95-433b-8d9b-24b89b783145', '86f7d6ed-5717-4777-baa8-5662db460d91', '56d6dc03-bc39-46e3-997d-476c6cef31c4', 'd3376403-fa38-42f1-a137-aac60164727b'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:51:39 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-4dad5e39-bc70-47e2-a41e-9e2ef53017f2 tempest-CreateVolumesFromSnapshotTest-499441882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:51:39 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-4dad5e39-bc70-47e2-a41e-9e2ef53017f2 tempest-CreateVolumesFromSnapshotTest-499441882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:51:39 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-4dad5e39-bc70-47e2-a41e-9e2ef53017f2 tempest-CreateVolumesFromSnapshotTest-499441882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:51:39 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-4dad5e39-bc70-47e2-a41e-9e2ef53017f2 tempest-CreateVolumesFromSnapshotTest-499441882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:51:39 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-4dad5e39-bc70-47e2-a41e-9e2ef53017f2 tempest-CreateVolumesFromSnapshotTest-499441882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:51:39 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-4dad5e39-bc70-47e2-a41e-9e2ef53017f2 tempest-CreateVolumesFromSnapshotTest-499441882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:51:39 devstack sudo[106464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:51:39 devstack sudo[106464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:51:40 devstack sudo[106464]: pam_unix(sudo:session): session closed for user root Sep 06 06:51:40 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-4dad5e39-bc70-47e2-a41e-9e2ef53017f2 tempest-CreateVolumesFromSnapshotTest-499441882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.711s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:51:40 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-4dad5e39-bc70-47e2-a41e-9e2ef53017f2 tempest-CreateVolumesFromSnapshotTest-499441882 None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:51:40 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-4dad5e39-bc70-47e2-a41e-9e2ef53017f2 tempest-CreateVolumesFromSnapshotTest-499441882 None] Deleted volume successfully. Sep 06 06:51:40 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-4dad5e39-bc70-47e2-a41e-9e2ef53017f2 tempest-CreateVolumesFromSnapshotTest-499441882 None] Lock "cinder-4eae1be3-f28d-4929-9c94-9939377f9f4f-delete_volume" released by "delete_volume" :: held 3.247s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:51:40 devstack sudo[106430]: pam_unix(sudo:session): session closed for user root Sep 06 06:51:40 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-db0770ad-39d6-4107-a2e1-346d7a266849 tempest-VolumeDependencyTests-1618338243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-fa5460fe-3c45-4eaf-98bf-cad81902db55 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-115496dd-f46d-4766-8fcd-c28f99191df8" returned: 0 in 6.195s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:51:40 devstack cinder-volume[87329]: DEBUG cinder.image.image_utils [None req-db0770ad-39d6-4107-a2e1-346d7a266849 tempest-VolumeDependencyTests-1618338243 None] Image conversion details: src /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-fa5460fe-3c45-4eaf-98bf-cad81902db55, size 1024.00 MB, duration 6.20 sec, destination /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-115496dd-f46d-4766-8fcd-c28f99191df8 {{(pid=87329) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 06 06:51:40 devstack cinder-volume[87329]: INFO cinder.image.image_utils [None req-db0770ad-39d6-4107-a2e1-346d7a266849 tempest-VolumeDependencyTests-1618338243 None] Converted 1024.00 MB image at 165.27 MB/s Sep 06 06:51:40 devstack cinder-volume[87329]: WARNING cinder.volume.drivers.remotefs [None req-db0770ad-39d6-4107-a2e1-346d7a266849 tempest-VolumeDependencyTests-1618338243 None] /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-115496dd-f46d-4766-8fcd-c28f99191df8 is being set with open permissions: ugo+rw Sep 06 06:51:40 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-db0770ad-39d6-4107-a2e1-346d7a266849 tempest-VolumeDependencyTests-1618338243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-115496dd-f46d-4766-8fcd-c28f99191df8 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:51:40 devstack sudo[106468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-115496dd-f46d-4766-8fcd-c28f99191df8 Sep 06 06:51:40 devstack sudo[106468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:51:40 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-fe3f058c-1e00-4a5a-933a-679ba1c696ba tempest-CreateVolumesFromSnapshotTest-499441882 None] Acquiring lock "cinder-510c6730-6a62-4a12-b6af-4699e5bdfb9e-delete_volume" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:51:40 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-fe3f058c-1e00-4a5a-933a-679ba1c696ba tempest-CreateVolumesFromSnapshotTest-499441882 None] Lock "cinder-510c6730-6a62-4a12-b6af-4699e5bdfb9e-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:51:40 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-fe3f058c-1e00-4a5a-933a-679ba1c696ba tempest-CreateVolumesFromSnapshotTest-499441882 None] Acquiring lock "cinder-quobyte-510c6730-6a62-4a12-b6af-4699e5bdfb9e" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:51:40 devstack sudo[106468]: pam_unix(sudo:session): session closed for user root Sep 06 06:51:40 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-db0770ad-39d6-4107-a2e1-346d7a266849 tempest-VolumeDependencyTests-1618338243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-115496dd-f46d-4766-8fcd-c28f99191df8" returned: 0 in 0.299s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:51:40 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-fe3f058c-1e00-4a5a-933a-679ba1c696ba tempest-CreateVolumesFromSnapshotTest-499441882 None] Lock "cinder-quobyte-510c6730-6a62-4a12-b6af-4699e5bdfb9e" acquired by "delete_volume" :: waited 0.017s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:51:40 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-db0770ad-39d6-4107-a2e1-346d7a266849 tempest-VolumeDependencyTests-1618338243 None] Lock "cinder-quobyte-115496dd-f46d-4766-8fcd-c28f99191df8" released by "_copy_volume_from_snapshot" :: held 7.427s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:51:40 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d816e0d-50be-48b8-9efd-4fc274591504]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:51:40 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-fe3f058c-1e00-4a5a-933a-679ba1c696ba tempest-CreateVolumesFromSnapshotTest-499441882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-510c6730-6a62-4a12-b6af-4699e5bdfb9e {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:51:40 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-db0770ad-39d6-4107-a2e1-346d7a266849 tempest-VolumeDependencyTests-1618338243 None] Lock "cinder-quobyte-32c09ec4-10a8-4e63-8cc2-93be13c0aeac-115496dd-f46d-4766-8fcd-c28f99191df8" released by "_create_volume_from_snapshot" :: held 7.524s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:51:40 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-db0770ad-39d6-4107-a2e1-346d7a266849 tempest-VolumeDependencyTests-1618338243 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.576s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:51:40 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-db0770ad-39d6-4107-a2e1-346d7a266849 tempest-VolumeDependencyTests-1618338243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08ead5b1-af64-4d91-b681-d198d909d0b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-115496dd-f46d-4766-8fcd-c28f99191df8', 'volume_size': 1, 'snapshot_id': '32c09ec4-10a8-4e63-8cc2-93be13c0aeac'}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:51:40 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-db0770ad-39d6-4107-a2e1-346d7a266849 tempest-VolumeDependencyTests-1618338243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce5d19bf-6853-424b-a7af-c5bae198a90e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:51:40 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-db0770ad-39d6-4107-a2e1-346d7a266849 tempest-VolumeDependencyTests-1618338243 None] Volume volume-115496dd-f46d-4766-8fcd-c28f99191df8 (115496dd-f46d-4766-8fcd-c28f99191df8): created successfully Sep 06 06:51:40 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-db0770ad-39d6-4107-a2e1-346d7a266849 tempest-VolumeDependencyTests-1618338243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce5d19bf-6853-424b-a7af-c5bae198a90e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:51:40 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-db0770ad-39d6-4107-a2e1-346d7a266849 tempest-VolumeDependencyTests-1618338243 None] Flow 'volume_create_manager' (d86fdcce-dbd4-4756-a844-fafadb15990c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:51:40 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-db0770ad-39d6-4107-a2e1-346d7a266849 tempest-VolumeDependencyTests-1618338243 None] Created volume successfully. Sep 06 06:51:40 devstack sudo[106471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-510c6730-6a62-4a12-b6af-4699e5bdfb9e Sep 06 06:51:40 devstack sudo[106471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:51:41 devstack sudo[106471]: pam_unix(sudo:session): session closed for user root Sep 06 06:51:41 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-fe3f058c-1e00-4a5a-933a-679ba1c696ba tempest-CreateVolumesFromSnapshotTest-499441882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-510c6730-6a62-4a12-b6af-4699e5bdfb9e" returned: 0 in 0.454s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:51:41 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-fe3f058c-1e00-4a5a-933a-679ba1c696ba tempest-CreateVolumesFromSnapshotTest-499441882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-510c6730-6a62-4a12-b6af-4699e5bdfb9e {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:51:41 devstack sudo[106476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-510c6730-6a62-4a12-b6af-4699e5bdfb9e Sep 06 06:51:41 devstack sudo[106476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:51:41 devstack sudo[106476]: pam_unix(sudo:session): session closed for user root Sep 06 06:51:41 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-fe3f058c-1e00-4a5a-933a-679ba1c696ba tempest-CreateVolumesFromSnapshotTest-499441882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-510c6730-6a62-4a12-b6af-4699e5bdfb9e" returned: 0 in 0.262s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:51:41 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-fe3f058c-1e00-4a5a-933a-679ba1c696ba tempest-CreateVolumesFromSnapshotTest-499441882 None] Lock "cinder-quobyte-510c6730-6a62-4a12-b6af-4699e5bdfb9e" released by "delete_volume" :: held 0.774s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:51:41 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-fe3f058c-1e00-4a5a-933a-679ba1c696ba tempest-CreateVolumesFromSnapshotTest-499441882 None] Created reservations ['d74a43a9-88e5-47e2-9979-ab907608bf4e', '0b4bb817-da2f-40b7-8276-2f30fb6e47a0', '16a92ae3-0115-499d-897f-8473fbbaf3b3', '1b03ea91-6a4a-4d3f-a337-ba88bc37b867'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:51:41 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-1dc428a3-9ca2-495e-9263-3e7081a99959 tempest-VolumeDependencyTests-1618338243 None] Acquiring lock "cinder-32c09ec4-10a8-4e63-8cc2-93be13c0aeac-delete_snapshot" by "delete_snapshot" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:51:41 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-1dc428a3-9ca2-495e-9263-3e7081a99959 tempest-VolumeDependencyTests-1618338243 None] Lock "cinder-32c09ec4-10a8-4e63-8cc2-93be13c0aeac-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:51:41 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-1dc428a3-9ca2-495e-9263-3e7081a99959 tempest-VolumeDependencyTests-1618338243 None] Acquiring lock "cinder-quobyte-fa5460fe-3c45-4eaf-98bf-cad81902db55" by "delete_snapshot" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:51:41 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-fe3f058c-1e00-4a5a-933a-679ba1c696ba tempest-CreateVolumesFromSnapshotTest-499441882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:51:41 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-fe3f058c-1e00-4a5a-933a-679ba1c696ba tempest-CreateVolumesFromSnapshotTest-499441882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:51:41 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-fe3f058c-1e00-4a5a-933a-679ba1c696ba tempest-CreateVolumesFromSnapshotTest-499441882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:51:41 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-fe3f058c-1e00-4a5a-933a-679ba1c696ba tempest-CreateVolumesFromSnapshotTest-499441882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:51:41 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-fe3f058c-1e00-4a5a-933a-679ba1c696ba tempest-CreateVolumesFromSnapshotTest-499441882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:51:41 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-fe3f058c-1e00-4a5a-933a-679ba1c696ba tempest-CreateVolumesFromSnapshotTest-499441882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:51:41 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-1dc428a3-9ca2-495e-9263-3e7081a99959 tempest-VolumeDependencyTests-1618338243 None] Lock "cinder-quobyte-fa5460fe-3c45-4eaf-98bf-cad81902db55" acquired by "delete_snapshot" :: waited 0.044s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:51:41 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-1dc428a3-9ca2-495e-9263-3e7081a99959 tempest-VolumeDependencyTests-1618338243 None] Acquiring lock "cinder-quobyte-32c09ec4-10a8-4e63-8cc2-93be13c0aeac" by "_delete_snapshot" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:51:41 devstack sudo[106479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:51:41 devstack sudo[106479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:51:41 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-1dc428a3-9ca2-495e-9263-3e7081a99959 tempest-VolumeDependencyTests-1618338243 None] Lock "cinder-quobyte-32c09ec4-10a8-4e63-8cc2-93be13c0aeac" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:51:41 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-1dc428a3-9ca2-495e-9263-3e7081a99959 tempest-VolumeDependencyTests-1618338243 None] Deleting offline snapshot 32c09ec4-10a8-4e63-8cc2-93be13c0aeac of volume fa5460fe-3c45-4eaf-98bf-cad81902db55 {{(pid=87329) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 06 06:51:41 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-1dc428a3-9ca2-495e-9263-3e7081a99959 tempest-VolumeDependencyTests-1618338243 None] snapshot_file for this snap is: volume-fa5460fe-3c45-4eaf-98bf-cad81902db55.32c09ec4-10a8-4e63-8cc2-93be13c0aeac {{(pid=87329) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 06 06:51:41 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[a762a9c5-bad9-4be4-b339-2af89f7fdd17]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:51:41 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-1dc428a3-9ca2-495e-9263-3e7081a99959 tempest-VolumeDependencyTests-1618338243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-fa5460fe-3c45-4eaf-98bf-cad81902db55.32c09ec4-10a8-4e63-8cc2-93be13c0aeac {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:51:41 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-78aeb636-80af-48d2-af6f-72728d50720d tempest-CreateVolumesFromSnapshotTest-499441882 None] Acquiring lock "cinder-e55bcb32-3a06-4e03-adef-30f86de1793b-delete_volume" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:51:41 devstack sudo[106481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-fa5460fe-3c45-4eaf-98bf-cad81902db55.32c09ec4-10a8-4e63-8cc2-93be13c0aeac Sep 06 06:51:41 devstack sudo[106481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:51:41 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-78aeb636-80af-48d2-af6f-72728d50720d tempest-CreateVolumesFromSnapshotTest-499441882 None] Lock "cinder-e55bcb32-3a06-4e03-adef-30f86de1793b-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:51:41 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-78aeb636-80af-48d2-af6f-72728d50720d tempest-CreateVolumesFromSnapshotTest-499441882 None] Acquiring lock "cinder-quobyte-e55bcb32-3a06-4e03-adef-30f86de1793b" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:51:41 devstack sudo[106479]: pam_unix(sudo:session): session closed for user root Sep 06 06:51:41 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-78aeb636-80af-48d2-af6f-72728d50720d tempest-CreateVolumesFromSnapshotTest-499441882 None] Lock "cinder-quobyte-e55bcb32-3a06-4e03-adef-30f86de1793b" acquired by "delete_volume" :: waited 0.031s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:51:41 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-fe3f058c-1e00-4a5a-933a-679ba1c696ba tempest-CreateVolumesFromSnapshotTest-499441882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.387s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:51:41 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-fe3f058c-1e00-4a5a-933a-679ba1c696ba tempest-CreateVolumesFromSnapshotTest-499441882 None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:51:41 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-fe3f058c-1e00-4a5a-933a-679ba1c696ba tempest-CreateVolumesFromSnapshotTest-499441882 None] Deleted volume successfully. Sep 06 06:51:41 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7e37523-c69e-480e-8f29-a9813e590081]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:51:41 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-78aeb636-80af-48d2-af6f-72728d50720d tempest-CreateVolumesFromSnapshotTest-499441882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e55bcb32-3a06-4e03-adef-30f86de1793b {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:51:41 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-fe3f058c-1e00-4a5a-933a-679ba1c696ba tempest-CreateVolumesFromSnapshotTest-499441882 None] Lock "cinder-510c6730-6a62-4a12-b6af-4699e5bdfb9e-delete_volume" released by "delete_volume" :: held 1.485s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:51:42 devstack sudo[106484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e55bcb32-3a06-4e03-adef-30f86de1793b Sep 06 06:51:42 devstack sudo[106484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:51:42 devstack sudo[106481]: pam_unix(sudo:session): session closed for user root Sep 06 06:51:42 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-1dc428a3-9ca2-495e-9263-3e7081a99959 tempest-VolumeDependencyTests-1618338243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-fa5460fe-3c45-4eaf-98bf-cad81902db55.32c09ec4-10a8-4e63-8cc2-93be13c0aeac" returned: 0 in 0.537s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:51:42 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-1dc428a3-9ca2-495e-9263-3e7081a99959 tempest-VolumeDependencyTests-1618338243 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fa5460fe-3c45-4eaf-98bf-cad81902db55(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87329) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 06:51:42 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[48942e96-7d2c-4a9b-b77a-de66ba426ffa]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:51:42 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-1dc428a3-9ca2-495e-9263-3e7081a99959 tempest-VolumeDependencyTests-1618338243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-fa5460fe-3c45-4eaf-98bf-cad81902db55 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:51:42 devstack sudo[106489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-fa5460fe-3c45-4eaf-98bf-cad81902db55 Sep 06 06:51:42 devstack sudo[106489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:51:42 devstack sudo[106484]: pam_unix(sudo:session): session closed for user root Sep 06 06:51:42 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-78aeb636-80af-48d2-af6f-72728d50720d tempest-CreateVolumesFromSnapshotTest-499441882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e55bcb32-3a06-4e03-adef-30f86de1793b" returned: 0 in 0.516s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:51:42 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-78aeb636-80af-48d2-af6f-72728d50720d tempest-CreateVolumesFromSnapshotTest-499441882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e55bcb32-3a06-4e03-adef-30f86de1793b {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:51:42 devstack sudo[106494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e55bcb32-3a06-4e03-adef-30f86de1793b Sep 06 06:51:42 devstack sudo[106494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:51:42 devstack sudo[106494]: pam_unix(sudo:session): session closed for user root Sep 06 06:51:42 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-78aeb636-80af-48d2-af6f-72728d50720d tempest-CreateVolumesFromSnapshotTest-499441882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e55bcb32-3a06-4e03-adef-30f86de1793b" returned: 0 in 0.306s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:51:42 devstack sudo[106489]: pam_unix(sudo:session): session closed for user root Sep 06 06:51:42 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-78aeb636-80af-48d2-af6f-72728d50720d tempest-CreateVolumesFromSnapshotTest-499441882 None] Lock "cinder-quobyte-e55bcb32-3a06-4e03-adef-30f86de1793b" released by "delete_volume" :: held 0.902s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:51:42 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-1dc428a3-9ca2-495e-9263-3e7081a99959 tempest-VolumeDependencyTests-1618338243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-fa5460fe-3c45-4eaf-98bf-cad81902db55" returned: 0 in 0.603s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:51:42 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-1dc428a3-9ca2-495e-9263-3e7081a99959 tempest-VolumeDependencyTests-1618338243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-fa5460fe-3c45-4eaf-98bf-cad81902db55.32c09ec4-10a8-4e63-8cc2-93be13c0aeac {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:51:42 devstack sudo[106500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-fa5460fe-3c45-4eaf-98bf-cad81902db55.32c09ec4-10a8-4e63-8cc2-93be13c0aeac Sep 06 06:51:42 devstack sudo[106500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:51:42 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-78aeb636-80af-48d2-af6f-72728d50720d tempest-CreateVolumesFromSnapshotTest-499441882 None] Created reservations ['0d9ba7fa-53c4-463a-ba5d-a99bb952c029', '39804191-e8ee-41fd-af70-1cfb20d30578', 'bbadc9c0-6f40-4498-89fa-5b9c718188cb', '57164207-b6a3-45c3-86ad-ff0589bb2b0d'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:51:42 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-78aeb636-80af-48d2-af6f-72728d50720d tempest-CreateVolumesFromSnapshotTest-499441882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:51:42 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-78aeb636-80af-48d2-af6f-72728d50720d tempest-CreateVolumesFromSnapshotTest-499441882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:51:42 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-78aeb636-80af-48d2-af6f-72728d50720d tempest-CreateVolumesFromSnapshotTest-499441882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:51:42 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-78aeb636-80af-48d2-af6f-72728d50720d tempest-CreateVolumesFromSnapshotTest-499441882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:51:42 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-78aeb636-80af-48d2-af6f-72728d50720d tempest-CreateVolumesFromSnapshotTest-499441882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:51:42 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-78aeb636-80af-48d2-af6f-72728d50720d tempest-CreateVolumesFromSnapshotTest-499441882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:51:42 devstack sudo[106502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:51:42 devstack sudo[106502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:51:43 devstack sudo[106500]: pam_unix(sudo:session): session closed for user root Sep 06 06:51:43 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-1dc428a3-9ca2-495e-9263-3e7081a99959 tempest-VolumeDependencyTests-1618338243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-fa5460fe-3c45-4eaf-98bf-cad81902db55.32c09ec4-10a8-4e63-8cc2-93be13c0aeac" returned: 0 in 0.367s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:51:43 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-1dc428a3-9ca2-495e-9263-3e7081a99959 tempest-VolumeDependencyTests-1618338243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-fa5460fe-3c45-4eaf-98bf-cad81902db55.32c09ec4-10a8-4e63-8cc2-93be13c0aeac {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:51:43 devstack sudo[106509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-fa5460fe-3c45-4eaf-98bf-cad81902db55.32c09ec4-10a8-4e63-8cc2-93be13c0aeac Sep 06 06:51:43 devstack sudo[106509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:51:43 devstack sudo[106502]: pam_unix(sudo:session): session closed for user root Sep 06 06:51:43 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-2476bdf9-45c2-4bc1-9bc3-15accfda4f93 tempest-ProjectAdminTests-1799481984 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.6685256958008, 'free_capacity_gb': 1773.6685256958008, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87329) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 06 06:51:43 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-78aeb636-80af-48d2-af6f-72728d50720d tempest-CreateVolumesFromSnapshotTest-499441882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.262s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:51:43 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-78aeb636-80af-48d2-af6f-72728d50720d tempest-CreateVolumesFromSnapshotTest-499441882 None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:51:43 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-78aeb636-80af-48d2-af6f-72728d50720d tempest-CreateVolumesFromSnapshotTest-499441882 None] Deleted volume successfully. Sep 06 06:51:43 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-78aeb636-80af-48d2-af6f-72728d50720d tempest-CreateVolumesFromSnapshotTest-499441882 None] Lock "cinder-e55bcb32-3a06-4e03-adef-30f86de1793b-delete_volume" released by "delete_volume" :: held 1.442s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:51:43 devstack sudo[106509]: pam_unix(sudo:session): session closed for user root Sep 06 06:51:43 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-1dc428a3-9ca2-495e-9263-3e7081a99959 tempest-VolumeDependencyTests-1618338243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-fa5460fe-3c45-4eaf-98bf-cad81902db55.32c09ec4-10a8-4e63-8cc2-93be13c0aeac" returned: 0 in 0.261s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:51:43 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-1dc428a3-9ca2-495e-9263-3e7081a99959 tempest-VolumeDependencyTests-1618338243 None] Lock "cinder-quobyte-32c09ec4-10a8-4e63-8cc2-93be13c0aeac" released by "_delete_snapshot" :: held 1.895s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:51:43 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-1dc428a3-9ca2-495e-9263-3e7081a99959 tempest-VolumeDependencyTests-1618338243 None] Lock "cinder-quobyte-fa5460fe-3c45-4eaf-98bf-cad81902db55" released by "delete_snapshot" :: held 1.925s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:51:43 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-1dc428a3-9ca2-495e-9263-3e7081a99959 tempest-VolumeDependencyTests-1618338243 None] Created reservations ['866df036-232e-45b8-8eb8-f58a97af28d8', 'fce95f72-caf4-42f6-9b04-217465e93846', 'a797b465-9d18-42b9-8868-eb00aa552a7c', '50a3a623-9ddf-440a-9c99-cd9e2cd90030'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:51:43 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-1dc428a3-9ca2-495e-9263-3e7081a99959 tempest-VolumeDependencyTests-1618338243 None] Delete snapshot completed successfully. Sep 06 06:51:43 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-1dc428a3-9ca2-495e-9263-3e7081a99959 tempest-VolumeDependencyTests-1618338243 None] Lock "cinder-32c09ec4-10a8-4e63-8cc2-93be13c0aeac-delete_snapshot" released by "delete_snapshot" :: held 2.102s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:51:43 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-9614d662-29da-43c7-9439-05ab4ad5ad3e tempest-VolumeDependencyTests-1618338243 None] Acquiring lock "cinder-fa5460fe-3c45-4eaf-98bf-cad81902db55-delete_volume" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:51:43 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-9614d662-29da-43c7-9439-05ab4ad5ad3e tempest-VolumeDependencyTests-1618338243 None] Lock "cinder-fa5460fe-3c45-4eaf-98bf-cad81902db55-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:51:43 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-9614d662-29da-43c7-9439-05ab4ad5ad3e tempest-VolumeDependencyTests-1618338243 None] Acquiring lock "cinder-quobyte-fa5460fe-3c45-4eaf-98bf-cad81902db55" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:51:43 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-9614d662-29da-43c7-9439-05ab4ad5ad3e tempest-VolumeDependencyTests-1618338243 None] Lock "cinder-quobyte-fa5460fe-3c45-4eaf-98bf-cad81902db55" acquired by "delete_volume" :: waited 0.017s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:51:43 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ed0f703-7e59-4477-9204-c834cb3f13d7]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:51:43 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-9614d662-29da-43c7-9439-05ab4ad5ad3e tempest-VolumeDependencyTests-1618338243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-fa5460fe-3c45-4eaf-98bf-cad81902db55 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:51:43 devstack sudo[106526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-fa5460fe-3c45-4eaf-98bf-cad81902db55 Sep 06 06:51:43 devstack sudo[106526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:51:44 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-04a46617-a92a-43de-8400-0a158bf93634 tempest-CreateVolumesFromSnapshotTest-499441882 None] Acquiring lock "cinder-202822af-3551-4789-a3d9-ac6b8e38416a-delete_volume" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:51:44 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-04a46617-a92a-43de-8400-0a158bf93634 tempest-CreateVolumesFromSnapshotTest-499441882 None] Lock "cinder-202822af-3551-4789-a3d9-ac6b8e38416a-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:51:44 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-04a46617-a92a-43de-8400-0a158bf93634 tempest-CreateVolumesFromSnapshotTest-499441882 None] Acquiring lock "cinder-quobyte-202822af-3551-4789-a3d9-ac6b8e38416a" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:51:44 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-04a46617-a92a-43de-8400-0a158bf93634 tempest-CreateVolumesFromSnapshotTest-499441882 None] Lock "cinder-quobyte-202822af-3551-4789-a3d9-ac6b8e38416a" acquired by "delete_volume" :: waited 0.023s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:51:44 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[362a76d2-20b8-4830-989f-de258fafb9be]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:51:44 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-04a46617-a92a-43de-8400-0a158bf93634 tempest-CreateVolumesFromSnapshotTest-499441882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-202822af-3551-4789-a3d9-ac6b8e38416a {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:51:44 devstack sudo[106526]: pam_unix(sudo:session): session closed for user root Sep 06 06:51:44 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-9614d662-29da-43c7-9439-05ab4ad5ad3e tempest-VolumeDependencyTests-1618338243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-fa5460fe-3c45-4eaf-98bf-cad81902db55" returned: 0 in 0.536s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:51:44 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-9614d662-29da-43c7-9439-05ab4ad5ad3e tempest-VolumeDependencyTests-1618338243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-fa5460fe-3c45-4eaf-98bf-cad81902db55 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:51:44 devstack sudo[106552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-fa5460fe-3c45-4eaf-98bf-cad81902db55 Sep 06 06:51:44 devstack sudo[106552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:51:44 devstack sudo[106549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-202822af-3551-4789-a3d9-ac6b8e38416a Sep 06 06:51:44 devstack sudo[106549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:51:44 devstack sudo[106552]: pam_unix(sudo:session): session closed for user root Sep 06 06:51:44 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-9614d662-29da-43c7-9439-05ab4ad5ad3e tempest-VolumeDependencyTests-1618338243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-fa5460fe-3c45-4eaf-98bf-cad81902db55" returned: 0 in 0.392s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:51:44 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-9614d662-29da-43c7-9439-05ab4ad5ad3e tempest-VolumeDependencyTests-1618338243 None] Lock "cinder-quobyte-fa5460fe-3c45-4eaf-98bf-cad81902db55" released by "delete_volume" :: held 1.012s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:51:44 devstack sudo[106549]: pam_unix(sudo:session): session closed for user root Sep 06 06:51:44 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-04a46617-a92a-43de-8400-0a158bf93634 tempest-CreateVolumesFromSnapshotTest-499441882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-202822af-3551-4789-a3d9-ac6b8e38416a" returned: 0 in 0.562s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:51:44 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-04a46617-a92a-43de-8400-0a158bf93634 tempest-CreateVolumesFromSnapshotTest-499441882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-202822af-3551-4789-a3d9-ac6b8e38416a {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:51:44 devstack sudo[106561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-202822af-3551-4789-a3d9-ac6b8e38416a Sep 06 06:51:44 devstack sudo[106561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:51:44 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-9614d662-29da-43c7-9439-05ab4ad5ad3e tempest-VolumeDependencyTests-1618338243 None] Created reservations ['4ccfa904-12a3-4004-b038-741c204499c9', 'c9d2b80c-8a91-4b81-adfb-2afe7617030b', '1e513c6f-1a29-4e96-b08a-c8eb3c136509', '19d94671-366f-448b-8a72-caab9d68a3e8'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:51:44 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-9614d662-29da-43c7-9439-05ab4ad5ad3e tempest-VolumeDependencyTests-1618338243 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:51:44 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-9614d662-29da-43c7-9439-05ab4ad5ad3e tempest-VolumeDependencyTests-1618338243 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:51:44 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-9614d662-29da-43c7-9439-05ab4ad5ad3e tempest-VolumeDependencyTests-1618338243 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:51:44 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-9614d662-29da-43c7-9439-05ab4ad5ad3e tempest-VolumeDependencyTests-1618338243 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:51:44 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-9614d662-29da-43c7-9439-05ab4ad5ad3e tempest-VolumeDependencyTests-1618338243 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:51:44 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-9614d662-29da-43c7-9439-05ab4ad5ad3e tempest-VolumeDependencyTests-1618338243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:51:44 devstack sudo[106563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:51:44 devstack sudo[106563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:51:45 devstack sudo[106561]: pam_unix(sudo:session): session closed for user root Sep 06 06:51:45 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-04a46617-a92a-43de-8400-0a158bf93634 tempest-CreateVolumesFromSnapshotTest-499441882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-202822af-3551-4789-a3d9-ac6b8e38416a" returned: 0 in 0.274s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:51:45 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-04a46617-a92a-43de-8400-0a158bf93634 tempest-CreateVolumesFromSnapshotTest-499441882 None] Lock "cinder-quobyte-202822af-3551-4789-a3d9-ac6b8e38416a" released by "delete_volume" :: held 0.921s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:51:45 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-04a46617-a92a-43de-8400-0a158bf93634 tempest-CreateVolumesFromSnapshotTest-499441882 None] Created reservations ['47aadb31-16a6-41f4-983f-98d73fad90b1', 'edf08e04-dbc2-41a8-819c-39fb9343a605', 'bd9530c8-d901-403f-8765-e976c58a5e6e', '254efd2c-4e9f-42d7-a000-fcf34236597e'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:51:45 devstack sudo[106563]: pam_unix(sudo:session): session closed for user root Sep 06 06:51:45 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-9614d662-29da-43c7-9439-05ab4ad5ad3e tempest-VolumeDependencyTests-1618338243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.266s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:51:45 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-9614d662-29da-43c7-9439-05ab4ad5ad3e tempest-VolumeDependencyTests-1618338243 None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:51:45 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-9614d662-29da-43c7-9439-05ab4ad5ad3e tempest-VolumeDependencyTests-1618338243 None] Deleted volume successfully. Sep 06 06:51:45 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-04a46617-a92a-43de-8400-0a158bf93634 tempest-CreateVolumesFromSnapshotTest-499441882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:51:45 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-04a46617-a92a-43de-8400-0a158bf93634 tempest-CreateVolumesFromSnapshotTest-499441882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:51:45 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-04a46617-a92a-43de-8400-0a158bf93634 tempest-CreateVolumesFromSnapshotTest-499441882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:51:45 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-04a46617-a92a-43de-8400-0a158bf93634 tempest-CreateVolumesFromSnapshotTest-499441882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:51:45 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-04a46617-a92a-43de-8400-0a158bf93634 tempest-CreateVolumesFromSnapshotTest-499441882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:51:45 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-04a46617-a92a-43de-8400-0a158bf93634 tempest-CreateVolumesFromSnapshotTest-499441882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:51:45 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-9614d662-29da-43c7-9439-05ab4ad5ad3e tempest-VolumeDependencyTests-1618338243 None] Lock "cinder-fa5460fe-3c45-4eaf-98bf-cad81902db55-delete_volume" released by "delete_volume" :: held 1.589s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:51:45 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-04636d65-a6d7-463d-8ed9-262526dc8f40 tempest-CreateVolumesFromSnapshotTest-499441882 None] Acquiring lock "cinder-efceaee3-00a9-47fd-8c9e-979338f93da5-delete_snapshot" by "delete_snapshot" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:51:45 devstack sudo[106567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:51:45 devstack sudo[106567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:51:45 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-04636d65-a6d7-463d-8ed9-262526dc8f40 tempest-CreateVolumesFromSnapshotTest-499441882 None] Lock "cinder-efceaee3-00a9-47fd-8c9e-979338f93da5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:51:45 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-04636d65-a6d7-463d-8ed9-262526dc8f40 tempest-CreateVolumesFromSnapshotTest-499441882 None] Acquiring lock "cinder-quobyte-494f33c8-6091-4f8c-b766-dca143277075" by "delete_snapshot" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:51:45 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-04636d65-a6d7-463d-8ed9-262526dc8f40 tempest-CreateVolumesFromSnapshotTest-499441882 None] Lock "cinder-quobyte-494f33c8-6091-4f8c-b766-dca143277075" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:51:45 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-04636d65-a6d7-463d-8ed9-262526dc8f40 tempest-CreateVolumesFromSnapshotTest-499441882 None] Acquiring lock "cinder-quobyte-efceaee3-00a9-47fd-8c9e-979338f93da5" by "_delete_snapshot" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:51:45 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-04636d65-a6d7-463d-8ed9-262526dc8f40 tempest-CreateVolumesFromSnapshotTest-499441882 None] Lock "cinder-quobyte-efceaee3-00a9-47fd-8c9e-979338f93da5" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:51:45 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-04636d65-a6d7-463d-8ed9-262526dc8f40 tempest-CreateVolumesFromSnapshotTest-499441882 None] Deleting offline snapshot efceaee3-00a9-47fd-8c9e-979338f93da5 of volume 494f33c8-6091-4f8c-b766-dca143277075 {{(pid=87329) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 06 06:51:45 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-04636d65-a6d7-463d-8ed9-262526dc8f40 tempest-CreateVolumesFromSnapshotTest-499441882 None] snapshot_file for this snap is: volume-494f33c8-6091-4f8c-b766-dca143277075.efceaee3-00a9-47fd-8c9e-979338f93da5 {{(pid=87329) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 06 06:51:45 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed5bd369-e86e-4d11-9057-8f286d4dbc2b]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:51:45 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-04636d65-a6d7-463d-8ed9-262526dc8f40 tempest-CreateVolumesFromSnapshotTest-499441882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-494f33c8-6091-4f8c-b766-dca143277075.efceaee3-00a9-47fd-8c9e-979338f93da5 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:51:45 devstack sudo[106569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-494f33c8-6091-4f8c-b766-dca143277075.efceaee3-00a9-47fd-8c9e-979338f93da5 Sep 06 06:51:45 devstack sudo[106569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:51:45 devstack sudo[106567]: pam_unix(sudo:session): session closed for user root Sep 06 06:51:45 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-04a46617-a92a-43de-8400-0a158bf93634 tempest-CreateVolumesFromSnapshotTest-499441882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.321s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:51:45 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-04a46617-a92a-43de-8400-0a158bf93634 tempest-CreateVolumesFromSnapshotTest-499441882 None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:51:45 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-04a46617-a92a-43de-8400-0a158bf93634 tempest-CreateVolumesFromSnapshotTest-499441882 None] Deleted volume successfully. Sep 06 06:51:45 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-04a46617-a92a-43de-8400-0a158bf93634 tempest-CreateVolumesFromSnapshotTest-499441882 None] Lock "cinder-202822af-3551-4789-a3d9-ac6b8e38416a-delete_volume" released by "delete_volume" :: held 1.511s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:51:45 devstack sudo[106569]: pam_unix(sudo:session): session closed for user root Sep 06 06:51:45 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-04636d65-a6d7-463d-8ed9-262526dc8f40 tempest-CreateVolumesFromSnapshotTest-499441882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-494f33c8-6091-4f8c-b766-dca143277075.efceaee3-00a9-47fd-8c9e-979338f93da5" returned: 0 in 0.409s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:51:45 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-04636d65-a6d7-463d-8ed9-262526dc8f40 tempest-CreateVolumesFromSnapshotTest-499441882 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-494f33c8-6091-4f8c-b766-dca143277075(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87329) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 06:51:45 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[227b5e71-bccc-4b6e-b2a6-f9c79b8435fe]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:51:45 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-04636d65-a6d7-463d-8ed9-262526dc8f40 tempest-CreateVolumesFromSnapshotTest-499441882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-494f33c8-6091-4f8c-b766-dca143277075 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:51:45 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-4fdc45bd-930e-40e6-84ca-adccb5735eab tempest-VolumeDependencyTests-1618338243 None] Acquiring lock "cinder-115496dd-f46d-4766-8fcd-c28f99191df8-delete_volume" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:51:45 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-4fdc45bd-930e-40e6-84ca-adccb5735eab tempest-VolumeDependencyTests-1618338243 None] Lock "cinder-115496dd-f46d-4766-8fcd-c28f99191df8-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:51:46 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-4fdc45bd-930e-40e6-84ca-adccb5735eab tempest-VolumeDependencyTests-1618338243 None] Acquiring lock "cinder-quobyte-115496dd-f46d-4766-8fcd-c28f99191df8" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:51:46 devstack sudo[106575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-494f33c8-6091-4f8c-b766-dca143277075 Sep 06 06:51:46 devstack sudo[106575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:51:46 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-4fdc45bd-930e-40e6-84ca-adccb5735eab tempest-VolumeDependencyTests-1618338243 None] Lock "cinder-quobyte-115496dd-f46d-4766-8fcd-c28f99191df8" acquired by "delete_volume" :: waited 0.026s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:51:46 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[669a372d-bdea-4e8d-85b9-a2ebcdf9f85b]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:51:46 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-4fdc45bd-930e-40e6-84ca-adccb5735eab tempest-VolumeDependencyTests-1618338243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-115496dd-f46d-4766-8fcd-c28f99191df8 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:51:46 devstack sudo[106577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-115496dd-f46d-4766-8fcd-c28f99191df8 Sep 06 06:51:46 devstack sudo[106577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:51:46 devstack sudo[106575]: pam_unix(sudo:session): session closed for user root Sep 06 06:51:46 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-04636d65-a6d7-463d-8ed9-262526dc8f40 tempest-CreateVolumesFromSnapshotTest-499441882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-494f33c8-6091-4f8c-b766-dca143277075" returned: 0 in 0.548s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:51:46 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-04636d65-a6d7-463d-8ed9-262526dc8f40 tempest-CreateVolumesFromSnapshotTest-499441882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-494f33c8-6091-4f8c-b766-dca143277075.efceaee3-00a9-47fd-8c9e-979338f93da5 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:51:46 devstack sudo[106582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-494f33c8-6091-4f8c-b766-dca143277075.efceaee3-00a9-47fd-8c9e-979338f93da5 Sep 06 06:51:46 devstack sudo[106582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:51:46 devstack sudo[106577]: pam_unix(sudo:session): session closed for user root Sep 06 06:51:46 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-4fdc45bd-930e-40e6-84ca-adccb5735eab tempest-VolumeDependencyTests-1618338243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-115496dd-f46d-4766-8fcd-c28f99191df8" returned: 0 in 0.496s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:51:46 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-4fdc45bd-930e-40e6-84ca-adccb5735eab tempest-VolumeDependencyTests-1618338243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-115496dd-f46d-4766-8fcd-c28f99191df8 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:51:46 devstack sudo[106587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-115496dd-f46d-4766-8fcd-c28f99191df8 Sep 06 06:51:46 devstack sudo[106587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:51:46 devstack sudo[106582]: pam_unix(sudo:session): session closed for user root Sep 06 06:51:46 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-04636d65-a6d7-463d-8ed9-262526dc8f40 tempest-CreateVolumesFromSnapshotTest-499441882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-494f33c8-6091-4f8c-b766-dca143277075.efceaee3-00a9-47fd-8c9e-979338f93da5" returned: 0 in 0.403s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:51:46 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-04636d65-a6d7-463d-8ed9-262526dc8f40 tempest-CreateVolumesFromSnapshotTest-499441882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-494f33c8-6091-4f8c-b766-dca143277075.efceaee3-00a9-47fd-8c9e-979338f93da5 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:51:46 devstack sudo[106593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-494f33c8-6091-4f8c-b766-dca143277075.efceaee3-00a9-47fd-8c9e-979338f93da5 Sep 06 06:51:46 devstack sudo[106593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:51:46 devstack sudo[106587]: pam_unix(sudo:session): session closed for user root Sep 06 06:51:46 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-4fdc45bd-930e-40e6-84ca-adccb5735eab tempest-VolumeDependencyTests-1618338243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-115496dd-f46d-4766-8fcd-c28f99191df8" returned: 0 in 0.332s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:51:46 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-4fdc45bd-930e-40e6-84ca-adccb5735eab tempest-VolumeDependencyTests-1618338243 None] Lock "cinder-quobyte-115496dd-f46d-4766-8fcd-c28f99191df8" released by "delete_volume" :: held 0.883s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:51:47 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-4fdc45bd-930e-40e6-84ca-adccb5735eab tempest-VolumeDependencyTests-1618338243 None] Created reservations ['bd29f176-9142-4890-85bc-79d2bd4a3435', 'f409e574-2cfe-426f-8c05-824492458a9d', '33699b00-2105-415e-95aa-fcfd8e85915b', '652ee600-ea19-4e9a-bf7b-e4b8820c4f8e'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:51:47 devstack sudo[106593]: pam_unix(sudo:session): session closed for user root Sep 06 06:51:47 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-04636d65-a6d7-463d-8ed9-262526dc8f40 tempest-CreateVolumesFromSnapshotTest-499441882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-494f33c8-6091-4f8c-b766-dca143277075.efceaee3-00a9-47fd-8c9e-979338f93da5" returned: 0 in 0.299s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:51:47 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-04636d65-a6d7-463d-8ed9-262526dc8f40 tempest-CreateVolumesFromSnapshotTest-499441882 None] Lock "cinder-quobyte-efceaee3-00a9-47fd-8c9e-979338f93da5" released by "_delete_snapshot" :: held 1.797s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:51:47 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-4fdc45bd-930e-40e6-84ca-adccb5735eab tempest-VolumeDependencyTests-1618338243 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:51:47 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-4fdc45bd-930e-40e6-84ca-adccb5735eab tempest-VolumeDependencyTests-1618338243 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:51:47 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-4fdc45bd-930e-40e6-84ca-adccb5735eab tempest-VolumeDependencyTests-1618338243 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:51:47 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-4fdc45bd-930e-40e6-84ca-adccb5735eab tempest-VolumeDependencyTests-1618338243 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:51:47 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-4fdc45bd-930e-40e6-84ca-adccb5735eab tempest-VolumeDependencyTests-1618338243 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:51:47 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-4fdc45bd-930e-40e6-84ca-adccb5735eab tempest-VolumeDependencyTests-1618338243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:51:47 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-04636d65-a6d7-463d-8ed9-262526dc8f40 tempest-CreateVolumesFromSnapshotTest-499441882 None] Lock "cinder-quobyte-494f33c8-6091-4f8c-b766-dca143277075" released by "delete_snapshot" :: held 1.842s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:51:47 devstack sudo[106597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:51:47 devstack sudo[106597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:51:47 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-04636d65-a6d7-463d-8ed9-262526dc8f40 tempest-CreateVolumesFromSnapshotTest-499441882 None] Created reservations ['716c4b42-e5c0-4e9c-a3ae-032162c1dbd3', '4b79ff0f-105a-4a9b-bfc6-0599fabcd73a', '58d11ded-e641-4348-b3bf-be9b055993ae', '7c770b46-a5fe-4634-bad8-c5ea312dbcc2'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:51:47 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-04636d65-a6d7-463d-8ed9-262526dc8f40 tempest-CreateVolumesFromSnapshotTest-499441882 None] Delete snapshot completed successfully. Sep 06 06:51:47 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-04636d65-a6d7-463d-8ed9-262526dc8f40 tempest-CreateVolumesFromSnapshotTest-499441882 None] Lock "cinder-efceaee3-00a9-47fd-8c9e-979338f93da5-delete_snapshot" released by "delete_snapshot" :: held 2.004s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:51:47 devstack sudo[106597]: pam_unix(sudo:session): session closed for user root Sep 06 06:51:47 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-4fdc45bd-930e-40e6-84ca-adccb5735eab tempest-VolumeDependencyTests-1618338243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.262s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:51:47 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-4fdc45bd-930e-40e6-84ca-adccb5735eab tempest-VolumeDependencyTests-1618338243 None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:51:47 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-4fdc45bd-930e-40e6-84ca-adccb5735eab tempest-VolumeDependencyTests-1618338243 None] Deleted volume successfully. Sep 06 06:51:47 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-4fdc45bd-930e-40e6-84ca-adccb5735eab tempest-VolumeDependencyTests-1618338243 None] Lock "cinder-115496dd-f46d-4766-8fcd-c28f99191df8-delete_volume" released by "delete_volume" :: held 1.487s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:51:47 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-8195ffee-57c2-47a7-b8a3-f0281f7788b1 tempest-CreateVolumesFromSnapshotTest-499441882 None] Acquiring lock "cinder-494f33c8-6091-4f8c-b766-dca143277075-delete_volume" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:51:47 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-8195ffee-57c2-47a7-b8a3-f0281f7788b1 tempest-CreateVolumesFromSnapshotTest-499441882 None] Lock "cinder-494f33c8-6091-4f8c-b766-dca143277075-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:51:47 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-8195ffee-57c2-47a7-b8a3-f0281f7788b1 tempest-CreateVolumesFromSnapshotTest-499441882 None] Acquiring lock "cinder-quobyte-494f33c8-6091-4f8c-b766-dca143277075" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:51:47 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-8195ffee-57c2-47a7-b8a3-f0281f7788b1 tempest-CreateVolumesFromSnapshotTest-499441882 None] Lock "cinder-quobyte-494f33c8-6091-4f8c-b766-dca143277075" acquired by "delete_volume" :: waited 0.017s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:51:47 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[d189cdf3-57e1-4fb5-b342-c2c7ce9e98a1]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:51:47 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-8195ffee-57c2-47a7-b8a3-f0281f7788b1 tempest-CreateVolumesFromSnapshotTest-499441882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-494f33c8-6091-4f8c-b766-dca143277075 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:51:47 devstack sudo[106600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-494f33c8-6091-4f8c-b766-dca143277075 Sep 06 06:51:47 devstack sudo[106600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:51:48 devstack sudo[106600]: pam_unix(sudo:session): session closed for user root Sep 06 06:51:48 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-8195ffee-57c2-47a7-b8a3-f0281f7788b1 tempest-CreateVolumesFromSnapshotTest-499441882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-494f33c8-6091-4f8c-b766-dca143277075" returned: 0 in 0.425s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:51:48 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-8195ffee-57c2-47a7-b8a3-f0281f7788b1 tempest-CreateVolumesFromSnapshotTest-499441882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-494f33c8-6091-4f8c-b766-dca143277075 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:51:48 devstack sudo[106605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-494f33c8-6091-4f8c-b766-dca143277075 Sep 06 06:51:48 devstack sudo[106605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:51:48 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-4745cb28-db52-413c-b7a3-fb455062f5a4 tempest-ProjectReaderTests-1566093849 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87329) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 06:51:48 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-4745cb28-db52-413c-b7a3-fb455062f5a4 tempest-ProjectReaderTests-1566093849 None] Flow 'volume_create_manager' (e65ccbc6-2479-47cb-b68c-c1063d43f30d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:51:48 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-4745cb28-db52-413c-b7a3-fb455062f5a4 tempest-ProjectReaderTests-1566093849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c0c0745-8bd7-4def-a85a-229430271020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:51:48 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-4745cb28-db52-413c-b7a3-fb455062f5a4 tempest-ProjectReaderTests-1566093849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c0c0745-8bd7-4def-a85a-229430271020) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:51:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-517698698',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34d27674-ac7d-41ed-817f-1bf703b4a0eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47b14cc477564406b2c85835936b99d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:51:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:51:48Z,use_quota=True,user_id='2bb3aa6913034422a07b16fa1477428f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:51:48 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-4745cb28-db52-413c-b7a3-fb455062f5a4 tempest-ProjectReaderTests-1566093849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45d41f00-005e-49b5-a534-cb0f91adb7eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:51:48 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-4745cb28-db52-413c-b7a3-fb455062f5a4 tempest-ProjectReaderTests-1566093849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45d41f00-005e-49b5-a534-cb0f91adb7eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:51:48 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-4745cb28-db52-413c-b7a3-fb455062f5a4 tempest-ProjectReaderTests-1566093849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3c26510-67a0-44ac-85b4-39c10a4d7f8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:51:48 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-4745cb28-db52-413c-b7a3-fb455062f5a4 tempest-ProjectReaderTests-1566093849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3c26510-67a0-44ac-85b4-39c10a4d7f8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34d27674-ac7d-41ed-817f-1bf703b4a0eb', 'volume_name': 'volume-34d27674-ac7d-41ed-817f-1bf703b4a0eb', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:51:48 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-4745cb28-db52-413c-b7a3-fb455062f5a4 tempest-ProjectReaderTests-1566093849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8363be16-b950-4535-9956-d34d3a37b2ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:51:48 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-4745cb28-db52-413c-b7a3-fb455062f5a4 tempest-ProjectReaderTests-1566093849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8363be16-b950-4535-9956-d34d3a37b2ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:51:48 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-4745cb28-db52-413c-b7a3-fb455062f5a4 tempest-ProjectReaderTests-1566093849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70334543-520e-442a-98ac-ba717367f444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:51:48 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-4745cb28-db52-413c-b7a3-fb455062f5a4 tempest-ProjectReaderTests-1566093849 None] Volume 34d27674-ac7d-41ed-817f-1bf703b4a0eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34d27674-ac7d-41ed-817f-1bf703b4a0eb', 'volume_size': 1} Sep 06 06:51:48 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-4745cb28-db52-413c-b7a3-fb455062f5a4 tempest-ProjectReaderTests-1566093849 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:51:48 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-4745cb28-db52-413c-b7a3-fb455062f5a4 tempest-ProjectReaderTests-1566093849 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:51:48 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-4745cb28-db52-413c-b7a3-fb455062f5a4 tempest-ProjectReaderTests-1566093849 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:51:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-517698698',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34d27674-ac7d-41ed-817f-1bf703b4a0eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47b14cc477564406b2c85835936b99d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:51:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:51:48Z,use_quota=True,user_id='2bb3aa6913034422a07b16fa1477428f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)}" {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 06:51:48 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-4745cb28-db52-413c-b7a3-fb455062f5a4 tempest-ProjectReaderTests-1566093849 None] Creating volume 34d27674-ac7d-41ed-817f-1bf703b4a0eb {{(pid=87329) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 06:51:48 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-4745cb28-db52-413c-b7a3-fb455062f5a4 tempest-ProjectReaderTests-1566093849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:51:48 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-4745cb28-db52-413c-b7a3-fb455062f5a4 tempest-ProjectReaderTests-1566093849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:51:48 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-4745cb28-db52-413c-b7a3-fb455062f5a4 tempest-ProjectReaderTests-1566093849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:51:48 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-4745cb28-db52-413c-b7a3-fb455062f5a4 tempest-ProjectReaderTests-1566093849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:51:48 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-4745cb28-db52-413c-b7a3-fb455062f5a4 tempest-ProjectReaderTests-1566093849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:51:48 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-4745cb28-db52-413c-b7a3-fb455062f5a4 tempest-ProjectReaderTests-1566093849 None] Selected osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 as target Quobyte volume. {{(pid=87329) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 06:51:48 devstack cinder-volume[87329]: INFO cinder.volume.drivers.remotefs [None req-4745cb28-db52-413c-b7a3-fb455062f5a4 tempest-ProjectReaderTests-1566093849 None] casted to osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 Sep 06 06:51:48 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-4745cb28-db52-413c-b7a3-fb455062f5a4 tempest-ProjectReaderTests-1566093849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-34d27674-ac7d-41ed-817f-1bf703b4a0eb 1073741824 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:51:48 devstack sudo[106607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-34d27674-ac7d-41ed-817f-1bf703b4a0eb 1073741824 Sep 06 06:51:48 devstack sudo[106607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:51:48 devstack sudo[106605]: pam_unix(sudo:session): session closed for user root Sep 06 06:51:48 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-8195ffee-57c2-47a7-b8a3-f0281f7788b1 tempest-CreateVolumesFromSnapshotTest-499441882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-494f33c8-6091-4f8c-b766-dca143277075" returned: 0 in 0.320s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:51:48 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-8195ffee-57c2-47a7-b8a3-f0281f7788b1 tempest-CreateVolumesFromSnapshotTest-499441882 None] Lock "cinder-quobyte-494f33c8-6091-4f8c-b766-dca143277075" released by "delete_volume" :: held 0.819s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:51:48 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-8195ffee-57c2-47a7-b8a3-f0281f7788b1 tempest-CreateVolumesFromSnapshotTest-499441882 None] Created reservations ['66797e18-b581-452d-807c-adb6d7bac164', '841d9abe-7bbf-46d5-a8ef-29feb37e2765', '714ce8a7-8d62-4c6e-bc24-a43f3782fd03', '9721758a-14d5-49d8-b324-51a3a9ddea66'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:51:48 devstack cinder-volume[87329]: DEBUG oslo_service.periodic_task [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87329) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 06 06:51:48 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:51:48 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:51:48 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:51:48 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:51:48 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:51:48 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:51:48 devstack sudo[106610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:51:48 devstack sudo[106610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:51:48 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-8195ffee-57c2-47a7-b8a3-f0281f7788b1 tempest-CreateVolumesFromSnapshotTest-499441882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:51:48 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-8195ffee-57c2-47a7-b8a3-f0281f7788b1 tempest-CreateVolumesFromSnapshotTest-499441882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:51:48 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-8195ffee-57c2-47a7-b8a3-f0281f7788b1 tempest-CreateVolumesFromSnapshotTest-499441882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:51:48 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-8195ffee-57c2-47a7-b8a3-f0281f7788b1 tempest-CreateVolumesFromSnapshotTest-499441882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:51:48 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-8195ffee-57c2-47a7-b8a3-f0281f7788b1 tempest-CreateVolumesFromSnapshotTest-499441882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:51:48 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-8195ffee-57c2-47a7-b8a3-f0281f7788b1 tempest-CreateVolumesFromSnapshotTest-499441882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:51:48 devstack sudo[106615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:51:48 devstack sudo[106615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:51:48 devstack sudo[106607]: pam_unix(sudo:session): session closed for user root Sep 06 06:51:48 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-4745cb28-db52-413c-b7a3-fb455062f5a4 tempest-ProjectReaderTests-1566093849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-34d27674-ac7d-41ed-817f-1bf703b4a0eb 1073741824" returned: 0 in 0.569s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:51:48 devstack sudo[106610]: pam_unix(sudo:session): session closed for user root Sep 06 06:51:48 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.324s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:51:48 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:51:48 devstack cinder-volume[87329]: DEBUG oslo_service.periodic_task [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Running periodic task VolumeManager._thread_info {{(pid=87329) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 06 06:51:48 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] thread count: 28 {{(pid=87329) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 06 06:51:48 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] thread info: [<_MainThread(MainThread, started 126855043821696)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87329) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 06 06:51:48 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-4745cb28-db52-413c-b7a3-fb455062f5a4 tempest-ProjectReaderTests-1566093849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-34d27674-ac7d-41ed-817f-1bf703b4a0eb {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:51:48 devstack sudo[106619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-34d27674-ac7d-41ed-817f-1bf703b4a0eb Sep 06 06:51:48 devstack sudo[106619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:51:48 devstack sudo[106615]: pam_unix(sudo:session): session closed for user root Sep 06 06:51:48 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-8195ffee-57c2-47a7-b8a3-f0281f7788b1 tempest-CreateVolumesFromSnapshotTest-499441882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.367s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:51:48 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-8195ffee-57c2-47a7-b8a3-f0281f7788b1 tempest-CreateVolumesFromSnapshotTest-499441882 None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:51:48 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-8195ffee-57c2-47a7-b8a3-f0281f7788b1 tempest-CreateVolumesFromSnapshotTest-499441882 None] Deleted volume successfully. Sep 06 06:51:48 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-8195ffee-57c2-47a7-b8a3-f0281f7788b1 tempest-CreateVolumesFromSnapshotTest-499441882 None] Lock "cinder-494f33c8-6091-4f8c-b766-dca143277075-delete_volume" released by "delete_volume" :: held 1.474s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:51:49 devstack sudo[106619]: pam_unix(sudo:session): session closed for user root Sep 06 06:51:49 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-4745cb28-db52-413c-b7a3-fb455062f5a4 tempest-ProjectReaderTests-1566093849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-34d27674-ac7d-41ed-817f-1bf703b4a0eb" returned: 0 in 0.327s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:51:49 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-4745cb28-db52-413c-b7a3-fb455062f5a4 tempest-ProjectReaderTests-1566093849 None] <== create_volume: return (982ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'} {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 06:51:49 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-4745cb28-db52-413c-b7a3-fb455062f5a4 tempest-ProjectReaderTests-1566093849 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.984s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:51:49 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-4745cb28-db52-413c-b7a3-fb455062f5a4 tempest-ProjectReaderTests-1566093849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70334543-520e-442a-98ac-ba717367f444) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34d27674-ac7d-41ed-817f-1bf703b4a0eb', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:51:49 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-4745cb28-db52-413c-b7a3-fb455062f5a4 tempest-ProjectReaderTests-1566093849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e87269c-db94-4600-9ff7-8eb9cd209122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:51:49 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-4745cb28-db52-413c-b7a3-fb455062f5a4 tempest-ProjectReaderTests-1566093849 None] Volume volume-34d27674-ac7d-41ed-817f-1bf703b4a0eb (34d27674-ac7d-41ed-817f-1bf703b4a0eb): created successfully Sep 06 06:51:49 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-4745cb28-db52-413c-b7a3-fb455062f5a4 tempest-ProjectReaderTests-1566093849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e87269c-db94-4600-9ff7-8eb9cd209122) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:51:49 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-4745cb28-db52-413c-b7a3-fb455062f5a4 tempest-ProjectReaderTests-1566093849 None] Flow 'volume_create_manager' (e65ccbc6-2479-47cb-b68c-c1063d43f30d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:51:49 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-4745cb28-db52-413c-b7a3-fb455062f5a4 tempest-ProjectReaderTests-1566093849 None] Created volume successfully. Sep 06 06:51:50 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-7c614bc3-cd39-4619-bac5-1f9063a8aeec tempest-ProjectReaderTests-1566093849 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:51:50 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-7c614bc3-cd39-4619-bac5-1f9063a8aeec tempest-ProjectReaderTests-1566093849 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:51:50 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-7c614bc3-cd39-4619-bac5-1f9063a8aeec tempest-ProjectReaderTests-1566093849 None] Creating offline snapshot dfe9aa59-34ca-40ec-add1-906b518b5eff of volume 34d27674-ac7d-41ed-817f-1bf703b4a0eb {{(pid=87329) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 06 06:51:50 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[eed89e93-5127-4fbc-aae7-7558c5c59fd3]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:51:50 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-7c614bc3-cd39-4619-bac5-1f9063a8aeec tempest-ProjectReaderTests-1566093849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-34d27674-ac7d-41ed-817f-1bf703b4a0eb {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:51:50 devstack sudo[106624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-34d27674-ac7d-41ed-817f-1bf703b4a0eb Sep 06 06:51:50 devstack sudo[106624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:51:50 devstack sudo[106624]: pam_unix(sudo:session): session closed for user root Sep 06 06:51:50 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-7c614bc3-cd39-4619-bac5-1f9063a8aeec tempest-ProjectReaderTests-1566093849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-34d27674-ac7d-41ed-817f-1bf703b4a0eb" returned: 0 in 0.478s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:51:50 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-7c614bc3-cd39-4619-bac5-1f9063a8aeec tempest-ProjectReaderTests-1566093849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-34d27674-ac7d-41ed-817f-1bf703b4a0eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-34d27674-ac7d-41ed-817f-1bf703b4a0eb.dfe9aa59-34ca-40ec-add1-906b518b5eff 1G {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:51:51 devstack sudo[106629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-34d27674-ac7d-41ed-817f-1bf703b4a0eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-34d27674-ac7d-41ed-817f-1bf703b4a0eb.dfe9aa59-34ca-40ec-add1-906b518b5eff 1G Sep 06 06:51:51 devstack sudo[106629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:51:51 devstack sudo[106629]: pam_unix(sudo:session): session closed for user root Sep 06 06:51:51 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-7c614bc3-cd39-4619-bac5-1f9063a8aeec tempest-ProjectReaderTests-1566093849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-34d27674-ac7d-41ed-817f-1bf703b4a0eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-34d27674-ac7d-41ed-817f-1bf703b4a0eb.dfe9aa59-34ca-40ec-add1-906b518b5eff 1G" returned: 0 in 0.433s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:51:51 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-7c614bc3-cd39-4619-bac5-1f9063a8aeec tempest-ProjectReaderTests-1566093849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34d27674-ac7d-41ed-817f-1bf703b4a0eb -F qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-34d27674-ac7d-41ed-817f-1bf703b4a0eb.dfe9aa59-34ca-40ec-add1-906b518b5eff {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:51:51 devstack sudo[106635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34d27674-ac7d-41ed-817f-1bf703b4a0eb -F qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-34d27674-ac7d-41ed-817f-1bf703b4a0eb.dfe9aa59-34ca-40ec-add1-906b518b5eff Sep 06 06:51:51 devstack sudo[106635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:51:51 devstack sudo[106635]: pam_unix(sudo:session): session closed for user root Sep 06 06:51:51 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-7c614bc3-cd39-4619-bac5-1f9063a8aeec tempest-ProjectReaderTests-1566093849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34d27674-ac7d-41ed-817f-1bf703b4a0eb -F qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-34d27674-ac7d-41ed-817f-1bf703b4a0eb.dfe9aa59-34ca-40ec-add1-906b518b5eff" returned: 0 in 0.368s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:51:51 devstack cinder-volume[87329]: WARNING cinder.volume.drivers.remotefs [None req-7c614bc3-cd39-4619-bac5-1f9063a8aeec tempest-ProjectReaderTests-1566093849 None] /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-34d27674-ac7d-41ed-817f-1bf703b4a0eb.dfe9aa59-34ca-40ec-add1-906b518b5eff is being set with open permissions: ugo+rw Sep 06 06:51:51 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-7c614bc3-cd39-4619-bac5-1f9063a8aeec tempest-ProjectReaderTests-1566093849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-34d27674-ac7d-41ed-817f-1bf703b4a0eb.dfe9aa59-34ca-40ec-add1-906b518b5eff {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:51:51 devstack sudo[106643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-34d27674-ac7d-41ed-817f-1bf703b4a0eb.dfe9aa59-34ca-40ec-add1-906b518b5eff Sep 06 06:51:51 devstack sudo[106643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:51:52 devstack sudo[106643]: pam_unix(sudo:session): session closed for user root Sep 06 06:51:52 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-7c614bc3-cd39-4619-bac5-1f9063a8aeec tempest-ProjectReaderTests-1566093849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-34d27674-ac7d-41ed-817f-1bf703b4a0eb.dfe9aa59-34ca-40ec-add1-906b518b5eff" returned: 0 in 0.278s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:51:52 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-7c614bc3-cd39-4619-bac5-1f9063a8aeec tempest-ProjectReaderTests-1566093849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-34d27674-ac7d-41ed-817f-1bf703b4a0eb.info {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:51:52 devstack sudo[106646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-34d27674-ac7d-41ed-817f-1bf703b4a0eb.info Sep 06 06:51:52 devstack sudo[106646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:51:52 devstack sudo[106646]: pam_unix(sudo:session): session closed for user root Sep 06 06:51:52 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-7c614bc3-cd39-4619-bac5-1f9063a8aeec tempest-ProjectReaderTests-1566093849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-34d27674-ac7d-41ed-817f-1bf703b4a0eb.info" returned: 0 in 0.269s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:51:52 devstack cinder-volume[87329]: WARNING cinder.volume.drivers.remotefs [None req-7c614bc3-cd39-4619-bac5-1f9063a8aeec tempest-ProjectReaderTests-1566093849 None] /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-34d27674-ac7d-41ed-817f-1bf703b4a0eb.info is being set with open permissions: ugo+rw Sep 06 06:51:52 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-7c614bc3-cd39-4619-bac5-1f9063a8aeec tempest-ProjectReaderTests-1566093849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-34d27674-ac7d-41ed-817f-1bf703b4a0eb.info {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:51:52 devstack sudo[106649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-34d27674-ac7d-41ed-817f-1bf703b4a0eb.info Sep 06 06:51:52 devstack sudo[106649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:51:52 devstack sudo[106649]: pam_unix(sudo:session): session closed for user root Sep 06 06:51:52 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-7c614bc3-cd39-4619-bac5-1f9063a8aeec tempest-ProjectReaderTests-1566093849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-34d27674-ac7d-41ed-817f-1bf703b4a0eb.info" returned: 0 in 0.260s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:51:52 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-7c614bc3-cd39-4619-bac5-1f9063a8aeec tempest-ProjectReaderTests-1566093849 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.189s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:51:52 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-7c614bc3-cd39-4619-bac5-1f9063a8aeec tempest-ProjectReaderTests-1566093849 None] Create snapshot completed successfully Sep 06 06:51:53 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c225cbc-928f-4710-a72b-8f3c8176f373 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87329) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 06:51:53 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-6c225cbc-928f-4710-a72b-8f3c8176f373 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Flow 'volume_create_manager' (63cdbad9-6532-4475-8785-2f7b4e1c918b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:51:53 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-6c225cbc-928f-4710-a72b-8f3c8176f373 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8acd5f77-885f-42a3-9068-36ee5d9234d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:51:53 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-6c225cbc-928f-4710-a72b-8f3c8176f373 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8acd5f77-885f-42a3-9068-36ee5d9234d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:51:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-307717878',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13fea464-9700-4471-9da8-8cc5ca88da4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40344910e0f142f0869ec08ba17947ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:51:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:51:53Z,use_quota=True,user_id='96c1f3ce1eea4447aacccf1418192edd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:51:53 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-6c225cbc-928f-4710-a72b-8f3c8176f373 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52fecb87-67d3-4e6e-abf8-85e72c5144b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:51:53 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-6c225cbc-928f-4710-a72b-8f3c8176f373 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52fecb87-67d3-4e6e-abf8-85e72c5144b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:51:53 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-6c225cbc-928f-4710-a72b-8f3c8176f373 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2ff1e5f-d14f-4af6-9d51-cad727b454c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:51:53 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-6c225cbc-928f-4710-a72b-8f3c8176f373 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2ff1e5f-d14f-4af6-9d51-cad727b454c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13fea464-9700-4471-9da8-8cc5ca88da4d', 'volume_name': 'volume-13fea464-9700-4471-9da8-8cc5ca88da4d', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:51:53 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-6c225cbc-928f-4710-a72b-8f3c8176f373 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12069b42-3bfa-4bf2-bfcf-433fc65f0ad7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:51:53 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-6c225cbc-928f-4710-a72b-8f3c8176f373 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12069b42-3bfa-4bf2-bfcf-433fc65f0ad7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:51:53 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-6c225cbc-928f-4710-a72b-8f3c8176f373 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1dfa690-00bf-4b71-a334-ec0ea05e3c58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:51:53 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-6c225cbc-928f-4710-a72b-8f3c8176f373 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Volume 13fea464-9700-4471-9da8-8cc5ca88da4d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13fea464-9700-4471-9da8-8cc5ca88da4d', 'volume_size': 1} Sep 06 06:51:53 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-6c225cbc-928f-4710-a72b-8f3c8176f373 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:51:53 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-6c225cbc-928f-4710-a72b-8f3c8176f373 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:51:53 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-6c225cbc-928f-4710-a72b-8f3c8176f373 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:51:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-307717878',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13fea464-9700-4471-9da8-8cc5ca88da4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40344910e0f142f0869ec08ba17947ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:51:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:51:53Z,use_quota=True,user_id='96c1f3ce1eea4447aacccf1418192edd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)}" {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 06:51:53 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-6c225cbc-928f-4710-a72b-8f3c8176f373 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Creating volume 13fea464-9700-4471-9da8-8cc5ca88da4d {{(pid=87329) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 06:51:53 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-6c225cbc-928f-4710-a72b-8f3c8176f373 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:51:53 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-6c225cbc-928f-4710-a72b-8f3c8176f373 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:51:53 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-6c225cbc-928f-4710-a72b-8f3c8176f373 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:51:53 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-6c225cbc-928f-4710-a72b-8f3c8176f373 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:51:53 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-6c225cbc-928f-4710-a72b-8f3c8176f373 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:51:53 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-6c225cbc-928f-4710-a72b-8f3c8176f373 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Selected osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 as target Quobyte volume. {{(pid=87329) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 06:51:53 devstack cinder-volume[87329]: INFO cinder.volume.drivers.remotefs [None req-6c225cbc-928f-4710-a72b-8f3c8176f373 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] casted to osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 Sep 06 06:51:53 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-6c225cbc-928f-4710-a72b-8f3c8176f373 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-13fea464-9700-4471-9da8-8cc5ca88da4d 1073741824 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:51:53 devstack sudo[106652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-13fea464-9700-4471-9da8-8cc5ca88da4d 1073741824 Sep 06 06:51:53 devstack sudo[106652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:51:53 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-135c065b-b89e-43ca-af88-b503e13437bd tempest-ProjectReaderTests-1566093849 None] Acquiring lock "cinder-dfe9aa59-34ca-40ec-add1-906b518b5eff-delete_snapshot" by "delete_snapshot" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:51:53 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-135c065b-b89e-43ca-af88-b503e13437bd tempest-ProjectReaderTests-1566093849 None] Lock "cinder-dfe9aa59-34ca-40ec-add1-906b518b5eff-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:51:53 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-135c065b-b89e-43ca-af88-b503e13437bd tempest-ProjectReaderTests-1566093849 None] Acquiring lock "cinder-quobyte-34d27674-ac7d-41ed-817f-1bf703b4a0eb" by "delete_snapshot" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:51:53 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-135c065b-b89e-43ca-af88-b503e13437bd tempest-ProjectReaderTests-1566093849 None] Lock "cinder-quobyte-34d27674-ac7d-41ed-817f-1bf703b4a0eb" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:51:53 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-135c065b-b89e-43ca-af88-b503e13437bd tempest-ProjectReaderTests-1566093849 None] Acquiring lock "cinder-quobyte-dfe9aa59-34ca-40ec-add1-906b518b5eff" by "_delete_snapshot" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:51:53 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-135c065b-b89e-43ca-af88-b503e13437bd tempest-ProjectReaderTests-1566093849 None] Lock "cinder-quobyte-dfe9aa59-34ca-40ec-add1-906b518b5eff" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:51:53 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-135c065b-b89e-43ca-af88-b503e13437bd tempest-ProjectReaderTests-1566093849 None] Deleting offline snapshot dfe9aa59-34ca-40ec-add1-906b518b5eff of volume 34d27674-ac7d-41ed-817f-1bf703b4a0eb {{(pid=87329) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 06 06:51:53 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-135c065b-b89e-43ca-af88-b503e13437bd tempest-ProjectReaderTests-1566093849 None] snapshot_file for this snap is: volume-34d27674-ac7d-41ed-817f-1bf703b4a0eb.dfe9aa59-34ca-40ec-add1-906b518b5eff {{(pid=87329) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 06 06:51:54 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[8802a845-3cb8-492f-9e0c-6c36ae2f4ac1]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:51:54 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-135c065b-b89e-43ca-af88-b503e13437bd tempest-ProjectReaderTests-1566093849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-34d27674-ac7d-41ed-817f-1bf703b4a0eb.dfe9aa59-34ca-40ec-add1-906b518b5eff {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:51:54 devstack sudo[106657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-34d27674-ac7d-41ed-817f-1bf703b4a0eb.dfe9aa59-34ca-40ec-add1-906b518b5eff Sep 06 06:51:54 devstack sudo[106657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:51:54 devstack sudo[106652]: pam_unix(sudo:session): session closed for user root Sep 06 06:51:54 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-6c225cbc-928f-4710-a72b-8f3c8176f373 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-13fea464-9700-4471-9da8-8cc5ca88da4d 1073741824" returned: 0 in 0.590s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:51:54 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-6c225cbc-928f-4710-a72b-8f3c8176f373 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-13fea464-9700-4471-9da8-8cc5ca88da4d {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:51:54 devstack sudo[106660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-13fea464-9700-4471-9da8-8cc5ca88da4d Sep 06 06:51:54 devstack sudo[106660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:51:54 devstack sudo[106657]: pam_unix(sudo:session): session closed for user root Sep 06 06:51:54 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-135c065b-b89e-43ca-af88-b503e13437bd tempest-ProjectReaderTests-1566093849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-34d27674-ac7d-41ed-817f-1bf703b4a0eb.dfe9aa59-34ca-40ec-add1-906b518b5eff" returned: 0 in 0.483s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:51:54 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-135c065b-b89e-43ca-af88-b503e13437bd tempest-ProjectReaderTests-1566093849 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-34d27674-ac7d-41ed-817f-1bf703b4a0eb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87329) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 06:51:54 devstack sudo[106660]: pam_unix(sudo:session): session closed for user root Sep 06 06:51:54 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-6c225cbc-928f-4710-a72b-8f3c8176f373 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-13fea464-9700-4471-9da8-8cc5ca88da4d" returned: 0 in 0.283s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:51:54 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-6c225cbc-928f-4710-a72b-8f3c8176f373 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] <== create_volume: return (918ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'} {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 06:51:54 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-6c225cbc-928f-4710-a72b-8f3c8176f373 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.919s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:51:54 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[57825e29-26ec-4bbf-8757-82989fc9593e]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:51:54 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-135c065b-b89e-43ca-af88-b503e13437bd tempest-ProjectReaderTests-1566093849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-34d27674-ac7d-41ed-817f-1bf703b4a0eb {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:51:54 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-6c225cbc-928f-4710-a72b-8f3c8176f373 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1dfa690-00bf-4b71-a334-ec0ea05e3c58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13fea464-9700-4471-9da8-8cc5ca88da4d', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:51:54 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-6c225cbc-928f-4710-a72b-8f3c8176f373 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b093e86b-88f3-4620-a138-5ebb09421a32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:51:54 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-6c225cbc-928f-4710-a72b-8f3c8176f373 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Volume volume-13fea464-9700-4471-9da8-8cc5ca88da4d (13fea464-9700-4471-9da8-8cc5ca88da4d): created successfully Sep 06 06:51:54 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-6c225cbc-928f-4710-a72b-8f3c8176f373 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b093e86b-88f3-4620-a138-5ebb09421a32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:51:54 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-6c225cbc-928f-4710-a72b-8f3c8176f373 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Flow 'volume_create_manager' (63cdbad9-6532-4475-8785-2f7b4e1c918b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:51:54 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-6c225cbc-928f-4710-a72b-8f3c8176f373 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Created volume successfully. Sep 06 06:51:54 devstack sudo[106666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-34d27674-ac7d-41ed-817f-1bf703b4a0eb Sep 06 06:51:54 devstack sudo[106666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:51:54 devstack sudo[106666]: pam_unix(sudo:session): session closed for user root Sep 06 06:51:54 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-135c065b-b89e-43ca-af88-b503e13437bd tempest-ProjectReaderTests-1566093849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-34d27674-ac7d-41ed-817f-1bf703b4a0eb" returned: 0 in 0.431s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:51:54 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-135c065b-b89e-43ca-af88-b503e13437bd tempest-ProjectReaderTests-1566093849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-34d27674-ac7d-41ed-817f-1bf703b4a0eb.dfe9aa59-34ca-40ec-add1-906b518b5eff {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:51:54 devstack sudo[106671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-34d27674-ac7d-41ed-817f-1bf703b4a0eb.dfe9aa59-34ca-40ec-add1-906b518b5eff Sep 06 06:51:54 devstack sudo[106671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:51:55 devstack sudo[106671]: pam_unix(sudo:session): session closed for user root Sep 06 06:51:55 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-135c065b-b89e-43ca-af88-b503e13437bd tempest-ProjectReaderTests-1566093849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-34d27674-ac7d-41ed-817f-1bf703b4a0eb.dfe9aa59-34ca-40ec-add1-906b518b5eff" returned: 0 in 0.394s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:51:55 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-135c065b-b89e-43ca-af88-b503e13437bd tempest-ProjectReaderTests-1566093849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-34d27674-ac7d-41ed-817f-1bf703b4a0eb.dfe9aa59-34ca-40ec-add1-906b518b5eff {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:51:55 devstack sudo[106677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-34d27674-ac7d-41ed-817f-1bf703b4a0eb.dfe9aa59-34ca-40ec-add1-906b518b5eff Sep 06 06:51:55 devstack sudo[106677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:51:55 devstack sudo[106677]: pam_unix(sudo:session): session closed for user root Sep 06 06:51:55 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-135c065b-b89e-43ca-af88-b503e13437bd tempest-ProjectReaderTests-1566093849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-34d27674-ac7d-41ed-817f-1bf703b4a0eb.dfe9aa59-34ca-40ec-add1-906b518b5eff" returned: 0 in 0.260s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:51:55 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-135c065b-b89e-43ca-af88-b503e13437bd tempest-ProjectReaderTests-1566093849 None] Lock "cinder-quobyte-dfe9aa59-34ca-40ec-add1-906b518b5eff" released by "_delete_snapshot" :: held 1.718s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:51:55 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c87b6be-8bb1-4f24-9cec-2377a7122e87 tempest-VolumeImageDependencyTests-182874516 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87329) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 06:51:55 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-4c87b6be-8bb1-4f24-9cec-2377a7122e87 tempest-VolumeImageDependencyTests-182874516 None] Flow 'volume_create_manager' (833f9d38-c4fd-4fde-9784-be19b1bbf16c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:51:55 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-4c87b6be-8bb1-4f24-9cec-2377a7122e87 tempest-VolumeImageDependencyTests-182874516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ff69c46-7d20-4b1c-903d-f60f17cf272a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:51:55 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-135c065b-b89e-43ca-af88-b503e13437bd tempest-ProjectReaderTests-1566093849 None] Lock "cinder-quobyte-34d27674-ac7d-41ed-817f-1bf703b4a0eb" released by "delete_snapshot" :: held 1.786s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:51:55 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-4c87b6be-8bb1-4f24-9cec-2377a7122e87 tempest-VolumeImageDependencyTests-182874516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ff69c46-7d20-4b1c-903d-f60f17cf272a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:51:55Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6551242d-27a3-46a5-8f19-0a68a1e0173f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ee427b8d7ab426d86cc9b64c457cbd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:51:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:51:56Z,use_quota=True,user_id='c1e63943e6fc43faa4ed841513464236',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:51:55 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-4c87b6be-8bb1-4f24-9cec-2377a7122e87 tempest-VolumeImageDependencyTests-182874516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b17dcdd-9305-4e0c-8ef6-8ddbf7574dd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:51:55 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-4c87b6be-8bb1-4f24-9cec-2377a7122e87 tempest-VolumeImageDependencyTests-182874516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b17dcdd-9305-4e0c-8ef6-8ddbf7574dd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:51:55 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-4c87b6be-8bb1-4f24-9cec-2377a7122e87 tempest-VolumeImageDependencyTests-182874516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (568e1ffa-b5ef-4efb-8489-32860a04c2d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:51:55 devstack cinder-volume[87329]: DEBUG cinder.image.glance [None req-4c87b6be-8bb1-4f24-9cec-2377a7122e87 tempest-VolumeImageDependencyTests-182874516 None] Creating Keystone auth plugin from conf {{(pid=87329) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 06 06:51:55 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-135c065b-b89e-43ca-af88-b503e13437bd tempest-ProjectReaderTests-1566093849 None] Created reservations ['24184c54-3d0a-494a-9c6e-bc47e65a8034', 'e55b0f29-b7aa-48db-bfe8-e844ad2804a7', 'cac8ec1a-fb4b-457d-ad33-a14ba44baa4c', '138b6901-a315-49a4-afaa-feff711a7cff'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:51:55 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-135c065b-b89e-43ca-af88-b503e13437bd tempest-ProjectReaderTests-1566093849 None] Delete snapshot completed successfully. Sep 06 06:51:55 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-135c065b-b89e-43ca-af88-b503e13437bd tempest-ProjectReaderTests-1566093849 None] Lock "cinder-dfe9aa59-34ca-40ec-add1-906b518b5eff-delete_snapshot" released by "delete_snapshot" :: held 2.012s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:51:56 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-02bf63d3-574c-403a-8215-1632a2a2e95c tempest-ProjectReaderTests-1566093849 None] Acquiring lock "cinder-34d27674-ac7d-41ed-817f-1bf703b4a0eb-delete_volume" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:51:56 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-02bf63d3-574c-403a-8215-1632a2a2e95c tempest-ProjectReaderTests-1566093849 None] Lock "cinder-34d27674-ac7d-41ed-817f-1bf703b4a0eb-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:51:56 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-02bf63d3-574c-403a-8215-1632a2a2e95c tempest-ProjectReaderTests-1566093849 None] Acquiring lock "cinder-quobyte-34d27674-ac7d-41ed-817f-1bf703b4a0eb" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:51:56 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-4c87b6be-8bb1-4f24-9cec-2377a7122e87 tempest-VolumeImageDependencyTests-182874516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (568e1ffa-b5ef-4efb-8489-32860a04c2d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '6551242d-27a3-46a5-8f19-0a68a1e0173f', 'volume_name': 'volume-6551242d-27a3-46a5-8f19-0a68a1e0173f', 'volume_size': 1, 'image_id': 'e8de3832-2d2c-460b-bbe7-8d844bd8fe26', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e8de3832-2d2c-460b-bbe7-8d844bd8fe26', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd3633c5a461f0eae92fd95cf4cb28f69', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4ee427b8d7ab426d86cc9b64c457cbd8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '17b1c3ddc2bb0b0fe825028f9419fcca0aed11513013cad69e5acf9d7fc32e9dc9b32726a9a5b435ba51a7682245330c0114de3c4052d573ab57ec7727d24c5c', 'id': 'e8de3832-2d2c-460b-bbe7-8d844bd8fe26', 'created_at': datetime.datetime(2026, 9, 6, 4, 51, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 6, 4, 51, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e8de3832-2d2c-460b-bbe7-8d844bd8fe26/file', 'properties': {}}, 'image_service': }' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:51:56 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-4c87b6be-8bb1-4f24-9cec-2377a7122e87 tempest-VolumeImageDependencyTests-182874516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (959ec690-9beb-486a-98d0-286873ce5072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:51:56 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-4c87b6be-8bb1-4f24-9cec-2377a7122e87 tempest-VolumeImageDependencyTests-182874516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (959ec690-9beb-486a-98d0-286873ce5072) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:51:56 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-4c87b6be-8bb1-4f24-9cec-2377a7122e87 tempest-VolumeImageDependencyTests-182874516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cee44b74-66dd-4d0f-bc20-416b8e312d29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:51:56 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-4c87b6be-8bb1-4f24-9cec-2377a7122e87 tempest-VolumeImageDependencyTests-182874516 None] Volume 6551242d-27a3-46a5-8f19-0a68a1e0173f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-6551242d-27a3-46a5-8f19-0a68a1e0173f', 'volume_size': 1, 'image_id': 'e8de3832-2d2c-460b-bbe7-8d844bd8fe26', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e8de3832-2d2c-460b-bbe7-8d844bd8fe26', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd3633c5a461f0eae92fd95cf4cb28f69', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4ee427b8d7ab426d86cc9b64c457cbd8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '17b1c3ddc2bb0b0fe825028f9419fcca0aed11513013cad69e5acf9d7fc32e9dc9b32726a9a5b435ba51a7682245330c0114de3c4052d573ab57ec7727d24c5c', 'id': 'e8de3832-2d2c-460b-bbe7-8d844bd8fe26', 'created_at': datetime.datetime(2026, 9, 6, 4, 51, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 6, 4, 51, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e8de3832-2d2c-460b-bbe7-8d844bd8fe26/file', 'properties': {}}, 'image_service': } Sep 06 06:51:56 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c87b6be-8bb1-4f24-9cec-2377a7122e87 tempest-VolumeImageDependencyTests-182874516 None] Trying to clone 6551242d-27a3-46a5-8f19-0a68a1e0173f from image e8de3832-2d2c-460b-bbe7-8d844bd8fe26 at location (None, [{'url': 'file:///opt/stack/data/glance/images/e8de3832-2d2c-460b-bbe7-8d844bd8fe26', 'metadata': {}}]). {{(pid=87329) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 06 06:51:56 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-02bf63d3-574c-403a-8215-1632a2a2e95c tempest-ProjectReaderTests-1566093849 None] Lock "cinder-quobyte-34d27674-ac7d-41ed-817f-1bf703b4a0eb" acquired by "delete_volume" :: waited 0.067s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:51:56 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c4aea08-aac8-4cb9-b232-2eb61e2914ff tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87329) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 06:51:56 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-3c4aea08-aac8-4cb9-b232-2eb61e2914ff tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Flow 'volume_create_manager' (000e7016-ec55-435b-a77f-0aba1f197cfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:51:56 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-3c4aea08-aac8-4cb9-b232-2eb61e2914ff tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (599a7002-219f-4bca-bf4d-d1c5ee0efc13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:51:56 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f1b7dde-3301-4f34-bf74-4539f27d098d]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:51:56 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-02bf63d3-574c-403a-8215-1632a2a2e95c tempest-ProjectReaderTests-1566093849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-34d27674-ac7d-41ed-817f-1bf703b4a0eb {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:51:56 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-3c4aea08-aac8-4cb9-b232-2eb61e2914ff tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (599a7002-219f-4bca-bf4d-d1c5ee0efc13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:51:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-185457562',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51a831ec-b156-4b0e-8632-eecebc8c0620,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40344910e0f142f0869ec08ba17947ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:51:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:51:56Z,use_quota=True,user_id='96c1f3ce1eea4447aacccf1418192edd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:51:56 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-3c4aea08-aac8-4cb9-b232-2eb61e2914ff tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc6a938e-94e9-4e5d-83f1-ddb09978cd5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:51:56 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-3c4aea08-aac8-4cb9-b232-2eb61e2914ff tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc6a938e-94e9-4e5d-83f1-ddb09978cd5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:51:56 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-3c4aea08-aac8-4cb9-b232-2eb61e2914ff tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bdc6e70-4632-4133-a5e4-6864f0ac5d5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:51:56 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-3c4aea08-aac8-4cb9-b232-2eb61e2914ff tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bdc6e70-4632-4133-a5e4-6864f0ac5d5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51a831ec-b156-4b0e-8632-eecebc8c0620', 'volume_name': 'volume-51a831ec-b156-4b0e-8632-eecebc8c0620', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:51:56 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-3c4aea08-aac8-4cb9-b232-2eb61e2914ff tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ce51e82-c4cc-4b0e-8dff-6543338e6f83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:51:56 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-3c4aea08-aac8-4cb9-b232-2eb61e2914ff tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ce51e82-c4cc-4b0e-8dff-6543338e6f83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:51:56 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-3c4aea08-aac8-4cb9-b232-2eb61e2914ff tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84034ba6-f21b-4c98-9154-3ebb8f0bec80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:51:56 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-3c4aea08-aac8-4cb9-b232-2eb61e2914ff tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Volume 51a831ec-b156-4b0e-8632-eecebc8c0620: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51a831ec-b156-4b0e-8632-eecebc8c0620', 'volume_size': 1} Sep 06 06:51:56 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-3c4aea08-aac8-4cb9-b232-2eb61e2914ff tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:51:56 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-3c4aea08-aac8-4cb9-b232-2eb61e2914ff tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:51:56 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-3c4aea08-aac8-4cb9-b232-2eb61e2914ff tempest-CreateVolumesFromSourceVolumeTest-156116101 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:51:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-185457562',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51a831ec-b156-4b0e-8632-eecebc8c0620,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40344910e0f142f0869ec08ba17947ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:51:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:51:56Z,use_quota=True,user_id='96c1f3ce1eea4447aacccf1418192edd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)}" {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 06:51:56 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-3c4aea08-aac8-4cb9-b232-2eb61e2914ff tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Creating volume 51a831ec-b156-4b0e-8632-eecebc8c0620 {{(pid=87329) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 06:51:56 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-3c4aea08-aac8-4cb9-b232-2eb61e2914ff tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:51:56 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-3c4aea08-aac8-4cb9-b232-2eb61e2914ff tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:51:56 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-3c4aea08-aac8-4cb9-b232-2eb61e2914ff tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:51:56 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-3c4aea08-aac8-4cb9-b232-2eb61e2914ff tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:51:56 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-3c4aea08-aac8-4cb9-b232-2eb61e2914ff tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:51:56 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-3c4aea08-aac8-4cb9-b232-2eb61e2914ff tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Selected osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 as target Quobyte volume. {{(pid=87329) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 06:51:56 devstack cinder-volume[87329]: INFO cinder.volume.drivers.remotefs [None req-3c4aea08-aac8-4cb9-b232-2eb61e2914ff tempest-CreateVolumesFromSourceVolumeTest-156116101 None] casted to osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 Sep 06 06:51:56 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-3c4aea08-aac8-4cb9-b232-2eb61e2914ff tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-51a831ec-b156-4b0e-8632-eecebc8c0620 1073741824 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:51:56 devstack sudo[106680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-34d27674-ac7d-41ed-817f-1bf703b4a0eb Sep 06 06:51:56 devstack sudo[106680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:51:56 devstack cinder-volume[87329]: DEBUG cinder.image.image_utils [None req-4c87b6be-8bb1-4f24-9cec-2377a7122e87 tempest-VolumeImageDependencyTests-182874516 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e8de3832-2d2c-460b-bbe7-8d844bd8fe26_studmatedevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87329) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 06 06:51:56 devstack cinder-volume[87329]: INFO cinder.image.image_utils [None req-4c87b6be-8bb1-4f24-9cec-2377a7122e87 tempest-VolumeImageDependencyTests-182874516 None] Image download 0.00 MB at 0.00 MB/s Sep 06 06:51:56 devstack sudo[106682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-51a831ec-b156-4b0e-8632-eecebc8c0620 1073741824 Sep 06 06:51:56 devstack sudo[106682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:51:56 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[8213bbfb-e04f-4442-8bab-02c69ab1f0d0]: (4, 'raw') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:51:56 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-4c87b6be-8bb1-4f24-9cec-2377a7122e87 tempest-VolumeImageDependencyTests-182874516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e8de3832-2d2c-460b-bbe7-8d844bd8fe26_studmatedevstack@QuobyteHD {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:51:56 devstack sudo[106684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e8de3832-2d2c-460b-bbe7-8d844bd8fe26_studmatedevstack@QuobyteHD Sep 06 06:51:56 devstack sudo[106684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:51:56 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e1b2fdd-e7ad-48c8-866d-15f9a9da7152 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87329) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 06:51:57 devstack sudo[106680]: pam_unix(sudo:session): session closed for user root Sep 06 06:51:57 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-8e1b2fdd-e7ad-48c8-866d-15f9a9da7152 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Flow 'volume_create_manager' (a783afcd-f3ac-42dd-8ab2-47694c14af05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:51:57 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-8e1b2fdd-e7ad-48c8-866d-15f9a9da7152 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d315d7ba-330d-4ee9-98ea-a1d69d58c087) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:51:57 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-02bf63d3-574c-403a-8215-1632a2a2e95c tempest-ProjectReaderTests-1566093849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-34d27674-ac7d-41ed-817f-1bf703b4a0eb" returned: 0 in 0.604s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:51:57 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-02bf63d3-574c-403a-8215-1632a2a2e95c tempest-ProjectReaderTests-1566093849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-34d27674-ac7d-41ed-817f-1bf703b4a0eb {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:51:57 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-8e1b2fdd-e7ad-48c8-866d-15f9a9da7152 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d315d7ba-330d-4ee9-98ea-a1d69d58c087) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:51:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1225356470',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=856414f5-82e0-49aa-80c9-ed29f138876b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40344910e0f142f0869ec08ba17947ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:51:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:51:57Z,use_quota=True,user_id='96c1f3ce1eea4447aacccf1418192edd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:51:57 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-8e1b2fdd-e7ad-48c8-866d-15f9a9da7152 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64460d0f-9cfd-4093-b4c7-b0fd3cb03105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:51:57 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-8e1b2fdd-e7ad-48c8-866d-15f9a9da7152 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64460d0f-9cfd-4093-b4c7-b0fd3cb03105) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:51:57 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-8e1b2fdd-e7ad-48c8-866d-15f9a9da7152 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fa173ec-7646-458b-9abd-19e510c3f2d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:51:57 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-8e1b2fdd-e7ad-48c8-866d-15f9a9da7152 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fa173ec-7646-458b-9abd-19e510c3f2d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '856414f5-82e0-49aa-80c9-ed29f138876b', 'volume_name': 'volume-856414f5-82e0-49aa-80c9-ed29f138876b', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:51:57 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-8e1b2fdd-e7ad-48c8-866d-15f9a9da7152 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bcfeebb-e264-451b-b266-f2e072c8c4b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:51:57 devstack sudo[106692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-34d27674-ac7d-41ed-817f-1bf703b4a0eb Sep 06 06:51:57 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-8e1b2fdd-e7ad-48c8-866d-15f9a9da7152 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bcfeebb-e264-451b-b266-f2e072c8c4b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:51:57 devstack sudo[106692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:51:57 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-8e1b2fdd-e7ad-48c8-866d-15f9a9da7152 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae600594-8863-459c-9aa4-7803a4ed5ed4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:51:57 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-8e1b2fdd-e7ad-48c8-866d-15f9a9da7152 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Volume 856414f5-82e0-49aa-80c9-ed29f138876b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-856414f5-82e0-49aa-80c9-ed29f138876b', 'volume_size': 1} Sep 06 06:51:57 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-8e1b2fdd-e7ad-48c8-866d-15f9a9da7152 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:51:57 devstack sudo[106684]: pam_unix(sudo:session): session closed for user root Sep 06 06:51:57 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-4c87b6be-8bb1-4f24-9cec-2377a7122e87 tempest-VolumeImageDependencyTests-182874516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e8de3832-2d2c-460b-bbe7-8d844bd8fe26_studmatedevstack@QuobyteHD" returned: 0 in 0.502s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:51:57 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-4c87b6be-8bb1-4f24-9cec-2377a7122e87 tempest-VolumeImageDependencyTests-182874516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e8de3832-2d2c-460b-bbe7-8d844bd8fe26_studmatedevstack@QuobyteHD {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:51:57 devstack sudo[106682]: pam_unix(sudo:session): session closed for user root Sep 06 06:51:57 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-3c4aea08-aac8-4cb9-b232-2eb61e2914ff tempest-CreateVolumesFromSourceVolumeTest-156116101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-51a831ec-b156-4b0e-8632-eecebc8c0620 1073741824" returned: 0 in 0.800s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:51:57 devstack sudo[106696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e8de3832-2d2c-460b-bbe7-8d844bd8fe26_studmatedevstack@QuobyteHD Sep 06 06:51:57 devstack sudo[106696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:51:57 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-3c4aea08-aac8-4cb9-b232-2eb61e2914ff tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-51a831ec-b156-4b0e-8632-eecebc8c0620 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:51:57 devstack sudo[106700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-51a831ec-b156-4b0e-8632-eecebc8c0620 Sep 06 06:51:57 devstack sudo[106700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:51:57 devstack sudo[106692]: pam_unix(sudo:session): session closed for user root Sep 06 06:51:57 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-02bf63d3-574c-403a-8215-1632a2a2e95c tempest-ProjectReaderTests-1566093849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-34d27674-ac7d-41ed-817f-1bf703b4a0eb" returned: 0 in 0.495s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:51:57 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-02bf63d3-574c-403a-8215-1632a2a2e95c tempest-ProjectReaderTests-1566093849 None] Lock "cinder-quobyte-34d27674-ac7d-41ed-817f-1bf703b4a0eb" released by "delete_volume" :: held 1.206s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:51:57 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea001b5a-03fb-4c1e-b551-9de5f88bc842 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87329) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 06:51:57 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-ea001b5a-03fb-4c1e-b551-9de5f88bc842 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Flow 'volume_create_manager' (86ab4fde-e7db-4073-8209-3e682ac0584d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:51:57 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-ea001b5a-03fb-4c1e-b551-9de5f88bc842 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (038a4f00-9c5e-4972-a050-ff8d6a508e4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:51:57 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-ea001b5a-03fb-4c1e-b551-9de5f88bc842 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (038a4f00-9c5e-4972-a050-ff8d6a508e4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:51:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1091502838',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52793c59-278b-4e22-a171-4a634d13ffa2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40344910e0f142f0869ec08ba17947ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:51:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:51:58Z,use_quota=True,user_id='96c1f3ce1eea4447aacccf1418192edd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:51:57 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-ea001b5a-03fb-4c1e-b551-9de5f88bc842 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b45666e-74ff-4863-9aa0-e53f0fc8fd2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:51:57 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-ea001b5a-03fb-4c1e-b551-9de5f88bc842 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b45666e-74ff-4863-9aa0-e53f0fc8fd2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:51:57 devstack sudo[106700]: pam_unix(sudo:session): session closed for user root Sep 06 06:51:57 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-ea001b5a-03fb-4c1e-b551-9de5f88bc842 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53c41a9d-f30f-4d28-9d63-3e7b70a356e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:51:57 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-ea001b5a-03fb-4c1e-b551-9de5f88bc842 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53c41a9d-f30f-4d28-9d63-3e7b70a356e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52793c59-278b-4e22-a171-4a634d13ffa2', 'volume_name': 'volume-52793c59-278b-4e22-a171-4a634d13ffa2', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:51:57 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-ea001b5a-03fb-4c1e-b551-9de5f88bc842 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (546f453b-1078-4616-824a-67e81e741b66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:51:57 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-ea001b5a-03fb-4c1e-b551-9de5f88bc842 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (546f453b-1078-4616-824a-67e81e741b66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:51:57 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-ea001b5a-03fb-4c1e-b551-9de5f88bc842 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f32e787-c519-45d0-8c54-204e28fd0125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:51:57 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-ea001b5a-03fb-4c1e-b551-9de5f88bc842 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Volume 52793c59-278b-4e22-a171-4a634d13ffa2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52793c59-278b-4e22-a171-4a634d13ffa2', 'volume_size': 1} Sep 06 06:51:57 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-ea001b5a-03fb-4c1e-b551-9de5f88bc842 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:51:57 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-3c4aea08-aac8-4cb9-b232-2eb61e2914ff tempest-CreateVolumesFromSourceVolumeTest-156116101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-51a831ec-b156-4b0e-8632-eecebc8c0620" returned: 0 in 0.370s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:51:57 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-3c4aea08-aac8-4cb9-b232-2eb61e2914ff tempest-CreateVolumesFromSourceVolumeTest-156116101 None] <== create_volume: return (1270ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'} {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 06:51:57 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-3c4aea08-aac8-4cb9-b232-2eb61e2914ff tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.278s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:51:57 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-8e1b2fdd-e7ad-48c8-866d-15f9a9da7152 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.700s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:51:57 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-8e1b2fdd-e7ad-48c8-866d-15f9a9da7152 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:51:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1225356470',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=856414f5-82e0-49aa-80c9-ed29f138876b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40344910e0f142f0869ec08ba17947ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:51:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:51:57Z,use_quota=True,user_id='96c1f3ce1eea4447aacccf1418192edd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)}" {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 06:51:57 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-8e1b2fdd-e7ad-48c8-866d-15f9a9da7152 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Creating volume 856414f5-82e0-49aa-80c9-ed29f138876b {{(pid=87329) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 06:51:57 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-8e1b2fdd-e7ad-48c8-866d-15f9a9da7152 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:51:57 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-8e1b2fdd-e7ad-48c8-866d-15f9a9da7152 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:51:57 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-8e1b2fdd-e7ad-48c8-866d-15f9a9da7152 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:51:57 devstack sudo[106696]: pam_unix(sudo:session): session closed for user root Sep 06 06:51:57 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-8e1b2fdd-e7ad-48c8-866d-15f9a9da7152 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:51:57 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-8e1b2fdd-e7ad-48c8-866d-15f9a9da7152 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:51:57 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-8e1b2fdd-e7ad-48c8-866d-15f9a9da7152 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Selected osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 as target Quobyte volume. {{(pid=87329) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 06:51:57 devstack cinder-volume[87329]: INFO cinder.volume.drivers.remotefs [None req-8e1b2fdd-e7ad-48c8-866d-15f9a9da7152 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] casted to osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 Sep 06 06:51:57 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-8e1b2fdd-e7ad-48c8-866d-15f9a9da7152 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-856414f5-82e0-49aa-80c9-ed29f138876b 1073741824 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:51:57 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-4c87b6be-8bb1-4f24-9cec-2377a7122e87 tempest-VolumeImageDependencyTests-182874516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e8de3832-2d2c-460b-bbe7-8d844bd8fe26_studmatedevstack@QuobyteHD" returned: 1 in 0.614s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:51:57 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-4c87b6be-8bb1-4f24-9cec-2377a7122e87 tempest-VolumeImageDependencyTests-182874516 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e8de3832-2d2c-460b-bbe7-8d844bd8fe26_studmatedevstack@QuobyteHD' failed. Not Retrying. {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 06 06:51:57 devstack cinder-volume[87329]: DEBUG cinder.image.image_utils [None req-4c87b6be-8bb1-4f24-9cec-2377a7122e87 tempest-VolumeImageDependencyTests-182874516 None] Temporary image e8de3832-2d2c-460b-bbe7-8d844bd8fe26 is fetched for user c1e63943e6fc43faa4ed841513464236. {{(pid=87329) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 06 06:51:57 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-02bf63d3-574c-403a-8215-1632a2a2e95c tempest-ProjectReaderTests-1566093849 None] Created reservations ['d2f8f8b1-5bd4-4383-bbfa-ba4cd9373eff', 'cfc351fd-ead3-453f-a853-29d7452fe963', '80b84175-697d-49fe-9e2e-2eb4e6ddd40b', '84f2bbe3-3055-4454-be05-46f2d129ff7a'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:51:57 devstack sudo[106706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-856414f5-82e0-49aa-80c9-ed29f138876b 1073741824 Sep 06 06:51:57 devstack sudo[106706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:51:57 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-3c4aea08-aac8-4cb9-b232-2eb61e2914ff tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84034ba6-f21b-4c98-9154-3ebb8f0bec80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51a831ec-b156-4b0e-8632-eecebc8c0620', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:51:57 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-3c4aea08-aac8-4cb9-b232-2eb61e2914ff tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (608f8853-f295-4452-aa6b-6867755349b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:51:57 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-3c4aea08-aac8-4cb9-b232-2eb61e2914ff tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Volume volume-51a831ec-b156-4b0e-8632-eecebc8c0620 (51a831ec-b156-4b0e-8632-eecebc8c0620): created successfully Sep 06 06:51:57 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-3c4aea08-aac8-4cb9-b232-2eb61e2914ff tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (608f8853-f295-4452-aa6b-6867755349b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:51:57 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-3c4aea08-aac8-4cb9-b232-2eb61e2914ff tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Flow 'volume_create_manager' (000e7016-ec55-435b-a77f-0aba1f197cfe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:51:57 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-3c4aea08-aac8-4cb9-b232-2eb61e2914ff tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Created volume successfully. Sep 06 06:51:57 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[83cde4a7-f3dc-4d69-9d33-d7353d00d44b]: (4, 'raw') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:51:57 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-4c87b6be-8bb1-4f24-9cec-2377a7122e87 tempest-VolumeImageDependencyTests-182874516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e8de3832-2d2c-460b-bbe7-8d844bd8fe26_studmatedevstack@QuobyteHD {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:51:58 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-02bf63d3-574c-403a-8215-1632a2a2e95c tempest-ProjectReaderTests-1566093849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:51:58 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-02bf63d3-574c-403a-8215-1632a2a2e95c tempest-ProjectReaderTests-1566093849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:51:58 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-02bf63d3-574c-403a-8215-1632a2a2e95c tempest-ProjectReaderTests-1566093849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:51:58 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-02bf63d3-574c-403a-8215-1632a2a2e95c tempest-ProjectReaderTests-1566093849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:51:58 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-02bf63d3-574c-403a-8215-1632a2a2e95c tempest-ProjectReaderTests-1566093849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:51:58 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-02bf63d3-574c-403a-8215-1632a2a2e95c tempest-ProjectReaderTests-1566093849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:51:58 devstack sudo[106709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:51:58 devstack sudo[106709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:51:58 devstack sudo[106708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e8de3832-2d2c-460b-bbe7-8d844bd8fe26_studmatedevstack@QuobyteHD Sep 06 06:51:58 devstack sudo[106708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:51:58 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b1e295c-4c17-4c35-a922-b3c74c7b8791 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87329) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 06:51:58 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-2b1e295c-4c17-4c35-a922-b3c74c7b8791 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Flow 'volume_create_manager' (9ff6d303-9501-4159-9d3a-a8668c7b20d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:51:58 devstack sudo[106709]: pam_unix(sudo:session): session closed for user root Sep 06 06:51:58 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-2b1e295c-4c17-4c35-a922-b3c74c7b8791 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50cf80a9-590d-464f-865f-7424482b41f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:51:58 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-02bf63d3-574c-403a-8215-1632a2a2e95c tempest-ProjectReaderTests-1566093849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.352s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:51:58 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-02bf63d3-574c-403a-8215-1632a2a2e95c tempest-ProjectReaderTests-1566093849 None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:51:58 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-2b1e295c-4c17-4c35-a922-b3c74c7b8791 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50cf80a9-590d-464f-865f-7424482b41f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:51:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1119983170',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e770100-7467-4922-9f1f-9c471245e2bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40344910e0f142f0869ec08ba17947ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:51:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:51:58Z,use_quota=True,user_id='96c1f3ce1eea4447aacccf1418192edd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:51:58 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-2b1e295c-4c17-4c35-a922-b3c74c7b8791 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0dd507b8-acf9-4e87-bc72-7ed3dd42f7d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:51:58 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-2b1e295c-4c17-4c35-a922-b3c74c7b8791 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0dd507b8-acf9-4e87-bc72-7ed3dd42f7d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:51:58 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-2b1e295c-4c17-4c35-a922-b3c74c7b8791 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98694edb-d859-4cf7-b04f-b2da6b0e0716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:51:58 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-2b1e295c-4c17-4c35-a922-b3c74c7b8791 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98694edb-d859-4cf7-b04f-b2da6b0e0716) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e770100-7467-4922-9f1f-9c471245e2bb', 'volume_name': 'volume-2e770100-7467-4922-9f1f-9c471245e2bb', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:51:58 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-2b1e295c-4c17-4c35-a922-b3c74c7b8791 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a09bc7e0-6175-4cac-826c-68d99b4237f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:51:58 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-2b1e295c-4c17-4c35-a922-b3c74c7b8791 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a09bc7e0-6175-4cac-826c-68d99b4237f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:51:58 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-2b1e295c-4c17-4c35-a922-b3c74c7b8791 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ab91dd3-cc81-4b89-9307-6ac23e66caa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:51:58 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-2b1e295c-4c17-4c35-a922-b3c74c7b8791 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Volume 2e770100-7467-4922-9f1f-9c471245e2bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e770100-7467-4922-9f1f-9c471245e2bb', 'volume_size': 1} Sep 06 06:51:58 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-2b1e295c-4c17-4c35-a922-b3c74c7b8791 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:51:58 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-02bf63d3-574c-403a-8215-1632a2a2e95c tempest-ProjectReaderTests-1566093849 None] Deleted volume successfully. Sep 06 06:51:58 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-02bf63d3-574c-403a-8215-1632a2a2e95c tempest-ProjectReaderTests-1566093849 None] Lock "cinder-34d27674-ac7d-41ed-817f-1bf703b4a0eb-delete_volume" released by "delete_volume" :: held 2.264s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:51:58 devstack sudo[106708]: pam_unix(sudo:session): session closed for user root Sep 06 06:51:58 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-4c87b6be-8bb1-4f24-9cec-2377a7122e87 tempest-VolumeImageDependencyTests-182874516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e8de3832-2d2c-460b-bbe7-8d844bd8fe26_studmatedevstack@QuobyteHD" returned: 0 in 0.511s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:51:58 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-4c87b6be-8bb1-4f24-9cec-2377a7122e87 tempest-VolumeImageDependencyTests-182874516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e8de3832-2d2c-460b-bbe7-8d844bd8fe26_studmatedevstack@QuobyteHD {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:51:58 devstack sudo[106706]: pam_unix(sudo:session): session closed for user root Sep 06 06:51:58 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-8e1b2fdd-e7ad-48c8-866d-15f9a9da7152 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-856414f5-82e0-49aa-80c9-ed29f138876b 1073741824" returned: 0 in 0.728s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:51:58 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-8e1b2fdd-e7ad-48c8-866d-15f9a9da7152 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-856414f5-82e0-49aa-80c9-ed29f138876b {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:51:58 devstack sudo[106719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e8de3832-2d2c-460b-bbe7-8d844bd8fe26_studmatedevstack@QuobyteHD Sep 06 06:51:58 devstack sudo[106719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:51:58 devstack sudo[106726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-856414f5-82e0-49aa-80c9-ed29f138876b Sep 06 06:51:58 devstack sudo[106726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:51:59 devstack sudo[106726]: pam_unix(sudo:session): session closed for user root Sep 06 06:51:59 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-8e1b2fdd-e7ad-48c8-866d-15f9a9da7152 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-856414f5-82e0-49aa-80c9-ed29f138876b" returned: 0 in 0.383s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:51:59 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-8e1b2fdd-e7ad-48c8-866d-15f9a9da7152 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] <== create_volume: return (1185ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'} {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 06:51:59 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-8e1b2fdd-e7ad-48c8-866d-15f9a9da7152 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.192s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:51:59 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-ea001b5a-03fb-4c1e-b551-9de5f88bc842 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.212s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:51:59 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-ea001b5a-03fb-4c1e-b551-9de5f88bc842 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:51:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1091502838',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52793c59-278b-4e22-a171-4a634d13ffa2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40344910e0f142f0869ec08ba17947ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:51:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:51:58Z,use_quota=True,user_id='96c1f3ce1eea4447aacccf1418192edd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)}" {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 06:51:59 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-ea001b5a-03fb-4c1e-b551-9de5f88bc842 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Creating volume 52793c59-278b-4e22-a171-4a634d13ffa2 {{(pid=87329) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 06:51:59 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-ea001b5a-03fb-4c1e-b551-9de5f88bc842 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:51:59 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-ea001b5a-03fb-4c1e-b551-9de5f88bc842 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:51:59 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-ea001b5a-03fb-4c1e-b551-9de5f88bc842 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:51:59 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-ea001b5a-03fb-4c1e-b551-9de5f88bc842 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:51:59 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-ea001b5a-03fb-4c1e-b551-9de5f88bc842 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:51:59 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-ea001b5a-03fb-4c1e-b551-9de5f88bc842 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Selected osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 as target Quobyte volume. {{(pid=87329) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 06:51:59 devstack cinder-volume[87329]: INFO cinder.volume.drivers.remotefs [None req-ea001b5a-03fb-4c1e-b551-9de5f88bc842 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] casted to osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 Sep 06 06:51:59 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-ea001b5a-03fb-4c1e-b551-9de5f88bc842 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-52793c59-278b-4e22-a171-4a634d13ffa2 1073741824 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:51:59 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-8e1b2fdd-e7ad-48c8-866d-15f9a9da7152 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae600594-8863-459c-9aa4-7803a4ed5ed4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-856414f5-82e0-49aa-80c9-ed29f138876b', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:51:59 devstack sudo[106730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-52793c59-278b-4e22-a171-4a634d13ffa2 1073741824 Sep 06 06:51:59 devstack sudo[106730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:51:59 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-8e1b2fdd-e7ad-48c8-866d-15f9a9da7152 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5dcf8994-bd2f-4753-a174-a8d9e8180920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:51:59 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-8e1b2fdd-e7ad-48c8-866d-15f9a9da7152 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Volume volume-856414f5-82e0-49aa-80c9-ed29f138876b (856414f5-82e0-49aa-80c9-ed29f138876b): created successfully Sep 06 06:51:59 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-8e1b2fdd-e7ad-48c8-866d-15f9a9da7152 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5dcf8994-bd2f-4753-a174-a8d9e8180920) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:51:59 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-8e1b2fdd-e7ad-48c8-866d-15f9a9da7152 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Flow 'volume_create_manager' (a783afcd-f3ac-42dd-8ab2-47694c14af05) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:51:59 devstack sudo[106719]: pam_unix(sudo:session): session closed for user root Sep 06 06:51:59 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-4c87b6be-8bb1-4f24-9cec-2377a7122e87 tempest-VolumeImageDependencyTests-182874516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e8de3832-2d2c-460b-bbe7-8d844bd8fe26_studmatedevstack@QuobyteHD" returned: 1 in 0.649s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:51:59 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-4c87b6be-8bb1-4f24-9cec-2377a7122e87 tempest-VolumeImageDependencyTests-182874516 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e8de3832-2d2c-460b-bbe7-8d844bd8fe26_studmatedevstack@QuobyteHD' failed. Not Retrying. {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 06 06:51:59 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-4c87b6be-8bb1-4f24-9cec-2377a7122e87 tempest-VolumeImageDependencyTests-182874516 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:51:59 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-8e1b2fdd-e7ad-48c8-866d-15f9a9da7152 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Created volume successfully. Sep 06 06:51:59 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-b27debd7-ffae-4fa0-bf0b-869f4fd10092 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87329) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 06:51:59 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-b27debd7-ffae-4fa0-bf0b-869f4fd10092 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Flow 'volume_create_manager' (5038d356-839c-419d-a8b1-7238e1511dcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:51:59 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-b27debd7-ffae-4fa0-bf0b-869f4fd10092 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c100c07d-5f03-4e4c-b5a8-702e2f4a3dd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:51:59 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-b27debd7-ffae-4fa0-bf0b-869f4fd10092 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c100c07d-5f03-4e4c-b5a8-702e2f4a3dd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:51:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-519453073',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bc418ce-ce1e-44c9-8294-57dc7a70a910,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40344910e0f142f0869ec08ba17947ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:51:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:51:59Z,use_quota=True,user_id='96c1f3ce1eea4447aacccf1418192edd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:51:59 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-b27debd7-ffae-4fa0-bf0b-869f4fd10092 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (872c7284-b168-4e9b-bfdc-3138d870e1a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:51:59 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-b27debd7-ffae-4fa0-bf0b-869f4fd10092 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (872c7284-b168-4e9b-bfdc-3138d870e1a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:51:59 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-b27debd7-ffae-4fa0-bf0b-869f4fd10092 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e274a5e-bfdf-4388-acf0-885759c67e86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:51:59 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-b27debd7-ffae-4fa0-bf0b-869f4fd10092 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e274a5e-bfdf-4388-acf0-885759c67e86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3bc418ce-ce1e-44c9-8294-57dc7a70a910', 'volume_name': 'volume-3bc418ce-ce1e-44c9-8294-57dc7a70a910', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:51:59 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-b27debd7-ffae-4fa0-bf0b-869f4fd10092 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8bc26f5-e307-4dd7-84c4-396cde810f0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:51:59 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-b27debd7-ffae-4fa0-bf0b-869f4fd10092 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8bc26f5-e307-4dd7-84c4-396cde810f0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:51:59 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-b27debd7-ffae-4fa0-bf0b-869f4fd10092 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f95dc0a-6bf6-4987-9ebd-aa594c7aee6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:51:59 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-b27debd7-ffae-4fa0-bf0b-869f4fd10092 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Volume 3bc418ce-ce1e-44c9-8294-57dc7a70a910: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3bc418ce-ce1e-44c9-8294-57dc7a70a910', 'volume_size': 1} Sep 06 06:51:59 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-b27debd7-ffae-4fa0-bf0b-869f4fd10092 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:51:59 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-e486997d-99ea-4048-a9c3-f0468ec57954 tempest-ProjectReaderTests-1566093849 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87329) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 06:51:59 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-e486997d-99ea-4048-a9c3-f0468ec57954 tempest-ProjectReaderTests-1566093849 None] Flow 'volume_create_manager' (15829518-06bb-4cc5-839d-a6a724c9c399) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:51:59 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-e486997d-99ea-4048-a9c3-f0468ec57954 tempest-ProjectReaderTests-1566093849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (508eed43-ea32-416f-9fbd-d6b99d97eb99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:51:59 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-e486997d-99ea-4048-a9c3-f0468ec57954 tempest-ProjectReaderTests-1566093849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (508eed43-ea32-416f-9fbd-d6b99d97eb99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:51:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1771362505',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa10e9db-97e3-4dde-ac06-a6f3542b18da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47b14cc477564406b2c85835936b99d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:51:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:51:59Z,use_quota=True,user_id='2bb3aa6913034422a07b16fa1477428f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:51:59 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-e486997d-99ea-4048-a9c3-f0468ec57954 tempest-ProjectReaderTests-1566093849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (287efe6e-9c71-420b-8d6a-d30c8c98aa37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:51:59 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-e486997d-99ea-4048-a9c3-f0468ec57954 tempest-ProjectReaderTests-1566093849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (287efe6e-9c71-420b-8d6a-d30c8c98aa37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:51:59 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-e486997d-99ea-4048-a9c3-f0468ec57954 tempest-ProjectReaderTests-1566093849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f946534b-2762-4f77-817e-a2438c5b5391) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:51:59 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-e486997d-99ea-4048-a9c3-f0468ec57954 tempest-ProjectReaderTests-1566093849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f946534b-2762-4f77-817e-a2438c5b5391) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa10e9db-97e3-4dde-ac06-a6f3542b18da', 'volume_name': 'volume-fa10e9db-97e3-4dde-ac06-a6f3542b18da', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:51:59 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-e486997d-99ea-4048-a9c3-f0468ec57954 tempest-ProjectReaderTests-1566093849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65086057-bbcc-4df3-85d9-245dd4f1c873) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:51:59 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-e486997d-99ea-4048-a9c3-f0468ec57954 tempest-ProjectReaderTests-1566093849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65086057-bbcc-4df3-85d9-245dd4f1c873) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:51:59 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-e486997d-99ea-4048-a9c3-f0468ec57954 tempest-ProjectReaderTests-1566093849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9dfc2d9-c028-4c70-b113-45667630de0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:51:59 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-e486997d-99ea-4048-a9c3-f0468ec57954 tempest-ProjectReaderTests-1566093849 None] Volume fa10e9db-97e3-4dde-ac06-a6f3542b18da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa10e9db-97e3-4dde-ac06-a6f3542b18da', 'volume_size': 1} Sep 06 06:51:59 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-e486997d-99ea-4048-a9c3-f0468ec57954 tempest-ProjectReaderTests-1566093849 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:51:59 devstack sudo[106730]: pam_unix(sudo:session): session closed for user root Sep 06 06:51:59 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-ea001b5a-03fb-4c1e-b551-9de5f88bc842 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-52793c59-278b-4e22-a171-4a634d13ffa2 1073741824" returned: 0 in 0.496s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:51:59 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-ea001b5a-03fb-4c1e-b551-9de5f88bc842 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-52793c59-278b-4e22-a171-4a634d13ffa2 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:51:59 devstack sudo[106738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-52793c59-278b-4e22-a171-4a634d13ffa2 Sep 06 06:51:59 devstack sudo[106738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:51:59 devstack sudo[106738]: pam_unix(sudo:session): session closed for user root Sep 06 06:51:59 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-ea001b5a-03fb-4c1e-b551-9de5f88bc842 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-52793c59-278b-4e22-a171-4a634d13ffa2" returned: 0 in 0.271s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:51:59 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-ea001b5a-03fb-4c1e-b551-9de5f88bc842 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] <== create_volume: return (815ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'} {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 06:51:59 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-ea001b5a-03fb-4c1e-b551-9de5f88bc842 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.822s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:51:59 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-2b1e295c-4c17-4c35-a922-b3c74c7b8791 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.403s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:51:59 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-2b1e295c-4c17-4c35-a922-b3c74c7b8791 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:51:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1119983170',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e770100-7467-4922-9f1f-9c471245e2bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40344910e0f142f0869ec08ba17947ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:51:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:51:58Z,use_quota=True,user_id='96c1f3ce1eea4447aacccf1418192edd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)}" {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 06:51:59 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-2b1e295c-4c17-4c35-a922-b3c74c7b8791 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Creating volume 2e770100-7467-4922-9f1f-9c471245e2bb {{(pid=87329) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 06:51:59 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-2b1e295c-4c17-4c35-a922-b3c74c7b8791 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:51:59 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-2b1e295c-4c17-4c35-a922-b3c74c7b8791 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:51:59 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-2b1e295c-4c17-4c35-a922-b3c74c7b8791 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:51:59 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-2b1e295c-4c17-4c35-a922-b3c74c7b8791 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:51:59 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-2b1e295c-4c17-4c35-a922-b3c74c7b8791 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:51:59 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-2b1e295c-4c17-4c35-a922-b3c74c7b8791 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Selected osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 as target Quobyte volume. {{(pid=87329) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 06:51:59 devstack cinder-volume[87329]: INFO cinder.volume.drivers.remotefs [None req-2b1e295c-4c17-4c35-a922-b3c74c7b8791 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] casted to osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 Sep 06 06:51:59 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-2b1e295c-4c17-4c35-a922-b3c74c7b8791 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-2e770100-7467-4922-9f1f-9c471245e2bb 1073741824 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:51:59 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-ea001b5a-03fb-4c1e-b551-9de5f88bc842 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f32e787-c519-45d0-8c54-204e28fd0125) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52793c59-278b-4e22-a171-4a634d13ffa2', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:51:59 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-ea001b5a-03fb-4c1e-b551-9de5f88bc842 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c829c5b3-ebc9-42dd-b112-b9a70bc213db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:51:59 devstack sudo[106741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-2e770100-7467-4922-9f1f-9c471245e2bb 1073741824 Sep 06 06:51:59 devstack sudo[106741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:51:59 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-ea001b5a-03fb-4c1e-b551-9de5f88bc842 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Volume volume-52793c59-278b-4e22-a171-4a634d13ffa2 (52793c59-278b-4e22-a171-4a634d13ffa2): created successfully Sep 06 06:51:59 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-ea001b5a-03fb-4c1e-b551-9de5f88bc842 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c829c5b3-ebc9-42dd-b112-b9a70bc213db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:51:59 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-ea001b5a-03fb-4c1e-b551-9de5f88bc842 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Flow 'volume_create_manager' (86ab4fde-e7db-4073-8209-3e682ac0584d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:51:59 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-ea001b5a-03fb-4c1e-b551-9de5f88bc842 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Created volume successfully. Sep 06 06:52:00 devstack sudo[106741]: pam_unix(sudo:session): session closed for user root Sep 06 06:52:00 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-2b1e295c-4c17-4c35-a922-b3c74c7b8791 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-2e770100-7467-4922-9f1f-9c471245e2bb 1073741824" returned: 0 in 0.539s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:52:00 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-2b1e295c-4c17-4c35-a922-b3c74c7b8791 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-2e770100-7467-4922-9f1f-9c471245e2bb {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:52:00 devstack sudo[106748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-2e770100-7467-4922-9f1f-9c471245e2bb Sep 06 06:52:00 devstack sudo[106748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:52:00 devstack sudo[106748]: pam_unix(sudo:session): session closed for user root Sep 06 06:52:00 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-2b1e295c-4c17-4c35-a922-b3c74c7b8791 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-2e770100-7467-4922-9f1f-9c471245e2bb" returned: 0 in 0.241s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:52:00 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-2b1e295c-4c17-4c35-a922-b3c74c7b8791 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] <== create_volume: return (824ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'} {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 06:52:00 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-2b1e295c-4c17-4c35-a922-b3c74c7b8791 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.827s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:52:00 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-4c87b6be-8bb1-4f24-9cec-2377a7122e87 tempest-VolumeImageDependencyTests-182874516 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.532s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:52:00 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-4c87b6be-8bb1-4f24-9cec-2377a7122e87 tempest-VolumeImageDependencyTests-182874516 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:51:55Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6551242d-27a3-46a5-8f19-0a68a1e0173f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ee427b8d7ab426d86cc9b64c457cbd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:51:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:51:56Z,use_quota=True,user_id='c1e63943e6fc43faa4ed841513464236',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)}" {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 06:52:00 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-4c87b6be-8bb1-4f24-9cec-2377a7122e87 tempest-VolumeImageDependencyTests-182874516 None] Creating volume 6551242d-27a3-46a5-8f19-0a68a1e0173f {{(pid=87329) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 06:52:00 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-4c87b6be-8bb1-4f24-9cec-2377a7122e87 tempest-VolumeImageDependencyTests-182874516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:52:00 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-4c87b6be-8bb1-4f24-9cec-2377a7122e87 tempest-VolumeImageDependencyTests-182874516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:52:00 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-4c87b6be-8bb1-4f24-9cec-2377a7122e87 tempest-VolumeImageDependencyTests-182874516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:52:00 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-4c87b6be-8bb1-4f24-9cec-2377a7122e87 tempest-VolumeImageDependencyTests-182874516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:52:00 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-4c87b6be-8bb1-4f24-9cec-2377a7122e87 tempest-VolumeImageDependencyTests-182874516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:52:00 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-4c87b6be-8bb1-4f24-9cec-2377a7122e87 tempest-VolumeImageDependencyTests-182874516 None] Selected osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 as target Quobyte volume. {{(pid=87329) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 06:52:00 devstack cinder-volume[87329]: INFO cinder.volume.drivers.remotefs [None req-4c87b6be-8bb1-4f24-9cec-2377a7122e87 tempest-VolumeImageDependencyTests-182874516 None] casted to osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 Sep 06 06:52:00 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-4c87b6be-8bb1-4f24-9cec-2377a7122e87 tempest-VolumeImageDependencyTests-182874516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6551242d-27a3-46a5-8f19-0a68a1e0173f 1073741824 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:52:00 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-2b1e295c-4c17-4c35-a922-b3c74c7b8791 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ab91dd3-cc81-4b89-9307-6ac23e66caa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e770100-7467-4922-9f1f-9c471245e2bb', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:52:00 devstack sudo[106751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6551242d-27a3-46a5-8f19-0a68a1e0173f 1073741824 Sep 06 06:52:00 devstack sudo[106751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:52:00 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-2b1e295c-4c17-4c35-a922-b3c74c7b8791 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8017d790-0c40-498f-91a7-82ecbc52c6e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:52:00 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-2b1e295c-4c17-4c35-a922-b3c74c7b8791 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Volume volume-2e770100-7467-4922-9f1f-9c471245e2bb (2e770100-7467-4922-9f1f-9c471245e2bb): created successfully Sep 06 06:52:00 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-2b1e295c-4c17-4c35-a922-b3c74c7b8791 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8017d790-0c40-498f-91a7-82ecbc52c6e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:52:00 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-2b1e295c-4c17-4c35-a922-b3c74c7b8791 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Flow 'volume_create_manager' (9ff6d303-9501-4159-9d3a-a8668c7b20d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:52:00 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-2b1e295c-4c17-4c35-a922-b3c74c7b8791 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Created volume successfully. Sep 06 06:52:01 devstack sudo[106751]: pam_unix(sudo:session): session closed for user root Sep 06 06:52:01 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-4c87b6be-8bb1-4f24-9cec-2377a7122e87 tempest-VolumeImageDependencyTests-182874516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6551242d-27a3-46a5-8f19-0a68a1e0173f 1073741824" returned: 0 in 0.443s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:52:01 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-4c87b6be-8bb1-4f24-9cec-2377a7122e87 tempest-VolumeImageDependencyTests-182874516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6551242d-27a3-46a5-8f19-0a68a1e0173f {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:52:01 devstack sudo[106756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6551242d-27a3-46a5-8f19-0a68a1e0173f Sep 06 06:52:01 devstack sudo[106756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:52:01 devstack sudo[106756]: pam_unix(sudo:session): session closed for user root Sep 06 06:52:01 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-4c87b6be-8bb1-4f24-9cec-2377a7122e87 tempest-VolumeImageDependencyTests-182874516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6551242d-27a3-46a5-8f19-0a68a1e0173f" returned: 0 in 0.268s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:52:01 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-4c87b6be-8bb1-4f24-9cec-2377a7122e87 tempest-VolumeImageDependencyTests-182874516 None] <== create_volume: return (761ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'} {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 06:52:01 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-4c87b6be-8bb1-4f24-9cec-2377a7122e87 tempest-VolumeImageDependencyTests-182874516 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.764s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:52:01 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-b27debd7-ffae-4fa0-bf0b-869f4fd10092 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.028s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:52:01 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-b27debd7-ffae-4fa0-bf0b-869f4fd10092 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:51:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-519453073',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bc418ce-ce1e-44c9-8294-57dc7a70a910,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40344910e0f142f0869ec08ba17947ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:51:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:51:59Z,use_quota=True,user_id='96c1f3ce1eea4447aacccf1418192edd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)}" {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 06:52:01 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-b27debd7-ffae-4fa0-bf0b-869f4fd10092 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Creating volume 3bc418ce-ce1e-44c9-8294-57dc7a70a910 {{(pid=87329) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 06:52:01 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-b27debd7-ffae-4fa0-bf0b-869f4fd10092 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:52:01 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-b27debd7-ffae-4fa0-bf0b-869f4fd10092 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:52:01 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-b27debd7-ffae-4fa0-bf0b-869f4fd10092 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:52:01 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-b27debd7-ffae-4fa0-bf0b-869f4fd10092 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:52:01 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-b27debd7-ffae-4fa0-bf0b-869f4fd10092 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:52:01 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-b27debd7-ffae-4fa0-bf0b-869f4fd10092 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Selected osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 as target Quobyte volume. {{(pid=87329) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 06:52:01 devstack cinder-volume[87329]: INFO cinder.volume.drivers.remotefs [None req-b27debd7-ffae-4fa0-bf0b-869f4fd10092 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] casted to osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 Sep 06 06:52:01 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-b27debd7-ffae-4fa0-bf0b-869f4fd10092 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-3bc418ce-ce1e-44c9-8294-57dc7a70a910 1073741824 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:52:01 devstack sudo[106759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-3bc418ce-ce1e-44c9-8294-57dc7a70a910 1073741824 Sep 06 06:52:01 devstack sudo[106759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:52:01 devstack cinder-volume[87329]: DEBUG cinder.volume.volume_utils [None req-4c87b6be-8bb1-4f24-9cec-2377a7122e87 tempest-VolumeImageDependencyTests-182874516 None] Attempting download of e8de3832-2d2c-460b-bbe7-8d844bd8fe26 ((None, [{'url': 'file:///opt/stack/data/glance/images/e8de3832-2d2c-460b-bbe7-8d844bd8fe26', 'metadata': {}}])) to volume 6551242d-27a3-46a5-8f19-0a68a1e0173f. {{(pid=87329) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 06 06:52:01 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdd48809-0a08-44e7-a991-b7a9e5b45d6a]: (4, 'raw') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:52:01 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-4c87b6be-8bb1-4f24-9cec-2377a7122e87 tempest-VolumeImageDependencyTests-182874516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e8de3832-2d2c-460b-bbe7-8d844bd8fe26_dq5iyie8 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:52:01 devstack sudo[106761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e8de3832-2d2c-460b-bbe7-8d844bd8fe26_dq5iyie8 Sep 06 06:52:01 devstack sudo[106761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:52:01 devstack sudo[106759]: pam_unix(sudo:session): session closed for user root Sep 06 06:52:01 devstack sudo[106761]: pam_unix(sudo:session): session closed for user root Sep 06 06:52:01 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-b27debd7-ffae-4fa0-bf0b-869f4fd10092 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-3bc418ce-ce1e-44c9-8294-57dc7a70a910 1073741824" returned: 0 in 0.434s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:52:01 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-4c87b6be-8bb1-4f24-9cec-2377a7122e87 tempest-VolumeImageDependencyTests-182874516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e8de3832-2d2c-460b-bbe7-8d844bd8fe26_dq5iyie8" returned: 0 in 0.356s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:52:01 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-4c87b6be-8bb1-4f24-9cec-2377a7122e87 tempest-VolumeImageDependencyTests-182874516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e8de3832-2d2c-460b-bbe7-8d844bd8fe26_dq5iyie8 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:52:01 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-b27debd7-ffae-4fa0-bf0b-869f4fd10092 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-3bc418ce-ce1e-44c9-8294-57dc7a70a910 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:52:01 devstack sudo[106769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-3bc418ce-ce1e-44c9-8294-57dc7a70a910 Sep 06 06:52:01 devstack sudo[106769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:52:02 devstack sudo[106768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e8de3832-2d2c-460b-bbe7-8d844bd8fe26_dq5iyie8 Sep 06 06:52:02 devstack sudo[106768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:52:02 devstack sudo[106768]: pam_unix(sudo:session): session closed for user root Sep 06 06:52:02 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-4c87b6be-8bb1-4f24-9cec-2377a7122e87 tempest-VolumeImageDependencyTests-182874516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e8de3832-2d2c-460b-bbe7-8d844bd8fe26_dq5iyie8" returned: 1 in 0.345s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:52:02 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-4c87b6be-8bb1-4f24-9cec-2377a7122e87 tempest-VolumeImageDependencyTests-182874516 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e8de3832-2d2c-460b-bbe7-8d844bd8fe26_dq5iyie8' failed. Not Retrying. {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 06 06:52:02 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[c54e908e-6e62-43aa-bfc7-ce5d5b4b9a44]: (4, 'raw') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:52:02 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-4c87b6be-8bb1-4f24-9cec-2377a7122e87 tempest-VolumeImageDependencyTests-182874516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e8de3832-2d2c-460b-bbe7-8d844bd8fe26_studmatedevstack@QuobyteHD {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:52:02 devstack sudo[106769]: pam_unix(sudo:session): session closed for user root Sep 06 06:52:02 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-b27debd7-ffae-4fa0-bf0b-869f4fd10092 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-3bc418ce-ce1e-44c9-8294-57dc7a70a910" returned: 0 in 0.324s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:52:02 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-b27debd7-ffae-4fa0-bf0b-869f4fd10092 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] <== create_volume: return (833ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'} {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 06:52:02 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-b27debd7-ffae-4fa0-bf0b-869f4fd10092 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.835s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:52:02 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-e486997d-99ea-4048-a9c3-f0468ec57954 tempest-ProjectReaderTests-1566093849 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.775s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:52:02 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-e486997d-99ea-4048-a9c3-f0468ec57954 tempest-ProjectReaderTests-1566093849 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:51:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1771362505',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa10e9db-97e3-4dde-ac06-a6f3542b18da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47b14cc477564406b2c85835936b99d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:51:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:51:59Z,use_quota=True,user_id='2bb3aa6913034422a07b16fa1477428f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)}" {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 06:52:02 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-e486997d-99ea-4048-a9c3-f0468ec57954 tempest-ProjectReaderTests-1566093849 None] Creating volume fa10e9db-97e3-4dde-ac06-a6f3542b18da {{(pid=87329) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 06:52:02 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-e486997d-99ea-4048-a9c3-f0468ec57954 tempest-ProjectReaderTests-1566093849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:52:02 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-e486997d-99ea-4048-a9c3-f0468ec57954 tempest-ProjectReaderTests-1566093849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:52:02 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-e486997d-99ea-4048-a9c3-f0468ec57954 tempest-ProjectReaderTests-1566093849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:52:02 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-e486997d-99ea-4048-a9c3-f0468ec57954 tempest-ProjectReaderTests-1566093849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:52:02 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-e486997d-99ea-4048-a9c3-f0468ec57954 tempest-ProjectReaderTests-1566093849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:52:02 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-e486997d-99ea-4048-a9c3-f0468ec57954 tempest-ProjectReaderTests-1566093849 None] Selected osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 as target Quobyte volume. {{(pid=87329) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 06:52:02 devstack cinder-volume[87329]: INFO cinder.volume.drivers.remotefs [None req-e486997d-99ea-4048-a9c3-f0468ec57954 tempest-ProjectReaderTests-1566093849 None] casted to osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 Sep 06 06:52:02 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-e486997d-99ea-4048-a9c3-f0468ec57954 tempest-ProjectReaderTests-1566093849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-fa10e9db-97e3-4dde-ac06-a6f3542b18da 1073741824 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:52:02 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-b27debd7-ffae-4fa0-bf0b-869f4fd10092 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f95dc0a-6bf6-4987-9ebd-aa594c7aee6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3bc418ce-ce1e-44c9-8294-57dc7a70a910', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:52:02 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-b27debd7-ffae-4fa0-bf0b-869f4fd10092 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d81806c-c6d7-4650-b489-bf96ccc36fde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:52:02 devstack sudo[106777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-fa10e9db-97e3-4dde-ac06-a6f3542b18da 1073741824 Sep 06 06:52:02 devstack sudo[106777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:52:02 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-b27debd7-ffae-4fa0-bf0b-869f4fd10092 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Volume volume-3bc418ce-ce1e-44c9-8294-57dc7a70a910 (3bc418ce-ce1e-44c9-8294-57dc7a70a910): created successfully Sep 06 06:52:02 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-b27debd7-ffae-4fa0-bf0b-869f4fd10092 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d81806c-c6d7-4650-b489-bf96ccc36fde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:52:02 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-b27debd7-ffae-4fa0-bf0b-869f4fd10092 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Flow 'volume_create_manager' (5038d356-839c-419d-a8b1-7238e1511dcf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:52:02 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-b27debd7-ffae-4fa0-bf0b-869f4fd10092 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Created volume successfully. Sep 06 06:52:02 devstack sudo[106776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e8de3832-2d2c-460b-bbe7-8d844bd8fe26_studmatedevstack@QuobyteHD Sep 06 06:52:02 devstack sudo[106776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:52:02 devstack sudo[106776]: pam_unix(sudo:session): session closed for user root Sep 06 06:52:02 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-4c87b6be-8bb1-4f24-9cec-2377a7122e87 tempest-VolumeImageDependencyTests-182874516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e8de3832-2d2c-460b-bbe7-8d844bd8fe26_studmatedevstack@QuobyteHD" returned: 0 in 0.403s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:52:02 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-4c87b6be-8bb1-4f24-9cec-2377a7122e87 tempest-VolumeImageDependencyTests-182874516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e8de3832-2d2c-460b-bbe7-8d844bd8fe26_studmatedevstack@QuobyteHD {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:52:02 devstack sudo[106785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e8de3832-2d2c-460b-bbe7-8d844bd8fe26_studmatedevstack@QuobyteHD Sep 06 06:52:02 devstack sudo[106785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:52:02 devstack sudo[106777]: pam_unix(sudo:session): session closed for user root Sep 06 06:52:02 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-e486997d-99ea-4048-a9c3-f0468ec57954 tempest-ProjectReaderTests-1566093849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-fa10e9db-97e3-4dde-ac06-a6f3542b18da 1073741824" returned: 0 in 0.528s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:52:02 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-e486997d-99ea-4048-a9c3-f0468ec57954 tempest-ProjectReaderTests-1566093849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-fa10e9db-97e3-4dde-ac06-a6f3542b18da {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:52:02 devstack sudo[106788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-fa10e9db-97e3-4dde-ac06-a6f3542b18da Sep 06 06:52:02 devstack sudo[106788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:52:02 devstack sudo[106785]: pam_unix(sudo:session): session closed for user root Sep 06 06:52:02 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-4c87b6be-8bb1-4f24-9cec-2377a7122e87 tempest-VolumeImageDependencyTests-182874516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e8de3832-2d2c-460b-bbe7-8d844bd8fe26_studmatedevstack@QuobyteHD" returned: 1 in 0.342s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:52:03 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-4c87b6be-8bb1-4f24-9cec-2377a7122e87 tempest-VolumeImageDependencyTests-182874516 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e8de3832-2d2c-460b-bbe7-8d844bd8fe26_studmatedevstack@QuobyteHD' failed. Not Retrying. {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 06 06:52:03 devstack cinder-volume[87329]: DEBUG cinder.image.image_utils [None req-4c87b6be-8bb1-4f24-9cec-2377a7122e87 tempest-VolumeImageDependencyTests-182874516 None] e8de3832-2d2c-460b-bbe7-8d844bd8fe26 was raw, converting to qcow2 {{(pid=87329) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 06 06:52:03 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-4c87b6be-8bb1-4f24-9cec-2377a7122e87 tempest-VolumeImageDependencyTests-182874516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_e8de3832-2d2c-460b-bbe7-8d844bd8fe26_studmatedevstack@QuobyteHD /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6551242d-27a3-46a5-8f19-0a68a1e0173f {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:52:03 devstack sudo[106793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_e8de3832-2d2c-460b-bbe7-8d844bd8fe26_studmatedevstack@QuobyteHD /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6551242d-27a3-46a5-8f19-0a68a1e0173f Sep 06 06:52:03 devstack sudo[106793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:52:03 devstack sudo[106788]: pam_unix(sudo:session): session closed for user root Sep 06 06:52:03 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-e486997d-99ea-4048-a9c3-f0468ec57954 tempest-ProjectReaderTests-1566093849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-fa10e9db-97e3-4dde-ac06-a6f3542b18da" returned: 0 in 0.259s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:52:03 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-e486997d-99ea-4048-a9c3-f0468ec57954 tempest-ProjectReaderTests-1566093849 None] <== create_volume: return (841ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'} {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 06:52:03 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-e486997d-99ea-4048-a9c3-f0468ec57954 tempest-ProjectReaderTests-1566093849 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.843s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:52:03 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-e486997d-99ea-4048-a9c3-f0468ec57954 tempest-ProjectReaderTests-1566093849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9dfc2d9-c028-4c70-b113-45667630de0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa10e9db-97e3-4dde-ac06-a6f3542b18da', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:52:03 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-e486997d-99ea-4048-a9c3-f0468ec57954 tempest-ProjectReaderTests-1566093849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (533d79bb-0833-460e-867b-50f168c242a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:52:03 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-e486997d-99ea-4048-a9c3-f0468ec57954 tempest-ProjectReaderTests-1566093849 None] Volume volume-fa10e9db-97e3-4dde-ac06-a6f3542b18da (fa10e9db-97e3-4dde-ac06-a6f3542b18da): created successfully Sep 06 06:52:03 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-e486997d-99ea-4048-a9c3-f0468ec57954 tempest-ProjectReaderTests-1566093849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (533d79bb-0833-460e-867b-50f168c242a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:52:03 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-e486997d-99ea-4048-a9c3-f0468ec57954 tempest-ProjectReaderTests-1566093849 None] Flow 'volume_create_manager' (15829518-06bb-4cc5-839d-a6a724c9c399) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:52:03 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-e486997d-99ea-4048-a9c3-f0468ec57954 tempest-ProjectReaderTests-1566093849 None] Created volume successfully. Sep 06 06:52:03 devstack sudo[106793]: pam_unix(sudo:session): session closed for user root Sep 06 06:52:03 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-4c87b6be-8bb1-4f24-9cec-2377a7122e87 tempest-VolumeImageDependencyTests-182874516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_e8de3832-2d2c-460b-bbe7-8d844bd8fe26_studmatedevstack@QuobyteHD /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6551242d-27a3-46a5-8f19-0a68a1e0173f" returned: 0 in 0.512s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:52:03 devstack cinder-volume[87329]: DEBUG cinder.image.image_utils [None req-4c87b6be-8bb1-4f24-9cec-2377a7122e87 tempest-VolumeImageDependencyTests-182874516 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e8de3832-2d2c-460b-bbe7-8d844bd8fe26_studmatedevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6551242d-27a3-46a5-8f19-0a68a1e0173f {{(pid=87329) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 06 06:52:03 devstack cinder-volume[87329]: INFO cinder.image.image_utils [None req-4c87b6be-8bb1-4f24-9cec-2377a7122e87 tempest-VolumeImageDependencyTests-182874516 None] Converted 0.00 MB image at 0.00 MB/s Sep 06 06:52:03 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-4c87b6be-8bb1-4f24-9cec-2377a7122e87 tempest-VolumeImageDependencyTests-182874516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6551242d-27a3-46a5-8f19-0a68a1e0173f 1G {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:52:03 devstack sudo[106800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6551242d-27a3-46a5-8f19-0a68a1e0173f 1G Sep 06 06:52:03 devstack sudo[106800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:52:03 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-5193986f-870d-4d2c-874d-8b7430c426ca tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Acquiring lock "cinder-3bc418ce-ce1e-44c9-8294-57dc7a70a910-delete_volume" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:52:03 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-5193986f-870d-4d2c-874d-8b7430c426ca tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Lock "cinder-3bc418ce-ce1e-44c9-8294-57dc7a70a910-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:52:03 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-48ff4a04-4019-4555-8cd7-645bdb7c86ac tempest-ProjectReaderTests-1566093849 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:52:03 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-48ff4a04-4019-4555-8cd7-645bdb7c86ac tempest-ProjectReaderTests-1566093849 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:52:03 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-48ff4a04-4019-4555-8cd7-645bdb7c86ac tempest-ProjectReaderTests-1566093849 None] Creating offline snapshot d2f1aeca-6a69-475c-bac9-bd631acb46b9 of volume fa10e9db-97e3-4dde-ac06-a6f3542b18da {{(pid=87329) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 06 06:52:03 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc44138c-52a1-4e38-a1f8-a0af2f36f21d]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:52:03 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-48ff4a04-4019-4555-8cd7-645bdb7c86ac tempest-ProjectReaderTests-1566093849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-fa10e9db-97e3-4dde-ac06-a6f3542b18da {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:52:03 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-5193986f-870d-4d2c-874d-8b7430c426ca tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Acquiring lock "cinder-quobyte-3bc418ce-ce1e-44c9-8294-57dc7a70a910" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:52:03 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-5193986f-870d-4d2c-874d-8b7430c426ca tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Lock "cinder-quobyte-3bc418ce-ce1e-44c9-8294-57dc7a70a910" acquired by "delete_volume" :: waited 0.022s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:52:03 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[cac6f972-7e8a-4187-abb0-7f05b37bd01e]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:52:03 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-5193986f-870d-4d2c-874d-8b7430c426ca tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-3bc418ce-ce1e-44c9-8294-57dc7a70a910 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:52:03 devstack sudo[106802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-fa10e9db-97e3-4dde-ac06-a6f3542b18da Sep 06 06:52:03 devstack sudo[106802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:52:04 devstack sudo[106803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-3bc418ce-ce1e-44c9-8294-57dc7a70a910 Sep 06 06:52:04 devstack sudo[106803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:52:04 devstack sudo[106800]: pam_unix(sudo:session): session closed for user root Sep 06 06:52:04 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-4c87b6be-8bb1-4f24-9cec-2377a7122e87 tempest-VolumeImageDependencyTests-182874516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6551242d-27a3-46a5-8f19-0a68a1e0173f 1G" returned: 0 in 0.558s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:52:04 devstack cinder-volume[87329]: DEBUG cinder.volume.volume_utils [None req-4c87b6be-8bb1-4f24-9cec-2377a7122e87 tempest-VolumeImageDependencyTests-182874516 None] Downloaded image e8de3832-2d2c-460b-bbe7-8d844bd8fe26 ((None, [{'url': 'file:///opt/stack/data/glance/images/e8de3832-2d2c-460b-bbe7-8d844bd8fe26', 'metadata': {}}])) to volume 6551242d-27a3-46a5-8f19-0a68a1e0173f successfully. {{(pid=87329) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 06 06:52:04 devstack cinder-volume[87329]: DEBUG cinder.image.image_utils [None req-4c87b6be-8bb1-4f24-9cec-2377a7122e87 tempest-VolumeImageDependencyTests-182874516 None] Temporary image e8de3832-2d2c-460b-bbe7-8d844bd8fe26 for user c1e63943e6fc43faa4ed841513464236 is deleted. {{(pid=87329) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 06 06:52:04 devstack cinder-volume[87329]: DEBUG cinder.volume.volume_utils [None req-4c87b6be-8bb1-4f24-9cec-2377a7122e87 tempest-VolumeImageDependencyTests-182874516 None] Marking volume 6551242d-27a3-46a5-8f19-0a68a1e0173f as bootable. {{(pid=87329) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 06 06:52:04 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c87b6be-8bb1-4f24-9cec-2377a7122e87 tempest-VolumeImageDependencyTests-182874516 None] Copying metadata from image e8de3832-2d2c-460b-bbe7-8d844bd8fe26 to 6551242d-27a3-46a5-8f19-0a68a1e0173f. {{(pid=87329) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 06 06:52:04 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c87b6be-8bb1-4f24-9cec-2377a7122e87 tempest-VolumeImageDependencyTests-182874516 None] Creating volume glance metadata for volume 6551242d-27a3-46a5-8f19-0a68a1e0173f backed by image e8de3832-2d2c-460b-bbe7-8d844bd8fe26 with: {'image_id': 'e8de3832-2d2c-460b-bbe7-8d844bd8fe26', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'd3633c5a461f0eae92fd95cf4cb28f69', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87329) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 06 06:52:04 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-4c87b6be-8bb1-4f24-9cec-2377a7122e87 tempest-VolumeImageDependencyTests-182874516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cee44b74-66dd-4d0f-bc20-416b8e312d29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6551242d-27a3-46a5-8f19-0a68a1e0173f', 'volume_size': 1, 'image_id': 'e8de3832-2d2c-460b-bbe7-8d844bd8fe26', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e8de3832-2d2c-460b-bbe7-8d844bd8fe26', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd3633c5a461f0eae92fd95cf4cb28f69', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4ee427b8d7ab426d86cc9b64c457cbd8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '17b1c3ddc2bb0b0fe825028f9419fcca0aed11513013cad69e5acf9d7fc32e9dc9b32726a9a5b435ba51a7682245330c0114de3c4052d573ab57ec7727d24c5c', 'id': 'e8de3832-2d2c-460b-bbe7-8d844bd8fe26', 'created_at': datetime.datetime(2026, 9, 6, 4, 51, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 6, 4, 51, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e8de3832-2d2c-460b-bbe7-8d844bd8fe26/file', 'properties': {}}, 'image_service': }' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:52:04 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-4c87b6be-8bb1-4f24-9cec-2377a7122e87 tempest-VolumeImageDependencyTests-182874516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfef4ea3-e90c-48e2-9289-b9549033d0df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:52:04 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-4c87b6be-8bb1-4f24-9cec-2377a7122e87 tempest-VolumeImageDependencyTests-182874516 None] Volume volume-6551242d-27a3-46a5-8f19-0a68a1e0173f (6551242d-27a3-46a5-8f19-0a68a1e0173f): created successfully Sep 06 06:52:04 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-4c87b6be-8bb1-4f24-9cec-2377a7122e87 tempest-VolumeImageDependencyTests-182874516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfef4ea3-e90c-48e2-9289-b9549033d0df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:52:04 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-4c87b6be-8bb1-4f24-9cec-2377a7122e87 tempest-VolumeImageDependencyTests-182874516 None] Flow 'volume_create_manager' (833f9d38-c4fd-4fde-9784-be19b1bbf16c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:52:04 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-4c87b6be-8bb1-4f24-9cec-2377a7122e87 tempest-VolumeImageDependencyTests-182874516 None] Created volume successfully. Sep 06 06:52:04 devstack sudo[106802]: pam_unix(sudo:session): session closed for user root Sep 06 06:52:04 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-48ff4a04-4019-4555-8cd7-645bdb7c86ac tempest-ProjectReaderTests-1566093849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-fa10e9db-97e3-4dde-ac06-a6f3542b18da" returned: 0 in 0.558s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:52:04 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-48ff4a04-4019-4555-8cd7-645bdb7c86ac tempest-ProjectReaderTests-1566093849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-fa10e9db-97e3-4dde-ac06-a6f3542b18da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-fa10e9db-97e3-4dde-ac06-a6f3542b18da.d2f1aeca-6a69-475c-bac9-bd631acb46b9 1G {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:52:04 devstack sudo[106815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-fa10e9db-97e3-4dde-ac06-a6f3542b18da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-fa10e9db-97e3-4dde-ac06-a6f3542b18da.d2f1aeca-6a69-475c-bac9-bd631acb46b9 1G Sep 06 06:52:04 devstack sudo[106815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:52:04 devstack sudo[106803]: pam_unix(sudo:session): session closed for user root Sep 06 06:52:04 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-5193986f-870d-4d2c-874d-8b7430c426ca tempest-CreateVolumesFromSourceVolumeTest-156116101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-3bc418ce-ce1e-44c9-8294-57dc7a70a910" returned: 0 in 0.593s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:52:04 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-5193986f-870d-4d2c-874d-8b7430c426ca tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-3bc418ce-ce1e-44c9-8294-57dc7a70a910 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:52:04 devstack sudo[106820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-3bc418ce-ce1e-44c9-8294-57dc7a70a910 Sep 06 06:52:04 devstack sudo[106820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:52:04 devstack sudo[106820]: pam_unix(sudo:session): session closed for user root Sep 06 06:52:04 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-5193986f-870d-4d2c-874d-8b7430c426ca tempest-CreateVolumesFromSourceVolumeTest-156116101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-3bc418ce-ce1e-44c9-8294-57dc7a70a910" returned: 0 in 0.304s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:52:04 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-5193986f-870d-4d2c-874d-8b7430c426ca tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Lock "cinder-quobyte-3bc418ce-ce1e-44c9-8294-57dc7a70a910" released by "delete_volume" :: held 0.997s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:52:04 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-5193986f-870d-4d2c-874d-8b7430c426ca tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Created reservations ['dec7b3b3-ccd4-4661-84d0-3b12fbe6ed5c', '0a1c2e31-0244-4f2a-96ae-eb1fd2b9dab7', '47e39204-ad65-4b98-b8e2-d7ca748169dc', '01bb7ac8-10b8-42f6-b4a7-1cce4441f7f5'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:52:04 devstack sudo[106815]: pam_unix(sudo:session): session closed for user root Sep 06 06:52:04 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-48ff4a04-4019-4555-8cd7-645bdb7c86ac tempest-ProjectReaderTests-1566093849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-fa10e9db-97e3-4dde-ac06-a6f3542b18da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-fa10e9db-97e3-4dde-ac06-a6f3542b18da.d2f1aeca-6a69-475c-bac9-bd631acb46b9 1G" returned: 0 in 0.567s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:52:04 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-48ff4a04-4019-4555-8cd7-645bdb7c86ac tempest-ProjectReaderTests-1566093849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa10e9db-97e3-4dde-ac06-a6f3542b18da -F qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-fa10e9db-97e3-4dde-ac06-a6f3542b18da.d2f1aeca-6a69-475c-bac9-bd631acb46b9 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:52:04 devstack sudo[106829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa10e9db-97e3-4dde-ac06-a6f3542b18da -F qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-fa10e9db-97e3-4dde-ac06-a6f3542b18da.d2f1aeca-6a69-475c-bac9-bd631acb46b9 Sep 06 06:52:04 devstack sudo[106829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:52:04 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-5193986f-870d-4d2c-874d-8b7430c426ca tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:52:04 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-5193986f-870d-4d2c-874d-8b7430c426ca tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:52:04 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-5193986f-870d-4d2c-874d-8b7430c426ca tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:52:04 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-5193986f-870d-4d2c-874d-8b7430c426ca tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:52:04 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-5193986f-870d-4d2c-874d-8b7430c426ca tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:52:04 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-5193986f-870d-4d2c-874d-8b7430c426ca tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:52:04 devstack sudo[106831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:52:04 devstack sudo[106831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:52:05 devstack sudo[106831]: pam_unix(sudo:session): session closed for user root Sep 06 06:52:05 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-5193986f-870d-4d2c-874d-8b7430c426ca tempest-CreateVolumesFromSourceVolumeTest-156116101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.240s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:52:05 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-5193986f-870d-4d2c-874d-8b7430c426ca tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:52:05 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-5193986f-870d-4d2c-874d-8b7430c426ca tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Deleted volume successfully. Sep 06 06:52:05 devstack sudo[106829]: pam_unix(sudo:session): session closed for user root Sep 06 06:52:05 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-48ff4a04-4019-4555-8cd7-645bdb7c86ac tempest-ProjectReaderTests-1566093849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa10e9db-97e3-4dde-ac06-a6f3542b18da -F qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-fa10e9db-97e3-4dde-ac06-a6f3542b18da.d2f1aeca-6a69-475c-bac9-bd631acb46b9" returned: 0 in 0.309s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:52:05 devstack cinder-volume[87329]: WARNING cinder.volume.drivers.remotefs [None req-48ff4a04-4019-4555-8cd7-645bdb7c86ac tempest-ProjectReaderTests-1566093849 None] /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-fa10e9db-97e3-4dde-ac06-a6f3542b18da.d2f1aeca-6a69-475c-bac9-bd631acb46b9 is being set with open permissions: ugo+rw Sep 06 06:52:05 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-48ff4a04-4019-4555-8cd7-645bdb7c86ac tempest-ProjectReaderTests-1566093849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-fa10e9db-97e3-4dde-ac06-a6f3542b18da.d2f1aeca-6a69-475c-bac9-bd631acb46b9 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:52:05 devstack sudo[106837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-fa10e9db-97e3-4dde-ac06-a6f3542b18da.d2f1aeca-6a69-475c-bac9-bd631acb46b9 Sep 06 06:52:05 devstack sudo[106837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:52:05 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-5193986f-870d-4d2c-874d-8b7430c426ca tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Lock "cinder-3bc418ce-ce1e-44c9-8294-57dc7a70a910-delete_volume" released by "delete_volume" :: held 1.555s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:52:05 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-ec270004-2d3f-44bc-a795-a0e803a6e24c tempest-VolumeImageDependencyTests-182874516 None] Acquiring lock "cinder-6551242d-27a3-46a5-8f19-0a68a1e0173f-delete_volume" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:52:05 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-ec270004-2d3f-44bc-a795-a0e803a6e24c tempest-VolumeImageDependencyTests-182874516 None] Lock "cinder-6551242d-27a3-46a5-8f19-0a68a1e0173f-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:52:05 devstack sudo[106837]: pam_unix(sudo:session): session closed for user root Sep 06 06:52:05 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-48ff4a04-4019-4555-8cd7-645bdb7c86ac tempest-ProjectReaderTests-1566093849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-fa10e9db-97e3-4dde-ac06-a6f3542b18da.d2f1aeca-6a69-475c-bac9-bd631acb46b9" returned: 0 in 0.289s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:52:05 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-48ff4a04-4019-4555-8cd7-645bdb7c86ac tempest-ProjectReaderTests-1566093849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-fa10e9db-97e3-4dde-ac06-a6f3542b18da.info {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:52:05 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-ec270004-2d3f-44bc-a795-a0e803a6e24c tempest-VolumeImageDependencyTests-182874516 None] Acquiring lock "cinder-quobyte-6551242d-27a3-46a5-8f19-0a68a1e0173f" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:52:05 devstack sudo[106840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-fa10e9db-97e3-4dde-ac06-a6f3542b18da.info Sep 06 06:52:05 devstack sudo[106840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:52:05 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-ec270004-2d3f-44bc-a795-a0e803a6e24c tempest-VolumeImageDependencyTests-182874516 None] Lock "cinder-quobyte-6551242d-27a3-46a5-8f19-0a68a1e0173f" acquired by "delete_volume" :: waited 0.025s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:52:05 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cd586ba-fb4f-410b-b7b1-d029d541c248]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:52:05 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-ec270004-2d3f-44bc-a795-a0e803a6e24c tempest-VolumeImageDependencyTests-182874516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6551242d-27a3-46a5-8f19-0a68a1e0173f {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:52:05 devstack sudo[106842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6551242d-27a3-46a5-8f19-0a68a1e0173f Sep 06 06:52:05 devstack sudo[106842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:52:05 devstack sudo[106840]: pam_unix(sudo:session): session closed for user root Sep 06 06:52:05 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-48ff4a04-4019-4555-8cd7-645bdb7c86ac tempest-ProjectReaderTests-1566093849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-fa10e9db-97e3-4dde-ac06-a6f3542b18da.info" returned: 0 in 0.292s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:52:05 devstack cinder-volume[87329]: WARNING cinder.volume.drivers.remotefs [None req-48ff4a04-4019-4555-8cd7-645bdb7c86ac tempest-ProjectReaderTests-1566093849 None] /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-fa10e9db-97e3-4dde-ac06-a6f3542b18da.info is being set with open permissions: ugo+rw Sep 06 06:52:05 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-48ff4a04-4019-4555-8cd7-645bdb7c86ac tempest-ProjectReaderTests-1566093849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-fa10e9db-97e3-4dde-ac06-a6f3542b18da.info {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:52:05 devstack sudo[106845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-fa10e9db-97e3-4dde-ac06-a6f3542b18da.info Sep 06 06:52:05 devstack sudo[106845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:52:05 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-30aa1e0c-3021-4a4e-be5e-ca3a9719c697 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Acquiring lock "cinder-2e770100-7467-4922-9f1f-9c471245e2bb-delete_volume" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:52:05 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-30aa1e0c-3021-4a4e-be5e-ca3a9719c697 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Lock "cinder-2e770100-7467-4922-9f1f-9c471245e2bb-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:52:06 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-30aa1e0c-3021-4a4e-be5e-ca3a9719c697 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Acquiring lock "cinder-quobyte-2e770100-7467-4922-9f1f-9c471245e2bb" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:52:06 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-30aa1e0c-3021-4a4e-be5e-ca3a9719c697 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Lock "cinder-quobyte-2e770100-7467-4922-9f1f-9c471245e2bb" acquired by "delete_volume" :: waited 0.025s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:52:06 devstack sudo[106842]: pam_unix(sudo:session): session closed for user root Sep 06 06:52:06 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa004b82-63b7-4dd5-8f56-a67e0374a4c5]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:52:06 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-30aa1e0c-3021-4a4e-be5e-ca3a9719c697 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-2e770100-7467-4922-9f1f-9c471245e2bb {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:52:06 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-ec270004-2d3f-44bc-a795-a0e803a6e24c tempest-VolumeImageDependencyTests-182874516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6551242d-27a3-46a5-8f19-0a68a1e0173f" returned: 0 in 0.486s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:52:06 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-ec270004-2d3f-44bc-a795-a0e803a6e24c tempest-VolumeImageDependencyTests-182874516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6551242d-27a3-46a5-8f19-0a68a1e0173f {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:52:06 devstack sudo[106851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6551242d-27a3-46a5-8f19-0a68a1e0173f Sep 06 06:52:06 devstack sudo[106851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:52:06 devstack sudo[106850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-2e770100-7467-4922-9f1f-9c471245e2bb Sep 06 06:52:06 devstack sudo[106850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:52:06 devstack sudo[106845]: pam_unix(sudo:session): session closed for user root Sep 06 06:52:06 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-48ff4a04-4019-4555-8cd7-645bdb7c86ac tempest-ProjectReaderTests-1566093849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-fa10e9db-97e3-4dde-ac06-a6f3542b18da.info" returned: 0 in 0.405s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:52:06 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-48ff4a04-4019-4555-8cd7-645bdb7c86ac tempest-ProjectReaderTests-1566093849 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.559s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:52:06 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-48ff4a04-4019-4555-8cd7-645bdb7c86ac tempest-ProjectReaderTests-1566093849 None] Create snapshot completed successfully Sep 06 06:52:06 devstack sudo[106851]: pam_unix(sudo:session): session closed for user root Sep 06 06:52:06 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-ec270004-2d3f-44bc-a795-a0e803a6e24c tempest-VolumeImageDependencyTests-182874516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6551242d-27a3-46a5-8f19-0a68a1e0173f" returned: 0 in 0.273s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:52:06 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-ec270004-2d3f-44bc-a795-a0e803a6e24c tempest-VolumeImageDependencyTests-182874516 None] Lock "cinder-quobyte-6551242d-27a3-46a5-8f19-0a68a1e0173f" released by "delete_volume" :: held 0.801s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:52:06 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-ec270004-2d3f-44bc-a795-a0e803a6e24c tempest-VolumeImageDependencyTests-182874516 None] Created reservations ['38b67796-0584-45e5-8b16-93de4ad63e78', 'db8ee6dc-369b-4c5b-95a0-73be36fe1c70', 'a8b9ad49-8b0f-4ffb-918c-ecd928aabc01', 'c6356589-1f67-45bb-a864-bc1d3f32340b'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:52:06 devstack sudo[106850]: pam_unix(sudo:session): session closed for user root Sep 06 06:52:06 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-30aa1e0c-3021-4a4e-be5e-ca3a9719c697 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-2e770100-7467-4922-9f1f-9c471245e2bb" returned: 0 in 0.421s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:52:06 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-30aa1e0c-3021-4a4e-be5e-ca3a9719c697 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-2e770100-7467-4922-9f1f-9c471245e2bb {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:52:06 devstack sudo[106859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-2e770100-7467-4922-9f1f-9c471245e2bb Sep 06 06:52:06 devstack sudo[106859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:52:06 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-ec270004-2d3f-44bc-a795-a0e803a6e24c tempest-VolumeImageDependencyTests-182874516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:52:06 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-ec270004-2d3f-44bc-a795-a0e803a6e24c tempest-VolumeImageDependencyTests-182874516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:52:06 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-ec270004-2d3f-44bc-a795-a0e803a6e24c tempest-VolumeImageDependencyTests-182874516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:52:06 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-ec270004-2d3f-44bc-a795-a0e803a6e24c tempest-VolumeImageDependencyTests-182874516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:52:06 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-ec270004-2d3f-44bc-a795-a0e803a6e24c tempest-VolumeImageDependencyTests-182874516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:52:06 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-ec270004-2d3f-44bc-a795-a0e803a6e24c tempest-VolumeImageDependencyTests-182874516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:52:06 devstack sudo[106861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:52:06 devstack sudo[106861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:52:06 devstack sudo[106859]: pam_unix(sudo:session): session closed for user root Sep 06 06:52:06 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-30aa1e0c-3021-4a4e-be5e-ca3a9719c697 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-2e770100-7467-4922-9f1f-9c471245e2bb" returned: 0 in 0.411s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:52:06 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-78efa8a4-d431-48ec-9265-07bda3facf20 tempest-ProjectReaderTests-1566093849 None] Acquiring lock "cinder-d2f1aeca-6a69-475c-bac9-bd631acb46b9-delete_snapshot" by "delete_snapshot" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:52:06 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-30aa1e0c-3021-4a4e-be5e-ca3a9719c697 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Lock "cinder-quobyte-2e770100-7467-4922-9f1f-9c471245e2bb" released by "delete_volume" :: held 0.923s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:52:06 devstack sudo[106861]: pam_unix(sudo:session): session closed for user root Sep 06 06:52:06 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-ec270004-2d3f-44bc-a795-a0e803a6e24c tempest-VolumeImageDependencyTests-182874516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.427s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:52:06 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-ec270004-2d3f-44bc-a795-a0e803a6e24c tempest-VolumeImageDependencyTests-182874516 None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:52:06 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-78efa8a4-d431-48ec-9265-07bda3facf20 tempest-ProjectReaderTests-1566093849 None] Lock "cinder-d2f1aeca-6a69-475c-bac9-bd631acb46b9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.047s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:52:06 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-78efa8a4-d431-48ec-9265-07bda3facf20 tempest-ProjectReaderTests-1566093849 None] Acquiring lock "cinder-quobyte-fa10e9db-97e3-4dde-ac06-a6f3542b18da" by "delete_snapshot" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:52:06 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-ec270004-2d3f-44bc-a795-a0e803a6e24c tempest-VolumeImageDependencyTests-182874516 None] Deleted volume successfully. Sep 06 06:52:07 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-78efa8a4-d431-48ec-9265-07bda3facf20 tempest-ProjectReaderTests-1566093849 None] Lock "cinder-quobyte-fa10e9db-97e3-4dde-ac06-a6f3542b18da" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:52:07 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-78efa8a4-d431-48ec-9265-07bda3facf20 tempest-ProjectReaderTests-1566093849 None] Acquiring lock "cinder-quobyte-d2f1aeca-6a69-475c-bac9-bd631acb46b9" by "_delete_snapshot" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:52:07 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-ec270004-2d3f-44bc-a795-a0e803a6e24c tempest-VolumeImageDependencyTests-182874516 None] Lock "cinder-6551242d-27a3-46a5-8f19-0a68a1e0173f-delete_volume" released by "delete_volume" :: held 1.558s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:52:07 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-78efa8a4-d431-48ec-9265-07bda3facf20 tempest-ProjectReaderTests-1566093849 None] Lock "cinder-quobyte-d2f1aeca-6a69-475c-bac9-bd631acb46b9" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:52:07 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-78efa8a4-d431-48ec-9265-07bda3facf20 tempest-ProjectReaderTests-1566093849 None] Deleting offline snapshot d2f1aeca-6a69-475c-bac9-bd631acb46b9 of volume fa10e9db-97e3-4dde-ac06-a6f3542b18da {{(pid=87329) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 06 06:52:07 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-78efa8a4-d431-48ec-9265-07bda3facf20 tempest-ProjectReaderTests-1566093849 None] snapshot_file for this snap is: volume-fa10e9db-97e3-4dde-ac06-a6f3542b18da.d2f1aeca-6a69-475c-bac9-bd631acb46b9 {{(pid=87329) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 06 06:52:07 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cd878c2-b6e7-4bb2-a628-79b46d397576]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:52:07 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-78efa8a4-d431-48ec-9265-07bda3facf20 tempest-ProjectReaderTests-1566093849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-fa10e9db-97e3-4dde-ac06-a6f3542b18da.d2f1aeca-6a69-475c-bac9-bd631acb46b9 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:52:07 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-30aa1e0c-3021-4a4e-be5e-ca3a9719c697 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Created reservations ['34fa1033-bf75-4b06-a611-4d037a8941a0', '76831cc5-24f9-466a-830e-6c4ef3bb042b', '61faea79-583b-40e1-8862-32a5f39c016f', '73cf3e37-aff4-49d7-a2ac-d17a8778a480'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:52:07 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-30aa1e0c-3021-4a4e-be5e-ca3a9719c697 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:52:07 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-30aa1e0c-3021-4a4e-be5e-ca3a9719c697 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:52:07 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-30aa1e0c-3021-4a4e-be5e-ca3a9719c697 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:52:07 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-30aa1e0c-3021-4a4e-be5e-ca3a9719c697 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:52:07 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-30aa1e0c-3021-4a4e-be5e-ca3a9719c697 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:52:07 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-30aa1e0c-3021-4a4e-be5e-ca3a9719c697 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:52:07 devstack sudo[106865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-fa10e9db-97e3-4dde-ac06-a6f3542b18da.d2f1aeca-6a69-475c-bac9-bd631acb46b9 Sep 06 06:52:07 devstack sudo[106865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:52:07 devstack sudo[106866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:52:07 devstack sudo[106866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:52:07 devstack sudo[106865]: pam_unix(sudo:session): session closed for user root Sep 06 06:52:07 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-78efa8a4-d431-48ec-9265-07bda3facf20 tempest-ProjectReaderTests-1566093849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-fa10e9db-97e3-4dde-ac06-a6f3542b18da.d2f1aeca-6a69-475c-bac9-bd631acb46b9" returned: 0 in 0.498s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:52:07 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-78efa8a4-d431-48ec-9265-07bda3facf20 tempest-ProjectReaderTests-1566093849 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fa10e9db-97e3-4dde-ac06-a6f3542b18da(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87329) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 06:52:07 devstack sudo[106866]: pam_unix(sudo:session): session closed for user root Sep 06 06:52:07 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-30aa1e0c-3021-4a4e-be5e-ca3a9719c697 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.379s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:52:07 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-30aa1e0c-3021-4a4e-be5e-ca3a9719c697 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:52:07 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[884179f5-01fb-4fe9-83f7-b4504f5fade0]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:52:07 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-78efa8a4-d431-48ec-9265-07bda3facf20 tempest-ProjectReaderTests-1566093849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-fa10e9db-97e3-4dde-ac06-a6f3542b18da {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:52:07 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-30aa1e0c-3021-4a4e-be5e-ca3a9719c697 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Deleted volume successfully. Sep 06 06:52:07 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-30aa1e0c-3021-4a4e-be5e-ca3a9719c697 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Lock "cinder-2e770100-7467-4922-9f1f-9c471245e2bb-delete_volume" released by "delete_volume" :: held 1.719s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:52:07 devstack sudo[106873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-fa10e9db-97e3-4dde-ac06-a6f3542b18da Sep 06 06:52:07 devstack sudo[106873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:52:08 devstack sudo[106873]: pam_unix(sudo:session): session closed for user root Sep 06 06:52:08 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-78efa8a4-d431-48ec-9265-07bda3facf20 tempest-ProjectReaderTests-1566093849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-fa10e9db-97e3-4dde-ac06-a6f3542b18da" returned: 0 in 0.466s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:52:08 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-78efa8a4-d431-48ec-9265-07bda3facf20 tempest-ProjectReaderTests-1566093849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-fa10e9db-97e3-4dde-ac06-a6f3542b18da.d2f1aeca-6a69-475c-bac9-bd631acb46b9 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:52:08 devstack sudo[106878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-fa10e9db-97e3-4dde-ac06-a6f3542b18da.d2f1aeca-6a69-475c-bac9-bd631acb46b9 Sep 06 06:52:08 devstack sudo[106878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:52:08 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-0d5deece-f21e-4f24-9490-8794978d402e tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Acquiring lock "cinder-52793c59-278b-4e22-a171-4a634d13ffa2-delete_volume" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:52:08 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-0d5deece-f21e-4f24-9490-8794978d402e tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Lock "cinder-52793c59-278b-4e22-a171-4a634d13ffa2-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:52:08 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-0d5deece-f21e-4f24-9490-8794978d402e tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Acquiring lock "cinder-quobyte-52793c59-278b-4e22-a171-4a634d13ffa2" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:52:08 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-0d5deece-f21e-4f24-9490-8794978d402e tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Lock "cinder-quobyte-52793c59-278b-4e22-a171-4a634d13ffa2" acquired by "delete_volume" :: waited 0.020s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:52:08 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[040344c4-c7c7-41b5-86df-3f4d9d7ac0e6]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:52:08 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-0d5deece-f21e-4f24-9490-8794978d402e tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-52793c59-278b-4e22-a171-4a634d13ffa2 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:52:08 devstack sudo[106883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-52793c59-278b-4e22-a171-4a634d13ffa2 Sep 06 06:52:08 devstack sudo[106883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:52:08 devstack sudo[106878]: pam_unix(sudo:session): session closed for user root Sep 06 06:52:08 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-78efa8a4-d431-48ec-9265-07bda3facf20 tempest-ProjectReaderTests-1566093849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-fa10e9db-97e3-4dde-ac06-a6f3542b18da.d2f1aeca-6a69-475c-bac9-bd631acb46b9" returned: 0 in 0.440s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:52:08 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-78efa8a4-d431-48ec-9265-07bda3facf20 tempest-ProjectReaderTests-1566093849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-fa10e9db-97e3-4dde-ac06-a6f3542b18da.d2f1aeca-6a69-475c-bac9-bd631acb46b9 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:52:08 devstack sudo[106886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-fa10e9db-97e3-4dde-ac06-a6f3542b18da.d2f1aeca-6a69-475c-bac9-bd631acb46b9 Sep 06 06:52:08 devstack sudo[106886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:52:08 devstack sudo[106883]: pam_unix(sudo:session): session closed for user root Sep 06 06:52:08 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-0d5deece-f21e-4f24-9490-8794978d402e tempest-CreateVolumesFromSourceVolumeTest-156116101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-52793c59-278b-4e22-a171-4a634d13ffa2" returned: 0 in 0.453s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:52:08 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-0d5deece-f21e-4f24-9490-8794978d402e tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-52793c59-278b-4e22-a171-4a634d13ffa2 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:52:08 devstack sudo[106892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-52793c59-278b-4e22-a171-4a634d13ffa2 Sep 06 06:52:08 devstack sudo[106892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:52:08 devstack sudo[106886]: pam_unix(sudo:session): session closed for user root Sep 06 06:52:08 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-78efa8a4-d431-48ec-9265-07bda3facf20 tempest-ProjectReaderTests-1566093849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-fa10e9db-97e3-4dde-ac06-a6f3542b18da.d2f1aeca-6a69-475c-bac9-bd631acb46b9" returned: 0 in 0.353s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:52:08 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-78efa8a4-d431-48ec-9265-07bda3facf20 tempest-ProjectReaderTests-1566093849 None] Lock "cinder-quobyte-d2f1aeca-6a69-475c-bac9-bd631acb46b9" released by "_delete_snapshot" :: held 1.894s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:52:08 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-78efa8a4-d431-48ec-9265-07bda3facf20 tempest-ProjectReaderTests-1566093849 None] Lock "cinder-quobyte-fa10e9db-97e3-4dde-ac06-a6f3542b18da" released by "delete_snapshot" :: held 1.936s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:52:09 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-78efa8a4-d431-48ec-9265-07bda3facf20 tempest-ProjectReaderTests-1566093849 None] Created reservations ['c7d8b037-6f87-48a2-8d4f-c5fd37bb5434', 'ba990a05-b791-4c6c-bdb6-a2f5a86965c5', '9ee106dd-3764-4dbb-af41-fc4dd11ca2ba', 'e318598c-709a-4a2c-bf59-fef144f74a4d'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:52:09 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-78efa8a4-d431-48ec-9265-07bda3facf20 tempest-ProjectReaderTests-1566093849 None] Delete snapshot completed successfully. Sep 06 06:52:09 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-78efa8a4-d431-48ec-9265-07bda3facf20 tempest-ProjectReaderTests-1566093849 None] Lock "cinder-d2f1aeca-6a69-475c-bac9-bd631acb46b9-delete_snapshot" released by "delete_snapshot" :: held 2.150s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:52:09 devstack sudo[106892]: pam_unix(sudo:session): session closed for user root Sep 06 06:52:09 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-0d5deece-f21e-4f24-9490-8794978d402e tempest-CreateVolumesFromSourceVolumeTest-156116101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-52793c59-278b-4e22-a171-4a634d13ffa2" returned: 0 in 0.367s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:52:09 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-0d5deece-f21e-4f24-9490-8794978d402e tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Lock "cinder-quobyte-52793c59-278b-4e22-a171-4a634d13ffa2" released by "delete_volume" :: held 0.869s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:52:09 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-0d5deece-f21e-4f24-9490-8794978d402e tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Created reservations ['defbabdb-3ae2-459c-aa74-f23625695bad', '41ac8601-32fc-4ee1-aeda-02721048bf0d', 'c02b4c38-4499-4bee-9edb-d0f8d3148165', 'c4ead328-f3e3-44f8-a3ad-9a27f88f4d28'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:52:09 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-0d5deece-f21e-4f24-9490-8794978d402e tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:52:09 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-0d5deece-f21e-4f24-9490-8794978d402e tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:52:09 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-0d5deece-f21e-4f24-9490-8794978d402e tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:52:09 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-0d5deece-f21e-4f24-9490-8794978d402e tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:52:09 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-0d5deece-f21e-4f24-9490-8794978d402e tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:52:09 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-0d5deece-f21e-4f24-9490-8794978d402e tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:52:09 devstack sudo[106895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:52:09 devstack sudo[106895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:52:09 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-946ee0c6-8ba9-4438-8189-3a1ba5f122b7 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Acquiring lock "cinder-856414f5-82e0-49aa-80c9-ed29f138876b-delete_volume" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:52:09 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-946ee0c6-8ba9-4438-8189-3a1ba5f122b7 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Lock "cinder-856414f5-82e0-49aa-80c9-ed29f138876b-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:52:09 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-946ee0c6-8ba9-4438-8189-3a1ba5f122b7 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Acquiring lock "cinder-quobyte-856414f5-82e0-49aa-80c9-ed29f138876b" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:52:09 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-946ee0c6-8ba9-4438-8189-3a1ba5f122b7 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Lock "cinder-quobyte-856414f5-82e0-49aa-80c9-ed29f138876b" acquired by "delete_volume" :: waited 0.024s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:52:09 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[f407793f-6b0a-4186-8c43-6fdbc3603671]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:52:09 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-946ee0c6-8ba9-4438-8189-3a1ba5f122b7 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-856414f5-82e0-49aa-80c9-ed29f138876b {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:52:09 devstack sudo[106895]: pam_unix(sudo:session): session closed for user root Sep 06 06:52:09 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-0d5deece-f21e-4f24-9490-8794978d402e tempest-CreateVolumesFromSourceVolumeTest-156116101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.333s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:52:09 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-0d5deece-f21e-4f24-9490-8794978d402e tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:52:09 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-0d5deece-f21e-4f24-9490-8794978d402e tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Deleted volume successfully. Sep 06 06:52:09 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-0d5deece-f21e-4f24-9490-8794978d402e tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Lock "cinder-52793c59-278b-4e22-a171-4a634d13ffa2-delete_volume" released by "delete_volume" :: held 1.471s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:52:09 devstack sudo[106898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-856414f5-82e0-49aa-80c9-ed29f138876b Sep 06 06:52:09 devstack sudo[106898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:52:10 devstack sudo[106898]: pam_unix(sudo:session): session closed for user root Sep 06 06:52:10 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-946ee0c6-8ba9-4438-8189-3a1ba5f122b7 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-856414f5-82e0-49aa-80c9-ed29f138876b" returned: 0 in 0.440s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:52:10 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-946ee0c6-8ba9-4438-8189-3a1ba5f122b7 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-856414f5-82e0-49aa-80c9-ed29f138876b {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:52:10 devstack sudo[106904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-856414f5-82e0-49aa-80c9-ed29f138876b Sep 06 06:52:10 devstack sudo[106904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:52:10 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-74217e5d-8c9a-450f-9058-0a149decfd83 tempest-ProjectReaderTests-1566093849 None] Acquiring lock "cinder-fa10e9db-97e3-4dde-ac06-a6f3542b18da-delete_volume" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:52:10 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-74217e5d-8c9a-450f-9058-0a149decfd83 tempest-ProjectReaderTests-1566093849 None] Lock "cinder-fa10e9db-97e3-4dde-ac06-a6f3542b18da-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:52:10 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-74217e5d-8c9a-450f-9058-0a149decfd83 tempest-ProjectReaderTests-1566093849 None] Acquiring lock "cinder-quobyte-fa10e9db-97e3-4dde-ac06-a6f3542b18da" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:52:10 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-74217e5d-8c9a-450f-9058-0a149decfd83 tempest-ProjectReaderTests-1566093849 None] Lock "cinder-quobyte-fa10e9db-97e3-4dde-ac06-a6f3542b18da" acquired by "delete_volume" :: waited 0.029s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:52:10 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[12a0c7cd-30f8-463f-a20b-8e7f57c7a153]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:52:10 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-74217e5d-8c9a-450f-9058-0a149decfd83 tempest-ProjectReaderTests-1566093849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-fa10e9db-97e3-4dde-ac06-a6f3542b18da {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:52:10 devstack sudo[106906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-fa10e9db-97e3-4dde-ac06-a6f3542b18da Sep 06 06:52:10 devstack sudo[106906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:52:10 devstack sudo[106904]: pam_unix(sudo:session): session closed for user root Sep 06 06:52:10 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-946ee0c6-8ba9-4438-8189-3a1ba5f122b7 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-856414f5-82e0-49aa-80c9-ed29f138876b" returned: 0 in 0.398s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:52:10 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-946ee0c6-8ba9-4438-8189-3a1ba5f122b7 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Lock "cinder-quobyte-856414f5-82e0-49aa-80c9-ed29f138876b" released by "delete_volume" :: held 0.902s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:52:10 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-946ee0c6-8ba9-4438-8189-3a1ba5f122b7 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Created reservations ['4c11ecc7-fa09-4f54-a771-e4ebca8005af', '750ebc23-5a85-4fc6-aa24-875d0fa3079a', 'b3623eb9-1dfe-4e33-9eda-58992af8175a', 'a5c2d1ad-5ca1-4c87-8125-eb742b282d8a'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:52:10 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-946ee0c6-8ba9-4438-8189-3a1ba5f122b7 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:52:10 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-946ee0c6-8ba9-4438-8189-3a1ba5f122b7 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:52:10 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-946ee0c6-8ba9-4438-8189-3a1ba5f122b7 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:52:10 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-946ee0c6-8ba9-4438-8189-3a1ba5f122b7 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:52:10 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-946ee0c6-8ba9-4438-8189-3a1ba5f122b7 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:52:10 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-946ee0c6-8ba9-4438-8189-3a1ba5f122b7 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:52:10 devstack sudo[106909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:52:10 devstack sudo[106909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:52:10 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-5b1e6e7c-9703-490e-896f-408dc1015fcd tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Acquiring lock "cinder-51a831ec-b156-4b0e-8632-eecebc8c0620-delete_volume" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:52:10 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-5b1e6e7c-9703-490e-896f-408dc1015fcd tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Lock "cinder-51a831ec-b156-4b0e-8632-eecebc8c0620-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:52:10 devstack sudo[106906]: pam_unix(sudo:session): session closed for user root Sep 06 06:52:10 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-74217e5d-8c9a-450f-9058-0a149decfd83 tempest-ProjectReaderTests-1566093849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-fa10e9db-97e3-4dde-ac06-a6f3542b18da" returned: 0 in 0.533s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:52:10 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-74217e5d-8c9a-450f-9058-0a149decfd83 tempest-ProjectReaderTests-1566093849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-fa10e9db-97e3-4dde-ac06-a6f3542b18da {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:52:10 devstack sudo[106914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-fa10e9db-97e3-4dde-ac06-a6f3542b18da Sep 06 06:52:10 devstack sudo[106914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:52:10 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-5b1e6e7c-9703-490e-896f-408dc1015fcd tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Acquiring lock "cinder-quobyte-51a831ec-b156-4b0e-8632-eecebc8c0620" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:52:10 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-5b1e6e7c-9703-490e-896f-408dc1015fcd tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Lock "cinder-quobyte-51a831ec-b156-4b0e-8632-eecebc8c0620" acquired by "delete_volume" :: waited 0.019s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:52:10 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[80c6016b-2ffd-426f-abc8-ea9fab0bbd0e]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:52:10 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-5b1e6e7c-9703-490e-896f-408dc1015fcd tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-51a831ec-b156-4b0e-8632-eecebc8c0620 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:52:11 devstack sudo[106909]: pam_unix(sudo:session): session closed for user root Sep 06 06:52:11 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-946ee0c6-8ba9-4438-8189-3a1ba5f122b7 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.356s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:52:11 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-946ee0c6-8ba9-4438-8189-3a1ba5f122b7 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:52:11 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-946ee0c6-8ba9-4438-8189-3a1ba5f122b7 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Deleted volume successfully. Sep 06 06:52:11 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-946ee0c6-8ba9-4438-8189-3a1ba5f122b7 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Lock "cinder-856414f5-82e0-49aa-80c9-ed29f138876b-delete_volume" released by "delete_volume" :: held 1.544s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:52:11 devstack sudo[106917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-51a831ec-b156-4b0e-8632-eecebc8c0620 Sep 06 06:52:11 devstack sudo[106917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:52:11 devstack sudo[106914]: pam_unix(sudo:session): session closed for user root Sep 06 06:52:11 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-74217e5d-8c9a-450f-9058-0a149decfd83 tempest-ProjectReaderTests-1566093849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-fa10e9db-97e3-4dde-ac06-a6f3542b18da" returned: 0 in 0.324s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:52:11 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-74217e5d-8c9a-450f-9058-0a149decfd83 tempest-ProjectReaderTests-1566093849 None] Lock "cinder-quobyte-fa10e9db-97e3-4dde-ac06-a6f3542b18da" released by "delete_volume" :: held 0.947s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:52:11 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-74217e5d-8c9a-450f-9058-0a149decfd83 tempest-ProjectReaderTests-1566093849 None] Created reservations ['4c981df9-e5ab-4f76-ac85-af1df0e633cf', '91b35b2a-293f-418d-a843-aa35ae27a401', '46cf44c3-1ce0-4069-b89b-86bce7b3c53e', '78f44b75-1f27-4026-b744-1b51cdf7b2d4'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:52:11 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-74217e5d-8c9a-450f-9058-0a149decfd83 tempest-ProjectReaderTests-1566093849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:52:11 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-74217e5d-8c9a-450f-9058-0a149decfd83 tempest-ProjectReaderTests-1566093849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:52:11 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-74217e5d-8c9a-450f-9058-0a149decfd83 tempest-ProjectReaderTests-1566093849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:52:11 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-74217e5d-8c9a-450f-9058-0a149decfd83 tempest-ProjectReaderTests-1566093849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:52:11 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-74217e5d-8c9a-450f-9058-0a149decfd83 tempest-ProjectReaderTests-1566093849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:52:11 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-74217e5d-8c9a-450f-9058-0a149decfd83 tempest-ProjectReaderTests-1566093849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:52:11 devstack sudo[106923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:52:11 devstack sudo[106923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:52:11 devstack sudo[106917]: pam_unix(sudo:session): session closed for user root Sep 06 06:52:11 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-5b1e6e7c-9703-490e-896f-408dc1015fcd tempest-CreateVolumesFromSourceVolumeTest-156116101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-51a831ec-b156-4b0e-8632-eecebc8c0620" returned: 0 in 0.483s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:52:11 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-5b1e6e7c-9703-490e-896f-408dc1015fcd tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-51a831ec-b156-4b0e-8632-eecebc8c0620 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:52:11 devstack sudo[106925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-51a831ec-b156-4b0e-8632-eecebc8c0620 Sep 06 06:52:11 devstack sudo[106925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:52:11 devstack sudo[106923]: pam_unix(sudo:session): session closed for user root Sep 06 06:52:11 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-74217e5d-8c9a-450f-9058-0a149decfd83 tempest-ProjectReaderTests-1566093849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.412s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:52:11 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-74217e5d-8c9a-450f-9058-0a149decfd83 tempest-ProjectReaderTests-1566093849 None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:52:11 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-74217e5d-8c9a-450f-9058-0a149decfd83 tempest-ProjectReaderTests-1566093849 None] Deleted volume successfully. Sep 06 06:52:11 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-74217e5d-8c9a-450f-9058-0a149decfd83 tempest-ProjectReaderTests-1566093849 None] Lock "cinder-fa10e9db-97e3-4dde-ac06-a6f3542b18da-delete_volume" released by "delete_volume" :: held 1.675s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:52:11 devstack sudo[106925]: pam_unix(sudo:session): session closed for user root Sep 06 06:52:11 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-5b1e6e7c-9703-490e-896f-408dc1015fcd tempest-CreateVolumesFromSourceVolumeTest-156116101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-51a831ec-b156-4b0e-8632-eecebc8c0620" returned: 0 in 0.520s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:52:12 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-5b1e6e7c-9703-490e-896f-408dc1015fcd tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Lock "cinder-quobyte-51a831ec-b156-4b0e-8632-eecebc8c0620" released by "delete_volume" :: held 1.063s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:52:12 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-5b1e6e7c-9703-490e-896f-408dc1015fcd tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Created reservations ['ede74d1d-8b32-4973-b2fc-4fbf06ffca02', '155fbd54-5b05-4424-8e23-b0662ec927bb', '6b695516-5568-4429-853c-0905a92c8f98', 'acb52933-64c7-49f3-9dc4-fce6f05adb4f'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:52:12 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-5b1e6e7c-9703-490e-896f-408dc1015fcd tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:52:12 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-5b1e6e7c-9703-490e-896f-408dc1015fcd tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:52:12 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-5b1e6e7c-9703-490e-896f-408dc1015fcd tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:52:12 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-5b1e6e7c-9703-490e-896f-408dc1015fcd tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:52:12 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-5b1e6e7c-9703-490e-896f-408dc1015fcd tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:52:12 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-5b1e6e7c-9703-490e-896f-408dc1015fcd tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:52:12 devstack sudo[106929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:52:12 devstack sudo[106929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:52:12 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb4d7245-76ee-412c-961d-d4e6c384a305 tempest-ProjectReaderTests-1566093849 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87329) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 06:52:12 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-bb4d7245-76ee-412c-961d-d4e6c384a305 tempest-ProjectReaderTests-1566093849 None] Flow 'volume_create_manager' (d37fd2ff-5773-4339-a016-e975069979c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:52:12 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-bb4d7245-76ee-412c-961d-d4e6c384a305 tempest-ProjectReaderTests-1566093849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1ab5536-b85b-4942-9e8f-e520b8b9607f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:52:12 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-bb4d7245-76ee-412c-961d-d4e6c384a305 tempest-ProjectReaderTests-1566093849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1ab5536-b85b-4942-9e8f-e520b8b9607f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:52:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-703068005',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0fb650b-8224-4733-9707-c4bce6b709da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47b14cc477564406b2c85835936b99d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:52:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:52:12Z,use_quota=True,user_id='2bb3aa6913034422a07b16fa1477428f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:52:12 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-bb4d7245-76ee-412c-961d-d4e6c384a305 tempest-ProjectReaderTests-1566093849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (084c4b21-b549-4c16-a55b-a8de93f52f46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:52:12 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-bb4d7245-76ee-412c-961d-d4e6c384a305 tempest-ProjectReaderTests-1566093849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (084c4b21-b549-4c16-a55b-a8de93f52f46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:52:12 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-bb4d7245-76ee-412c-961d-d4e6c384a305 tempest-ProjectReaderTests-1566093849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48ece9a6-44b9-48da-8c21-504ee914c2ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:52:12 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-bb4d7245-76ee-412c-961d-d4e6c384a305 tempest-ProjectReaderTests-1566093849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48ece9a6-44b9-48da-8c21-504ee914c2ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b0fb650b-8224-4733-9707-c4bce6b709da', 'volume_name': 'volume-b0fb650b-8224-4733-9707-c4bce6b709da', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:52:12 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-bb4d7245-76ee-412c-961d-d4e6c384a305 tempest-ProjectReaderTests-1566093849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71e2ce2c-39e2-4536-9002-effcf8e164a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:52:12 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-bb4d7245-76ee-412c-961d-d4e6c384a305 tempest-ProjectReaderTests-1566093849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71e2ce2c-39e2-4536-9002-effcf8e164a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:52:12 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-bb4d7245-76ee-412c-961d-d4e6c384a305 tempest-ProjectReaderTests-1566093849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be0645b8-32c2-4ebb-a495-9d9630587124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:52:12 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-bb4d7245-76ee-412c-961d-d4e6c384a305 tempest-ProjectReaderTests-1566093849 None] Volume b0fb650b-8224-4733-9707-c4bce6b709da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b0fb650b-8224-4733-9707-c4bce6b709da', 'volume_size': 1} Sep 06 06:52:12 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-bb4d7245-76ee-412c-961d-d4e6c384a305 tempest-ProjectReaderTests-1566093849 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:52:12 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-bb4d7245-76ee-412c-961d-d4e6c384a305 tempest-ProjectReaderTests-1566093849 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:52:12 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-bb4d7245-76ee-412c-961d-d4e6c384a305 tempest-ProjectReaderTests-1566093849 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:52:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-703068005',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0fb650b-8224-4733-9707-c4bce6b709da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47b14cc477564406b2c85835936b99d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:52:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:52:12Z,use_quota=True,user_id='2bb3aa6913034422a07b16fa1477428f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)}" {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 06:52:12 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-bb4d7245-76ee-412c-961d-d4e6c384a305 tempest-ProjectReaderTests-1566093849 None] Creating volume b0fb650b-8224-4733-9707-c4bce6b709da {{(pid=87329) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 06:52:12 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-bb4d7245-76ee-412c-961d-d4e6c384a305 tempest-ProjectReaderTests-1566093849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:52:12 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-bb4d7245-76ee-412c-961d-d4e6c384a305 tempest-ProjectReaderTests-1566093849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:52:12 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-bb4d7245-76ee-412c-961d-d4e6c384a305 tempest-ProjectReaderTests-1566093849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:52:12 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-bb4d7245-76ee-412c-961d-d4e6c384a305 tempest-ProjectReaderTests-1566093849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:52:12 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-bb4d7245-76ee-412c-961d-d4e6c384a305 tempest-ProjectReaderTests-1566093849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:52:12 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-bb4d7245-76ee-412c-961d-d4e6c384a305 tempest-ProjectReaderTests-1566093849 None] Selected osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 as target Quobyte volume. {{(pid=87329) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 06:52:12 devstack cinder-volume[87329]: INFO cinder.volume.drivers.remotefs [None req-bb4d7245-76ee-412c-961d-d4e6c384a305 tempest-ProjectReaderTests-1566093849 None] casted to osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 Sep 06 06:52:12 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-bb4d7245-76ee-412c-961d-d4e6c384a305 tempest-ProjectReaderTests-1566093849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b0fb650b-8224-4733-9707-c4bce6b709da 1073741824 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:52:12 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-e05bdb93-b65b-4b91-b69e-e23b9743b295 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Acquiring lock "cinder-13fea464-9700-4471-9da8-8cc5ca88da4d-delete_volume" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:52:12 devstack sudo[106933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b0fb650b-8224-4733-9707-c4bce6b709da 1073741824 Sep 06 06:52:12 devstack sudo[106933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:52:12 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-e05bdb93-b65b-4b91-b69e-e23b9743b295 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Lock "cinder-13fea464-9700-4471-9da8-8cc5ca88da4d-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:52:12 devstack sudo[106929]: pam_unix(sudo:session): session closed for user root Sep 06 06:52:12 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-5b1e6e7c-9703-490e-896f-408dc1015fcd tempest-CreateVolumesFromSourceVolumeTest-156116101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.440s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:52:12 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-5b1e6e7c-9703-490e-896f-408dc1015fcd tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:52:12 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-5b1e6e7c-9703-490e-896f-408dc1015fcd tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Deleted volume successfully. Sep 06 06:52:12 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-e05bdb93-b65b-4b91-b69e-e23b9743b295 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Acquiring lock "cinder-quobyte-13fea464-9700-4471-9da8-8cc5ca88da4d" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:52:12 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-5b1e6e7c-9703-490e-896f-408dc1015fcd tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Lock "cinder-51a831ec-b156-4b0e-8632-eecebc8c0620-delete_volume" released by "delete_volume" :: held 1.841s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:52:12 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-e05bdb93-b65b-4b91-b69e-e23b9743b295 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Lock "cinder-quobyte-13fea464-9700-4471-9da8-8cc5ca88da4d" acquired by "delete_volume" :: waited 0.032s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:52:12 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[970c66bb-8c43-4e64-a8d3-87f8288b98ac]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:52:12 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-e05bdb93-b65b-4b91-b69e-e23b9743b295 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-13fea464-9700-4471-9da8-8cc5ca88da4d {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:52:12 devstack sudo[106935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-13fea464-9700-4471-9da8-8cc5ca88da4d Sep 06 06:52:12 devstack sudo[106935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:52:13 devstack sudo[106933]: pam_unix(sudo:session): session closed for user root Sep 06 06:52:13 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-bb4d7245-76ee-412c-961d-d4e6c384a305 tempest-ProjectReaderTests-1566093849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b0fb650b-8224-4733-9707-c4bce6b709da 1073741824" returned: 0 in 0.564s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:52:13 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-bb4d7245-76ee-412c-961d-d4e6c384a305 tempest-ProjectReaderTests-1566093849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b0fb650b-8224-4733-9707-c4bce6b709da {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:52:13 devstack sudo[106935]: pam_unix(sudo:session): session closed for user root Sep 06 06:52:13 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-e05bdb93-b65b-4b91-b69e-e23b9743b295 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-13fea464-9700-4471-9da8-8cc5ca88da4d" returned: 0 in 0.441s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:52:13 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-e05bdb93-b65b-4b91-b69e-e23b9743b295 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-13fea464-9700-4471-9da8-8cc5ca88da4d {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:52:13 devstack sudo[106944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b0fb650b-8224-4733-9707-c4bce6b709da Sep 06 06:52:13 devstack sudo[106944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:52:13 devstack sudo[106945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-13fea464-9700-4471-9da8-8cc5ca88da4d Sep 06 06:52:13 devstack sudo[106945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:52:13 devstack sudo[106945]: pam_unix(sudo:session): session closed for user root Sep 06 06:52:13 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-e05bdb93-b65b-4b91-b69e-e23b9743b295 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-13fea464-9700-4471-9da8-8cc5ca88da4d" returned: 0 in 0.295s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:52:13 devstack sudo[106944]: pam_unix(sudo:session): session closed for user root Sep 06 06:52:13 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-e05bdb93-b65b-4b91-b69e-e23b9743b295 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Lock "cinder-quobyte-13fea464-9700-4471-9da8-8cc5ca88da4d" released by "delete_volume" :: held 0.803s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:52:13 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-bb4d7245-76ee-412c-961d-d4e6c384a305 tempest-ProjectReaderTests-1566093849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b0fb650b-8224-4733-9707-c4bce6b709da" returned: 0 in 0.346s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:52:13 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-bb4d7245-76ee-412c-961d-d4e6c384a305 tempest-ProjectReaderTests-1566093849 None] <== create_volume: return (970ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'} {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 06:52:13 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-bb4d7245-76ee-412c-961d-d4e6c384a305 tempest-ProjectReaderTests-1566093849 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.974s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:52:13 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-bb4d7245-76ee-412c-961d-d4e6c384a305 tempest-ProjectReaderTests-1566093849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be0645b8-32c2-4ebb-a495-9d9630587124) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0fb650b-8224-4733-9707-c4bce6b709da', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:52:13 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-bb4d7245-76ee-412c-961d-d4e6c384a305 tempest-ProjectReaderTests-1566093849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (602b1d63-7253-41de-b53a-12c2f88e9859) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:52:13 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-bb4d7245-76ee-412c-961d-d4e6c384a305 tempest-ProjectReaderTests-1566093849 None] Volume volume-b0fb650b-8224-4733-9707-c4bce6b709da (b0fb650b-8224-4733-9707-c4bce6b709da): created successfully Sep 06 06:52:13 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-bb4d7245-76ee-412c-961d-d4e6c384a305 tempest-ProjectReaderTests-1566093849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (602b1d63-7253-41de-b53a-12c2f88e9859) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:52:13 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-bb4d7245-76ee-412c-961d-d4e6c384a305 tempest-ProjectReaderTests-1566093849 None] Flow 'volume_create_manager' (d37fd2ff-5773-4339-a016-e975069979c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:52:13 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-bb4d7245-76ee-412c-961d-d4e6c384a305 tempest-ProjectReaderTests-1566093849 None] Created volume successfully. Sep 06 06:52:13 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-e05bdb93-b65b-4b91-b69e-e23b9743b295 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Created reservations ['84b72d84-264e-45e9-b6cb-6f28b2736ecb', '4565769f-8328-414e-8e12-608f7d97ae6d', 'b608990d-53fd-4aef-b2ec-515cc8465b94', '60267e05-0eb6-4585-b8cd-052ddf917c06'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:52:13 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-e05bdb93-b65b-4b91-b69e-e23b9743b295 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:52:13 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-e05bdb93-b65b-4b91-b69e-e23b9743b295 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:52:13 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-e05bdb93-b65b-4b91-b69e-e23b9743b295 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:52:13 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-e05bdb93-b65b-4b91-b69e-e23b9743b295 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:52:13 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-e05bdb93-b65b-4b91-b69e-e23b9743b295 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:52:13 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-e05bdb93-b65b-4b91-b69e-e23b9743b295 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:52:13 devstack sudo[106950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:52:13 devstack sudo[106950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:52:13 devstack sudo[106950]: pam_unix(sudo:session): session closed for user root Sep 06 06:52:13 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-e05bdb93-b65b-4b91-b69e-e23b9743b295 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.292s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:52:13 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-e05bdb93-b65b-4b91-b69e-e23b9743b295 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:52:13 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-e05bdb93-b65b-4b91-b69e-e23b9743b295 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Deleted volume successfully. Sep 06 06:52:13 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-e05bdb93-b65b-4b91-b69e-e23b9743b295 tempest-CreateVolumesFromSourceVolumeTest-156116101 None] Lock "cinder-13fea464-9700-4471-9da8-8cc5ca88da4d-delete_volume" released by "delete_volume" :: held 1.425s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:52:14 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-581a3d8b-67f0-4cdf-9ec5-72350a8be320 tempest-ProjectReaderTests-1566093849 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:52:14 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-581a3d8b-67f0-4cdf-9ec5-72350a8be320 tempest-ProjectReaderTests-1566093849 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:52:14 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-581a3d8b-67f0-4cdf-9ec5-72350a8be320 tempest-ProjectReaderTests-1566093849 None] Creating offline snapshot dc915d43-ebeb-465e-ad58-4069b1b2fb4e of volume b0fb650b-8224-4733-9707-c4bce6b709da {{(pid=87329) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 06 06:52:14 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a18fd1e-bc1f-4a5b-a753-a2b7db30890e]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:52:14 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-581a3d8b-67f0-4cdf-9ec5-72350a8be320 tempest-ProjectReaderTests-1566093849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b0fb650b-8224-4733-9707-c4bce6b709da {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:52:14 devstack sudo[106953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b0fb650b-8224-4733-9707-c4bce6b709da Sep 06 06:52:14 devstack sudo[106953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:52:15 devstack sudo[106953]: pam_unix(sudo:session): session closed for user root Sep 06 06:52:15 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-581a3d8b-67f0-4cdf-9ec5-72350a8be320 tempest-ProjectReaderTests-1566093849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b0fb650b-8224-4733-9707-c4bce6b709da" returned: 0 in 0.515s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:52:15 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-581a3d8b-67f0-4cdf-9ec5-72350a8be320 tempest-ProjectReaderTests-1566093849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b0fb650b-8224-4733-9707-c4bce6b709da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b0fb650b-8224-4733-9707-c4bce6b709da.dc915d43-ebeb-465e-ad58-4069b1b2fb4e 1G {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:52:15 devstack sudo[106958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b0fb650b-8224-4733-9707-c4bce6b709da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b0fb650b-8224-4733-9707-c4bce6b709da.dc915d43-ebeb-465e-ad58-4069b1b2fb4e 1G Sep 06 06:52:15 devstack sudo[106958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:52:15 devstack sudo[106958]: pam_unix(sudo:session): session closed for user root Sep 06 06:52:15 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-581a3d8b-67f0-4cdf-9ec5-72350a8be320 tempest-ProjectReaderTests-1566093849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b0fb650b-8224-4733-9707-c4bce6b709da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b0fb650b-8224-4733-9707-c4bce6b709da.dc915d43-ebeb-465e-ad58-4069b1b2fb4e 1G" returned: 0 in 0.452s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:52:15 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-581a3d8b-67f0-4cdf-9ec5-72350a8be320 tempest-ProjectReaderTests-1566093849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b0fb650b-8224-4733-9707-c4bce6b709da -F qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b0fb650b-8224-4733-9707-c4bce6b709da.dc915d43-ebeb-465e-ad58-4069b1b2fb4e {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:52:15 devstack sudo[106964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b0fb650b-8224-4733-9707-c4bce6b709da -F qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b0fb650b-8224-4733-9707-c4bce6b709da.dc915d43-ebeb-465e-ad58-4069b1b2fb4e Sep 06 06:52:15 devstack sudo[106964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:52:15 devstack sudo[106964]: pam_unix(sudo:session): session closed for user root Sep 06 06:52:15 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-581a3d8b-67f0-4cdf-9ec5-72350a8be320 tempest-ProjectReaderTests-1566093849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b0fb650b-8224-4733-9707-c4bce6b709da -F qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b0fb650b-8224-4733-9707-c4bce6b709da.dc915d43-ebeb-465e-ad58-4069b1b2fb4e" returned: 0 in 0.374s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:52:15 devstack cinder-volume[87329]: WARNING cinder.volume.drivers.remotefs [None req-581a3d8b-67f0-4cdf-9ec5-72350a8be320 tempest-ProjectReaderTests-1566093849 None] /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b0fb650b-8224-4733-9707-c4bce6b709da.dc915d43-ebeb-465e-ad58-4069b1b2fb4e is being set with open permissions: ugo+rw Sep 06 06:52:15 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-581a3d8b-67f0-4cdf-9ec5-72350a8be320 tempest-ProjectReaderTests-1566093849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b0fb650b-8224-4733-9707-c4bce6b709da.dc915d43-ebeb-465e-ad58-4069b1b2fb4e {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:52:15 devstack sudo[106969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b0fb650b-8224-4733-9707-c4bce6b709da.dc915d43-ebeb-465e-ad58-4069b1b2fb4e Sep 06 06:52:15 devstack sudo[106969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:52:16 devstack sudo[106969]: pam_unix(sudo:session): session closed for user root Sep 06 06:52:16 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-581a3d8b-67f0-4cdf-9ec5-72350a8be320 tempest-ProjectReaderTests-1566093849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b0fb650b-8224-4733-9707-c4bce6b709da.dc915d43-ebeb-465e-ad58-4069b1b2fb4e" returned: 0 in 0.344s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:52:16 devstack cinder-volume[87329]: DEBUG dbcounter [-] [87329] Writing DB stats cinder:UPDATE=300,cinder:SELECT=193,cinder:INSERT=75,cinder:DELETE=27 {{(pid=87329) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 06:52:16 devstack cinder-volume[87329]: DEBUG dbcounter [-] [87329] Writing DB stats cinder:SELECT=227,cinder:UPDATE=277,cinder:INSERT=80,cinder:DELETE=24 {{(pid=87329) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 06:52:16 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-581a3d8b-67f0-4cdf-9ec5-72350a8be320 tempest-ProjectReaderTests-1566093849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b0fb650b-8224-4733-9707-c4bce6b709da.info {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:52:16 devstack sudo[106972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b0fb650b-8224-4733-9707-c4bce6b709da.info Sep 06 06:52:16 devstack sudo[106972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:52:16 devstack sudo[106972]: pam_unix(sudo:session): session closed for user root Sep 06 06:52:16 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-581a3d8b-67f0-4cdf-9ec5-72350a8be320 tempest-ProjectReaderTests-1566093849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b0fb650b-8224-4733-9707-c4bce6b709da.info" returned: 0 in 0.297s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:52:16 devstack cinder-volume[87329]: WARNING cinder.volume.drivers.remotefs [None req-581a3d8b-67f0-4cdf-9ec5-72350a8be320 tempest-ProjectReaderTests-1566093849 None] /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b0fb650b-8224-4733-9707-c4bce6b709da.info is being set with open permissions: ugo+rw Sep 06 06:52:16 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-581a3d8b-67f0-4cdf-9ec5-72350a8be320 tempest-ProjectReaderTests-1566093849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b0fb650b-8224-4733-9707-c4bce6b709da.info {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:52:16 devstack sudo[106975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b0fb650b-8224-4733-9707-c4bce6b709da.info Sep 06 06:52:16 devstack sudo[106975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:52:17 devstack sudo[106975]: pam_unix(sudo:session): session closed for user root Sep 06 06:52:17 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-581a3d8b-67f0-4cdf-9ec5-72350a8be320 tempest-ProjectReaderTests-1566093849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b0fb650b-8224-4733-9707-c4bce6b709da.info" returned: 0 in 0.401s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:52:17 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-581a3d8b-67f0-4cdf-9ec5-72350a8be320 tempest-ProjectReaderTests-1566093849 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.507s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:52:17 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-581a3d8b-67f0-4cdf-9ec5-72350a8be320 tempest-ProjectReaderTests-1566093849 None] Create snapshot completed successfully Sep 06 06:52:17 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-96db2241-3cec-4046-9b3b-27d592aebf47 tempest-ProjectReaderTests-1566093849 None] Acquiring lock "cinder-dc915d43-ebeb-465e-ad58-4069b1b2fb4e-delete_snapshot" by "delete_snapshot" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:52:17 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-96db2241-3cec-4046-9b3b-27d592aebf47 tempest-ProjectReaderTests-1566093849 None] Lock "cinder-dc915d43-ebeb-465e-ad58-4069b1b2fb4e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:52:17 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-96db2241-3cec-4046-9b3b-27d592aebf47 tempest-ProjectReaderTests-1566093849 None] Acquiring lock "cinder-quobyte-b0fb650b-8224-4733-9707-c4bce6b709da" by "delete_snapshot" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:52:17 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-96db2241-3cec-4046-9b3b-27d592aebf47 tempest-ProjectReaderTests-1566093849 None] Lock "cinder-quobyte-b0fb650b-8224-4733-9707-c4bce6b709da" acquired by "delete_snapshot" :: waited 0.068s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:52:17 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-96db2241-3cec-4046-9b3b-27d592aebf47 tempest-ProjectReaderTests-1566093849 None] Acquiring lock "cinder-quobyte-dc915d43-ebeb-465e-ad58-4069b1b2fb4e" by "_delete_snapshot" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:52:17 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-96db2241-3cec-4046-9b3b-27d592aebf47 tempest-ProjectReaderTests-1566093849 None] Lock "cinder-quobyte-dc915d43-ebeb-465e-ad58-4069b1b2fb4e" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:52:17 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-96db2241-3cec-4046-9b3b-27d592aebf47 tempest-ProjectReaderTests-1566093849 None] Deleting offline snapshot dc915d43-ebeb-465e-ad58-4069b1b2fb4e of volume b0fb650b-8224-4733-9707-c4bce6b709da {{(pid=87329) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 06 06:52:17 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-96db2241-3cec-4046-9b3b-27d592aebf47 tempest-ProjectReaderTests-1566093849 None] snapshot_file for this snap is: volume-b0fb650b-8224-4733-9707-c4bce6b709da.dc915d43-ebeb-465e-ad58-4069b1b2fb4e {{(pid=87329) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 06 06:52:17 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[af270d51-e777-4917-8988-45c376241c8e]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:52:17 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-96db2241-3cec-4046-9b3b-27d592aebf47 tempest-ProjectReaderTests-1566093849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b0fb650b-8224-4733-9707-c4bce6b709da.dc915d43-ebeb-465e-ad58-4069b1b2fb4e {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:52:18 devstack sudo[106978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b0fb650b-8224-4733-9707-c4bce6b709da.dc915d43-ebeb-465e-ad58-4069b1b2fb4e Sep 06 06:52:18 devstack sudo[106978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:52:18 devstack sudo[106978]: pam_unix(sudo:session): session closed for user root Sep 06 06:52:18 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-96db2241-3cec-4046-9b3b-27d592aebf47 tempest-ProjectReaderTests-1566093849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b0fb650b-8224-4733-9707-c4bce6b709da.dc915d43-ebeb-465e-ad58-4069b1b2fb4e" returned: 0 in 0.580s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:52:18 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-96db2241-3cec-4046-9b3b-27d592aebf47 tempest-ProjectReaderTests-1566093849 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b0fb650b-8224-4733-9707-c4bce6b709da(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87329) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 06:52:18 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e88bd95-4112-46e3-b269-aea5f1ae7866]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:52:18 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-96db2241-3cec-4046-9b3b-27d592aebf47 tempest-ProjectReaderTests-1566093849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b0fb650b-8224-4733-9707-c4bce6b709da {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:52:18 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-421bf300-8a02-4fc3-8708-5de507ad1826 tempest-CinderUnicodeTest-1212770282 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87329) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 06:52:18 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-421bf300-8a02-4fc3-8708-5de507ad1826 tempest-CinderUnicodeTest-1212770282 None] Flow 'volume_create_manager' (e5d28f5c-91ae-4eac-8a8b-73d0c3bcbd91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:52:18 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-421bf300-8a02-4fc3-8708-5de507ad1826 tempest-CinderUnicodeTest-1212770282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (574aea65-8d4a-4979-a197-ce82c7cf2a9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:52:18 devstack sudo[106984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b0fb650b-8224-4733-9707-c4bce6b709da Sep 06 06:52:18 devstack sudo[106984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:52:18 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-421bf300-8a02-4fc3-8708-5de507ad1826 tempest-CinderUnicodeTest-1212770282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (574aea65-8d4a-4979-a197-ce82c7cf2a9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:52:18Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8e16a3a-dcb9-4b44-96e8-d8c4209ad77c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75066039df1547bebc862598e0ae1fe4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:52:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:52:19Z,use_quota=True,user_id='e0d2f48443b14bc4bc3e67960d2690b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:52:18 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-421bf300-8a02-4fc3-8708-5de507ad1826 tempest-CinderUnicodeTest-1212770282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6455ff23-9732-4a62-87d0-f424111f2bf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:52:18 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-421bf300-8a02-4fc3-8708-5de507ad1826 tempest-CinderUnicodeTest-1212770282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6455ff23-9732-4a62-87d0-f424111f2bf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:52:18 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-421bf300-8a02-4fc3-8708-5de507ad1826 tempest-CinderUnicodeTest-1212770282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a2843ff-e623-44b4-b780-c4b55066dbc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:52:18 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-421bf300-8a02-4fc3-8708-5de507ad1826 tempest-CinderUnicodeTest-1212770282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a2843ff-e623-44b4-b780-c4b55066dbc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8e16a3a-dcb9-4b44-96e8-d8c4209ad77c', 'volume_name': 'volume-c8e16a3a-dcb9-4b44-96e8-d8c4209ad77c', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:52:18 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-421bf300-8a02-4fc3-8708-5de507ad1826 tempest-CinderUnicodeTest-1212770282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a20f01a-0d0e-4faf-b63d-a1598cc76d04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:52:18 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-421bf300-8a02-4fc3-8708-5de507ad1826 tempest-CinderUnicodeTest-1212770282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a20f01a-0d0e-4faf-b63d-a1598cc76d04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:52:18 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-421bf300-8a02-4fc3-8708-5de507ad1826 tempest-CinderUnicodeTest-1212770282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5387189e-5c93-4366-a645-1cf864fc590b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:52:18 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-421bf300-8a02-4fc3-8708-5de507ad1826 tempest-CinderUnicodeTest-1212770282 None] Volume c8e16a3a-dcb9-4b44-96e8-d8c4209ad77c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8e16a3a-dcb9-4b44-96e8-d8c4209ad77c', 'volume_size': 1} Sep 06 06:52:18 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-421bf300-8a02-4fc3-8708-5de507ad1826 tempest-CinderUnicodeTest-1212770282 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:52:18 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-421bf300-8a02-4fc3-8708-5de507ad1826 tempest-CinderUnicodeTest-1212770282 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:52:18 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-421bf300-8a02-4fc3-8708-5de507ad1826 tempest-CinderUnicodeTest-1212770282 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:52:18Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8e16a3a-dcb9-4b44-96e8-d8c4209ad77c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75066039df1547bebc862598e0ae1fe4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:52:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:52:19Z,use_quota=True,user_id='e0d2f48443b14bc4bc3e67960d2690b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)}" {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 06:52:18 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-421bf300-8a02-4fc3-8708-5de507ad1826 tempest-CinderUnicodeTest-1212770282 None] Creating volume c8e16a3a-dcb9-4b44-96e8-d8c4209ad77c {{(pid=87329) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 06:52:18 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-421bf300-8a02-4fc3-8708-5de507ad1826 tempest-CinderUnicodeTest-1212770282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:52:18 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-421bf300-8a02-4fc3-8708-5de507ad1826 tempest-CinderUnicodeTest-1212770282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:52:18 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-421bf300-8a02-4fc3-8708-5de507ad1826 tempest-CinderUnicodeTest-1212770282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:52:18 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-421bf300-8a02-4fc3-8708-5de507ad1826 tempest-CinderUnicodeTest-1212770282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:52:18 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-421bf300-8a02-4fc3-8708-5de507ad1826 tempest-CinderUnicodeTest-1212770282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:52:18 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-421bf300-8a02-4fc3-8708-5de507ad1826 tempest-CinderUnicodeTest-1212770282 None] Selected osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 as target Quobyte volume. {{(pid=87329) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 06:52:18 devstack cinder-volume[87329]: INFO cinder.volume.drivers.remotefs [None req-421bf300-8a02-4fc3-8708-5de507ad1826 tempest-CinderUnicodeTest-1212770282 None] casted to osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 Sep 06 06:52:18 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-421bf300-8a02-4fc3-8708-5de507ad1826 tempest-CinderUnicodeTest-1212770282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-c8e16a3a-dcb9-4b44-96e8-d8c4209ad77c 1073741824 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:52:18 devstack sudo[106986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-c8e16a3a-dcb9-4b44-96e8-d8c4209ad77c 1073741824 Sep 06 06:52:18 devstack sudo[106986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:52:19 devstack sudo[106984]: pam_unix(sudo:session): session closed for user root Sep 06 06:52:19 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-96db2241-3cec-4046-9b3b-27d592aebf47 tempest-ProjectReaderTests-1566093849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b0fb650b-8224-4733-9707-c4bce6b709da" returned: 0 in 0.551s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:52:19 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-96db2241-3cec-4046-9b3b-27d592aebf47 tempest-ProjectReaderTests-1566093849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b0fb650b-8224-4733-9707-c4bce6b709da.dc915d43-ebeb-465e-ad58-4069b1b2fb4e {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:52:19 devstack sudo[106991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b0fb650b-8224-4733-9707-c4bce6b709da.dc915d43-ebeb-465e-ad58-4069b1b2fb4e Sep 06 06:52:19 devstack sudo[106991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:52:19 devstack sudo[106986]: pam_unix(sudo:session): session closed for user root Sep 06 06:52:19 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-421bf300-8a02-4fc3-8708-5de507ad1826 tempest-CinderUnicodeTest-1212770282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-c8e16a3a-dcb9-4b44-96e8-d8c4209ad77c 1073741824" returned: 0 in 0.710s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:52:19 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-421bf300-8a02-4fc3-8708-5de507ad1826 tempest-CinderUnicodeTest-1212770282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-c8e16a3a-dcb9-4b44-96e8-d8c4209ad77c {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:52:19 devstack sudo[106991]: pam_unix(sudo:session): session closed for user root Sep 06 06:52:19 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-96db2241-3cec-4046-9b3b-27d592aebf47 tempest-ProjectReaderTests-1566093849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b0fb650b-8224-4733-9707-c4bce6b709da.dc915d43-ebeb-465e-ad58-4069b1b2fb4e" returned: 0 in 0.441s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:52:19 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-96db2241-3cec-4046-9b3b-27d592aebf47 tempest-ProjectReaderTests-1566093849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b0fb650b-8224-4733-9707-c4bce6b709da.dc915d43-ebeb-465e-ad58-4069b1b2fb4e {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:52:19 devstack sudo[107001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-c8e16a3a-dcb9-4b44-96e8-d8c4209ad77c Sep 06 06:52:19 devstack sudo[107001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:52:19 devstack sudo[107002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b0fb650b-8224-4733-9707-c4bce6b709da.dc915d43-ebeb-465e-ad58-4069b1b2fb4e Sep 06 06:52:19 devstack sudo[107002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:52:19 devstack sudo[107001]: pam_unix(sudo:session): session closed for user root Sep 06 06:52:19 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-421bf300-8a02-4fc3-8708-5de507ad1826 tempest-CinderUnicodeTest-1212770282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-c8e16a3a-dcb9-4b44-96e8-d8c4209ad77c" returned: 0 in 0.249s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:52:19 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-421bf300-8a02-4fc3-8708-5de507ad1826 tempest-CinderUnicodeTest-1212770282 None] <== create_volume: return (1014ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'} {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 06:52:19 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-421bf300-8a02-4fc3-8708-5de507ad1826 tempest-CinderUnicodeTest-1212770282 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.017s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:52:19 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-421bf300-8a02-4fc3-8708-5de507ad1826 tempest-CinderUnicodeTest-1212770282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5387189e-5c93-4366-a645-1cf864fc590b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8e16a3a-dcb9-4b44-96e8-d8c4209ad77c', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:52:19 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-421bf300-8a02-4fc3-8708-5de507ad1826 tempest-CinderUnicodeTest-1212770282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e17b6630-2b5b-4a60-8ed4-439a4587c426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:52:19 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-421bf300-8a02-4fc3-8708-5de507ad1826 tempest-CinderUnicodeTest-1212770282 None] Volume volume-c8e16a3a-dcb9-4b44-96e8-d8c4209ad77c (c8e16a3a-dcb9-4b44-96e8-d8c4209ad77c): created successfully Sep 06 06:52:19 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-421bf300-8a02-4fc3-8708-5de507ad1826 tempest-CinderUnicodeTest-1212770282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e17b6630-2b5b-4a60-8ed4-439a4587c426) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:52:19 devstack sudo[107002]: pam_unix(sudo:session): session closed for user root Sep 06 06:52:19 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-421bf300-8a02-4fc3-8708-5de507ad1826 tempest-CinderUnicodeTest-1212770282 None] Flow 'volume_create_manager' (e5d28f5c-91ae-4eac-8a8b-73d0c3bcbd91) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:52:19 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-96db2241-3cec-4046-9b3b-27d592aebf47 tempest-ProjectReaderTests-1566093849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b0fb650b-8224-4733-9707-c4bce6b709da.dc915d43-ebeb-465e-ad58-4069b1b2fb4e" returned: 0 in 0.294s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:52:19 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-96db2241-3cec-4046-9b3b-27d592aebf47 tempest-ProjectReaderTests-1566093849 None] Lock "cinder-quobyte-dc915d43-ebeb-465e-ad58-4069b1b2fb4e" released by "_delete_snapshot" :: held 2.004s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:52:19 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-421bf300-8a02-4fc3-8708-5de507ad1826 tempest-CinderUnicodeTest-1212770282 None] Created volume successfully. Sep 06 06:52:19 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-96db2241-3cec-4046-9b3b-27d592aebf47 tempest-ProjectReaderTests-1566093849 None] Lock "cinder-quobyte-b0fb650b-8224-4733-9707-c4bce6b709da" released by "delete_snapshot" :: held 2.038s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:52:19 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-96db2241-3cec-4046-9b3b-27d592aebf47 tempest-ProjectReaderTests-1566093849 None] Created reservations ['5c70211a-e13a-4e4f-bd42-aa865a541938', '8a183135-6fb3-4a7e-9f5b-06184017f336', '145608ef-4156-413a-bc77-97f167d11f7a', '3d442cc9-985c-4dc7-a47c-798de23ce1ea'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:52:20 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-96db2241-3cec-4046-9b3b-27d592aebf47 tempest-ProjectReaderTests-1566093849 None] Delete snapshot completed successfully. Sep 06 06:52:20 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-96db2241-3cec-4046-9b3b-27d592aebf47 tempest-ProjectReaderTests-1566093849 None] Lock "cinder-dc915d43-ebeb-465e-ad58-4069b1b2fb4e-delete_snapshot" released by "delete_snapshot" :: held 2.298s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:52:21 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-aca49f82-77c2-497c-abc1-b981356d22f4 tempest-ProjectReaderTests-1566093849 None] Acquiring lock "cinder-b0fb650b-8224-4733-9707-c4bce6b709da-delete_volume" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:52:21 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-aca49f82-77c2-497c-abc1-b981356d22f4 tempest-ProjectReaderTests-1566093849 None] Lock "cinder-b0fb650b-8224-4733-9707-c4bce6b709da-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:52:21 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-aca49f82-77c2-497c-abc1-b981356d22f4 tempest-ProjectReaderTests-1566093849 None] Acquiring lock "cinder-quobyte-b0fb650b-8224-4733-9707-c4bce6b709da" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:52:21 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-aca49f82-77c2-497c-abc1-b981356d22f4 tempest-ProjectReaderTests-1566093849 None] Lock "cinder-quobyte-b0fb650b-8224-4733-9707-c4bce6b709da" acquired by "delete_volume" :: waited 0.019s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:52:21 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[82f819c8-5bbd-45a5-a9dd-df3a71a9a4a8]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:52:21 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-aca49f82-77c2-497c-abc1-b981356d22f4 tempest-ProjectReaderTests-1566093849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b0fb650b-8224-4733-9707-c4bce6b709da {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:52:21 devstack sudo[107008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b0fb650b-8224-4733-9707-c4bce6b709da Sep 06 06:52:21 devstack sudo[107008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:52:21 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e87bb80-db5e-4ffa-a545-da9bc9464715 tempest-CinderUnicodeTest-1212770282 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87329) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 06:52:21 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-8e87bb80-db5e-4ffa-a545-da9bc9464715 tempest-CinderUnicodeTest-1212770282 None] Flow 'volume_create_manager' (961c0f57-ad52-4f27-bbd4-2c9532a3f359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:52:21 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-8e87bb80-db5e-4ffa-a545-da9bc9464715 tempest-CinderUnicodeTest-1212770282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8c53cd9-ad7c-481a-8570-3ed3f88329d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:52:21 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-8e87bb80-db5e-4ffa-a545-da9bc9464715 tempest-CinderUnicodeTest-1212770282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8c53cd9-ad7c-481a-8570-3ed3f88329d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:52:21Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-222315712',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd0a6909-8d3d-4631-8394-a1d2fc3ef97a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75066039df1547bebc862598e0ae1fe4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:52:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:52:22Z,use_quota=True,user_id='e0d2f48443b14bc4bc3e67960d2690b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:52:21 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-8e87bb80-db5e-4ffa-a545-da9bc9464715 tempest-CinderUnicodeTest-1212770282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21fdc612-9f19-4078-949f-00c74c417f80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:52:21 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-8e87bb80-db5e-4ffa-a545-da9bc9464715 tempest-CinderUnicodeTest-1212770282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21fdc612-9f19-4078-949f-00c74c417f80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:52:21 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-8e87bb80-db5e-4ffa-a545-da9bc9464715 tempest-CinderUnicodeTest-1212770282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70c2ed2a-a6bc-4efa-bdd2-f91b7cdbfc3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:52:21 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-8e87bb80-db5e-4ffa-a545-da9bc9464715 tempest-CinderUnicodeTest-1212770282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70c2ed2a-a6bc-4efa-bdd2-f91b7cdbfc3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd0a6909-8d3d-4631-8394-a1d2fc3ef97a', 'volume_name': 'volume-dd0a6909-8d3d-4631-8394-a1d2fc3ef97a', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:52:21 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-8e87bb80-db5e-4ffa-a545-da9bc9464715 tempest-CinderUnicodeTest-1212770282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0eab63e-3615-46bd-9011-c4c42523a661) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:52:21 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-8e87bb80-db5e-4ffa-a545-da9bc9464715 tempest-CinderUnicodeTest-1212770282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0eab63e-3615-46bd-9011-c4c42523a661) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:52:21 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-8e87bb80-db5e-4ffa-a545-da9bc9464715 tempest-CinderUnicodeTest-1212770282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25147963-c258-4cf1-95ec-2c80aee1a52c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:52:21 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-8e87bb80-db5e-4ffa-a545-da9bc9464715 tempest-CinderUnicodeTest-1212770282 None] Volume dd0a6909-8d3d-4631-8394-a1d2fc3ef97a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd0a6909-8d3d-4631-8394-a1d2fc3ef97a', 'volume_size': 1} Sep 06 06:52:21 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-8e87bb80-db5e-4ffa-a545-da9bc9464715 tempest-CinderUnicodeTest-1212770282 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:52:21 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-8e87bb80-db5e-4ffa-a545-da9bc9464715 tempest-CinderUnicodeTest-1212770282 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:52:21 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-8e87bb80-db5e-4ffa-a545-da9bc9464715 tempest-CinderUnicodeTest-1212770282 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:52:21Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-222315712',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd0a6909-8d3d-4631-8394-a1d2fc3ef97a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75066039df1547bebc862598e0ae1fe4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:52:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:52:22Z,use_quota=True,user_id='e0d2f48443b14bc4bc3e67960d2690b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)}" {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 06:52:21 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-8e87bb80-db5e-4ffa-a545-da9bc9464715 tempest-CinderUnicodeTest-1212770282 None] Creating volume dd0a6909-8d3d-4631-8394-a1d2fc3ef97a {{(pid=87329) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 06:52:21 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-8e87bb80-db5e-4ffa-a545-da9bc9464715 tempest-CinderUnicodeTest-1212770282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:52:21 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-8e87bb80-db5e-4ffa-a545-da9bc9464715 tempest-CinderUnicodeTest-1212770282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:52:21 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-8e87bb80-db5e-4ffa-a545-da9bc9464715 tempest-CinderUnicodeTest-1212770282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:52:21 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-8e87bb80-db5e-4ffa-a545-da9bc9464715 tempest-CinderUnicodeTest-1212770282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:52:21 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-8e87bb80-db5e-4ffa-a545-da9bc9464715 tempest-CinderUnicodeTest-1212770282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:52:21 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-8e87bb80-db5e-4ffa-a545-da9bc9464715 tempest-CinderUnicodeTest-1212770282 None] Selected osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 as target Quobyte volume. {{(pid=87329) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 06:52:21 devstack cinder-volume[87329]: INFO cinder.volume.drivers.remotefs [None req-8e87bb80-db5e-4ffa-a545-da9bc9464715 tempest-CinderUnicodeTest-1212770282 None] casted to osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 Sep 06 06:52:21 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-8e87bb80-db5e-4ffa-a545-da9bc9464715 tempest-CinderUnicodeTest-1212770282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-dd0a6909-8d3d-4631-8394-a1d2fc3ef97a 1073741824 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:52:21 devstack sudo[107010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-dd0a6909-8d3d-4631-8394-a1d2fc3ef97a 1073741824 Sep 06 06:52:21 devstack sudo[107010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:52:22 devstack sudo[107008]: pam_unix(sudo:session): session closed for user root Sep 06 06:52:22 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-aca49f82-77c2-497c-abc1-b981356d22f4 tempest-ProjectReaderTests-1566093849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b0fb650b-8224-4733-9707-c4bce6b709da" returned: 0 in 0.570s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:52:22 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-aca49f82-77c2-497c-abc1-b981356d22f4 tempest-ProjectReaderTests-1566093849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b0fb650b-8224-4733-9707-c4bce6b709da {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:52:22 devstack sudo[107015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b0fb650b-8224-4733-9707-c4bce6b709da Sep 06 06:52:22 devstack sudo[107015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:52:22 devstack sudo[107015]: pam_unix(sudo:session): session closed for user root Sep 06 06:52:22 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-aca49f82-77c2-497c-abc1-b981356d22f4 tempest-ProjectReaderTests-1566093849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-b0fb650b-8224-4733-9707-c4bce6b709da" returned: 0 in 0.323s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:52:22 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-aca49f82-77c2-497c-abc1-b981356d22f4 tempest-ProjectReaderTests-1566093849 None] Lock "cinder-quobyte-b0fb650b-8224-4733-9707-c4bce6b709da" released by "delete_volume" :: held 0.989s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:52:22 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-aca49f82-77c2-497c-abc1-b981356d22f4 tempest-ProjectReaderTests-1566093849 None] Created reservations ['cd4b3caf-505a-425a-8760-56d37efa424c', '99afedfe-af4f-4b18-802b-bcad30593c87', '580bf02e-a549-4c42-b533-7c267f11a1de', 'ee43a9f6-c7cd-4dd8-bae7-57c9711b4a67'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:52:22 devstack sudo[107010]: pam_unix(sudo:session): session closed for user root Sep 06 06:52:22 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-8e87bb80-db5e-4ffa-a545-da9bc9464715 tempest-CinderUnicodeTest-1212770282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-dd0a6909-8d3d-4631-8394-a1d2fc3ef97a 1073741824" returned: 0 in 0.638s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:52:22 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-8e87bb80-db5e-4ffa-a545-da9bc9464715 tempest-CinderUnicodeTest-1212770282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-dd0a6909-8d3d-4631-8394-a1d2fc3ef97a {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:52:22 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-aca49f82-77c2-497c-abc1-b981356d22f4 tempest-ProjectReaderTests-1566093849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:52:22 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-aca49f82-77c2-497c-abc1-b981356d22f4 tempest-ProjectReaderTests-1566093849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:52:22 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-aca49f82-77c2-497c-abc1-b981356d22f4 tempest-ProjectReaderTests-1566093849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:52:22 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-aca49f82-77c2-497c-abc1-b981356d22f4 tempest-ProjectReaderTests-1566093849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:52:22 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-aca49f82-77c2-497c-abc1-b981356d22f4 tempest-ProjectReaderTests-1566093849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:52:22 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-aca49f82-77c2-497c-abc1-b981356d22f4 tempest-ProjectReaderTests-1566093849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:52:22 devstack sudo[107022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-dd0a6909-8d3d-4631-8394-a1d2fc3ef97a Sep 06 06:52:22 devstack sudo[107022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:52:22 devstack sudo[107023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:52:22 devstack sudo[107023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:52:22 devstack sudo[107023]: pam_unix(sudo:session): session closed for user root Sep 06 06:52:22 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-aca49f82-77c2-497c-abc1-b981356d22f4 tempest-ProjectReaderTests-1566093849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.347s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:52:22 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-aca49f82-77c2-497c-abc1-b981356d22f4 tempest-ProjectReaderTests-1566093849 None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:52:22 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-aca49f82-77c2-497c-abc1-b981356d22f4 tempest-ProjectReaderTests-1566093849 None] Deleted volume successfully. Sep 06 06:52:22 devstack sudo[107022]: pam_unix(sudo:session): session closed for user root Sep 06 06:52:23 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-8e87bb80-db5e-4ffa-a545-da9bc9464715 tempest-CinderUnicodeTest-1212770282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-dd0a6909-8d3d-4631-8394-a1d2fc3ef97a" returned: 0 in 0.420s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:52:23 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-8e87bb80-db5e-4ffa-a545-da9bc9464715 tempest-CinderUnicodeTest-1212770282 None] <== create_volume: return (1139ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'} {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 06:52:23 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-8e87bb80-db5e-4ffa-a545-da9bc9464715 tempest-CinderUnicodeTest-1212770282 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.144s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:52:23 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-aca49f82-77c2-497c-abc1-b981356d22f4 tempest-ProjectReaderTests-1566093849 None] Lock "cinder-b0fb650b-8224-4733-9707-c4bce6b709da-delete_volume" released by "delete_volume" :: held 1.683s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:52:23 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-8e87bb80-db5e-4ffa-a545-da9bc9464715 tempest-CinderUnicodeTest-1212770282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25147963-c258-4cf1-95ec-2c80aee1a52c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd0a6909-8d3d-4631-8394-a1d2fc3ef97a', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:52:23 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-8e87bb80-db5e-4ffa-a545-da9bc9464715 tempest-CinderUnicodeTest-1212770282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b6304c5-4688-4958-83c3-ce279196b793) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:52:23 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-8e87bb80-db5e-4ffa-a545-da9bc9464715 tempest-CinderUnicodeTest-1212770282 None] Volume volume-dd0a6909-8d3d-4631-8394-a1d2fc3ef97a (dd0a6909-8d3d-4631-8394-a1d2fc3ef97a): created successfully Sep 06 06:52:23 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-8e87bb80-db5e-4ffa-a545-da9bc9464715 tempest-CinderUnicodeTest-1212770282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b6304c5-4688-4958-83c3-ce279196b793) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:52:23 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-8e87bb80-db5e-4ffa-a545-da9bc9464715 tempest-CinderUnicodeTest-1212770282 None] Flow 'volume_create_manager' (961c0f57-ad52-4f27-bbd4-2c9532a3f359) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:52:23 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-8e87bb80-db5e-4ffa-a545-da9bc9464715 tempest-CinderUnicodeTest-1212770282 None] Created volume successfully. Sep 06 06:52:23 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-32b1815f-515c-4590-b2eb-9c15b4b12752 tempest-CinderUnicodeTest-1212770282 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:52:23 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-32b1815f-515c-4590-b2eb-9c15b4b12752 tempest-CinderUnicodeTest-1212770282 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:52:23 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-32b1815f-515c-4590-b2eb-9c15b4b12752 tempest-CinderUnicodeTest-1212770282 None] Creating offline snapshot 7aca075a-d9b2-477e-a8fa-7b399a17f2f9 of volume dd0a6909-8d3d-4631-8394-a1d2fc3ef97a {{(pid=87329) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 06 06:52:23 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e79f7ac-8756-440c-9472-04a2d700f4e3]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:52:23 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-32b1815f-515c-4590-b2eb-9c15b4b12752 tempest-CinderUnicodeTest-1212770282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-dd0a6909-8d3d-4631-8394-a1d2fc3ef97a {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:52:24 devstack sudo[107028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-dd0a6909-8d3d-4631-8394-a1d2fc3ef97a Sep 06 06:52:24 devstack sudo[107028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:52:24 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-08cdad7e-57b4-4f98-b721-67220a879cce tempest-ProjectReaderTests-1566093849 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87329) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 06:52:24 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-08cdad7e-57b4-4f98-b721-67220a879cce tempest-ProjectReaderTests-1566093849 None] Flow 'volume_create_manager' (1f363910-72b0-4f79-803a-79d0f8964b20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:52:24 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-08cdad7e-57b4-4f98-b721-67220a879cce tempest-ProjectReaderTests-1566093849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5adec6f2-0888-4c88-a34b-7ea468fa7c17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:52:24 devstack sudo[107028]: pam_unix(sudo:session): session closed for user root Sep 06 06:52:24 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-32b1815f-515c-4590-b2eb-9c15b4b12752 tempest-CinderUnicodeTest-1212770282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-dd0a6909-8d3d-4631-8394-a1d2fc3ef97a" returned: 0 in 0.566s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:52:24 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-32b1815f-515c-4590-b2eb-9c15b4b12752 tempest-CinderUnicodeTest-1212770282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-dd0a6909-8d3d-4631-8394-a1d2fc3ef97a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-dd0a6909-8d3d-4631-8394-a1d2fc3ef97a.7aca075a-d9b2-477e-a8fa-7b399a17f2f9 1G {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:52:24 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-08cdad7e-57b4-4f98-b721-67220a879cce tempest-ProjectReaderTests-1566093849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5adec6f2-0888-4c88-a34b-7ea468fa7c17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:52:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1038052613',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4b67bb0-a527-48c2-b52a-18bce33d3394,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47b14cc477564406b2c85835936b99d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:52:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:52:24Z,use_quota=True,user_id='2bb3aa6913034422a07b16fa1477428f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:52:24 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-08cdad7e-57b4-4f98-b721-67220a879cce tempest-ProjectReaderTests-1566093849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71c4d565-aa83-4a76-9dae-5e90abf184c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:52:24 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-08cdad7e-57b4-4f98-b721-67220a879cce tempest-ProjectReaderTests-1566093849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71c4d565-aa83-4a76-9dae-5e90abf184c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:52:24 devstack sudo[107033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-dd0a6909-8d3d-4631-8394-a1d2fc3ef97a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-dd0a6909-8d3d-4631-8394-a1d2fc3ef97a.7aca075a-d9b2-477e-a8fa-7b399a17f2f9 1G Sep 06 06:52:24 devstack sudo[107033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:52:24 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-08cdad7e-57b4-4f98-b721-67220a879cce tempest-ProjectReaderTests-1566093849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba555262-7bf4-4866-8a2a-78c2b2eb7bce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:52:24 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-08cdad7e-57b4-4f98-b721-67220a879cce tempest-ProjectReaderTests-1566093849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba555262-7bf4-4866-8a2a-78c2b2eb7bce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4b67bb0-a527-48c2-b52a-18bce33d3394', 'volume_name': 'volume-d4b67bb0-a527-48c2-b52a-18bce33d3394', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:52:24 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-08cdad7e-57b4-4f98-b721-67220a879cce tempest-ProjectReaderTests-1566093849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f52dffd-4507-430e-b883-58a05fa81855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:52:24 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-08cdad7e-57b4-4f98-b721-67220a879cce tempest-ProjectReaderTests-1566093849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f52dffd-4507-430e-b883-58a05fa81855) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:52:24 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-08cdad7e-57b4-4f98-b721-67220a879cce tempest-ProjectReaderTests-1566093849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c0205c2-967b-4348-871b-4a8edec6d6f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:52:24 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-08cdad7e-57b4-4f98-b721-67220a879cce tempest-ProjectReaderTests-1566093849 None] Volume d4b67bb0-a527-48c2-b52a-18bce33d3394: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4b67bb0-a527-48c2-b52a-18bce33d3394', 'volume_size': 1} Sep 06 06:52:24 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-08cdad7e-57b4-4f98-b721-67220a879cce tempest-ProjectReaderTests-1566093849 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:52:24 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a7c432b-3678-4725-aad7-e0cfec50de23 tempest-SnapshotDependencyTests-1896093265 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87329) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 06:52:24 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-9a7c432b-3678-4725-aad7-e0cfec50de23 tempest-SnapshotDependencyTests-1896093265 None] Flow 'volume_create_manager' (421a9dc5-21b7-49c3-820a-8a82b33a83b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:52:24 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-9a7c432b-3678-4725-aad7-e0cfec50de23 tempest-SnapshotDependencyTests-1896093265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fa136ac-adf3-4c89-8da3-7c6974bd78c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:52:24 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-9a7c432b-3678-4725-aad7-e0cfec50de23 tempest-SnapshotDependencyTests-1896093265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fa136ac-adf3-4c89-8da3-7c6974bd78c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:52:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-440663273',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e06a97bd-6ce9-49ef-8f1b-8469f31060fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6646d5625b8a4bf6b08fa2f37f1ef662',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:52:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:52:25Z,use_quota=True,user_id='9ffe18145c90463c86e414a6c44e4f4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:52:24 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-9a7c432b-3678-4725-aad7-e0cfec50de23 tempest-SnapshotDependencyTests-1896093265 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (430b7cac-0283-4fa9-ba3b-20ad5d32b63d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:52:24 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-9a7c432b-3678-4725-aad7-e0cfec50de23 tempest-SnapshotDependencyTests-1896093265 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (430b7cac-0283-4fa9-ba3b-20ad5d32b63d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:52:24 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-9a7c432b-3678-4725-aad7-e0cfec50de23 tempest-SnapshotDependencyTests-1896093265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2db9637f-b22c-430d-b97a-ab1df87620d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:52:24 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-9a7c432b-3678-4725-aad7-e0cfec50de23 tempest-SnapshotDependencyTests-1896093265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2db9637f-b22c-430d-b97a-ab1df87620d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e06a97bd-6ce9-49ef-8f1b-8469f31060fe', 'volume_name': 'volume-e06a97bd-6ce9-49ef-8f1b-8469f31060fe', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:52:24 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-9a7c432b-3678-4725-aad7-e0cfec50de23 tempest-SnapshotDependencyTests-1896093265 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ad7badd-1217-4817-adc4-8795515217ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:52:24 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-9a7c432b-3678-4725-aad7-e0cfec50de23 tempest-SnapshotDependencyTests-1896093265 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ad7badd-1217-4817-adc4-8795515217ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:52:24 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-9a7c432b-3678-4725-aad7-e0cfec50de23 tempest-SnapshotDependencyTests-1896093265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (016f64df-b41d-41ba-85b9-c3f1ab910eb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:52:24 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-9a7c432b-3678-4725-aad7-e0cfec50de23 tempest-SnapshotDependencyTests-1896093265 None] Volume e06a97bd-6ce9-49ef-8f1b-8469f31060fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e06a97bd-6ce9-49ef-8f1b-8469f31060fe', 'volume_size': 1} Sep 06 06:52:24 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-9a7c432b-3678-4725-aad7-e0cfec50de23 tempest-SnapshotDependencyTests-1896093265 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:52:24 devstack sudo[107033]: pam_unix(sudo:session): session closed for user root Sep 06 06:52:24 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-32b1815f-515c-4590-b2eb-9c15b4b12752 tempest-CinderUnicodeTest-1212770282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-dd0a6909-8d3d-4631-8394-a1d2fc3ef97a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-dd0a6909-8d3d-4631-8394-a1d2fc3ef97a.7aca075a-d9b2-477e-a8fa-7b399a17f2f9 1G" returned: 0 in 0.573s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:52:24 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-32b1815f-515c-4590-b2eb-9c15b4b12752 tempest-CinderUnicodeTest-1212770282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dd0a6909-8d3d-4631-8394-a1d2fc3ef97a -F qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-dd0a6909-8d3d-4631-8394-a1d2fc3ef97a.7aca075a-d9b2-477e-a8fa-7b399a17f2f9 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:52:25 devstack sudo[107038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dd0a6909-8d3d-4631-8394-a1d2fc3ef97a -F qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-dd0a6909-8d3d-4631-8394-a1d2fc3ef97a.7aca075a-d9b2-477e-a8fa-7b399a17f2f9 Sep 06 06:52:25 devstack sudo[107038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:52:25 devstack sudo[107038]: pam_unix(sudo:session): session closed for user root Sep 06 06:52:25 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-32b1815f-515c-4590-b2eb-9c15b4b12752 tempest-CinderUnicodeTest-1212770282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dd0a6909-8d3d-4631-8394-a1d2fc3ef97a -F qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-dd0a6909-8d3d-4631-8394-a1d2fc3ef97a.7aca075a-d9b2-477e-a8fa-7b399a17f2f9" returned: 0 in 0.321s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:52:25 devstack cinder-volume[87329]: WARNING cinder.volume.drivers.remotefs [None req-32b1815f-515c-4590-b2eb-9c15b4b12752 tempest-CinderUnicodeTest-1212770282 None] /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-dd0a6909-8d3d-4631-8394-a1d2fc3ef97a.7aca075a-d9b2-477e-a8fa-7b399a17f2f9 is being set with open permissions: ugo+rw Sep 06 06:52:25 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-32b1815f-515c-4590-b2eb-9c15b4b12752 tempest-CinderUnicodeTest-1212770282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-dd0a6909-8d3d-4631-8394-a1d2fc3ef97a.7aca075a-d9b2-477e-a8fa-7b399a17f2f9 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:52:25 devstack sudo[107044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-dd0a6909-8d3d-4631-8394-a1d2fc3ef97a.7aca075a-d9b2-477e-a8fa-7b399a17f2f9 Sep 06 06:52:25 devstack sudo[107044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:52:25 devstack sudo[107044]: pam_unix(sudo:session): session closed for user root Sep 06 06:52:25 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-32b1815f-515c-4590-b2eb-9c15b4b12752 tempest-CinderUnicodeTest-1212770282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-dd0a6909-8d3d-4631-8394-a1d2fc3ef97a.7aca075a-d9b2-477e-a8fa-7b399a17f2f9" returned: 0 in 0.262s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:52:25 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-32b1815f-515c-4590-b2eb-9c15b4b12752 tempest-CinderUnicodeTest-1212770282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-dd0a6909-8d3d-4631-8394-a1d2fc3ef97a.info {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:52:25 devstack sudo[107047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-dd0a6909-8d3d-4631-8394-a1d2fc3ef97a.info Sep 06 06:52:25 devstack sudo[107047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:52:25 devstack sudo[107047]: pam_unix(sudo:session): session closed for user root Sep 06 06:52:25 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-32b1815f-515c-4590-b2eb-9c15b4b12752 tempest-CinderUnicodeTest-1212770282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-dd0a6909-8d3d-4631-8394-a1d2fc3ef97a.info" returned: 0 in 0.258s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:52:25 devstack cinder-volume[87329]: WARNING cinder.volume.drivers.remotefs [None req-32b1815f-515c-4590-b2eb-9c15b4b12752 tempest-CinderUnicodeTest-1212770282 None] /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-dd0a6909-8d3d-4631-8394-a1d2fc3ef97a.info is being set with open permissions: ugo+rw Sep 06 06:52:25 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-32b1815f-515c-4590-b2eb-9c15b4b12752 tempest-CinderUnicodeTest-1212770282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-dd0a6909-8d3d-4631-8394-a1d2fc3ef97a.info {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:52:25 devstack sudo[107050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-dd0a6909-8d3d-4631-8394-a1d2fc3ef97a.info Sep 06 06:52:25 devstack sudo[107050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:52:26 devstack sudo[107050]: pam_unix(sudo:session): session closed for user root Sep 06 06:52:26 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-32b1815f-515c-4590-b2eb-9c15b4b12752 tempest-CinderUnicodeTest-1212770282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-dd0a6909-8d3d-4631-8394-a1d2fc3ef97a.info" returned: 0 in 0.258s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:52:26 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-32b1815f-515c-4590-b2eb-9c15b4b12752 tempest-CinderUnicodeTest-1212770282 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.339s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:52:26 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-08cdad7e-57b4-4f98-b721-67220a879cce tempest-ProjectReaderTests-1566093849 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.659s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:52:26 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-08cdad7e-57b4-4f98-b721-67220a879cce tempest-ProjectReaderTests-1566093849 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:52:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1038052613',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4b67bb0-a527-48c2-b52a-18bce33d3394,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47b14cc477564406b2c85835936b99d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:52:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:52:24Z,use_quota=True,user_id='2bb3aa6913034422a07b16fa1477428f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)}" {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 06:52:26 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-08cdad7e-57b4-4f98-b721-67220a879cce tempest-ProjectReaderTests-1566093849 None] Creating volume d4b67bb0-a527-48c2-b52a-18bce33d3394 {{(pid=87329) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 06:52:26 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-08cdad7e-57b4-4f98-b721-67220a879cce tempest-ProjectReaderTests-1566093849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:52:26 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-08cdad7e-57b4-4f98-b721-67220a879cce tempest-ProjectReaderTests-1566093849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:52:26 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-08cdad7e-57b4-4f98-b721-67220a879cce tempest-ProjectReaderTests-1566093849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:52:26 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-08cdad7e-57b4-4f98-b721-67220a879cce tempest-ProjectReaderTests-1566093849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:52:26 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-08cdad7e-57b4-4f98-b721-67220a879cce tempest-ProjectReaderTests-1566093849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:52:26 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-08cdad7e-57b4-4f98-b721-67220a879cce tempest-ProjectReaderTests-1566093849 None] Selected osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 as target Quobyte volume. {{(pid=87329) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 06:52:26 devstack cinder-volume[87329]: INFO cinder.volume.drivers.remotefs [None req-08cdad7e-57b4-4f98-b721-67220a879cce tempest-ProjectReaderTests-1566093849 None] casted to osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 Sep 06 06:52:26 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-08cdad7e-57b4-4f98-b721-67220a879cce tempest-ProjectReaderTests-1566093849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-d4b67bb0-a527-48c2-b52a-18bce33d3394 1073741824 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:52:26 devstack sudo[107053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-d4b67bb0-a527-48c2-b52a-18bce33d3394 1073741824 Sep 06 06:52:26 devstack sudo[107053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:52:26 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-32b1815f-515c-4590-b2eb-9c15b4b12752 tempest-CinderUnicodeTest-1212770282 None] Create snapshot completed successfully Sep 06 06:52:26 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-70ae60c6-d872-4f4c-9095-8dccc3d2e1cc tempest-CinderUnicodeTest-1212770282 None] Acquiring lock "cinder-7aca075a-d9b2-477e-a8fa-7b399a17f2f9-delete_snapshot" by "delete_snapshot" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:52:26 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-70ae60c6-d872-4f4c-9095-8dccc3d2e1cc tempest-CinderUnicodeTest-1212770282 None] Lock "cinder-7aca075a-d9b2-477e-a8fa-7b399a17f2f9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:52:26 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-70ae60c6-d872-4f4c-9095-8dccc3d2e1cc tempest-CinderUnicodeTest-1212770282 None] Acquiring lock "cinder-quobyte-dd0a6909-8d3d-4631-8394-a1d2fc3ef97a" by "delete_snapshot" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:52:26 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-70ae60c6-d872-4f4c-9095-8dccc3d2e1cc tempest-CinderUnicodeTest-1212770282 None] Lock "cinder-quobyte-dd0a6909-8d3d-4631-8394-a1d2fc3ef97a" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:52:26 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-70ae60c6-d872-4f4c-9095-8dccc3d2e1cc tempest-CinderUnicodeTest-1212770282 None] Acquiring lock "cinder-quobyte-7aca075a-d9b2-477e-a8fa-7b399a17f2f9" by "_delete_snapshot" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:52:26 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-70ae60c6-d872-4f4c-9095-8dccc3d2e1cc tempest-CinderUnicodeTest-1212770282 None] Lock "cinder-quobyte-7aca075a-d9b2-477e-a8fa-7b399a17f2f9" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:52:26 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-70ae60c6-d872-4f4c-9095-8dccc3d2e1cc tempest-CinderUnicodeTest-1212770282 None] Deleting offline snapshot 7aca075a-d9b2-477e-a8fa-7b399a17f2f9 of volume dd0a6909-8d3d-4631-8394-a1d2fc3ef97a {{(pid=87329) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 06 06:52:26 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-70ae60c6-d872-4f4c-9095-8dccc3d2e1cc tempest-CinderUnicodeTest-1212770282 None] snapshot_file for this snap is: volume-dd0a6909-8d3d-4631-8394-a1d2fc3ef97a.7aca075a-d9b2-477e-a8fa-7b399a17f2f9 {{(pid=87329) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 06 06:52:26 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb0ce935-4fcd-4ce3-b9db-5cb3917d1cfe]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:52:26 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-70ae60c6-d872-4f4c-9095-8dccc3d2e1cc tempest-CinderUnicodeTest-1212770282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-dd0a6909-8d3d-4631-8394-a1d2fc3ef97a.7aca075a-d9b2-477e-a8fa-7b399a17f2f9 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:52:26 devstack sudo[107058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-dd0a6909-8d3d-4631-8394-a1d2fc3ef97a.7aca075a-d9b2-477e-a8fa-7b399a17f2f9 Sep 06 06:52:26 devstack sudo[107058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:52:26 devstack sudo[107053]: pam_unix(sudo:session): session closed for user root Sep 06 06:52:26 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-08cdad7e-57b4-4f98-b721-67220a879cce tempest-ProjectReaderTests-1566093849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-d4b67bb0-a527-48c2-b52a-18bce33d3394 1073741824" returned: 0 in 0.506s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:52:26 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-08cdad7e-57b4-4f98-b721-67220a879cce tempest-ProjectReaderTests-1566093849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-d4b67bb0-a527-48c2-b52a-18bce33d3394 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:52:26 devstack sudo[107061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-d4b67bb0-a527-48c2-b52a-18bce33d3394 Sep 06 06:52:26 devstack sudo[107061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:52:26 devstack sudo[107058]: pam_unix(sudo:session): session closed for user root Sep 06 06:52:26 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-70ae60c6-d872-4f4c-9095-8dccc3d2e1cc tempest-CinderUnicodeTest-1212770282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-dd0a6909-8d3d-4631-8394-a1d2fc3ef97a.7aca075a-d9b2-477e-a8fa-7b399a17f2f9" returned: 0 in 0.417s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:52:26 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-70ae60c6-d872-4f4c-9095-8dccc3d2e1cc tempest-CinderUnicodeTest-1212770282 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dd0a6909-8d3d-4631-8394-a1d2fc3ef97a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87329) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 06:52:26 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[f633b88e-e647-40ec-b663-eacac4c85fa1]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:52:26 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-70ae60c6-d872-4f4c-9095-8dccc3d2e1cc tempest-CinderUnicodeTest-1212770282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-dd0a6909-8d3d-4631-8394-a1d2fc3ef97a {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:52:26 devstack sudo[107061]: pam_unix(sudo:session): session closed for user root Sep 06 06:52:26 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-08cdad7e-57b4-4f98-b721-67220a879cce tempest-ProjectReaderTests-1566093849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-d4b67bb0-a527-48c2-b52a-18bce33d3394" returned: 0 in 0.283s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:52:26 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-08cdad7e-57b4-4f98-b721-67220a879cce tempest-ProjectReaderTests-1566093849 None] <== create_volume: return (832ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'} {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 06:52:26 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-08cdad7e-57b4-4f98-b721-67220a879cce tempest-ProjectReaderTests-1566093849 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.836s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:52:26 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-9a7c432b-3678-4725-aad7-e0cfec50de23 tempest-SnapshotDependencyTests-1896093265 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.049s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:52:26 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-9a7c432b-3678-4725-aad7-e0cfec50de23 tempest-SnapshotDependencyTests-1896093265 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:52:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-440663273',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e06a97bd-6ce9-49ef-8f1b-8469f31060fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6646d5625b8a4bf6b08fa2f37f1ef662',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:52:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:52:25Z,use_quota=True,user_id='9ffe18145c90463c86e414a6c44e4f4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)}" {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 06:52:26 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-9a7c432b-3678-4725-aad7-e0cfec50de23 tempest-SnapshotDependencyTests-1896093265 None] Creating volume e06a97bd-6ce9-49ef-8f1b-8469f31060fe {{(pid=87329) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 06:52:27 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-9a7c432b-3678-4725-aad7-e0cfec50de23 tempest-SnapshotDependencyTests-1896093265 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:52:27 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-9a7c432b-3678-4725-aad7-e0cfec50de23 tempest-SnapshotDependencyTests-1896093265 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:52:27 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-9a7c432b-3678-4725-aad7-e0cfec50de23 tempest-SnapshotDependencyTests-1896093265 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:52:27 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-9a7c432b-3678-4725-aad7-e0cfec50de23 tempest-SnapshotDependencyTests-1896093265 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:52:27 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-9a7c432b-3678-4725-aad7-e0cfec50de23 tempest-SnapshotDependencyTests-1896093265 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:52:27 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-9a7c432b-3678-4725-aad7-e0cfec50de23 tempest-SnapshotDependencyTests-1896093265 None] Selected osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 as target Quobyte volume. {{(pid=87329) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 06:52:27 devstack cinder-volume[87329]: INFO cinder.volume.drivers.remotefs [None req-9a7c432b-3678-4725-aad7-e0cfec50de23 tempest-SnapshotDependencyTests-1896093265 None] casted to osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 Sep 06 06:52:27 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-9a7c432b-3678-4725-aad7-e0cfec50de23 tempest-SnapshotDependencyTests-1896093265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e06a97bd-6ce9-49ef-8f1b-8469f31060fe 1073741824 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:52:27 devstack sudo[107066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-dd0a6909-8d3d-4631-8394-a1d2fc3ef97a Sep 06 06:52:27 devstack sudo[107066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:52:27 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-08cdad7e-57b4-4f98-b721-67220a879cce tempest-ProjectReaderTests-1566093849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c0205c2-967b-4348-871b-4a8edec6d6f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4b67bb0-a527-48c2-b52a-18bce33d3394', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:52:27 devstack sudo[107068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e06a97bd-6ce9-49ef-8f1b-8469f31060fe 1073741824 Sep 06 06:52:27 devstack sudo[107068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:52:27 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-08cdad7e-57b4-4f98-b721-67220a879cce tempest-ProjectReaderTests-1566093849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a03d8f7-dabf-437b-9254-b4a0a72e131d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:52:27 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-08cdad7e-57b4-4f98-b721-67220a879cce tempest-ProjectReaderTests-1566093849 None] Volume volume-d4b67bb0-a527-48c2-b52a-18bce33d3394 (d4b67bb0-a527-48c2-b52a-18bce33d3394): created successfully Sep 06 06:52:27 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-08cdad7e-57b4-4f98-b721-67220a879cce tempest-ProjectReaderTests-1566093849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a03d8f7-dabf-437b-9254-b4a0a72e131d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:52:27 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-08cdad7e-57b4-4f98-b721-67220a879cce tempest-ProjectReaderTests-1566093849 None] Flow 'volume_create_manager' (1f363910-72b0-4f79-803a-79d0f8964b20) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:52:27 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-08cdad7e-57b4-4f98-b721-67220a879cce tempest-ProjectReaderTests-1566093849 None] Created volume successfully. Sep 06 06:52:27 devstack sudo[107066]: pam_unix(sudo:session): session closed for user root Sep 06 06:52:27 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-70ae60c6-d872-4f4c-9095-8dccc3d2e1cc tempest-CinderUnicodeTest-1212770282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-dd0a6909-8d3d-4631-8394-a1d2fc3ef97a" returned: 0 in 0.387s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:52:27 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-70ae60c6-d872-4f4c-9095-8dccc3d2e1cc tempest-CinderUnicodeTest-1212770282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-dd0a6909-8d3d-4631-8394-a1d2fc3ef97a.7aca075a-d9b2-477e-a8fa-7b399a17f2f9 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:52:27 devstack sudo[107077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-dd0a6909-8d3d-4631-8394-a1d2fc3ef97a.7aca075a-d9b2-477e-a8fa-7b399a17f2f9 Sep 06 06:52:27 devstack sudo[107077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:52:27 devstack sudo[107068]: pam_unix(sudo:session): session closed for user root Sep 06 06:52:27 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-9a7c432b-3678-4725-aad7-e0cfec50de23 tempest-SnapshotDependencyTests-1896093265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e06a97bd-6ce9-49ef-8f1b-8469f31060fe 1073741824" returned: 0 in 0.515s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:52:27 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-9a7c432b-3678-4725-aad7-e0cfec50de23 tempest-SnapshotDependencyTests-1896093265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e06a97bd-6ce9-49ef-8f1b-8469f31060fe {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:52:27 devstack sudo[107081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e06a97bd-6ce9-49ef-8f1b-8469f31060fe Sep 06 06:52:27 devstack sudo[107081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:52:27 devstack sudo[107077]: pam_unix(sudo:session): session closed for user root Sep 06 06:52:27 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-70ae60c6-d872-4f4c-9095-8dccc3d2e1cc tempest-CinderUnicodeTest-1212770282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-dd0a6909-8d3d-4631-8394-a1d2fc3ef97a.7aca075a-d9b2-477e-a8fa-7b399a17f2f9" returned: 0 in 0.411s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:52:27 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-70ae60c6-d872-4f4c-9095-8dccc3d2e1cc tempest-CinderUnicodeTest-1212770282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-dd0a6909-8d3d-4631-8394-a1d2fc3ef97a.7aca075a-d9b2-477e-a8fa-7b399a17f2f9 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:52:27 devstack sudo[107085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-dd0a6909-8d3d-4631-8394-a1d2fc3ef97a.7aca075a-d9b2-477e-a8fa-7b399a17f2f9 Sep 06 06:52:27 devstack sudo[107085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:52:27 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-79550e83-fd78-4bcc-ad8a-ffcf03506b1a tempest-ProjectReaderTests-1566093849 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:52:27 devstack sudo[107081]: pam_unix(sudo:session): session closed for user root Sep 06 06:52:27 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-9a7c432b-3678-4725-aad7-e0cfec50de23 tempest-SnapshotDependencyTests-1896093265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e06a97bd-6ce9-49ef-8f1b-8469f31060fe" returned: 0 in 0.293s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:52:27 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-9a7c432b-3678-4725-aad7-e0cfec50de23 tempest-SnapshotDependencyTests-1896093265 None] <== create_volume: return (857ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'} {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 06:52:27 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-9a7c432b-3678-4725-aad7-e0cfec50de23 tempest-SnapshotDependencyTests-1896093265 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.860s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:52:27 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-79550e83-fd78-4bcc-ad8a-ffcf03506b1a tempest-ProjectReaderTests-1566093849 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.062s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:52:27 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-9a7c432b-3678-4725-aad7-e0cfec50de23 tempest-SnapshotDependencyTests-1896093265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (016f64df-b41d-41ba-85b9-c3f1ab910eb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e06a97bd-6ce9-49ef-8f1b-8469f31060fe', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:52:27 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-9a7c432b-3678-4725-aad7-e0cfec50de23 tempest-SnapshotDependencyTests-1896093265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75f418c1-2fda-4be9-a6a1-c4c20ec673db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:52:27 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-79550e83-fd78-4bcc-ad8a-ffcf03506b1a tempest-ProjectReaderTests-1566093849 None] Creating offline snapshot 27716bed-0b79-4487-8eec-caf167a9992e of volume d4b67bb0-a527-48c2-b52a-18bce33d3394 {{(pid=87329) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 06 06:52:27 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-9a7c432b-3678-4725-aad7-e0cfec50de23 tempest-SnapshotDependencyTests-1896093265 None] Volume volume-e06a97bd-6ce9-49ef-8f1b-8469f31060fe (e06a97bd-6ce9-49ef-8f1b-8469f31060fe): created successfully Sep 06 06:52:27 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-9a7c432b-3678-4725-aad7-e0cfec50de23 tempest-SnapshotDependencyTests-1896093265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75f418c1-2fda-4be9-a6a1-c4c20ec673db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:52:27 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-9a7c432b-3678-4725-aad7-e0cfec50de23 tempest-SnapshotDependencyTests-1896093265 None] Flow 'volume_create_manager' (421a9dc5-21b7-49c3-820a-8a82b33a83b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:52:27 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[c296ded0-c9c4-4332-97dd-621a672e5f3f]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:52:27 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-79550e83-fd78-4bcc-ad8a-ffcf03506b1a tempest-ProjectReaderTests-1566093849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-d4b67bb0-a527-48c2-b52a-18bce33d3394 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:52:27 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-9a7c432b-3678-4725-aad7-e0cfec50de23 tempest-SnapshotDependencyTests-1896093265 None] Created volume successfully. Sep 06 06:52:27 devstack sudo[107085]: pam_unix(sudo:session): session closed for user root Sep 06 06:52:27 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-70ae60c6-d872-4f4c-9095-8dccc3d2e1cc tempest-CinderUnicodeTest-1212770282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-dd0a6909-8d3d-4631-8394-a1d2fc3ef97a.7aca075a-d9b2-477e-a8fa-7b399a17f2f9" returned: 0 in 0.269s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:52:28 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-70ae60c6-d872-4f4c-9095-8dccc3d2e1cc tempest-CinderUnicodeTest-1212770282 None] Lock "cinder-quobyte-7aca075a-d9b2-477e-a8fa-7b399a17f2f9" released by "_delete_snapshot" :: held 1.601s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:52:28 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-70ae60c6-d872-4f4c-9095-8dccc3d2e1cc tempest-CinderUnicodeTest-1212770282 None] Lock "cinder-quobyte-dd0a6909-8d3d-4631-8394-a1d2fc3ef97a" released by "delete_snapshot" :: held 1.626s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:52:28 devstack sudo[107089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-d4b67bb0-a527-48c2-b52a-18bce33d3394 Sep 06 06:52:28 devstack sudo[107089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:52:28 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-70ae60c6-d872-4f4c-9095-8dccc3d2e1cc tempest-CinderUnicodeTest-1212770282 None] Created reservations ['691d1c89-1830-4928-9272-ae30fd0b1d43', '39e2a2ae-4540-4b82-9202-4fca630c9fc8', 'a872dd8f-839d-4d7a-89a2-3d096926254a', '5767a260-48b4-48dd-a146-7a13f3fcc980'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:52:28 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-70ae60c6-d872-4f4c-9095-8dccc3d2e1cc tempest-CinderUnicodeTest-1212770282 None] Delete snapshot completed successfully. Sep 06 06:52:28 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-70ae60c6-d872-4f4c-9095-8dccc3d2e1cc tempest-CinderUnicodeTest-1212770282 None] Lock "cinder-7aca075a-d9b2-477e-a8fa-7b399a17f2f9-delete_snapshot" released by "delete_snapshot" :: held 1.760s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:52:28 devstack sudo[107089]: pam_unix(sudo:session): session closed for user root Sep 06 06:52:28 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-79550e83-fd78-4bcc-ad8a-ffcf03506b1a tempest-ProjectReaderTests-1566093849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-d4b67bb0-a527-48c2-b52a-18bce33d3394" returned: 0 in 0.355s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:52:28 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-79550e83-fd78-4bcc-ad8a-ffcf03506b1a tempest-ProjectReaderTests-1566093849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-d4b67bb0-a527-48c2-b52a-18bce33d3394,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-d4b67bb0-a527-48c2-b52a-18bce33d3394.27716bed-0b79-4487-8eec-caf167a9992e 1G {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:52:28 devstack sudo[107094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-d4b67bb0-a527-48c2-b52a-18bce33d3394,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-d4b67bb0-a527-48c2-b52a-18bce33d3394.27716bed-0b79-4487-8eec-caf167a9992e 1G Sep 06 06:52:28 devstack sudo[107094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:52:28 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-6e77afa1-5e29-466e-9bfb-b96791159c19 tempest-CinderUnicodeTest-1212770282 None] Acquiring lock "cinder-dd0a6909-8d3d-4631-8394-a1d2fc3ef97a-delete_volume" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:52:28 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-6e77afa1-5e29-466e-9bfb-b96791159c19 tempest-CinderUnicodeTest-1212770282 None] Lock "cinder-dd0a6909-8d3d-4631-8394-a1d2fc3ef97a-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:52:28 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-6e77afa1-5e29-466e-9bfb-b96791159c19 tempest-CinderUnicodeTest-1212770282 None] Acquiring lock "cinder-quobyte-dd0a6909-8d3d-4631-8394-a1d2fc3ef97a" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:52:28 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-6e77afa1-5e29-466e-9bfb-b96791159c19 tempest-CinderUnicodeTest-1212770282 None] Lock "cinder-quobyte-dd0a6909-8d3d-4631-8394-a1d2fc3ef97a" acquired by "delete_volume" :: waited 0.017s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:52:28 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca69a480-6de6-4ca7-90c2-374547dfb455]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:52:28 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-6e77afa1-5e29-466e-9bfb-b96791159c19 tempest-CinderUnicodeTest-1212770282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-dd0a6909-8d3d-4631-8394-a1d2fc3ef97a {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:52:28 devstack sudo[107094]: pam_unix(sudo:session): session closed for user root Sep 06 06:52:28 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-79550e83-fd78-4bcc-ad8a-ffcf03506b1a tempest-ProjectReaderTests-1566093849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-d4b67bb0-a527-48c2-b52a-18bce33d3394,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-d4b67bb0-a527-48c2-b52a-18bce33d3394.27716bed-0b79-4487-8eec-caf167a9992e 1G" returned: 0 in 0.440s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:52:28 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-79550e83-fd78-4bcc-ad8a-ffcf03506b1a tempest-ProjectReaderTests-1566093849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d4b67bb0-a527-48c2-b52a-18bce33d3394 -F qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-d4b67bb0-a527-48c2-b52a-18bce33d3394.27716bed-0b79-4487-8eec-caf167a9992e {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:52:28 devstack sudo[107101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d4b67bb0-a527-48c2-b52a-18bce33d3394 -F qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-d4b67bb0-a527-48c2-b52a-18bce33d3394.27716bed-0b79-4487-8eec-caf167a9992e Sep 06 06:52:28 devstack sudo[107101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:52:28 devstack sudo[107100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-dd0a6909-8d3d-4631-8394-a1d2fc3ef97a Sep 06 06:52:28 devstack sudo[107100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:52:29 devstack sudo[107100]: pam_unix(sudo:session): session closed for user root Sep 06 06:52:29 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-6e77afa1-5e29-466e-9bfb-b96791159c19 tempest-CinderUnicodeTest-1212770282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-dd0a6909-8d3d-4631-8394-a1d2fc3ef97a" returned: 0 in 0.425s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:52:29 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-6e77afa1-5e29-466e-9bfb-b96791159c19 tempest-CinderUnicodeTest-1212770282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-dd0a6909-8d3d-4631-8394-a1d2fc3ef97a {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:52:29 devstack sudo[107101]: pam_unix(sudo:session): session closed for user root Sep 06 06:52:29 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-79550e83-fd78-4bcc-ad8a-ffcf03506b1a tempest-ProjectReaderTests-1566093849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d4b67bb0-a527-48c2-b52a-18bce33d3394 -F qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-d4b67bb0-a527-48c2-b52a-18bce33d3394.27716bed-0b79-4487-8eec-caf167a9992e" returned: 0 in 0.350s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:52:29 devstack cinder-volume[87329]: WARNING cinder.volume.drivers.remotefs [None req-79550e83-fd78-4bcc-ad8a-ffcf03506b1a tempest-ProjectReaderTests-1566093849 None] /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-d4b67bb0-a527-48c2-b52a-18bce33d3394.27716bed-0b79-4487-8eec-caf167a9992e is being set with open permissions: ugo+rw Sep 06 06:52:29 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-79550e83-fd78-4bcc-ad8a-ffcf03506b1a tempest-ProjectReaderTests-1566093849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-d4b67bb0-a527-48c2-b52a-18bce33d3394.27716bed-0b79-4487-8eec-caf167a9992e {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:52:29 devstack sudo[107110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-dd0a6909-8d3d-4631-8394-a1d2fc3ef97a Sep 06 06:52:29 devstack sudo[107110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:52:29 devstack sudo[107111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-d4b67bb0-a527-48c2-b52a-18bce33d3394.27716bed-0b79-4487-8eec-caf167a9992e Sep 06 06:52:29 devstack sudo[107111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:52:29 devstack sudo[107111]: pam_unix(sudo:session): session closed for user root Sep 06 06:52:29 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-79550e83-fd78-4bcc-ad8a-ffcf03506b1a tempest-ProjectReaderTests-1566093849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-d4b67bb0-a527-48c2-b52a-18bce33d3394.27716bed-0b79-4487-8eec-caf167a9992e" returned: 0 in 0.312s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:52:29 devstack sudo[107110]: pam_unix(sudo:session): session closed for user root Sep 06 06:52:29 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-0eed0b7c-960c-457a-ab66-a6b9e335d218 tempest-SnapshotDependencyTests-1896093265 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:52:29 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-6e77afa1-5e29-466e-9bfb-b96791159c19 tempest-CinderUnicodeTest-1212770282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-dd0a6909-8d3d-4631-8394-a1d2fc3ef97a" returned: 0 in 0.344s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:52:29 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-6e77afa1-5e29-466e-9bfb-b96791159c19 tempest-CinderUnicodeTest-1212770282 None] Lock "cinder-quobyte-dd0a6909-8d3d-4631-8394-a1d2fc3ef97a" released by "delete_volume" :: held 0.828s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:52:29 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-79550e83-fd78-4bcc-ad8a-ffcf03506b1a tempest-ProjectReaderTests-1566093849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-d4b67bb0-a527-48c2-b52a-18bce33d3394.info {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:52:29 devstack sudo[107116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-d4b67bb0-a527-48c2-b52a-18bce33d3394.info Sep 06 06:52:29 devstack sudo[107116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:52:29 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-6e77afa1-5e29-466e-9bfb-b96791159c19 tempest-CinderUnicodeTest-1212770282 None] Created reservations ['b1c4fcc6-1b0d-4318-9ec0-d434c6efb626', '4f7b859e-b1b6-4d52-b08c-0324466e2682', '9872ab88-805a-4fc2-9cd7-332dcab3d85f', '6f69c201-28e6-4e36-878b-28e59306d721'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:52:29 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-6e77afa1-5e29-466e-9bfb-b96791159c19 tempest-CinderUnicodeTest-1212770282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:52:29 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-6e77afa1-5e29-466e-9bfb-b96791159c19 tempest-CinderUnicodeTest-1212770282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:52:29 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-6e77afa1-5e29-466e-9bfb-b96791159c19 tempest-CinderUnicodeTest-1212770282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:52:29 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-6e77afa1-5e29-466e-9bfb-b96791159c19 tempest-CinderUnicodeTest-1212770282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:52:29 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-6e77afa1-5e29-466e-9bfb-b96791159c19 tempest-CinderUnicodeTest-1212770282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:52:29 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-6e77afa1-5e29-466e-9bfb-b96791159c19 tempest-CinderUnicodeTest-1212770282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:52:29 devstack sudo[107118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:52:29 devstack sudo[107118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:52:29 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-9335579e-208e-40d9-8039-0b49fa5d14f8 tempest-CinderUnicodeTest-1212770282 None] Acquiring lock "cinder-c8e16a3a-dcb9-4b44-96e8-d8c4209ad77c-delete_volume" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:52:29 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-9335579e-208e-40d9-8039-0b49fa5d14f8 tempest-CinderUnicodeTest-1212770282 None] Lock "cinder-c8e16a3a-dcb9-4b44-96e8-d8c4209ad77c-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:52:29 devstack sudo[107116]: pam_unix(sudo:session): session closed for user root Sep 06 06:52:29 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-79550e83-fd78-4bcc-ad8a-ffcf03506b1a tempest-ProjectReaderTests-1566093849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-d4b67bb0-a527-48c2-b52a-18bce33d3394.info" returned: 0 in 0.365s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:52:29 devstack cinder-volume[87329]: WARNING cinder.volume.drivers.remotefs [None req-79550e83-fd78-4bcc-ad8a-ffcf03506b1a tempest-ProjectReaderTests-1566093849 None] /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-d4b67bb0-a527-48c2-b52a-18bce33d3394.info is being set with open permissions: ugo+rw Sep 06 06:52:29 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-79550e83-fd78-4bcc-ad8a-ffcf03506b1a tempest-ProjectReaderTests-1566093849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-d4b67bb0-a527-48c2-b52a-18bce33d3394.info {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:52:29 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-9335579e-208e-40d9-8039-0b49fa5d14f8 tempest-CinderUnicodeTest-1212770282 None] Acquiring lock "cinder-quobyte-c8e16a3a-dcb9-4b44-96e8-d8c4209ad77c" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:52:29 devstack sudo[107121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-d4b67bb0-a527-48c2-b52a-18bce33d3394.info Sep 06 06:52:29 devstack sudo[107121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:52:29 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-9335579e-208e-40d9-8039-0b49fa5d14f8 tempest-CinderUnicodeTest-1212770282 None] Lock "cinder-quobyte-c8e16a3a-dcb9-4b44-96e8-d8c4209ad77c" acquired by "delete_volume" :: waited 0.016s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:52:29 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba71de7e-b001-4fa0-b746-5af22a314268]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:52:29 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-9335579e-208e-40d9-8039-0b49fa5d14f8 tempest-CinderUnicodeTest-1212770282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-c8e16a3a-dcb9-4b44-96e8-d8c4209ad77c {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:52:29 devstack sudo[107118]: pam_unix(sudo:session): session closed for user root Sep 06 06:52:29 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-6e77afa1-5e29-466e-9bfb-b96791159c19 tempest-CinderUnicodeTest-1212770282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.353s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:52:29 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-6e77afa1-5e29-466e-9bfb-b96791159c19 tempest-CinderUnicodeTest-1212770282 None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:52:29 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-6e77afa1-5e29-466e-9bfb-b96791159c19 tempest-CinderUnicodeTest-1212770282 None] Deleted volume successfully. Sep 06 06:52:30 devstack sudo[107123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-c8e16a3a-dcb9-4b44-96e8-d8c4209ad77c Sep 06 06:52:30 devstack sudo[107123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:52:30 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-6e77afa1-5e29-466e-9bfb-b96791159c19 tempest-CinderUnicodeTest-1212770282 None] Lock "cinder-dd0a6909-8d3d-4631-8394-a1d2fc3ef97a-delete_volume" released by "delete_volume" :: held 1.471s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:52:30 devstack sudo[107121]: pam_unix(sudo:session): session closed for user root Sep 06 06:52:30 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-79550e83-fd78-4bcc-ad8a-ffcf03506b1a tempest-ProjectReaderTests-1566093849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-d4b67bb0-a527-48c2-b52a-18bce33d3394.info" returned: 0 in 0.277s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:52:30 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-79550e83-fd78-4bcc-ad8a-ffcf03506b1a tempest-ProjectReaderTests-1566093849 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.236s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:52:30 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-0eed0b7c-960c-457a-ab66-a6b9e335d218 tempest-SnapshotDependencyTests-1896093265 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.700s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:52:30 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-0eed0b7c-960c-457a-ab66-a6b9e335d218 tempest-SnapshotDependencyTests-1896093265 None] Creating offline snapshot baa1e468-23be-4db0-8d16-13d6c4a693f6 of volume e06a97bd-6ce9-49ef-8f1b-8469f31060fe {{(pid=87329) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 06 06:52:30 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-79550e83-fd78-4bcc-ad8a-ffcf03506b1a tempest-ProjectReaderTests-1566093849 None] Create snapshot completed successfully Sep 06 06:52:30 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[3763e09e-8d6a-41d2-85e9-1b77567d4b93]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:52:30 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-0eed0b7c-960c-457a-ab66-a6b9e335d218 tempest-SnapshotDependencyTests-1896093265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e06a97bd-6ce9-49ef-8f1b-8469f31060fe {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:52:30 devstack sudo[107128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e06a97bd-6ce9-49ef-8f1b-8469f31060fe Sep 06 06:52:30 devstack sudo[107123]: pam_unix(sudo:session): session closed for user root Sep 06 06:52:30 devstack sudo[107128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:52:30 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-9335579e-208e-40d9-8039-0b49fa5d14f8 tempest-CinderUnicodeTest-1212770282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-c8e16a3a-dcb9-4b44-96e8-d8c4209ad77c" returned: 0 in 0.396s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:52:30 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-9335579e-208e-40d9-8039-0b49fa5d14f8 tempest-CinderUnicodeTest-1212770282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-c8e16a3a-dcb9-4b44-96e8-d8c4209ad77c {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:52:30 devstack sudo[107133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-c8e16a3a-dcb9-4b44-96e8-d8c4209ad77c Sep 06 06:52:30 devstack sudo[107133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:52:30 devstack sudo[107128]: pam_unix(sudo:session): session closed for user root Sep 06 06:52:30 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-0eed0b7c-960c-457a-ab66-a6b9e335d218 tempest-SnapshotDependencyTests-1896093265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e06a97bd-6ce9-49ef-8f1b-8469f31060fe" returned: 0 in 0.350s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:52:30 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-0eed0b7c-960c-457a-ab66-a6b9e335d218 tempest-SnapshotDependencyTests-1896093265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e06a97bd-6ce9-49ef-8f1b-8469f31060fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e06a97bd-6ce9-49ef-8f1b-8469f31060fe.baa1e468-23be-4db0-8d16-13d6c4a693f6 1G {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:52:30 devstack sudo[107133]: pam_unix(sudo:session): session closed for user root Sep 06 06:52:30 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-9335579e-208e-40d9-8039-0b49fa5d14f8 tempest-CinderUnicodeTest-1212770282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-c8e16a3a-dcb9-4b44-96e8-d8c4209ad77c" returned: 0 in 0.246s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:52:30 devstack sudo[107139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e06a97bd-6ce9-49ef-8f1b-8469f31060fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e06a97bd-6ce9-49ef-8f1b-8469f31060fe.baa1e468-23be-4db0-8d16-13d6c4a693f6 1G Sep 06 06:52:30 devstack sudo[107139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:52:30 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-9335579e-208e-40d9-8039-0b49fa5d14f8 tempest-CinderUnicodeTest-1212770282 None] Lock "cinder-quobyte-c8e16a3a-dcb9-4b44-96e8-d8c4209ad77c" released by "delete_volume" :: held 0.686s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:52:30 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-9335579e-208e-40d9-8039-0b49fa5d14f8 tempest-CinderUnicodeTest-1212770282 None] Created reservations ['64326b27-66c1-4087-8571-842f6c5dde53', 'dc266654-a5e6-42d6-b1ed-ab4bfd274bac', 'fae6206b-94e4-4d2c-8217-4b88d665cdd8', '9fc8e4e1-bcc5-4cf8-9f3b-9e4865b5629f'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:52:30 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-9335579e-208e-40d9-8039-0b49fa5d14f8 tempest-CinderUnicodeTest-1212770282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:52:30 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-9335579e-208e-40d9-8039-0b49fa5d14f8 tempest-CinderUnicodeTest-1212770282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:52:30 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-9335579e-208e-40d9-8039-0b49fa5d14f8 tempest-CinderUnicodeTest-1212770282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:52:30 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-9335579e-208e-40d9-8039-0b49fa5d14f8 tempest-CinderUnicodeTest-1212770282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:52:30 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-9335579e-208e-40d9-8039-0b49fa5d14f8 tempest-CinderUnicodeTest-1212770282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:52:30 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-9335579e-208e-40d9-8039-0b49fa5d14f8 tempest-CinderUnicodeTest-1212770282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:52:30 devstack sudo[107141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:52:30 devstack sudo[107141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:52:30 devstack sudo[107141]: pam_unix(sudo:session): session closed for user root Sep 06 06:52:30 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-42fc9283-cd36-4c6a-800e-5b3fbda138fe tempest-ProjectReaderTests-1566093849 None] Acquiring lock "cinder-27716bed-0b79-4487-8eec-caf167a9992e-delete_snapshot" by "delete_snapshot" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:52:30 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-9335579e-208e-40d9-8039-0b49fa5d14f8 tempest-CinderUnicodeTest-1212770282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.340s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:52:30 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-9335579e-208e-40d9-8039-0b49fa5d14f8 tempest-CinderUnicodeTest-1212770282 None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:52:31 devstack sudo[107139]: pam_unix(sudo:session): session closed for user root Sep 06 06:52:31 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-9335579e-208e-40d9-8039-0b49fa5d14f8 tempest-CinderUnicodeTest-1212770282 None] Deleted volume successfully. Sep 06 06:52:31 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-0eed0b7c-960c-457a-ab66-a6b9e335d218 tempest-SnapshotDependencyTests-1896093265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e06a97bd-6ce9-49ef-8f1b-8469f31060fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e06a97bd-6ce9-49ef-8f1b-8469f31060fe.baa1e468-23be-4db0-8d16-13d6c4a693f6 1G" returned: 0 in 0.510s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:52:31 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-0eed0b7c-960c-457a-ab66-a6b9e335d218 tempest-SnapshotDependencyTests-1896093265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e06a97bd-6ce9-49ef-8f1b-8469f31060fe -F qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e06a97bd-6ce9-49ef-8f1b-8469f31060fe.baa1e468-23be-4db0-8d16-13d6c4a693f6 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:52:31 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-42fc9283-cd36-4c6a-800e-5b3fbda138fe tempest-ProjectReaderTests-1566093849 None] Lock "cinder-27716bed-0b79-4487-8eec-caf167a9992e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.053s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:52:31 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-42fc9283-cd36-4c6a-800e-5b3fbda138fe tempest-ProjectReaderTests-1566093849 None] Acquiring lock "cinder-quobyte-d4b67bb0-a527-48c2-b52a-18bce33d3394" by "delete_snapshot" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:52:31 devstack sudo[107148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e06a97bd-6ce9-49ef-8f1b-8469f31060fe -F qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e06a97bd-6ce9-49ef-8f1b-8469f31060fe.baa1e468-23be-4db0-8d16-13d6c4a693f6 Sep 06 06:52:31 devstack sudo[107148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:52:31 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-42fc9283-cd36-4c6a-800e-5b3fbda138fe tempest-ProjectReaderTests-1566093849 None] Lock "cinder-quobyte-d4b67bb0-a527-48c2-b52a-18bce33d3394" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:52:31 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-42fc9283-cd36-4c6a-800e-5b3fbda138fe tempest-ProjectReaderTests-1566093849 None] Acquiring lock "cinder-quobyte-27716bed-0b79-4487-8eec-caf167a9992e" by "_delete_snapshot" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:52:31 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-9335579e-208e-40d9-8039-0b49fa5d14f8 tempest-CinderUnicodeTest-1212770282 None] Lock "cinder-c8e16a3a-dcb9-4b44-96e8-d8c4209ad77c-delete_volume" released by "delete_volume" :: held 1.288s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:52:31 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-42fc9283-cd36-4c6a-800e-5b3fbda138fe tempest-ProjectReaderTests-1566093849 None] Lock "cinder-quobyte-27716bed-0b79-4487-8eec-caf167a9992e" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:52:31 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-42fc9283-cd36-4c6a-800e-5b3fbda138fe tempest-ProjectReaderTests-1566093849 None] Deleting offline snapshot 27716bed-0b79-4487-8eec-caf167a9992e of volume d4b67bb0-a527-48c2-b52a-18bce33d3394 {{(pid=87329) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 06 06:52:31 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-42fc9283-cd36-4c6a-800e-5b3fbda138fe tempest-ProjectReaderTests-1566093849 None] snapshot_file for this snap is: volume-d4b67bb0-a527-48c2-b52a-18bce33d3394.27716bed-0b79-4487-8eec-caf167a9992e {{(pid=87329) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 06 06:52:31 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f6eba02-16f0-4864-a792-a72ed03d30c9]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:52:31 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-42fc9283-cd36-4c6a-800e-5b3fbda138fe tempest-ProjectReaderTests-1566093849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-d4b67bb0-a527-48c2-b52a-18bce33d3394.27716bed-0b79-4487-8eec-caf167a9992e {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:52:31 devstack sudo[107150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-d4b67bb0-a527-48c2-b52a-18bce33d3394.27716bed-0b79-4487-8eec-caf167a9992e Sep 06 06:52:31 devstack sudo[107150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:52:31 devstack sudo[107148]: pam_unix(sudo:session): session closed for user root Sep 06 06:52:31 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-0eed0b7c-960c-457a-ab66-a6b9e335d218 tempest-SnapshotDependencyTests-1896093265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e06a97bd-6ce9-49ef-8f1b-8469f31060fe -F qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e06a97bd-6ce9-49ef-8f1b-8469f31060fe.baa1e468-23be-4db0-8d16-13d6c4a693f6" returned: 0 in 0.355s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:52:31 devstack cinder-volume[87329]: WARNING cinder.volume.drivers.remotefs [None req-0eed0b7c-960c-457a-ab66-a6b9e335d218 tempest-SnapshotDependencyTests-1896093265 None] /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e06a97bd-6ce9-49ef-8f1b-8469f31060fe.baa1e468-23be-4db0-8d16-13d6c4a693f6 is being set with open permissions: ugo+rw Sep 06 06:52:31 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-0eed0b7c-960c-457a-ab66-a6b9e335d218 tempest-SnapshotDependencyTests-1896093265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e06a97bd-6ce9-49ef-8f1b-8469f31060fe.baa1e468-23be-4db0-8d16-13d6c4a693f6 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:52:31 devstack sudo[107155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e06a97bd-6ce9-49ef-8f1b-8469f31060fe.baa1e468-23be-4db0-8d16-13d6c4a693f6 Sep 06 06:52:31 devstack sudo[107155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:52:31 devstack sudo[107150]: pam_unix(sudo:session): session closed for user root Sep 06 06:52:31 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-42fc9283-cd36-4c6a-800e-5b3fbda138fe tempest-ProjectReaderTests-1566093849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-d4b67bb0-a527-48c2-b52a-18bce33d3394.27716bed-0b79-4487-8eec-caf167a9992e" returned: 0 in 0.434s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:52:31 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-42fc9283-cd36-4c6a-800e-5b3fbda138fe tempest-ProjectReaderTests-1566093849 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d4b67bb0-a527-48c2-b52a-18bce33d3394(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87329) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 06:52:31 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2b1be0a-7555-4c23-b56e-6886c761a425]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:52:31 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-42fc9283-cd36-4c6a-800e-5b3fbda138fe tempest-ProjectReaderTests-1566093849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-d4b67bb0-a527-48c2-b52a-18bce33d3394 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:52:31 devstack sudo[107155]: pam_unix(sudo:session): session closed for user root Sep 06 06:52:31 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-0eed0b7c-960c-457a-ab66-a6b9e335d218 tempest-SnapshotDependencyTests-1896093265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e06a97bd-6ce9-49ef-8f1b-8469f31060fe.baa1e468-23be-4db0-8d16-13d6c4a693f6" returned: 0 in 0.305s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:52:31 devstack sudo[107160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-d4b67bb0-a527-48c2-b52a-18bce33d3394 Sep 06 06:52:31 devstack sudo[107160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:52:31 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-0eed0b7c-960c-457a-ab66-a6b9e335d218 tempest-SnapshotDependencyTests-1896093265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e06a97bd-6ce9-49ef-8f1b-8469f31060fe.info {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:52:31 devstack sudo[107163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e06a97bd-6ce9-49ef-8f1b-8469f31060fe.info Sep 06 06:52:31 devstack sudo[107163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:52:32 devstack sudo[107163]: pam_unix(sudo:session): session closed for user root Sep 06 06:52:32 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-0eed0b7c-960c-457a-ab66-a6b9e335d218 tempest-SnapshotDependencyTests-1896093265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e06a97bd-6ce9-49ef-8f1b-8469f31060fe.info" returned: 0 in 0.293s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:52:32 devstack cinder-volume[87329]: WARNING cinder.volume.drivers.remotefs [None req-0eed0b7c-960c-457a-ab66-a6b9e335d218 tempest-SnapshotDependencyTests-1896093265 None] /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e06a97bd-6ce9-49ef-8f1b-8469f31060fe.info is being set with open permissions: ugo+rw Sep 06 06:52:32 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-0eed0b7c-960c-457a-ab66-a6b9e335d218 tempest-SnapshotDependencyTests-1896093265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e06a97bd-6ce9-49ef-8f1b-8469f31060fe.info {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:52:32 devstack sudo[107169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e06a97bd-6ce9-49ef-8f1b-8469f31060fe.info Sep 06 06:52:32 devstack sudo[107169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:52:32 devstack sudo[107160]: pam_unix(sudo:session): session closed for user root Sep 06 06:52:32 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-42fc9283-cd36-4c6a-800e-5b3fbda138fe tempest-ProjectReaderTests-1566093849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-d4b67bb0-a527-48c2-b52a-18bce33d3394" returned: 0 in 0.483s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:52:32 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-42fc9283-cd36-4c6a-800e-5b3fbda138fe tempest-ProjectReaderTests-1566093849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-d4b67bb0-a527-48c2-b52a-18bce33d3394.27716bed-0b79-4487-8eec-caf167a9992e {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:52:32 devstack sudo[107171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-d4b67bb0-a527-48c2-b52a-18bce33d3394.27716bed-0b79-4487-8eec-caf167a9992e Sep 06 06:52:32 devstack sudo[107171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:52:32 devstack sudo[107169]: pam_unix(sudo:session): session closed for user root Sep 06 06:52:32 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-0eed0b7c-960c-457a-ab66-a6b9e335d218 tempest-SnapshotDependencyTests-1896093265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e06a97bd-6ce9-49ef-8f1b-8469f31060fe.info" returned: 0 in 0.331s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:52:32 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-0eed0b7c-960c-457a-ab66-a6b9e335d218 tempest-SnapshotDependencyTests-1896093265 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.254s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:52:32 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-0eed0b7c-960c-457a-ab66-a6b9e335d218 tempest-SnapshotDependencyTests-1896093265 None] Create snapshot completed successfully Sep 06 06:52:32 devstack sudo[107171]: pam_unix(sudo:session): session closed for user root Sep 06 06:52:32 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-42fc9283-cd36-4c6a-800e-5b3fbda138fe tempest-ProjectReaderTests-1566093849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-d4b67bb0-a527-48c2-b52a-18bce33d3394.27716bed-0b79-4487-8eec-caf167a9992e" returned: 0 in 0.523s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:52:32 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-42fc9283-cd36-4c6a-800e-5b3fbda138fe tempest-ProjectReaderTests-1566093849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-d4b67bb0-a527-48c2-b52a-18bce33d3394.27716bed-0b79-4487-8eec-caf167a9992e {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:52:32 devstack sudo[107178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-d4b67bb0-a527-48c2-b52a-18bce33d3394.27716bed-0b79-4487-8eec-caf167a9992e Sep 06 06:52:32 devstack sudo[107178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:52:32 devstack sudo[107178]: pam_unix(sudo:session): session closed for user root Sep 06 06:52:32 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-42fc9283-cd36-4c6a-800e-5b3fbda138fe tempest-ProjectReaderTests-1566093849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-d4b67bb0-a527-48c2-b52a-18bce33d3394.27716bed-0b79-4487-8eec-caf167a9992e" returned: 0 in 0.349s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:52:32 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-42fc9283-cd36-4c6a-800e-5b3fbda138fe tempest-ProjectReaderTests-1566093849 None] Lock "cinder-quobyte-27716bed-0b79-4487-8eec-caf167a9992e" released by "_delete_snapshot" :: held 1.912s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:52:33 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-42fc9283-cd36-4c6a-800e-5b3fbda138fe tempest-ProjectReaderTests-1566093849 None] Lock "cinder-quobyte-d4b67bb0-a527-48c2-b52a-18bce33d3394" released by "delete_snapshot" :: held 1.945s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:52:33 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-42fc9283-cd36-4c6a-800e-5b3fbda138fe tempest-ProjectReaderTests-1566093849 None] Created reservations ['1d4f17bd-3cdb-4034-afbf-2b8c5cfa4a4c', '94f9539d-552d-4230-816b-44f5c3b67519', '374fe057-9308-4a6e-88e4-b5fe1cf27f28', 'b66a9b7f-5d06-4fe1-b6be-c6f262d9f0a1'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:52:33 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-42fc9283-cd36-4c6a-800e-5b3fbda138fe tempest-ProjectReaderTests-1566093849 None] Delete snapshot completed successfully. Sep 06 06:52:33 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-42fc9283-cd36-4c6a-800e-5b3fbda138fe tempest-ProjectReaderTests-1566093849 None] Lock "cinder-27716bed-0b79-4487-8eec-caf167a9992e-delete_snapshot" released by "delete_snapshot" :: held 2.180s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:52:33 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a7a79ab-01a7-48e9-ba16-ba68fca15751 tempest-SnapshotDependencyTests-1896093265 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87329) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 06:52:33 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-7a7a79ab-01a7-48e9-ba16-ba68fca15751 tempest-SnapshotDependencyTests-1896093265 None] Flow 'volume_create_manager' (2524894f-4e83-4623-9c24-b7548f398760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:52:33 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-7a7a79ab-01a7-48e9-ba16-ba68fca15751 tempest-SnapshotDependencyTests-1896093265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b045e27a-c218-4990-a613-fdd8fcf4f090) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:52:33 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-7a7a79ab-01a7-48e9-ba16-ba68fca15751 tempest-SnapshotDependencyTests-1896093265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b045e27a-c218-4990-a613-fdd8fcf4f090) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:52:33Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=194c70ca-e42a-4969-914c-4c6169ecacbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6646d5625b8a4bf6b08fa2f37f1ef662',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:52:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=baa1e468-23be-4db0-8d16-13d6c4a693f6,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:52:33Z,use_quota=True,user_id='9ffe18145c90463c86e414a6c44e4f4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:52:33 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-7a7a79ab-01a7-48e9-ba16-ba68fca15751 tempest-SnapshotDependencyTests-1896093265 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8033b63-ba25-4e55-bb30-b3baae102cd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:52:33 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-7a7a79ab-01a7-48e9-ba16-ba68fca15751 tempest-SnapshotDependencyTests-1896093265 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8033b63-ba25-4e55-bb30-b3baae102cd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:52:33 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-7a7a79ab-01a7-48e9-ba16-ba68fca15751 tempest-SnapshotDependencyTests-1896093265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c210bd7f-64ab-43f0-ab62-0f076f07ab67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:52:33 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-7a7a79ab-01a7-48e9-ba16-ba68fca15751 tempest-SnapshotDependencyTests-1896093265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c210bd7f-64ab-43f0-ab62-0f076f07ab67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '194c70ca-e42a-4969-914c-4c6169ecacbe', 'volume_name': 'volume-194c70ca-e42a-4969-914c-4c6169ecacbe', 'volume_size': 1, 'snapshot_id': 'baa1e468-23be-4db0-8d16-13d6c4a693f6'}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:52:33 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-7a7a79ab-01a7-48e9-ba16-ba68fca15751 tempest-SnapshotDependencyTests-1896093265 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c28fc45d-6062-494c-9986-0a25e7673da4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:52:33 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-7a7a79ab-01a7-48e9-ba16-ba68fca15751 tempest-SnapshotDependencyTests-1896093265 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c28fc45d-6062-494c-9986-0a25e7673da4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:52:33 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-7a7a79ab-01a7-48e9-ba16-ba68fca15751 tempest-SnapshotDependencyTests-1896093265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (903b0a38-35e4-44f5-a174-db6e0c78694c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:52:33 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-7a7a79ab-01a7-48e9-ba16-ba68fca15751 tempest-SnapshotDependencyTests-1896093265 None] Volume 194c70ca-e42a-4969-914c-4c6169ecacbe: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-194c70ca-e42a-4969-914c-4c6169ecacbe', 'volume_size': 1, 'snapshot_id': 'baa1e468-23be-4db0-8d16-13d6c4a693f6'} Sep 06 06:52:33 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-7a7a79ab-01a7-48e9-ba16-ba68fca15751 tempest-SnapshotDependencyTests-1896093265 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:52:33 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-7a7a79ab-01a7-48e9-ba16-ba68fca15751 tempest-SnapshotDependencyTests-1896093265 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:52:33 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-7a7a79ab-01a7-48e9-ba16-ba68fca15751 tempest-SnapshotDependencyTests-1896093265 None] Acquiring lock "cinder-quobyte-baa1e468-23be-4db0-8d16-13d6c4a693f6-194c70ca-e42a-4969-914c-4c6169ecacbe" by "_create_volume_from_snapshot" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:52:33 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-7a7a79ab-01a7-48e9-ba16-ba68fca15751 tempest-SnapshotDependencyTests-1896093265 None] Lock "cinder-quobyte-baa1e468-23be-4db0-8d16-13d6c4a693f6-194c70ca-e42a-4969-914c-4c6169ecacbe" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:52:33 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-7a7a79ab-01a7-48e9-ba16-ba68fca15751 tempest-SnapshotDependencyTests-1896093265 None] Creating volume 194c70ca-e42a-4969-914c-4c6169ecacbe from snapshot baa1e468-23be-4db0-8d16-13d6c4a693f6 {{(pid=87329) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 06 06:52:33 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-7a7a79ab-01a7-48e9-ba16-ba68fca15751 tempest-SnapshotDependencyTests-1896093265 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:52:33 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-7a7a79ab-01a7-48e9-ba16-ba68fca15751 tempest-SnapshotDependencyTests-1896093265 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:52:33 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-7a7a79ab-01a7-48e9-ba16-ba68fca15751 tempest-SnapshotDependencyTests-1896093265 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:52:33 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-7a7a79ab-01a7-48e9-ba16-ba68fca15751 tempest-SnapshotDependencyTests-1896093265 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:52:33 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-7a7a79ab-01a7-48e9-ba16-ba68fca15751 tempest-SnapshotDependencyTests-1896093265 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:52:33 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-7a7a79ab-01a7-48e9-ba16-ba68fca15751 tempest-SnapshotDependencyTests-1896093265 None] Selected osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 as target Quobyte volume. {{(pid=87329) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 06:52:33 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-7a7a79ab-01a7-48e9-ba16-ba68fca15751 tempest-SnapshotDependencyTests-1896093265 None] Acquiring lock "cinder-quobyte-194c70ca-e42a-4969-914c-4c6169ecacbe" by "_copy_volume_from_snapshot" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:52:33 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-7a7a79ab-01a7-48e9-ba16-ba68fca15751 tempest-SnapshotDependencyTests-1896093265 None] Lock "cinder-quobyte-194c70ca-e42a-4969-914c-4c6169ecacbe" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:52:33 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-7a7a79ab-01a7-48e9-ba16-ba68fca15751 tempest-SnapshotDependencyTests-1896093265 None] snapshot: baa1e468-23be-4db0-8d16-13d6c4a693f6, volume: 194c70ca-e42a-4969-914c-4c6169ecacbe, {{(pid=87329) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 06 06:52:33 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-7a7a79ab-01a7-48e9-ba16-ba68fca15751 tempest-SnapshotDependencyTests-1896093265 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:52:33 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-7a7a79ab-01a7-48e9-ba16-ba68fca15751 tempest-SnapshotDependencyTests-1896093265 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:52:33 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-7a7a79ab-01a7-48e9-ba16-ba68fca15751 tempest-SnapshotDependencyTests-1896093265 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:52:33 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-7a7a79ab-01a7-48e9-ba16-ba68fca15751 tempest-SnapshotDependencyTests-1896093265 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:52:33 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-7a7a79ab-01a7-48e9-ba16-ba68fca15751 tempest-SnapshotDependencyTests-1896093265 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:52:33 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[90a7814d-5082-4c97-8b19-9dd6449269de]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:52:33 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-7a7a79ab-01a7-48e9-ba16-ba68fca15751 tempest-SnapshotDependencyTests-1896093265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e06a97bd-6ce9-49ef-8f1b-8469f31060fe.baa1e468-23be-4db0-8d16-13d6c4a693f6 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:52:33 devstack sudo[107181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e06a97bd-6ce9-49ef-8f1b-8469f31060fe.baa1e468-23be-4db0-8d16-13d6c4a693f6 Sep 06 06:52:33 devstack sudo[107181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:52:33 devstack sudo[107181]: pam_unix(sudo:session): session closed for user root Sep 06 06:52:33 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-7a7a79ab-01a7-48e9-ba16-ba68fca15751 tempest-SnapshotDependencyTests-1896093265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e06a97bd-6ce9-49ef-8f1b-8469f31060fe.baa1e468-23be-4db0-8d16-13d6c4a693f6" returned: 0 in 0.396s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:52:33 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-7a7a79ab-01a7-48e9-ba16-ba68fca15751 tempest-SnapshotDependencyTests-1896093265 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e06a97bd-6ce9-49ef-8f1b-8469f31060fe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87329) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 06:52:33 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a5016f6-081c-4a53-b7d6-fceb13079bc2]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:52:33 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-7a7a79ab-01a7-48e9-ba16-ba68fca15751 tempest-SnapshotDependencyTests-1896093265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e06a97bd-6ce9-49ef-8f1b-8469f31060fe {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:52:34 devstack sudo[107187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e06a97bd-6ce9-49ef-8f1b-8469f31060fe Sep 06 06:52:34 devstack sudo[107187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:52:34 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-206e9069-6a09-4599-b062-224c010aad6d tempest-ProjectReaderTests-1566093849 None] Acquiring lock "cinder-d4b67bb0-a527-48c2-b52a-18bce33d3394-delete_volume" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:52:34 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-206e9069-6a09-4599-b062-224c010aad6d tempest-ProjectReaderTests-1566093849 None] Lock "cinder-d4b67bb0-a527-48c2-b52a-18bce33d3394-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:52:34 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-206e9069-6a09-4599-b062-224c010aad6d tempest-ProjectReaderTests-1566093849 None] Acquiring lock "cinder-quobyte-d4b67bb0-a527-48c2-b52a-18bce33d3394" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:52:34 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-206e9069-6a09-4599-b062-224c010aad6d tempest-ProjectReaderTests-1566093849 None] Lock "cinder-quobyte-d4b67bb0-a527-48c2-b52a-18bce33d3394" acquired by "delete_volume" :: waited 0.018s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:52:34 devstack sudo[107187]: pam_unix(sudo:session): session closed for user root Sep 06 06:52:34 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-7a7a79ab-01a7-48e9-ba16-ba68fca15751 tempest-SnapshotDependencyTests-1896093265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e06a97bd-6ce9-49ef-8f1b-8469f31060fe" returned: 0 in 0.468s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:52:34 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-7a7a79ab-01a7-48e9-ba16-ba68fca15751 tempest-SnapshotDependencyTests-1896093265 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e06a97bd-6ce9-49ef-8f1b-8469f31060fe {{(pid=87329) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 06 06:52:34 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-7a7a79ab-01a7-48e9-ba16-ba68fca15751 tempest-SnapshotDependencyTests-1896093265 None] Creating direct copy from snapshot {{(pid=87329) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 06 06:52:34 devstack cinder-volume[87329]: DEBUG cinder.utils [None req-7a7a79ab-01a7-48e9-ba16-ba68fca15751 tempest-SnapshotDependencyTests-1896093265 None] Path /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-194c70ca-e42a-4969-914c-4c6169ecacbe not found in is_blk_device check {{(pid=87329) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 06 06:52:34 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-7a7a79ab-01a7-48e9-ba16-ba68fca15751 tempest-SnapshotDependencyTests-1896093265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e06a97bd-6ce9-49ef-8f1b-8469f31060fe /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-194c70ca-e42a-4969-914c-4c6169ecacbe {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:52:34 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e52f00d-d83e-4c52-a636-23bee5209ee7]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:52:34 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-206e9069-6a09-4599-b062-224c010aad6d tempest-ProjectReaderTests-1566093849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-d4b67bb0-a527-48c2-b52a-18bce33d3394 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:52:34 devstack sudo[107193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e06a97bd-6ce9-49ef-8f1b-8469f31060fe /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-194c70ca-e42a-4969-914c-4c6169ecacbe Sep 06 06:52:34 devstack sudo[107193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:52:34 devstack sudo[107194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-d4b67bb0-a527-48c2-b52a-18bce33d3394 Sep 06 06:52:34 devstack sudo[107194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:52:34 devstack sudo[107194]: pam_unix(sudo:session): session closed for user root Sep 06 06:52:34 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-206e9069-6a09-4599-b062-224c010aad6d tempest-ProjectReaderTests-1566093849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-d4b67bb0-a527-48c2-b52a-18bce33d3394" returned: 0 in 0.444s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:52:34 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-206e9069-6a09-4599-b062-224c010aad6d tempest-ProjectReaderTests-1566093849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-d4b67bb0-a527-48c2-b52a-18bce33d3394 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:52:34 devstack sudo[107203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-d4b67bb0-a527-48c2-b52a-18bce33d3394 Sep 06 06:52:34 devstack sudo[107203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:52:35 devstack sudo[107203]: pam_unix(sudo:session): session closed for user root Sep 06 06:52:35 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-206e9069-6a09-4599-b062-224c010aad6d tempest-ProjectReaderTests-1566093849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-d4b67bb0-a527-48c2-b52a-18bce33d3394" returned: 0 in 0.422s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:52:35 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-206e9069-6a09-4599-b062-224c010aad6d tempest-ProjectReaderTests-1566093849 None] Lock "cinder-quobyte-d4b67bb0-a527-48c2-b52a-18bce33d3394" released by "delete_volume" :: held 0.979s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:52:35 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-206e9069-6a09-4599-b062-224c010aad6d tempest-ProjectReaderTests-1566093849 None] Created reservations ['c445196e-b9d8-4244-83a6-72421bb9eb5d', '81f1075d-5c30-4df3-8fb9-f234c3348e47', '0e487cfb-ef55-4a8a-99ae-5a45234eb9fd', 'a2edc662-076a-4800-8395-ec77438ae306'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:52:35 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-206e9069-6a09-4599-b062-224c010aad6d tempest-ProjectReaderTests-1566093849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:52:35 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-206e9069-6a09-4599-b062-224c010aad6d tempest-ProjectReaderTests-1566093849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:52:35 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-206e9069-6a09-4599-b062-224c010aad6d tempest-ProjectReaderTests-1566093849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:52:35 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-206e9069-6a09-4599-b062-224c010aad6d tempest-ProjectReaderTests-1566093849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:52:35 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-206e9069-6a09-4599-b062-224c010aad6d tempest-ProjectReaderTests-1566093849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:52:35 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-206e9069-6a09-4599-b062-224c010aad6d tempest-ProjectReaderTests-1566093849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:52:35 devstack sudo[107213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:52:35 devstack sudo[107213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:52:36 devstack sudo[107213]: pam_unix(sudo:session): session closed for user root Sep 06 06:52:36 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-206e9069-6a09-4599-b062-224c010aad6d tempest-ProjectReaderTests-1566093849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.581s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:52:36 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-206e9069-6a09-4599-b062-224c010aad6d tempest-ProjectReaderTests-1566093849 None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:52:36 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-206e9069-6a09-4599-b062-224c010aad6d tempest-ProjectReaderTests-1566093849 None] Deleted volume successfully. Sep 06 06:52:36 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-206e9069-6a09-4599-b062-224c010aad6d tempest-ProjectReaderTests-1566093849 None] Lock "cinder-d4b67bb0-a527-48c2-b52a-18bce33d3394-delete_volume" released by "delete_volume" :: held 2.056s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:52:38 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb609080-adf9-4189-b799-b6ee965d2a40 tempest-ProjectReaderTests-1566093849 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87329) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 06:52:38 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-cb609080-adf9-4189-b799-b6ee965d2a40 tempest-ProjectReaderTests-1566093849 None] Flow 'volume_create_manager' (edfa0e7c-647a-426e-b5f6-7e7be89e539d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:52:38 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-cb609080-adf9-4189-b799-b6ee965d2a40 tempest-ProjectReaderTests-1566093849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3c0425e-7d77-46b7-bb33-35b82294caa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:52:38 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-cb609080-adf9-4189-b799-b6ee965d2a40 tempest-ProjectReaderTests-1566093849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3c0425e-7d77-46b7-bb33-35b82294caa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:52:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-162208702',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f172b4a-90c3-49b8-9f72-c18e54809d99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47b14cc477564406b2c85835936b99d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:52:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:52:38Z,use_quota=True,user_id='2bb3aa6913034422a07b16fa1477428f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:52:38 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-cb609080-adf9-4189-b799-b6ee965d2a40 tempest-ProjectReaderTests-1566093849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4624186e-058f-4909-8de1-efe409547307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:52:38 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-cb609080-adf9-4189-b799-b6ee965d2a40 tempest-ProjectReaderTests-1566093849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4624186e-058f-4909-8de1-efe409547307) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:52:38 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-cb609080-adf9-4189-b799-b6ee965d2a40 tempest-ProjectReaderTests-1566093849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (070e27d6-e298-4e97-abde-0fe536c87d0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:52:38 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-cb609080-adf9-4189-b799-b6ee965d2a40 tempest-ProjectReaderTests-1566093849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (070e27d6-e298-4e97-abde-0fe536c87d0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f172b4a-90c3-49b8-9f72-c18e54809d99', 'volume_name': 'volume-6f172b4a-90c3-49b8-9f72-c18e54809d99', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:52:38 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-cb609080-adf9-4189-b799-b6ee965d2a40 tempest-ProjectReaderTests-1566093849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b324317d-3c21-435c-8e03-dd72c7bb099d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:52:38 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-cb609080-adf9-4189-b799-b6ee965d2a40 tempest-ProjectReaderTests-1566093849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b324317d-3c21-435c-8e03-dd72c7bb099d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:52:38 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-cb609080-adf9-4189-b799-b6ee965d2a40 tempest-ProjectReaderTests-1566093849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c61f8602-1d9a-4c1d-adbc-703201e52b4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:52:38 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-cb609080-adf9-4189-b799-b6ee965d2a40 tempest-ProjectReaderTests-1566093849 None] Volume 6f172b4a-90c3-49b8-9f72-c18e54809d99: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f172b4a-90c3-49b8-9f72-c18e54809d99', 'volume_size': 1} Sep 06 06:52:38 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-cb609080-adf9-4189-b799-b6ee965d2a40 tempest-ProjectReaderTests-1566093849 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:52:40 devstack sudo[107193]: pam_unix(sudo:session): session closed for user root Sep 06 06:52:40 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-7a7a79ab-01a7-48e9-ba16-ba68fca15751 tempest-SnapshotDependencyTests-1896093265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e06a97bd-6ce9-49ef-8f1b-8469f31060fe /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-194c70ca-e42a-4969-914c-4c6169ecacbe" returned: 0 in 5.727s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:52:40 devstack cinder-volume[87329]: DEBUG cinder.image.image_utils [None req-7a7a79ab-01a7-48e9-ba16-ba68fca15751 tempest-SnapshotDependencyTests-1896093265 None] Image conversion details: src /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e06a97bd-6ce9-49ef-8f1b-8469f31060fe, size 1024.00 MB, duration 5.73 sec, destination /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-194c70ca-e42a-4969-914c-4c6169ecacbe {{(pid=87329) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 06 06:52:40 devstack cinder-volume[87329]: INFO cinder.image.image_utils [None req-7a7a79ab-01a7-48e9-ba16-ba68fca15751 tempest-SnapshotDependencyTests-1896093265 None] Converted 1024.00 MB image at 178.77 MB/s Sep 06 06:52:40 devstack cinder-volume[87329]: WARNING cinder.volume.drivers.remotefs [None req-7a7a79ab-01a7-48e9-ba16-ba68fca15751 tempest-SnapshotDependencyTests-1896093265 None] /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-194c70ca-e42a-4969-914c-4c6169ecacbe is being set with open permissions: ugo+rw Sep 06 06:52:40 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-7a7a79ab-01a7-48e9-ba16-ba68fca15751 tempest-SnapshotDependencyTests-1896093265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-194c70ca-e42a-4969-914c-4c6169ecacbe {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:52:40 devstack sudo[107218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-194c70ca-e42a-4969-914c-4c6169ecacbe Sep 06 06:52:40 devstack sudo[107218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:52:40 devstack sudo[107218]: pam_unix(sudo:session): session closed for user root Sep 06 06:52:40 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-7a7a79ab-01a7-48e9-ba16-ba68fca15751 tempest-SnapshotDependencyTests-1896093265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-194c70ca-e42a-4969-914c-4c6169ecacbe" returned: 0 in 0.241s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:52:40 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-7a7a79ab-01a7-48e9-ba16-ba68fca15751 tempest-SnapshotDependencyTests-1896093265 None] Lock "cinder-quobyte-194c70ca-e42a-4969-914c-4c6169ecacbe" released by "_copy_volume_from_snapshot" :: held 6.929s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:52:40 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-7a7a79ab-01a7-48e9-ba16-ba68fca15751 tempest-SnapshotDependencyTests-1896093265 None] Lock "cinder-quobyte-baa1e468-23be-4db0-8d16-13d6c4a693f6-194c70ca-e42a-4969-914c-4c6169ecacbe" released by "_create_volume_from_snapshot" :: held 6.995s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:52:40 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-7a7a79ab-01a7-48e9-ba16-ba68fca15751 tempest-SnapshotDependencyTests-1896093265 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.013s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:52:40 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-cb609080-adf9-4189-b799-b6ee965d2a40 tempest-ProjectReaderTests-1566093849 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.024s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:52:40 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-cb609080-adf9-4189-b799-b6ee965d2a40 tempest-ProjectReaderTests-1566093849 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:52:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-162208702',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f172b4a-90c3-49b8-9f72-c18e54809d99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47b14cc477564406b2c85835936b99d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:52:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:52:38Z,use_quota=True,user_id='2bb3aa6913034422a07b16fa1477428f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)}" {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 06:52:40 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-cb609080-adf9-4189-b799-b6ee965d2a40 tempest-ProjectReaderTests-1566093849 None] Creating volume 6f172b4a-90c3-49b8-9f72-c18e54809d99 {{(pid=87329) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 06:52:40 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-cb609080-adf9-4189-b799-b6ee965d2a40 tempest-ProjectReaderTests-1566093849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:52:40 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-cb609080-adf9-4189-b799-b6ee965d2a40 tempest-ProjectReaderTests-1566093849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:52:40 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-cb609080-adf9-4189-b799-b6ee965d2a40 tempest-ProjectReaderTests-1566093849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:52:40 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-cb609080-adf9-4189-b799-b6ee965d2a40 tempest-ProjectReaderTests-1566093849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:52:40 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-cb609080-adf9-4189-b799-b6ee965d2a40 tempest-ProjectReaderTests-1566093849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:52:40 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-cb609080-adf9-4189-b799-b6ee965d2a40 tempest-ProjectReaderTests-1566093849 None] Selected osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 as target Quobyte volume. {{(pid=87329) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 06:52:40 devstack cinder-volume[87329]: INFO cinder.volume.drivers.remotefs [None req-cb609080-adf9-4189-b799-b6ee965d2a40 tempest-ProjectReaderTests-1566093849 None] casted to osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 Sep 06 06:52:40 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-cb609080-adf9-4189-b799-b6ee965d2a40 tempest-ProjectReaderTests-1566093849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6f172b4a-90c3-49b8-9f72-c18e54809d99 1073741824 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:52:40 devstack sudo[107221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6f172b4a-90c3-49b8-9f72-c18e54809d99 1073741824 Sep 06 06:52:40 devstack sudo[107221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:52:40 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-7a7a79ab-01a7-48e9-ba16-ba68fca15751 tempest-SnapshotDependencyTests-1896093265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (903b0a38-35e4-44f5-a174-db6e0c78694c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-194c70ca-e42a-4969-914c-4c6169ecacbe', 'volume_size': 1, 'snapshot_id': 'baa1e468-23be-4db0-8d16-13d6c4a693f6'}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:52:40 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-7a7a79ab-01a7-48e9-ba16-ba68fca15751 tempest-SnapshotDependencyTests-1896093265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (830f5408-998e-4aac-97ae-2a9d076bc645) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:52:40 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-7a7a79ab-01a7-48e9-ba16-ba68fca15751 tempest-SnapshotDependencyTests-1896093265 None] Volume volume-194c70ca-e42a-4969-914c-4c6169ecacbe (194c70ca-e42a-4969-914c-4c6169ecacbe): created successfully Sep 06 06:52:40 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-7a7a79ab-01a7-48e9-ba16-ba68fca15751 tempest-SnapshotDependencyTests-1896093265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (830f5408-998e-4aac-97ae-2a9d076bc645) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:52:40 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-7a7a79ab-01a7-48e9-ba16-ba68fca15751 tempest-SnapshotDependencyTests-1896093265 None] Flow 'volume_create_manager' (2524894f-4e83-4623-9c24-b7548f398760) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:52:40 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-7a7a79ab-01a7-48e9-ba16-ba68fca15751 tempest-SnapshotDependencyTests-1896093265 None] Created volume successfully. Sep 06 06:52:41 devstack sudo[107221]: pam_unix(sudo:session): session closed for user root Sep 06 06:52:41 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-cb609080-adf9-4189-b799-b6ee965d2a40 tempest-ProjectReaderTests-1566093849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6f172b4a-90c3-49b8-9f72-c18e54809d99 1073741824" returned: 0 in 0.537s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:52:41 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-cb609080-adf9-4189-b799-b6ee965d2a40 tempest-ProjectReaderTests-1566093849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6f172b4a-90c3-49b8-9f72-c18e54809d99 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:52:41 devstack sudo[107228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6f172b4a-90c3-49b8-9f72-c18e54809d99 Sep 06 06:52:41 devstack sudo[107228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:52:41 devstack sudo[107228]: pam_unix(sudo:session): session closed for user root Sep 06 06:52:41 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-cb609080-adf9-4189-b799-b6ee965d2a40 tempest-ProjectReaderTests-1566093849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6f172b4a-90c3-49b8-9f72-c18e54809d99" returned: 0 in 0.279s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:52:41 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-cb609080-adf9-4189-b799-b6ee965d2a40 tempest-ProjectReaderTests-1566093849 None] <== create_volume: return (877ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'} {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 06:52:41 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-cb609080-adf9-4189-b799-b6ee965d2a40 tempest-ProjectReaderTests-1566093849 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.879s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:52:41 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-cb609080-adf9-4189-b799-b6ee965d2a40 tempest-ProjectReaderTests-1566093849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c61f8602-1d9a-4c1d-adbc-703201e52b4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f172b4a-90c3-49b8-9f72-c18e54809d99', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:52:41 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-cb609080-adf9-4189-b799-b6ee965d2a40 tempest-ProjectReaderTests-1566093849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35c46d88-805b-4a05-afcb-cd9677a85b73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:52:41 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-cb609080-adf9-4189-b799-b6ee965d2a40 tempest-ProjectReaderTests-1566093849 None] Volume volume-6f172b4a-90c3-49b8-9f72-c18e54809d99 (6f172b4a-90c3-49b8-9f72-c18e54809d99): created successfully Sep 06 06:52:41 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-cb609080-adf9-4189-b799-b6ee965d2a40 tempest-ProjectReaderTests-1566093849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35c46d88-805b-4a05-afcb-cd9677a85b73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:52:41 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-cb609080-adf9-4189-b799-b6ee965d2a40 tempest-ProjectReaderTests-1566093849 None] Flow 'volume_create_manager' (edfa0e7c-647a-426e-b5f6-7e7be89e539d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:52:41 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-a2ff3026-e8b3-49ec-842a-fdbc83835a8e tempest-SnapshotDependencyTests-1896093265 None] Acquiring lock "cinder-baa1e468-23be-4db0-8d16-13d6c4a693f6-delete_snapshot" by "delete_snapshot" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:52:41 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-a2ff3026-e8b3-49ec-842a-fdbc83835a8e tempest-SnapshotDependencyTests-1896093265 None] Lock "cinder-baa1e468-23be-4db0-8d16-13d6c4a693f6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:52:41 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-a2ff3026-e8b3-49ec-842a-fdbc83835a8e tempest-SnapshotDependencyTests-1896093265 None] Acquiring lock "cinder-quobyte-e06a97bd-6ce9-49ef-8f1b-8469f31060fe" by "delete_snapshot" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:52:41 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-cb609080-adf9-4189-b799-b6ee965d2a40 tempest-ProjectReaderTests-1566093849 None] Created volume successfully. Sep 06 06:52:41 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-a2ff3026-e8b3-49ec-842a-fdbc83835a8e tempest-SnapshotDependencyTests-1896093265 None] Lock "cinder-quobyte-e06a97bd-6ce9-49ef-8f1b-8469f31060fe" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:52:41 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-a2ff3026-e8b3-49ec-842a-fdbc83835a8e tempest-SnapshotDependencyTests-1896093265 None] Acquiring lock "cinder-quobyte-baa1e468-23be-4db0-8d16-13d6c4a693f6" by "_delete_snapshot" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:52:41 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-a2ff3026-e8b3-49ec-842a-fdbc83835a8e tempest-SnapshotDependencyTests-1896093265 None] Lock "cinder-quobyte-baa1e468-23be-4db0-8d16-13d6c4a693f6" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:52:41 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-a2ff3026-e8b3-49ec-842a-fdbc83835a8e tempest-SnapshotDependencyTests-1896093265 None] Deleting offline snapshot baa1e468-23be-4db0-8d16-13d6c4a693f6 of volume e06a97bd-6ce9-49ef-8f1b-8469f31060fe {{(pid=87329) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 06 06:52:41 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-a2ff3026-e8b3-49ec-842a-fdbc83835a8e tempest-SnapshotDependencyTests-1896093265 None] snapshot_file for this snap is: volume-e06a97bd-6ce9-49ef-8f1b-8469f31060fe.baa1e468-23be-4db0-8d16-13d6c4a693f6 {{(pid=87329) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 06 06:52:41 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[69cbb28f-9774-4a36-8cf5-d92cfb5e72a2]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:52:41 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-a2ff3026-e8b3-49ec-842a-fdbc83835a8e tempest-SnapshotDependencyTests-1896093265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e06a97bd-6ce9-49ef-8f1b-8469f31060fe.baa1e468-23be-4db0-8d16-13d6c4a693f6 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:52:41 devstack sudo[107231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e06a97bd-6ce9-49ef-8f1b-8469f31060fe.baa1e468-23be-4db0-8d16-13d6c4a693f6 Sep 06 06:52:41 devstack sudo[107231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:52:41 devstack sudo[107231]: pam_unix(sudo:session): session closed for user root Sep 06 06:52:41 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-a2ff3026-e8b3-49ec-842a-fdbc83835a8e tempest-SnapshotDependencyTests-1896093265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e06a97bd-6ce9-49ef-8f1b-8469f31060fe.baa1e468-23be-4db0-8d16-13d6c4a693f6" returned: 0 in 0.389s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:52:41 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-a2ff3026-e8b3-49ec-842a-fdbc83835a8e tempest-SnapshotDependencyTests-1896093265 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e06a97bd-6ce9-49ef-8f1b-8469f31060fe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87329) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 06:52:41 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e51383b-adff-45b9-b0c0-088c8a69021b]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:52:41 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-a2ff3026-e8b3-49ec-842a-fdbc83835a8e tempest-SnapshotDependencyTests-1896093265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e06a97bd-6ce9-49ef-8f1b-8469f31060fe {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:52:42 devstack sudo[107236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e06a97bd-6ce9-49ef-8f1b-8469f31060fe Sep 06 06:52:42 devstack sudo[107236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:52:42 devstack sudo[107236]: pam_unix(sudo:session): session closed for user root Sep 06 06:52:42 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-a2ff3026-e8b3-49ec-842a-fdbc83835a8e tempest-SnapshotDependencyTests-1896093265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e06a97bd-6ce9-49ef-8f1b-8469f31060fe" returned: 0 in 0.578s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:52:42 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-a2ff3026-e8b3-49ec-842a-fdbc83835a8e tempest-SnapshotDependencyTests-1896093265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e06a97bd-6ce9-49ef-8f1b-8469f31060fe.baa1e468-23be-4db0-8d16-13d6c4a693f6 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:52:42 devstack sudo[107241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e06a97bd-6ce9-49ef-8f1b-8469f31060fe.baa1e468-23be-4db0-8d16-13d6c4a693f6 Sep 06 06:52:42 devstack sudo[107241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:52:42 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-0ab21248-062a-4a9e-98aa-70cb7b4ce324 tempest-ProjectReaderTests-1566093849 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:52:42 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-0ab21248-062a-4a9e-98aa-70cb7b4ce324 tempest-ProjectReaderTests-1566093849 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:52:42 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-0ab21248-062a-4a9e-98aa-70cb7b4ce324 tempest-ProjectReaderTests-1566093849 None] Creating offline snapshot ca7d982d-be3d-4a89-ae52-38e9452dcd81 of volume 6f172b4a-90c3-49b8-9f72-c18e54809d99 {{(pid=87329) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 06 06:52:42 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0a9a2f5-9a73-4451-9497-e26e6b9dff5b]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:52:42 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-0ab21248-062a-4a9e-98aa-70cb7b4ce324 tempest-ProjectReaderTests-1566093849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6f172b4a-90c3-49b8-9f72-c18e54809d99 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:52:42 devstack sudo[107243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6f172b4a-90c3-49b8-9f72-c18e54809d99 Sep 06 06:52:42 devstack sudo[107243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:52:42 devstack sudo[107241]: pam_unix(sudo:session): session closed for user root Sep 06 06:52:42 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-a2ff3026-e8b3-49ec-842a-fdbc83835a8e tempest-SnapshotDependencyTests-1896093265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e06a97bd-6ce9-49ef-8f1b-8469f31060fe.baa1e468-23be-4db0-8d16-13d6c4a693f6" returned: 0 in 0.407s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:52:42 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-a2ff3026-e8b3-49ec-842a-fdbc83835a8e tempest-SnapshotDependencyTests-1896093265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e06a97bd-6ce9-49ef-8f1b-8469f31060fe.baa1e468-23be-4db0-8d16-13d6c4a693f6 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:52:42 devstack sudo[107249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e06a97bd-6ce9-49ef-8f1b-8469f31060fe.baa1e468-23be-4db0-8d16-13d6c4a693f6 Sep 06 06:52:42 devstack sudo[107249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:52:43 devstack sudo[107243]: pam_unix(sudo:session): session closed for user root Sep 06 06:52:43 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-0ab21248-062a-4a9e-98aa-70cb7b4ce324 tempest-ProjectReaderTests-1566093849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6f172b4a-90c3-49b8-9f72-c18e54809d99" returned: 0 in 0.440s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:52:43 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-0ab21248-062a-4a9e-98aa-70cb7b4ce324 tempest-ProjectReaderTests-1566093849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6f172b4a-90c3-49b8-9f72-c18e54809d99,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6f172b4a-90c3-49b8-9f72-c18e54809d99.ca7d982d-be3d-4a89-ae52-38e9452dcd81 1G {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:52:43 devstack sudo[107254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6f172b4a-90c3-49b8-9f72-c18e54809d99,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6f172b4a-90c3-49b8-9f72-c18e54809d99.ca7d982d-be3d-4a89-ae52-38e9452dcd81 1G Sep 06 06:52:43 devstack sudo[107254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:52:43 devstack sudo[107249]: pam_unix(sudo:session): session closed for user root Sep 06 06:52:43 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-a2ff3026-e8b3-49ec-842a-fdbc83835a8e tempest-SnapshotDependencyTests-1896093265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e06a97bd-6ce9-49ef-8f1b-8469f31060fe.baa1e468-23be-4db0-8d16-13d6c4a693f6" returned: 0 in 0.256s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:52:43 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-a2ff3026-e8b3-49ec-842a-fdbc83835a8e tempest-SnapshotDependencyTests-1896093265 None] Lock "cinder-quobyte-baa1e468-23be-4db0-8d16-13d6c4a693f6" released by "_delete_snapshot" :: held 1.755s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:52:43 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-a2ff3026-e8b3-49ec-842a-fdbc83835a8e tempest-SnapshotDependencyTests-1896093265 None] Lock "cinder-quobyte-e06a97bd-6ce9-49ef-8f1b-8469f31060fe" released by "delete_snapshot" :: held 1.783s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:52:43 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-a2ff3026-e8b3-49ec-842a-fdbc83835a8e tempest-SnapshotDependencyTests-1896093265 None] Created reservations ['abdbdfba-9073-4784-a9e3-d9a623bc2648', 'ffd07852-ae3d-49d7-8d4f-9011cac0485d', '78df69a4-4ce1-4ee7-825b-8be2b4b7d88e', 'fcd60ed7-8df5-441e-b486-8601b2b21963'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:52:43 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-a2ff3026-e8b3-49ec-842a-fdbc83835a8e tempest-SnapshotDependencyTests-1896093265 None] Delete snapshot completed successfully. Sep 06 06:52:43 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-a2ff3026-e8b3-49ec-842a-fdbc83835a8e tempest-SnapshotDependencyTests-1896093265 None] Lock "cinder-baa1e468-23be-4db0-8d16-13d6c4a693f6-delete_snapshot" released by "delete_snapshot" :: held 1.978s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:52:43 devstack sudo[107254]: pam_unix(sudo:session): session closed for user root Sep 06 06:52:43 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-0ab21248-062a-4a9e-98aa-70cb7b4ce324 tempest-ProjectReaderTests-1566093849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6f172b4a-90c3-49b8-9f72-c18e54809d99,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6f172b4a-90c3-49b8-9f72-c18e54809d99.ca7d982d-be3d-4a89-ae52-38e9452dcd81 1G" returned: 0 in 0.547s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:52:43 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-0ab21248-062a-4a9e-98aa-70cb7b4ce324 tempest-ProjectReaderTests-1566093849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f172b4a-90c3-49b8-9f72-c18e54809d99 -F qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6f172b4a-90c3-49b8-9f72-c18e54809d99.ca7d982d-be3d-4a89-ae52-38e9452dcd81 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:52:43 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-300355af-3bdb-4bf4-80f9-47af5f9fc981 tempest-SnapshotDependencyTests-1896093265 None] Acquiring lock "cinder-e06a97bd-6ce9-49ef-8f1b-8469f31060fe-delete_volume" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:52:43 devstack sudo[107261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f172b4a-90c3-49b8-9f72-c18e54809d99 -F qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6f172b4a-90c3-49b8-9f72-c18e54809d99.ca7d982d-be3d-4a89-ae52-38e9452dcd81 Sep 06 06:52:43 devstack sudo[107261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:52:43 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-300355af-3bdb-4bf4-80f9-47af5f9fc981 tempest-SnapshotDependencyTests-1896093265 None] Lock "cinder-e06a97bd-6ce9-49ef-8f1b-8469f31060fe-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:52:43 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-300355af-3bdb-4bf4-80f9-47af5f9fc981 tempest-SnapshotDependencyTests-1896093265 None] Acquiring lock "cinder-quobyte-e06a97bd-6ce9-49ef-8f1b-8469f31060fe" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:52:43 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-300355af-3bdb-4bf4-80f9-47af5f9fc981 tempest-SnapshotDependencyTests-1896093265 None] Lock "cinder-quobyte-e06a97bd-6ce9-49ef-8f1b-8469f31060fe" acquired by "delete_volume" :: waited 0.023s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:52:43 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c971a67-d2ff-4c80-bcde-f85b303fd548]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:52:43 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-300355af-3bdb-4bf4-80f9-47af5f9fc981 tempest-SnapshotDependencyTests-1896093265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e06a97bd-6ce9-49ef-8f1b-8469f31060fe {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:52:43 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-6cda9691-e64c-49e6-9760-b61f180050ff tempest-ProjectMemberTests-77954883 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87329) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 06:52:43 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-6cda9691-e64c-49e6-9760-b61f180050ff tempest-ProjectMemberTests-77954883 None] Flow 'volume_create_manager' (aee25ea3-363e-4ffb-a519-b7dfcfafecc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:52:44 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-6cda9691-e64c-49e6-9760-b61f180050ff tempest-ProjectMemberTests-77954883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ac4710e-3fd9-4f8d-9294-6b7c2bb3e6f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:52:44 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-6cda9691-e64c-49e6-9760-b61f180050ff tempest-ProjectMemberTests-77954883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ac4710e-3fd9-4f8d-9294-6b7c2bb3e6f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:52:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-165383982',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24bb531f-806c-47ac-b7d2-20ac91133088,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9dc5436e8fa48389e888d8f19858d1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:52:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:52:44Z,use_quota=True,user_id='f9722e49a5da4ba7b028b07e73bfb4c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:52:44 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-6cda9691-e64c-49e6-9760-b61f180050ff tempest-ProjectMemberTests-77954883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1265b7e-2d35-43f1-be2f-96f378c026a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:52:44 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-6cda9691-e64c-49e6-9760-b61f180050ff tempest-ProjectMemberTests-77954883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1265b7e-2d35-43f1-be2f-96f378c026a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:52:44 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-6cda9691-e64c-49e6-9760-b61f180050ff tempest-ProjectMemberTests-77954883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e69af798-e3ae-48f2-acc5-3e0b812498c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:52:44 devstack sudo[107261]: pam_unix(sudo:session): session closed for user root Sep 06 06:52:44 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-6cda9691-e64c-49e6-9760-b61f180050ff tempest-ProjectMemberTests-77954883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e69af798-e3ae-48f2-acc5-3e0b812498c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24bb531f-806c-47ac-b7d2-20ac91133088', 'volume_name': 'volume-24bb531f-806c-47ac-b7d2-20ac91133088', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:52:44 devstack sudo[107263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e06a97bd-6ce9-49ef-8f1b-8469f31060fe Sep 06 06:52:44 devstack sudo[107263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:52:44 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-6cda9691-e64c-49e6-9760-b61f180050ff tempest-ProjectMemberTests-77954883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25f05741-fea2-4352-b65b-5032891e8502) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:52:44 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-6cda9691-e64c-49e6-9760-b61f180050ff tempest-ProjectMemberTests-77954883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25f05741-fea2-4352-b65b-5032891e8502) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:52:44 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-6cda9691-e64c-49e6-9760-b61f180050ff tempest-ProjectMemberTests-77954883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86ffb8fd-1ed9-4b42-a264-4ef346d702da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:52:44 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-6cda9691-e64c-49e6-9760-b61f180050ff tempest-ProjectMemberTests-77954883 None] Volume 24bb531f-806c-47ac-b7d2-20ac91133088: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24bb531f-806c-47ac-b7d2-20ac91133088', 'volume_size': 1} Sep 06 06:52:44 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-6cda9691-e64c-49e6-9760-b61f180050ff tempest-ProjectMemberTests-77954883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:52:44 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-0ab21248-062a-4a9e-98aa-70cb7b4ce324 tempest-ProjectReaderTests-1566093849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f172b4a-90c3-49b8-9f72-c18e54809d99 -F qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6f172b4a-90c3-49b8-9f72-c18e54809d99.ca7d982d-be3d-4a89-ae52-38e9452dcd81" returned: 0 in 0.411s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:52:44 devstack cinder-volume[87329]: WARNING cinder.volume.drivers.remotefs [None req-0ab21248-062a-4a9e-98aa-70cb7b4ce324 tempest-ProjectReaderTests-1566093849 None] /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6f172b4a-90c3-49b8-9f72-c18e54809d99.ca7d982d-be3d-4a89-ae52-38e9452dcd81 is being set with open permissions: ugo+rw Sep 06 06:52:44 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-0ab21248-062a-4a9e-98aa-70cb7b4ce324 tempest-ProjectReaderTests-1566093849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6f172b4a-90c3-49b8-9f72-c18e54809d99.ca7d982d-be3d-4a89-ae52-38e9452dcd81 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:52:44 devstack sudo[107269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6f172b4a-90c3-49b8-9f72-c18e54809d99.ca7d982d-be3d-4a89-ae52-38e9452dcd81 Sep 06 06:52:44 devstack sudo[107269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:52:44 devstack sudo[107269]: pam_unix(sudo:session): session closed for user root Sep 06 06:52:44 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-0ab21248-062a-4a9e-98aa-70cb7b4ce324 tempest-ProjectReaderTests-1566093849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6f172b4a-90c3-49b8-9f72-c18e54809d99.ca7d982d-be3d-4a89-ae52-38e9452dcd81" returned: 0 in 0.245s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:52:44 devstack sudo[107263]: pam_unix(sudo:session): session closed for user root Sep 06 06:52:44 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-300355af-3bdb-4bf4-80f9-47af5f9fc981 tempest-SnapshotDependencyTests-1896093265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e06a97bd-6ce9-49ef-8f1b-8469f31060fe" returned: 0 in 0.449s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:52:44 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-300355af-3bdb-4bf4-80f9-47af5f9fc981 tempest-SnapshotDependencyTests-1896093265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e06a97bd-6ce9-49ef-8f1b-8469f31060fe {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:52:44 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-0ab21248-062a-4a9e-98aa-70cb7b4ce324 tempest-ProjectReaderTests-1566093849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6f172b4a-90c3-49b8-9f72-c18e54809d99.info {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:52:44 devstack sudo[107275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e06a97bd-6ce9-49ef-8f1b-8469f31060fe Sep 06 06:52:44 devstack sudo[107275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:52:44 devstack sudo[107277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6f172b4a-90c3-49b8-9f72-c18e54809d99.info Sep 06 06:52:44 devstack sudo[107277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:52:44 devstack sudo[107275]: pam_unix(sudo:session): session closed for user root Sep 06 06:52:44 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-300355af-3bdb-4bf4-80f9-47af5f9fc981 tempest-SnapshotDependencyTests-1896093265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-e06a97bd-6ce9-49ef-8f1b-8469f31060fe" returned: 0 in 0.272s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:52:44 devstack sudo[107277]: pam_unix(sudo:session): session closed for user root Sep 06 06:52:44 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-300355af-3bdb-4bf4-80f9-47af5f9fc981 tempest-SnapshotDependencyTests-1896093265 None] Lock "cinder-quobyte-e06a97bd-6ce9-49ef-8f1b-8469f31060fe" released by "delete_volume" :: held 0.808s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:52:44 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-0ab21248-062a-4a9e-98aa-70cb7b4ce324 tempest-ProjectReaderTests-1566093849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6f172b4a-90c3-49b8-9f72-c18e54809d99.info" returned: 0 in 0.289s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:52:44 devstack cinder-volume[87329]: WARNING cinder.volume.drivers.remotefs [None req-0ab21248-062a-4a9e-98aa-70cb7b4ce324 tempest-ProjectReaderTests-1566093849 None] /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6f172b4a-90c3-49b8-9f72-c18e54809d99.info is being set with open permissions: ugo+rw Sep 06 06:52:44 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-0ab21248-062a-4a9e-98aa-70cb7b4ce324 tempest-ProjectReaderTests-1566093849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6f172b4a-90c3-49b8-9f72-c18e54809d99.info {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:52:44 devstack sudo[107281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6f172b4a-90c3-49b8-9f72-c18e54809d99.info Sep 06 06:52:44 devstack sudo[107281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:52:44 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-300355af-3bdb-4bf4-80f9-47af5f9fc981 tempest-SnapshotDependencyTests-1896093265 None] Created reservations ['e3fdc477-7526-431b-b858-1d09a57ec973', '2d9edb65-31cf-407e-b9bb-98f71ed8c8cb', 'fcf14239-2fc1-4be8-b4e6-45d2e45b88a7', '049bd372-ec97-4150-99b6-9714ffa67f47'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:52:44 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-300355af-3bdb-4bf4-80f9-47af5f9fc981 tempest-SnapshotDependencyTests-1896093265 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:52:44 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-300355af-3bdb-4bf4-80f9-47af5f9fc981 tempest-SnapshotDependencyTests-1896093265 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:52:44 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-300355af-3bdb-4bf4-80f9-47af5f9fc981 tempest-SnapshotDependencyTests-1896093265 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:52:44 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-300355af-3bdb-4bf4-80f9-47af5f9fc981 tempest-SnapshotDependencyTests-1896093265 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:52:44 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-300355af-3bdb-4bf4-80f9-47af5f9fc981 tempest-SnapshotDependencyTests-1896093265 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:52:44 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-300355af-3bdb-4bf4-80f9-47af5f9fc981 tempest-SnapshotDependencyTests-1896093265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:52:44 devstack sudo[107317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:52:44 devstack sudo[107317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:52:44 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-7b541a6b-2c6a-4af1-b3da-b76fb39d52d9 tempest-SnapshotDependencyTests-1896093265 None] Acquiring lock "cinder-194c70ca-e42a-4969-914c-4c6169ecacbe-delete_volume" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:52:44 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-7b541a6b-2c6a-4af1-b3da-b76fb39d52d9 tempest-SnapshotDependencyTests-1896093265 None] Lock "cinder-194c70ca-e42a-4969-914c-4c6169ecacbe-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:52:45 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-7b541a6b-2c6a-4af1-b3da-b76fb39d52d9 tempest-SnapshotDependencyTests-1896093265 None] Acquiring lock "cinder-quobyte-194c70ca-e42a-4969-914c-4c6169ecacbe" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:52:45 devstack sudo[107281]: pam_unix(sudo:session): session closed for user root Sep 06 06:52:45 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-0ab21248-062a-4a9e-98aa-70cb7b4ce324 tempest-ProjectReaderTests-1566093849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6f172b4a-90c3-49b8-9f72-c18e54809d99.info" returned: 0 in 0.429s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:52:45 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-0ab21248-062a-4a9e-98aa-70cb7b4ce324 tempest-ProjectReaderTests-1566093849 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.470s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:52:45 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-7b541a6b-2c6a-4af1-b3da-b76fb39d52d9 tempest-SnapshotDependencyTests-1896093265 None] Lock "cinder-quobyte-194c70ca-e42a-4969-914c-4c6169ecacbe" acquired by "delete_volume" :: waited 0.044s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:52:45 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-6cda9691-e64c-49e6-9760-b61f180050ff tempest-ProjectMemberTests-77954883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.053s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:52:45 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-6cda9691-e64c-49e6-9760-b61f180050ff tempest-ProjectMemberTests-77954883 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:52:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-165383982',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24bb531f-806c-47ac-b7d2-20ac91133088,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9dc5436e8fa48389e888d8f19858d1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:52:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:52:44Z,use_quota=True,user_id='f9722e49a5da4ba7b028b07e73bfb4c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)}" {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 06:52:45 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-6cda9691-e64c-49e6-9760-b61f180050ff tempest-ProjectMemberTests-77954883 None] Creating volume 24bb531f-806c-47ac-b7d2-20ac91133088 {{(pid=87329) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 06:52:45 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-6cda9691-e64c-49e6-9760-b61f180050ff tempest-ProjectMemberTests-77954883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:52:45 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-6cda9691-e64c-49e6-9760-b61f180050ff tempest-ProjectMemberTests-77954883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:52:45 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-6cda9691-e64c-49e6-9760-b61f180050ff tempest-ProjectMemberTests-77954883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:52:45 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-6cda9691-e64c-49e6-9760-b61f180050ff tempest-ProjectMemberTests-77954883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:52:45 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-6cda9691-e64c-49e6-9760-b61f180050ff tempest-ProjectMemberTests-77954883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:52:45 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-6cda9691-e64c-49e6-9760-b61f180050ff tempest-ProjectMemberTests-77954883 None] Selected osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 as target Quobyte volume. {{(pid=87329) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 06:52:45 devstack cinder-volume[87329]: INFO cinder.volume.drivers.remotefs [None req-6cda9691-e64c-49e6-9760-b61f180050ff tempest-ProjectMemberTests-77954883 None] casted to osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 Sep 06 06:52:45 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-6cda9691-e64c-49e6-9760-b61f180050ff tempest-ProjectMemberTests-77954883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-24bb531f-806c-47ac-b7d2-20ac91133088 1073741824 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:52:45 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eab486e-735f-49f6-9d9b-95e51b21b9af]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:52:45 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-7b541a6b-2c6a-4af1-b3da-b76fb39d52d9 tempest-SnapshotDependencyTests-1896093265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-194c70ca-e42a-4969-914c-4c6169ecacbe {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:52:45 devstack sudo[107320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-24bb531f-806c-47ac-b7d2-20ac91133088 1073741824 Sep 06 06:52:45 devstack sudo[107320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:52:45 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-0ab21248-062a-4a9e-98aa-70cb7b4ce324 tempest-ProjectReaderTests-1566093849 None] Create snapshot completed successfully Sep 06 06:52:45 devstack sudo[107317]: pam_unix(sudo:session): session closed for user root Sep 06 06:52:45 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-300355af-3bdb-4bf4-80f9-47af5f9fc981 tempest-SnapshotDependencyTests-1896093265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.414s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:52:45 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-300355af-3bdb-4bf4-80f9-47af5f9fc981 tempest-SnapshotDependencyTests-1896093265 None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:52:45 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-300355af-3bdb-4bf4-80f9-47af5f9fc981 tempest-SnapshotDependencyTests-1896093265 None] Deleted volume successfully. Sep 06 06:52:45 devstack sudo[107321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-194c70ca-e42a-4969-914c-4c6169ecacbe Sep 06 06:52:45 devstack sudo[107321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:52:45 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-300355af-3bdb-4bf4-80f9-47af5f9fc981 tempest-SnapshotDependencyTests-1896093265 None] Lock "cinder-e06a97bd-6ce9-49ef-8f1b-8469f31060fe-delete_volume" released by "delete_volume" :: held 1.546s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:52:45 devstack sudo[107321]: pam_unix(sudo:session): session closed for user root Sep 06 06:52:45 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-7b541a6b-2c6a-4af1-b3da-b76fb39d52d9 tempest-SnapshotDependencyTests-1896093265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-194c70ca-e42a-4969-914c-4c6169ecacbe" returned: 0 in 0.434s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:52:45 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-7b541a6b-2c6a-4af1-b3da-b76fb39d52d9 tempest-SnapshotDependencyTests-1896093265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-194c70ca-e42a-4969-914c-4c6169ecacbe {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:52:45 devstack sudo[107334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-194c70ca-e42a-4969-914c-4c6169ecacbe Sep 06 06:52:45 devstack sudo[107334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:52:45 devstack sudo[107320]: pam_unix(sudo:session): session closed for user root Sep 06 06:52:45 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-6cda9691-e64c-49e6-9760-b61f180050ff tempest-ProjectMemberTests-77954883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-24bb531f-806c-47ac-b7d2-20ac91133088 1073741824" returned: 0 in 0.543s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:52:45 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-6cda9691-e64c-49e6-9760-b61f180050ff tempest-ProjectMemberTests-77954883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-24bb531f-806c-47ac-b7d2-20ac91133088 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:52:45 devstack sudo[107336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-24bb531f-806c-47ac-b7d2-20ac91133088 Sep 06 06:52:45 devstack sudo[107336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:52:45 devstack sudo[107334]: pam_unix(sudo:session): session closed for user root Sep 06 06:52:45 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-7b541a6b-2c6a-4af1-b3da-b76fb39d52d9 tempest-SnapshotDependencyTests-1896093265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-194c70ca-e42a-4969-914c-4c6169ecacbe" returned: 0 in 0.292s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:52:45 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-7b541a6b-2c6a-4af1-b3da-b76fb39d52d9 tempest-SnapshotDependencyTests-1896093265 None] Lock "cinder-quobyte-194c70ca-e42a-4969-914c-4c6169ecacbe" released by "delete_volume" :: held 0.790s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:52:45 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-ab6a50a5-603d-4461-8c7f-2ed7c57cfeac tempest-ProjectReaderTests-1566093849 None] Acquiring lock "cinder-ca7d982d-be3d-4a89-ae52-38e9452dcd81-delete_snapshot" by "delete_snapshot" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:52:45 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-ab6a50a5-603d-4461-8c7f-2ed7c57cfeac tempest-ProjectReaderTests-1566093849 None] Lock "cinder-ca7d982d-be3d-4a89-ae52-38e9452dcd81-delete_snapshot" acquired by "delete_snapshot" :: waited 0.049s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:52:45 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-ab6a50a5-603d-4461-8c7f-2ed7c57cfeac tempest-ProjectReaderTests-1566093849 None] Acquiring lock "cinder-quobyte-6f172b4a-90c3-49b8-9f72-c18e54809d99" by "delete_snapshot" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:52:46 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-ab6a50a5-603d-4461-8c7f-2ed7c57cfeac tempest-ProjectReaderTests-1566093849 None] Lock "cinder-quobyte-6f172b4a-90c3-49b8-9f72-c18e54809d99" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:52:46 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-ab6a50a5-603d-4461-8c7f-2ed7c57cfeac tempest-ProjectReaderTests-1566093849 None] Acquiring lock "cinder-quobyte-ca7d982d-be3d-4a89-ae52-38e9452dcd81" by "_delete_snapshot" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:52:46 devstack sudo[107336]: pam_unix(sudo:session): session closed for user root Sep 06 06:52:46 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-6cda9691-e64c-49e6-9760-b61f180050ff tempest-ProjectMemberTests-77954883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-24bb531f-806c-47ac-b7d2-20ac91133088" returned: 0 in 0.330s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:52:46 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-6cda9691-e64c-49e6-9760-b61f180050ff tempest-ProjectMemberTests-77954883 None] <== create_volume: return (915ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'} {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 06:52:46 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-6cda9691-e64c-49e6-9760-b61f180050ff tempest-ProjectMemberTests-77954883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.919s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:52:46 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-ab6a50a5-603d-4461-8c7f-2ed7c57cfeac tempest-ProjectReaderTests-1566093849 None] Lock "cinder-quobyte-ca7d982d-be3d-4a89-ae52-38e9452dcd81" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:52:46 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-ab6a50a5-603d-4461-8c7f-2ed7c57cfeac tempest-ProjectReaderTests-1566093849 None] Deleting offline snapshot ca7d982d-be3d-4a89-ae52-38e9452dcd81 of volume 6f172b4a-90c3-49b8-9f72-c18e54809d99 {{(pid=87329) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 06 06:52:46 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-ab6a50a5-603d-4461-8c7f-2ed7c57cfeac tempest-ProjectReaderTests-1566093849 None] snapshot_file for this snap is: volume-6f172b4a-90c3-49b8-9f72-c18e54809d99.ca7d982d-be3d-4a89-ae52-38e9452dcd81 {{(pid=87329) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 06 06:52:46 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-6cda9691-e64c-49e6-9760-b61f180050ff tempest-ProjectMemberTests-77954883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86ffb8fd-1ed9-4b42-a264-4ef346d702da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24bb531f-806c-47ac-b7d2-20ac91133088', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:52:46 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-6cda9691-e64c-49e6-9760-b61f180050ff tempest-ProjectMemberTests-77954883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acf638b4-ed75-437c-a76b-52f5a2888371) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:52:46 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[434196af-a9ec-4825-90e4-b2b2c9e67ae2]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:52:46 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-ab6a50a5-603d-4461-8c7f-2ed7c57cfeac tempest-ProjectReaderTests-1566093849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6f172b4a-90c3-49b8-9f72-c18e54809d99.ca7d982d-be3d-4a89-ae52-38e9452dcd81 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:52:46 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-7b541a6b-2c6a-4af1-b3da-b76fb39d52d9 tempest-SnapshotDependencyTests-1896093265 None] Created reservations ['7fc92629-7f59-445a-a6fb-1731029b8d18', '2b4844fe-007a-4000-b654-2c9d54602c26', '7abd09b9-3c8f-46ea-88d5-6bb94da1c139', 'ff4594f6-ccd0-458f-a684-7a2835074aa1'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:52:46 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-6cda9691-e64c-49e6-9760-b61f180050ff tempest-ProjectMemberTests-77954883 None] Volume volume-24bb531f-806c-47ac-b7d2-20ac91133088 (24bb531f-806c-47ac-b7d2-20ac91133088): created successfully Sep 06 06:52:46 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-6cda9691-e64c-49e6-9760-b61f180050ff tempest-ProjectMemberTests-77954883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acf638b4-ed75-437c-a76b-52f5a2888371) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:52:46 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-6cda9691-e64c-49e6-9760-b61f180050ff tempest-ProjectMemberTests-77954883 None] Flow 'volume_create_manager' (aee25ea3-363e-4ffb-a519-b7dfcfafecc5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:52:46 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-6cda9691-e64c-49e6-9760-b61f180050ff tempest-ProjectMemberTests-77954883 None] Created volume successfully. Sep 06 06:52:46 devstack sudo[107340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6f172b4a-90c3-49b8-9f72-c18e54809d99.ca7d982d-be3d-4a89-ae52-38e9452dcd81 Sep 06 06:52:46 devstack sudo[107340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:52:46 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-7b541a6b-2c6a-4af1-b3da-b76fb39d52d9 tempest-SnapshotDependencyTests-1896093265 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:52:46 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-7b541a6b-2c6a-4af1-b3da-b76fb39d52d9 tempest-SnapshotDependencyTests-1896093265 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:52:46 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-7b541a6b-2c6a-4af1-b3da-b76fb39d52d9 tempest-SnapshotDependencyTests-1896093265 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:52:46 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-7b541a6b-2c6a-4af1-b3da-b76fb39d52d9 tempest-SnapshotDependencyTests-1896093265 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:52:46 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-7b541a6b-2c6a-4af1-b3da-b76fb39d52d9 tempest-SnapshotDependencyTests-1896093265 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:52:46 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-7b541a6b-2c6a-4af1-b3da-b76fb39d52d9 tempest-SnapshotDependencyTests-1896093265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:52:46 devstack sudo[107342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:52:46 devstack sudo[107342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:52:46 devstack sudo[107340]: pam_unix(sudo:session): session closed for user root Sep 06 06:52:46 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-ab6a50a5-603d-4461-8c7f-2ed7c57cfeac tempest-ProjectReaderTests-1566093849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6f172b4a-90c3-49b8-9f72-c18e54809d99.ca7d982d-be3d-4a89-ae52-38e9452dcd81" returned: 0 in 0.394s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:52:46 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-ab6a50a5-603d-4461-8c7f-2ed7c57cfeac tempest-ProjectReaderTests-1566093849 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6f172b4a-90c3-49b8-9f72-c18e54809d99(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87329) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 06:52:46 devstack sudo[107342]: pam_unix(sudo:session): session closed for user root Sep 06 06:52:46 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-7b541a6b-2c6a-4af1-b3da-b76fb39d52d9 tempest-SnapshotDependencyTests-1896093265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.272s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:52:46 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-7b541a6b-2c6a-4af1-b3da-b76fb39d52d9 tempest-SnapshotDependencyTests-1896093265 None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:52:46 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-7b541a6b-2c6a-4af1-b3da-b76fb39d52d9 tempest-SnapshotDependencyTests-1896093265 None] Deleted volume successfully. Sep 06 06:52:46 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[b66c5633-4db9-42b8-b763-484868be2a79]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:52:46 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-ab6a50a5-603d-4461-8c7f-2ed7c57cfeac tempest-ProjectReaderTests-1566093849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6f172b4a-90c3-49b8-9f72-c18e54809d99 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:52:46 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-7b541a6b-2c6a-4af1-b3da-b76fb39d52d9 tempest-SnapshotDependencyTests-1896093265 None] Lock "cinder-194c70ca-e42a-4969-914c-4c6169ecacbe-delete_volume" released by "delete_volume" :: held 1.591s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:52:46 devstack sudo[107348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6f172b4a-90c3-49b8-9f72-c18e54809d99 Sep 06 06:52:46 devstack sudo[107348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:52:46 devstack sudo[107348]: pam_unix(sudo:session): session closed for user root Sep 06 06:52:46 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-ab6a50a5-603d-4461-8c7f-2ed7c57cfeac tempest-ProjectReaderTests-1566093849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6f172b4a-90c3-49b8-9f72-c18e54809d99" returned: 0 in 0.376s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:52:46 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-ab6a50a5-603d-4461-8c7f-2ed7c57cfeac tempest-ProjectReaderTests-1566093849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6f172b4a-90c3-49b8-9f72-c18e54809d99.ca7d982d-be3d-4a89-ae52-38e9452dcd81 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:52:46 devstack sudo[107353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6f172b4a-90c3-49b8-9f72-c18e54809d99.ca7d982d-be3d-4a89-ae52-38e9452dcd81 Sep 06 06:52:46 devstack sudo[107353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:52:47 devstack sudo[107353]: pam_unix(sudo:session): session closed for user root Sep 06 06:52:47 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-ab6a50a5-603d-4461-8c7f-2ed7c57cfeac tempest-ProjectReaderTests-1566093849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6f172b4a-90c3-49b8-9f72-c18e54809d99.ca7d982d-be3d-4a89-ae52-38e9452dcd81" returned: 0 in 0.373s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:52:47 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-ab6a50a5-603d-4461-8c7f-2ed7c57cfeac tempest-ProjectReaderTests-1566093849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6f172b4a-90c3-49b8-9f72-c18e54809d99.ca7d982d-be3d-4a89-ae52-38e9452dcd81 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:52:47 devstack sudo[107359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6f172b4a-90c3-49b8-9f72-c18e54809d99.ca7d982d-be3d-4a89-ae52-38e9452dcd81 Sep 06 06:52:47 devstack sudo[107359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:52:47 devstack sudo[107359]: pam_unix(sudo:session): session closed for user root Sep 06 06:52:47 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-ab6a50a5-603d-4461-8c7f-2ed7c57cfeac tempest-ProjectReaderTests-1566093849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6f172b4a-90c3-49b8-9f72-c18e54809d99.ca7d982d-be3d-4a89-ae52-38e9452dcd81" returned: 0 in 0.252s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:52:47 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-ab6a50a5-603d-4461-8c7f-2ed7c57cfeac tempest-ProjectReaderTests-1566093849 None] Lock "cinder-quobyte-ca7d982d-be3d-4a89-ae52-38e9452dcd81" released by "_delete_snapshot" :: held 1.559s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:52:47 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-ab6a50a5-603d-4461-8c7f-2ed7c57cfeac tempest-ProjectReaderTests-1566093849 None] Lock "cinder-quobyte-6f172b4a-90c3-49b8-9f72-c18e54809d99" released by "delete_snapshot" :: held 1.603s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:52:47 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-1f58dac0-8e21-414e-9fd6-f695e0e120a8 tempest-ProjectMemberTests-77954883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:52:47 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-1f58dac0-8e21-414e-9fd6-f695e0e120a8 tempest-ProjectMemberTests-77954883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:52:47 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-1f58dac0-8e21-414e-9fd6-f695e0e120a8 tempest-ProjectMemberTests-77954883 None] Creating offline snapshot f7d58b61-8737-4280-9f7a-6d0f30c65cb4 of volume 24bb531f-806c-47ac-b7d2-20ac91133088 {{(pid=87329) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 06 06:52:47 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceffc653-72b3-445a-8c63-8e72dc45ff69]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:52:47 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-1f58dac0-8e21-414e-9fd6-f695e0e120a8 tempest-ProjectMemberTests-77954883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-24bb531f-806c-47ac-b7d2-20ac91133088 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:52:47 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-ab6a50a5-603d-4461-8c7f-2ed7c57cfeac tempest-ProjectReaderTests-1566093849 None] Created reservations ['f33c84ee-0325-400e-83a0-b8f642941f3b', '2a9f2732-7970-4d7d-829d-33b4e7ddae26', '22e7f0a5-d586-42dc-8e67-e1c595dffda2', '89188787-0885-485d-b36c-4c4c3a8fbb58'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:52:47 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-ab6a50a5-603d-4461-8c7f-2ed7c57cfeac tempest-ProjectReaderTests-1566093849 None] Delete snapshot completed successfully. Sep 06 06:52:47 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-ab6a50a5-603d-4461-8c7f-2ed7c57cfeac tempest-ProjectReaderTests-1566093849 None] Lock "cinder-ca7d982d-be3d-4a89-ae52-38e9452dcd81-delete_snapshot" released by "delete_snapshot" :: held 1.805s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:52:47 devstack sudo[107362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-24bb531f-806c-47ac-b7d2-20ac91133088 Sep 06 06:52:47 devstack sudo[107362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:52:48 devstack sudo[107362]: pam_unix(sudo:session): session closed for user root Sep 06 06:52:48 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-1f58dac0-8e21-414e-9fd6-f695e0e120a8 tempest-ProjectMemberTests-77954883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-24bb531f-806c-47ac-b7d2-20ac91133088" returned: 0 in 0.400s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:52:48 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-1f58dac0-8e21-414e-9fd6-f695e0e120a8 tempest-ProjectMemberTests-77954883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-24bb531f-806c-47ac-b7d2-20ac91133088,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-24bb531f-806c-47ac-b7d2-20ac91133088.f7d58b61-8737-4280-9f7a-6d0f30c65cb4 1G {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:52:48 devstack sudo[107367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-24bb531f-806c-47ac-b7d2-20ac91133088,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-24bb531f-806c-47ac-b7d2-20ac91133088.f7d58b61-8737-4280-9f7a-6d0f30c65cb4 1G Sep 06 06:52:48 devstack sudo[107367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:52:48 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-82df6c63-5b96-40a4-9dea-0220b949f16b tempest-ProjectReaderTests-1566093849 None] Acquiring lock "cinder-6f172b4a-90c3-49b8-9f72-c18e54809d99-delete_volume" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:52:48 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-82df6c63-5b96-40a4-9dea-0220b949f16b tempest-ProjectReaderTests-1566093849 None] Lock "cinder-6f172b4a-90c3-49b8-9f72-c18e54809d99-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:52:48 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-82df6c63-5b96-40a4-9dea-0220b949f16b tempest-ProjectReaderTests-1566093849 None] Acquiring lock "cinder-quobyte-6f172b4a-90c3-49b8-9f72-c18e54809d99" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:52:48 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-82df6c63-5b96-40a4-9dea-0220b949f16b tempest-ProjectReaderTests-1566093849 None] Lock "cinder-quobyte-6f172b4a-90c3-49b8-9f72-c18e54809d99" acquired by "delete_volume" :: waited 0.016s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:52:48 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[de3cb88f-359e-4d75-89bd-a0aa1f272dfe]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:52:48 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-82df6c63-5b96-40a4-9dea-0220b949f16b tempest-ProjectReaderTests-1566093849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6f172b4a-90c3-49b8-9f72-c18e54809d99 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:52:48 devstack sudo[107369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6f172b4a-90c3-49b8-9f72-c18e54809d99 Sep 06 06:52:48 devstack sudo[107369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:52:48 devstack cinder-volume[87329]: DEBUG oslo_service.periodic_task [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87329) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 06 06:52:48 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:52:48 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:52:48 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:52:48 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:52:48 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:52:48 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:52:48 devstack sudo[107374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:52:48 devstack sudo[107374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:52:48 devstack sudo[107367]: pam_unix(sudo:session): session closed for user root Sep 06 06:52:48 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-1f58dac0-8e21-414e-9fd6-f695e0e120a8 tempest-ProjectMemberTests-77954883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-24bb531f-806c-47ac-b7d2-20ac91133088,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-24bb531f-806c-47ac-b7d2-20ac91133088.f7d58b61-8737-4280-9f7a-6d0f30c65cb4 1G" returned: 0 in 0.488s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:52:48 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-1f58dac0-8e21-414e-9fd6-f695e0e120a8 tempest-ProjectMemberTests-77954883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-24bb531f-806c-47ac-b7d2-20ac91133088 -F qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-24bb531f-806c-47ac-b7d2-20ac91133088.f7d58b61-8737-4280-9f7a-6d0f30c65cb4 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:52:48 devstack sudo[107378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-24bb531f-806c-47ac-b7d2-20ac91133088 -F qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-24bb531f-806c-47ac-b7d2-20ac91133088.f7d58b61-8737-4280-9f7a-6d0f30c65cb4 Sep 06 06:52:48 devstack sudo[107378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:52:48 devstack sudo[107369]: pam_unix(sudo:session): session closed for user root Sep 06 06:52:48 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-82df6c63-5b96-40a4-9dea-0220b949f16b tempest-ProjectReaderTests-1566093849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6f172b4a-90c3-49b8-9f72-c18e54809d99" returned: 0 in 0.420s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:52:48 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-82df6c63-5b96-40a4-9dea-0220b949f16b tempest-ProjectReaderTests-1566093849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6f172b4a-90c3-49b8-9f72-c18e54809d99 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:52:48 devstack sudo[107382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6f172b4a-90c3-49b8-9f72-c18e54809d99 Sep 06 06:52:48 devstack sudo[107382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:52:48 devstack sudo[107374]: pam_unix(sudo:session): session closed for user root Sep 06 06:52:48 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.388s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:52:48 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:52:48 devstack cinder-volume[87329]: DEBUG oslo_service.periodic_task [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Running periodic task VolumeManager._thread_info {{(pid=87329) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 06 06:52:48 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] thread count: 28 {{(pid=87329) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 06 06:52:48 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] thread info: [<_MainThread(MainThread, started 126855043821696)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87329) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 06 06:52:48 devstack sudo[107378]: pam_unix(sudo:session): session closed for user root Sep 06 06:52:48 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-1f58dac0-8e21-414e-9fd6-f695e0e120a8 tempest-ProjectMemberTests-77954883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-24bb531f-806c-47ac-b7d2-20ac91133088 -F qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-24bb531f-806c-47ac-b7d2-20ac91133088.f7d58b61-8737-4280-9f7a-6d0f30c65cb4" returned: 0 in 0.344s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:52:48 devstack cinder-volume[87329]: WARNING cinder.volume.drivers.remotefs [None req-1f58dac0-8e21-414e-9fd6-f695e0e120a8 tempest-ProjectMemberTests-77954883 None] /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-24bb531f-806c-47ac-b7d2-20ac91133088.f7d58b61-8737-4280-9f7a-6d0f30c65cb4 is being set with open permissions: ugo+rw Sep 06 06:52:48 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-1f58dac0-8e21-414e-9fd6-f695e0e120a8 tempest-ProjectMemberTests-77954883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-24bb531f-806c-47ac-b7d2-20ac91133088.f7d58b61-8737-4280-9f7a-6d0f30c65cb4 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:52:48 devstack sudo[107390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-24bb531f-806c-47ac-b7d2-20ac91133088.f7d58b61-8737-4280-9f7a-6d0f30c65cb4 Sep 06 06:52:48 devstack sudo[107390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:52:48 devstack sudo[107382]: pam_unix(sudo:session): session closed for user root Sep 06 06:52:48 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-82df6c63-5b96-40a4-9dea-0220b949f16b tempest-ProjectReaderTests-1566093849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6f172b4a-90c3-49b8-9f72-c18e54809d99" returned: 0 in 0.306s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:52:49 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-82df6c63-5b96-40a4-9dea-0220b949f16b tempest-ProjectReaderTests-1566093849 None] Lock "cinder-quobyte-6f172b4a-90c3-49b8-9f72-c18e54809d99" released by "delete_volume" :: held 0.792s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:52:49 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-82df6c63-5b96-40a4-9dea-0220b949f16b tempest-ProjectReaderTests-1566093849 None] Created reservations ['7d5982b3-2ed8-4028-8b47-76174e871da7', 'd4662d7b-9e88-4c5d-847c-ddb45725b6a6', '161c4b44-fa05-476b-9774-fc6929f9225d', 'fac82594-c529-4639-bcbe-1224c644efed'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:52:49 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-82df6c63-5b96-40a4-9dea-0220b949f16b tempest-ProjectReaderTests-1566093849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:52:49 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-82df6c63-5b96-40a4-9dea-0220b949f16b tempest-ProjectReaderTests-1566093849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:52:49 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-82df6c63-5b96-40a4-9dea-0220b949f16b tempest-ProjectReaderTests-1566093849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:52:49 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-82df6c63-5b96-40a4-9dea-0220b949f16b tempest-ProjectReaderTests-1566093849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:52:49 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-82df6c63-5b96-40a4-9dea-0220b949f16b tempest-ProjectReaderTests-1566093849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:52:49 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-82df6c63-5b96-40a4-9dea-0220b949f16b tempest-ProjectReaderTests-1566093849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:52:49 devstack sudo[107390]: pam_unix(sudo:session): session closed for user root Sep 06 06:52:49 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-1f58dac0-8e21-414e-9fd6-f695e0e120a8 tempest-ProjectMemberTests-77954883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-24bb531f-806c-47ac-b7d2-20ac91133088.f7d58b61-8737-4280-9f7a-6d0f30c65cb4" returned: 0 in 0.253s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:52:49 devstack sudo[107394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:52:49 devstack sudo[107394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:52:49 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-1f58dac0-8e21-414e-9fd6-f695e0e120a8 tempest-ProjectMemberTests-77954883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-24bb531f-806c-47ac-b7d2-20ac91133088.info {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:52:49 devstack sudo[107396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-24bb531f-806c-47ac-b7d2-20ac91133088.info Sep 06 06:52:49 devstack sudo[107396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:52:49 devstack sudo[107394]: pam_unix(sudo:session): session closed for user root Sep 06 06:52:49 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-82df6c63-5b96-40a4-9dea-0220b949f16b tempest-ProjectReaderTests-1566093849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.289s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:52:49 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-82df6c63-5b96-40a4-9dea-0220b949f16b tempest-ProjectReaderTests-1566093849 None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:52:49 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-82df6c63-5b96-40a4-9dea-0220b949f16b tempest-ProjectReaderTests-1566093849 None] Deleted volume successfully. Sep 06 06:52:49 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-82df6c63-5b96-40a4-9dea-0220b949f16b tempest-ProjectReaderTests-1566093849 None] Lock "cinder-6f172b4a-90c3-49b8-9f72-c18e54809d99-delete_volume" released by "delete_volume" :: held 1.316s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:52:49 devstack sudo[107396]: pam_unix(sudo:session): session closed for user root Sep 06 06:52:49 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-1f58dac0-8e21-414e-9fd6-f695e0e120a8 tempest-ProjectMemberTests-77954883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-24bb531f-806c-47ac-b7d2-20ac91133088.info" returned: 0 in 0.292s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:52:49 devstack cinder-volume[87329]: WARNING cinder.volume.drivers.remotefs [None req-1f58dac0-8e21-414e-9fd6-f695e0e120a8 tempest-ProjectMemberTests-77954883 None] /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-24bb531f-806c-47ac-b7d2-20ac91133088.info is being set with open permissions: ugo+rw Sep 06 06:52:49 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-1f58dac0-8e21-414e-9fd6-f695e0e120a8 tempest-ProjectMemberTests-77954883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-24bb531f-806c-47ac-b7d2-20ac91133088.info {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:52:49 devstack sudo[107400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-24bb531f-806c-47ac-b7d2-20ac91133088.info Sep 06 06:52:49 devstack sudo[107400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:52:49 devstack sudo[107400]: pam_unix(sudo:session): session closed for user root Sep 06 06:52:49 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-1f58dac0-8e21-414e-9fd6-f695e0e120a8 tempest-ProjectMemberTests-77954883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-24bb531f-806c-47ac-b7d2-20ac91133088.info" returned: 0 in 0.267s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:52:49 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-1f58dac0-8e21-414e-9fd6-f695e0e120a8 tempest-ProjectMemberTests-77954883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.156s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:52:49 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-1f58dac0-8e21-414e-9fd6-f695e0e120a8 tempest-ProjectMemberTests-77954883 None] Create snapshot completed successfully Sep 06 06:52:50 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-aae5a98d-7357-494c-b4fd-0e3239f70f30 tempest-ProjectMemberTests-77954883 None] Acquiring lock "cinder-f7d58b61-8737-4280-9f7a-6d0f30c65cb4-delete_snapshot" by "delete_snapshot" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:52:50 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-aae5a98d-7357-494c-b4fd-0e3239f70f30 tempest-ProjectMemberTests-77954883 None] Lock "cinder-f7d58b61-8737-4280-9f7a-6d0f30c65cb4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.049s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:52:50 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-aae5a98d-7357-494c-b4fd-0e3239f70f30 tempest-ProjectMemberTests-77954883 None] Acquiring lock "cinder-quobyte-24bb531f-806c-47ac-b7d2-20ac91133088" by "delete_snapshot" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:52:50 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-aae5a98d-7357-494c-b4fd-0e3239f70f30 tempest-ProjectMemberTests-77954883 None] Lock "cinder-quobyte-24bb531f-806c-47ac-b7d2-20ac91133088" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:52:50 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-aae5a98d-7357-494c-b4fd-0e3239f70f30 tempest-ProjectMemberTests-77954883 None] Acquiring lock "cinder-quobyte-f7d58b61-8737-4280-9f7a-6d0f30c65cb4" by "_delete_snapshot" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:52:50 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-aae5a98d-7357-494c-b4fd-0e3239f70f30 tempest-ProjectMemberTests-77954883 None] Lock "cinder-quobyte-f7d58b61-8737-4280-9f7a-6d0f30c65cb4" acquired by "_delete_snapshot" :: waited 0.039s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:52:50 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-aae5a98d-7357-494c-b4fd-0e3239f70f30 tempest-ProjectMemberTests-77954883 None] Deleting offline snapshot f7d58b61-8737-4280-9f7a-6d0f30c65cb4 of volume 24bb531f-806c-47ac-b7d2-20ac91133088 {{(pid=87329) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 06 06:52:50 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-aae5a98d-7357-494c-b4fd-0e3239f70f30 tempest-ProjectMemberTests-77954883 None] snapshot_file for this snap is: volume-24bb531f-806c-47ac-b7d2-20ac91133088.f7d58b61-8737-4280-9f7a-6d0f30c65cb4 {{(pid=87329) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 06 06:52:50 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b48c58b-695b-4871-80f7-60c77a5eebe9]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:52:50 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-aae5a98d-7357-494c-b4fd-0e3239f70f30 tempest-ProjectMemberTests-77954883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-24bb531f-806c-47ac-b7d2-20ac91133088.f7d58b61-8737-4280-9f7a-6d0f30c65cb4 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:52:51 devstack sudo[107404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-24bb531f-806c-47ac-b7d2-20ac91133088.f7d58b61-8737-4280-9f7a-6d0f30c65cb4 Sep 06 06:52:51 devstack sudo[107404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:52:51 devstack sudo[107404]: pam_unix(sudo:session): session closed for user root Sep 06 06:52:51 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-aae5a98d-7357-494c-b4fd-0e3239f70f30 tempest-ProjectMemberTests-77954883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-24bb531f-806c-47ac-b7d2-20ac91133088.f7d58b61-8737-4280-9f7a-6d0f30c65cb4" returned: 0 in 0.428s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:52:51 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-aae5a98d-7357-494c-b4fd-0e3239f70f30 tempest-ProjectMemberTests-77954883 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-24bb531f-806c-47ac-b7d2-20ac91133088(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87329) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 06:52:51 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[08d7681d-e287-482a-8a50-265e0b2a0f1c]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:52:51 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-aae5a98d-7357-494c-b4fd-0e3239f70f30 tempest-ProjectMemberTests-77954883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-24bb531f-806c-47ac-b7d2-20ac91133088 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:52:51 devstack sudo[107409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-24bb531f-806c-47ac-b7d2-20ac91133088 Sep 06 06:52:51 devstack sudo[107409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:52:51 devstack sudo[107409]: pam_unix(sudo:session): session closed for user root Sep 06 06:52:51 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-aae5a98d-7357-494c-b4fd-0e3239f70f30 tempest-ProjectMemberTests-77954883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-24bb531f-806c-47ac-b7d2-20ac91133088" returned: 0 in 0.423s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:52:51 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-aae5a98d-7357-494c-b4fd-0e3239f70f30 tempest-ProjectMemberTests-77954883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-24bb531f-806c-47ac-b7d2-20ac91133088.f7d58b61-8737-4280-9f7a-6d0f30c65cb4 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:52:51 devstack sudo[107416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-24bb531f-806c-47ac-b7d2-20ac91133088.f7d58b61-8737-4280-9f7a-6d0f30c65cb4 Sep 06 06:52:51 devstack sudo[107416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:52:52 devstack sudo[107416]: pam_unix(sudo:session): session closed for user root Sep 06 06:52:52 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-aae5a98d-7357-494c-b4fd-0e3239f70f30 tempest-ProjectMemberTests-77954883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-24bb531f-806c-47ac-b7d2-20ac91133088.f7d58b61-8737-4280-9f7a-6d0f30c65cb4" returned: 0 in 0.388s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:52:52 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-aae5a98d-7357-494c-b4fd-0e3239f70f30 tempest-ProjectMemberTests-77954883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-24bb531f-806c-47ac-b7d2-20ac91133088.f7d58b61-8737-4280-9f7a-6d0f30c65cb4 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:52:52 devstack sudo[107422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-24bb531f-806c-47ac-b7d2-20ac91133088.f7d58b61-8737-4280-9f7a-6d0f30c65cb4 Sep 06 06:52:52 devstack sudo[107422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:52:52 devstack sudo[107422]: pam_unix(sudo:session): session closed for user root Sep 06 06:52:52 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-aae5a98d-7357-494c-b4fd-0e3239f70f30 tempest-ProjectMemberTests-77954883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-24bb531f-806c-47ac-b7d2-20ac91133088.f7d58b61-8737-4280-9f7a-6d0f30c65cb4" returned: 0 in 0.268s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:52:52 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-aae5a98d-7357-494c-b4fd-0e3239f70f30 tempest-ProjectMemberTests-77954883 None] Lock "cinder-quobyte-f7d58b61-8737-4280-9f7a-6d0f30c65cb4" released by "_delete_snapshot" :: held 1.665s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:52:52 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-aae5a98d-7357-494c-b4fd-0e3239f70f30 tempest-ProjectMemberTests-77954883 None] Lock "cinder-quobyte-24bb531f-806c-47ac-b7d2-20ac91133088" released by "delete_snapshot" :: held 1.712s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:52:52 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-aae5a98d-7357-494c-b4fd-0e3239f70f30 tempest-ProjectMemberTests-77954883 None] Created reservations ['8e86e2fa-1957-45d7-a0f0-fdf6c9d4d81d', '333c0705-8757-44a7-9fbe-05df5fe57c42', '20bd178c-436c-4ba5-ad11-05485237007f', '6b5fa497-ee25-4feb-b6f7-7002f2addd2a'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:52:52 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-aae5a98d-7357-494c-b4fd-0e3239f70f30 tempest-ProjectMemberTests-77954883 None] Delete snapshot completed successfully. Sep 06 06:52:52 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-aae5a98d-7357-494c-b4fd-0e3239f70f30 tempest-ProjectMemberTests-77954883 None] Lock "cinder-f7d58b61-8737-4280-9f7a-6d0f30c65cb4-delete_snapshot" released by "delete_snapshot" :: held 1.920s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:52:53 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-075261b7-f39a-4d46-9eeb-2b3bcd783d8c tempest-ProjectMemberTests-77954883 None] Acquiring lock "cinder-24bb531f-806c-47ac-b7d2-20ac91133088-delete_volume" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:52:53 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-075261b7-f39a-4d46-9eeb-2b3bcd783d8c tempest-ProjectMemberTests-77954883 None] Lock "cinder-24bb531f-806c-47ac-b7d2-20ac91133088-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:52:53 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-075261b7-f39a-4d46-9eeb-2b3bcd783d8c tempest-ProjectMemberTests-77954883 None] Acquiring lock "cinder-quobyte-24bb531f-806c-47ac-b7d2-20ac91133088" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:52:53 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-075261b7-f39a-4d46-9eeb-2b3bcd783d8c tempest-ProjectMemberTests-77954883 None] Lock "cinder-quobyte-24bb531f-806c-47ac-b7d2-20ac91133088" acquired by "delete_volume" :: waited 0.024s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:52:53 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0cc9107-4b13-4b76-a426-fc229ad3f108]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:52:53 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-075261b7-f39a-4d46-9eeb-2b3bcd783d8c tempest-ProjectMemberTests-77954883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-24bb531f-806c-47ac-b7d2-20ac91133088 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:52:53 devstack sudo[107425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-24bb531f-806c-47ac-b7d2-20ac91133088 Sep 06 06:52:53 devstack sudo[107425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:52:53 devstack sudo[107425]: pam_unix(sudo:session): session closed for user root Sep 06 06:52:53 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-075261b7-f39a-4d46-9eeb-2b3bcd783d8c tempest-ProjectMemberTests-77954883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-24bb531f-806c-47ac-b7d2-20ac91133088" returned: 0 in 0.427s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:52:53 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-075261b7-f39a-4d46-9eeb-2b3bcd783d8c tempest-ProjectMemberTests-77954883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-24bb531f-806c-47ac-b7d2-20ac91133088 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:52:53 devstack sudo[107432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-24bb531f-806c-47ac-b7d2-20ac91133088 Sep 06 06:52:53 devstack sudo[107432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:52:53 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c739020-91b6-4996-bd1e-90ef69881824 tempest-ProjectReaderTests-801230299 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87329) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 06:52:53 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-0c739020-91b6-4996-bd1e-90ef69881824 tempest-ProjectReaderTests-801230299 None] Flow 'volume_create_manager' (a03d4d52-8cc0-484e-b113-d8d063b4a5f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:52:53 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-0c739020-91b6-4996-bd1e-90ef69881824 tempest-ProjectReaderTests-801230299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (477f4387-444e-4635-9f1c-b9101dde676e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:52:53 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-0c739020-91b6-4996-bd1e-90ef69881824 tempest-ProjectReaderTests-801230299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (477f4387-444e-4635-9f1c-b9101dde676e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:52:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1672587364',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67f2cb36-25a8-4feb-9d7f-9300589daa71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e3094aeb03f4770b80420a4ce3147c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:52:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:52:54Z,use_quota=True,user_id='28acf64a08b34c72aad6ec6fec2c6c1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:52:53 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-0c739020-91b6-4996-bd1e-90ef69881824 tempest-ProjectReaderTests-801230299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3786dbb-2e4c-4848-8918-e8472cd78866) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:52:53 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-0c739020-91b6-4996-bd1e-90ef69881824 tempest-ProjectReaderTests-801230299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3786dbb-2e4c-4848-8918-e8472cd78866) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:52:53 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-0c739020-91b6-4996-bd1e-90ef69881824 tempest-ProjectReaderTests-801230299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94d2abc4-1ea9-4671-a646-6a12988abd31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:52:53 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-0c739020-91b6-4996-bd1e-90ef69881824 tempest-ProjectReaderTests-801230299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94d2abc4-1ea9-4671-a646-6a12988abd31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '67f2cb36-25a8-4feb-9d7f-9300589daa71', 'volume_name': 'volume-67f2cb36-25a8-4feb-9d7f-9300589daa71', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:52:53 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-0c739020-91b6-4996-bd1e-90ef69881824 tempest-ProjectReaderTests-801230299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a341d4b3-f926-4e6a-8ae1-83c9900a4e30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:52:53 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-0c739020-91b6-4996-bd1e-90ef69881824 tempest-ProjectReaderTests-801230299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a341d4b3-f926-4e6a-8ae1-83c9900a4e30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:52:53 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-0c739020-91b6-4996-bd1e-90ef69881824 tempest-ProjectReaderTests-801230299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa136d7e-21f9-44be-9888-1fded81ca36a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:52:53 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-0c739020-91b6-4996-bd1e-90ef69881824 tempest-ProjectReaderTests-801230299 None] Volume 67f2cb36-25a8-4feb-9d7f-9300589daa71: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-67f2cb36-25a8-4feb-9d7f-9300589daa71', 'volume_size': 1} Sep 06 06:52:53 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-0c739020-91b6-4996-bd1e-90ef69881824 tempest-ProjectReaderTests-801230299 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:52:53 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-0c739020-91b6-4996-bd1e-90ef69881824 tempest-ProjectReaderTests-801230299 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:52:53 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-0c739020-91b6-4996-bd1e-90ef69881824 tempest-ProjectReaderTests-801230299 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:52:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1672587364',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67f2cb36-25a8-4feb-9d7f-9300589daa71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e3094aeb03f4770b80420a4ce3147c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:52:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:52:54Z,use_quota=True,user_id='28acf64a08b34c72aad6ec6fec2c6c1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)}" {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 06:52:53 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-0c739020-91b6-4996-bd1e-90ef69881824 tempest-ProjectReaderTests-801230299 None] Creating volume 67f2cb36-25a8-4feb-9d7f-9300589daa71 {{(pid=87329) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 06:52:53 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-0c739020-91b6-4996-bd1e-90ef69881824 tempest-ProjectReaderTests-801230299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:52:53 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-0c739020-91b6-4996-bd1e-90ef69881824 tempest-ProjectReaderTests-801230299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:52:53 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-0c739020-91b6-4996-bd1e-90ef69881824 tempest-ProjectReaderTests-801230299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:52:53 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-0c739020-91b6-4996-bd1e-90ef69881824 tempest-ProjectReaderTests-801230299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:52:53 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-0c739020-91b6-4996-bd1e-90ef69881824 tempest-ProjectReaderTests-801230299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:52:53 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-0c739020-91b6-4996-bd1e-90ef69881824 tempest-ProjectReaderTests-801230299 None] Selected osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 as target Quobyte volume. {{(pid=87329) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 06:52:53 devstack cinder-volume[87329]: INFO cinder.volume.drivers.remotefs [None req-0c739020-91b6-4996-bd1e-90ef69881824 tempest-ProjectReaderTests-801230299 None] casted to osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 Sep 06 06:52:53 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-0c739020-91b6-4996-bd1e-90ef69881824 tempest-ProjectReaderTests-801230299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-67f2cb36-25a8-4feb-9d7f-9300589daa71 1073741824 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:52:53 devstack sudo[107434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-67f2cb36-25a8-4feb-9d7f-9300589daa71 1073741824 Sep 06 06:52:53 devstack sudo[107434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:52:53 devstack sudo[107432]: pam_unix(sudo:session): session closed for user root Sep 06 06:52:53 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-075261b7-f39a-4d46-9eeb-2b3bcd783d8c tempest-ProjectMemberTests-77954883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-24bb531f-806c-47ac-b7d2-20ac91133088" returned: 0 in 0.261s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:52:53 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-075261b7-f39a-4d46-9eeb-2b3bcd783d8c tempest-ProjectMemberTests-77954883 None] Lock "cinder-quobyte-24bb531f-806c-47ac-b7d2-20ac91133088" released by "delete_volume" :: held 0.753s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:52:53 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-075261b7-f39a-4d46-9eeb-2b3bcd783d8c tempest-ProjectMemberTests-77954883 None] Created reservations ['836f0e27-577a-4227-bd90-3ca2e8581d78', '5d2a20c4-982b-4fc1-bc7d-1d38934804b5', 'a738804b-933c-4cde-ab6a-bb8959a803d3', '92fda22c-52f7-4723-a069-4fc247ac59f6'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:52:54 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-075261b7-f39a-4d46-9eeb-2b3bcd783d8c tempest-ProjectMemberTests-77954883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:52:54 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-075261b7-f39a-4d46-9eeb-2b3bcd783d8c tempest-ProjectMemberTests-77954883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:52:54 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-075261b7-f39a-4d46-9eeb-2b3bcd783d8c tempest-ProjectMemberTests-77954883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:52:54 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-075261b7-f39a-4d46-9eeb-2b3bcd783d8c tempest-ProjectMemberTests-77954883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:52:54 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-075261b7-f39a-4d46-9eeb-2b3bcd783d8c tempest-ProjectMemberTests-77954883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:52:54 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-075261b7-f39a-4d46-9eeb-2b3bcd783d8c tempest-ProjectMemberTests-77954883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:52:54 devstack sudo[107440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:52:54 devstack sudo[107440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:52:54 devstack sudo[107434]: pam_unix(sudo:session): session closed for user root Sep 06 06:52:54 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-0c739020-91b6-4996-bd1e-90ef69881824 tempest-ProjectReaderTests-801230299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-67f2cb36-25a8-4feb-9d7f-9300589daa71 1073741824" returned: 0 in 0.473s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:52:54 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-0c739020-91b6-4996-bd1e-90ef69881824 tempest-ProjectReaderTests-801230299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-67f2cb36-25a8-4feb-9d7f-9300589daa71 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:52:54 devstack sudo[107443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-67f2cb36-25a8-4feb-9d7f-9300589daa71 Sep 06 06:52:54 devstack sudo[107443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:52:54 devstack sudo[107440]: pam_unix(sudo:session): session closed for user root Sep 06 06:52:54 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-075261b7-f39a-4d46-9eeb-2b3bcd783d8c tempest-ProjectMemberTests-77954883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.286s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:52:54 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-075261b7-f39a-4d46-9eeb-2b3bcd783d8c tempest-ProjectMemberTests-77954883 None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:52:54 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-075261b7-f39a-4d46-9eeb-2b3bcd783d8c tempest-ProjectMemberTests-77954883 None] Deleted volume successfully. Sep 06 06:52:54 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-075261b7-f39a-4d46-9eeb-2b3bcd783d8c tempest-ProjectMemberTests-77954883 None] Lock "cinder-24bb531f-806c-47ac-b7d2-20ac91133088-delete_volume" released by "delete_volume" :: held 1.282s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:52:54 devstack sudo[107443]: pam_unix(sudo:session): session closed for user root Sep 06 06:52:54 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-0c739020-91b6-4996-bd1e-90ef69881824 tempest-ProjectReaderTests-801230299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-67f2cb36-25a8-4feb-9d7f-9300589daa71" returned: 0 in 0.271s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:52:54 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-0c739020-91b6-4996-bd1e-90ef69881824 tempest-ProjectReaderTests-801230299 None] <== create_volume: return (789ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'} {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 06:52:54 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-0c739020-91b6-4996-bd1e-90ef69881824 tempest-ProjectReaderTests-801230299 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.792s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:52:54 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-0c739020-91b6-4996-bd1e-90ef69881824 tempest-ProjectReaderTests-801230299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa136d7e-21f9-44be-9888-1fded81ca36a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67f2cb36-25a8-4feb-9d7f-9300589daa71', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:52:54 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-0c739020-91b6-4996-bd1e-90ef69881824 tempest-ProjectReaderTests-801230299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2a696d0-6ee2-48bb-afd6-76fc636477e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:52:54 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-0c739020-91b6-4996-bd1e-90ef69881824 tempest-ProjectReaderTests-801230299 None] Volume volume-67f2cb36-25a8-4feb-9d7f-9300589daa71 (67f2cb36-25a8-4feb-9d7f-9300589daa71): created successfully Sep 06 06:52:54 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-0c739020-91b6-4996-bd1e-90ef69881824 tempest-ProjectReaderTests-801230299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2a696d0-6ee2-48bb-afd6-76fc636477e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:52:54 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-0c739020-91b6-4996-bd1e-90ef69881824 tempest-ProjectReaderTests-801230299 None] Flow 'volume_create_manager' (a03d4d52-8cc0-484e-b113-d8d063b4a5f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:52:54 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-0c739020-91b6-4996-bd1e-90ef69881824 tempest-ProjectReaderTests-801230299 None] Created volume successfully. Sep 06 06:52:54 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5b816d9-ba9c-4f18-8327-3e1fb5265a5d tempest-ProjectMemberTests-77954883 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87329) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 06:52:54 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-d5b816d9-ba9c-4f18-8327-3e1fb5265a5d tempest-ProjectMemberTests-77954883 None] Flow 'volume_create_manager' (37294c2b-e978-4aa7-b9d4-f798883099dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:52:54 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-d5b816d9-ba9c-4f18-8327-3e1fb5265a5d tempest-ProjectMemberTests-77954883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5cc5c4e-9749-4923-8a30-500d4e350f47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:52:54 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-d5b816d9-ba9c-4f18-8327-3e1fb5265a5d tempest-ProjectMemberTests-77954883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5cc5c4e-9749-4923-8a30-500d4e350f47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:52:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1496699138',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba741e71-7e57-4f1a-a32d-d761762061cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9dc5436e8fa48389e888d8f19858d1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:52:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:52:55Z,use_quota=True,user_id='f9722e49a5da4ba7b028b07e73bfb4c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:52:54 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-d5b816d9-ba9c-4f18-8327-3e1fb5265a5d tempest-ProjectMemberTests-77954883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (135bee6f-c04f-4013-b071-d2a33c1a7bae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:52:54 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-d5b816d9-ba9c-4f18-8327-3e1fb5265a5d tempest-ProjectMemberTests-77954883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (135bee6f-c04f-4013-b071-d2a33c1a7bae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:52:54 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-d5b816d9-ba9c-4f18-8327-3e1fb5265a5d tempest-ProjectMemberTests-77954883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca00ea1f-b85c-4a2f-b1e9-0b0502cfb9d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:52:54 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-d5b816d9-ba9c-4f18-8327-3e1fb5265a5d tempest-ProjectMemberTests-77954883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca00ea1f-b85c-4a2f-b1e9-0b0502cfb9d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba741e71-7e57-4f1a-a32d-d761762061cf', 'volume_name': 'volume-ba741e71-7e57-4f1a-a32d-d761762061cf', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:52:54 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-d5b816d9-ba9c-4f18-8327-3e1fb5265a5d tempest-ProjectMemberTests-77954883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17fff873-f9e5-4f87-a43f-625825b4fef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:52:54 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-d5b816d9-ba9c-4f18-8327-3e1fb5265a5d tempest-ProjectMemberTests-77954883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17fff873-f9e5-4f87-a43f-625825b4fef9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:52:54 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-d5b816d9-ba9c-4f18-8327-3e1fb5265a5d tempest-ProjectMemberTests-77954883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dae5b8d3-9c94-49ab-9590-3011e8975483) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:52:54 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-d5b816d9-ba9c-4f18-8327-3e1fb5265a5d tempest-ProjectMemberTests-77954883 None] Volume ba741e71-7e57-4f1a-a32d-d761762061cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba741e71-7e57-4f1a-a32d-d761762061cf', 'volume_size': 1} Sep 06 06:52:54 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-d5b816d9-ba9c-4f18-8327-3e1fb5265a5d tempest-ProjectMemberTests-77954883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:52:54 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-d5b816d9-ba9c-4f18-8327-3e1fb5265a5d tempest-ProjectMemberTests-77954883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:52:54 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-d5b816d9-ba9c-4f18-8327-3e1fb5265a5d tempest-ProjectMemberTests-77954883 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:52:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1496699138',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba741e71-7e57-4f1a-a32d-d761762061cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9dc5436e8fa48389e888d8f19858d1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:52:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:52:55Z,use_quota=True,user_id='f9722e49a5da4ba7b028b07e73bfb4c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)}" {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 06:52:54 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-d5b816d9-ba9c-4f18-8327-3e1fb5265a5d tempest-ProjectMemberTests-77954883 None] Creating volume ba741e71-7e57-4f1a-a32d-d761762061cf {{(pid=87329) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 06:52:54 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-d5b816d9-ba9c-4f18-8327-3e1fb5265a5d tempest-ProjectMemberTests-77954883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:52:54 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-d5b816d9-ba9c-4f18-8327-3e1fb5265a5d tempest-ProjectMemberTests-77954883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:52:54 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-d5b816d9-ba9c-4f18-8327-3e1fb5265a5d tempest-ProjectMemberTests-77954883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:52:54 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-d5b816d9-ba9c-4f18-8327-3e1fb5265a5d tempest-ProjectMemberTests-77954883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:52:54 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-d5b816d9-ba9c-4f18-8327-3e1fb5265a5d tempest-ProjectMemberTests-77954883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:52:54 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-d5b816d9-ba9c-4f18-8327-3e1fb5265a5d tempest-ProjectMemberTests-77954883 None] Selected osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 as target Quobyte volume. {{(pid=87329) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 06:52:54 devstack cinder-volume[87329]: INFO cinder.volume.drivers.remotefs [None req-d5b816d9-ba9c-4f18-8327-3e1fb5265a5d tempest-ProjectMemberTests-77954883 None] casted to osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 Sep 06 06:52:54 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-d5b816d9-ba9c-4f18-8327-3e1fb5265a5d tempest-ProjectMemberTests-77954883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-ba741e71-7e57-4f1a-a32d-d761762061cf 1073741824 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:52:54 devstack sudo[107447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-ba741e71-7e57-4f1a-a32d-d761762061cf 1073741824 Sep 06 06:52:54 devstack sudo[107447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:52:55 devstack sudo[107447]: pam_unix(sudo:session): session closed for user root Sep 06 06:52:55 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-d5b816d9-ba9c-4f18-8327-3e1fb5265a5d tempest-ProjectMemberTests-77954883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-ba741e71-7e57-4f1a-a32d-d761762061cf 1073741824" returned: 0 in 0.386s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:52:55 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-d5b816d9-ba9c-4f18-8327-3e1fb5265a5d tempest-ProjectMemberTests-77954883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-ba741e71-7e57-4f1a-a32d-d761762061cf {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:52:55 devstack sudo[107453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-ba741e71-7e57-4f1a-a32d-d761762061cf Sep 06 06:52:55 devstack sudo[107453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:52:55 devstack sudo[107453]: pam_unix(sudo:session): session closed for user root Sep 06 06:52:55 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-d5b816d9-ba9c-4f18-8327-3e1fb5265a5d tempest-ProjectMemberTests-77954883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-ba741e71-7e57-4f1a-a32d-d761762061cf" returned: 0 in 0.247s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:52:55 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-d5b816d9-ba9c-4f18-8327-3e1fb5265a5d tempest-ProjectMemberTests-77954883 None] <== create_volume: return (672ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'} {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 06:52:55 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-d5b816d9-ba9c-4f18-8327-3e1fb5265a5d tempest-ProjectMemberTests-77954883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.675s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:52:55 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-d5b816d9-ba9c-4f18-8327-3e1fb5265a5d tempest-ProjectMemberTests-77954883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dae5b8d3-9c94-49ab-9590-3011e8975483) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba741e71-7e57-4f1a-a32d-d761762061cf', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:52:55 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-d5b816d9-ba9c-4f18-8327-3e1fb5265a5d tempest-ProjectMemberTests-77954883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e817376a-01ac-43c7-a1e1-45f9b857ddf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:52:55 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-d5b816d9-ba9c-4f18-8327-3e1fb5265a5d tempest-ProjectMemberTests-77954883 None] Volume volume-ba741e71-7e57-4f1a-a32d-d761762061cf (ba741e71-7e57-4f1a-a32d-d761762061cf): created successfully Sep 06 06:52:55 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-d5b816d9-ba9c-4f18-8327-3e1fb5265a5d tempest-ProjectMemberTests-77954883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e817376a-01ac-43c7-a1e1-45f9b857ddf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:52:55 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-d5b816d9-ba9c-4f18-8327-3e1fb5265a5d tempest-ProjectMemberTests-77954883 None] Flow 'volume_create_manager' (37294c2b-e978-4aa7-b9d4-f798883099dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:52:55 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-d5b816d9-ba9c-4f18-8327-3e1fb5265a5d tempest-ProjectMemberTests-77954883 None] Created volume successfully. Sep 06 06:52:55 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-cb0fd6b9-e8e8-4f8b-946d-0ff086cc4ef1 tempest-ProjectReaderTests-801230299 None] Acquiring lock "cinder-67f2cb36-25a8-4feb-9d7f-9300589daa71-delete_volume" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:52:56 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-cb0fd6b9-e8e8-4f8b-946d-0ff086cc4ef1 tempest-ProjectReaderTests-801230299 None] Lock "cinder-67f2cb36-25a8-4feb-9d7f-9300589daa71-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:52:56 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-f4f3e74f-7b67-4f99-b36f-0cfa312d4ef3 tempest-ProjectMemberTests-77954883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:52:56 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-f4f3e74f-7b67-4f99-b36f-0cfa312d4ef3 tempest-ProjectMemberTests-77954883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:52:56 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-f4f3e74f-7b67-4f99-b36f-0cfa312d4ef3 tempest-ProjectMemberTests-77954883 None] Creating offline snapshot 30868bcd-cb48-4201-9c88-0dd1de711553 of volume ba741e71-7e57-4f1a-a32d-d761762061cf {{(pid=87329) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 06 06:52:56 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8cb844f-2075-46ed-a11d-da22c16cbea7]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:52:56 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-f4f3e74f-7b67-4f99-b36f-0cfa312d4ef3 tempest-ProjectMemberTests-77954883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-ba741e71-7e57-4f1a-a32d-d761762061cf {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:52:56 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-cb0fd6b9-e8e8-4f8b-946d-0ff086cc4ef1 tempest-ProjectReaderTests-801230299 None] Acquiring lock "cinder-quobyte-67f2cb36-25a8-4feb-9d7f-9300589daa71" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:52:56 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-cb0fd6b9-e8e8-4f8b-946d-0ff086cc4ef1 tempest-ProjectReaderTests-801230299 None] Lock "cinder-quobyte-67f2cb36-25a8-4feb-9d7f-9300589daa71" acquired by "delete_volume" :: waited 0.023s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:52:56 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[da4bc39d-ca0b-4a4c-80b2-2c35b774ab12]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:52:56 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-cb0fd6b9-e8e8-4f8b-946d-0ff086cc4ef1 tempest-ProjectReaderTests-801230299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-67f2cb36-25a8-4feb-9d7f-9300589daa71 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:52:56 devstack sudo[107456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-ba741e71-7e57-4f1a-a32d-d761762061cf Sep 06 06:52:56 devstack sudo[107456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:52:56 devstack sudo[107457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-67f2cb36-25a8-4feb-9d7f-9300589daa71 Sep 06 06:52:56 devstack sudo[107457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:52:56 devstack sudo[107456]: pam_unix(sudo:session): session closed for user root Sep 06 06:52:56 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-f4f3e74f-7b67-4f99-b36f-0cfa312d4ef3 tempest-ProjectMemberTests-77954883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-ba741e71-7e57-4f1a-a32d-d761762061cf" returned: 0 in 0.392s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:52:56 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-f4f3e74f-7b67-4f99-b36f-0cfa312d4ef3 tempest-ProjectMemberTests-77954883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-ba741e71-7e57-4f1a-a32d-d761762061cf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-ba741e71-7e57-4f1a-a32d-d761762061cf.30868bcd-cb48-4201-9c88-0dd1de711553 1G {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:52:56 devstack sudo[107465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-ba741e71-7e57-4f1a-a32d-d761762061cf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-ba741e71-7e57-4f1a-a32d-d761762061cf.30868bcd-cb48-4201-9c88-0dd1de711553 1G Sep 06 06:52:56 devstack sudo[107465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:52:56 devstack sudo[107457]: pam_unix(sudo:session): session closed for user root Sep 06 06:52:56 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-cb0fd6b9-e8e8-4f8b-946d-0ff086cc4ef1 tempest-ProjectReaderTests-801230299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-67f2cb36-25a8-4feb-9d7f-9300589daa71" returned: 0 in 0.388s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:52:56 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-cb0fd6b9-e8e8-4f8b-946d-0ff086cc4ef1 tempest-ProjectReaderTests-801230299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-67f2cb36-25a8-4feb-9d7f-9300589daa71 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:52:56 devstack sudo[107469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-67f2cb36-25a8-4feb-9d7f-9300589daa71 Sep 06 06:52:56 devstack sudo[107469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:52:56 devstack sudo[107469]: pam_unix(sudo:session): session closed for user root Sep 06 06:52:56 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-cb0fd6b9-e8e8-4f8b-946d-0ff086cc4ef1 tempest-ProjectReaderTests-801230299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-67f2cb36-25a8-4feb-9d7f-9300589daa71" returned: 0 in 0.293s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:52:56 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-cb0fd6b9-e8e8-4f8b-946d-0ff086cc4ef1 tempest-ProjectReaderTests-801230299 None] Lock "cinder-quobyte-67f2cb36-25a8-4feb-9d7f-9300589daa71" released by "delete_volume" :: held 0.735s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:52:56 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-cb0fd6b9-e8e8-4f8b-946d-0ff086cc4ef1 tempest-ProjectReaderTests-801230299 None] Created reservations ['625a9d4f-bfad-4617-af02-bdea9cf3c638', '55441ba2-6a23-4224-ac1a-7d502f7aa8fd', '53b3aed4-9dec-4085-ba48-18ab03db82bc', 'c8f59b3c-9266-4ccd-8f4f-646d0f2309db'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:52:56 devstack sudo[107465]: pam_unix(sudo:session): session closed for user root Sep 06 06:52:56 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-f4f3e74f-7b67-4f99-b36f-0cfa312d4ef3 tempest-ProjectMemberTests-77954883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-ba741e71-7e57-4f1a-a32d-d761762061cf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-ba741e71-7e57-4f1a-a32d-d761762061cf.30868bcd-cb48-4201-9c88-0dd1de711553 1G" returned: 0 in 0.490s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:52:56 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-f4f3e74f-7b67-4f99-b36f-0cfa312d4ef3 tempest-ProjectMemberTests-77954883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba741e71-7e57-4f1a-a32d-d761762061cf -F qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-ba741e71-7e57-4f1a-a32d-d761762061cf.30868bcd-cb48-4201-9c88-0dd1de711553 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:52:57 devstack sudo[107476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba741e71-7e57-4f1a-a32d-d761762061cf -F qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-ba741e71-7e57-4f1a-a32d-d761762061cf.30868bcd-cb48-4201-9c88-0dd1de711553 Sep 06 06:52:57 devstack sudo[107476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:52:57 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-cb0fd6b9-e8e8-4f8b-946d-0ff086cc4ef1 tempest-ProjectReaderTests-801230299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:52:57 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-cb0fd6b9-e8e8-4f8b-946d-0ff086cc4ef1 tempest-ProjectReaderTests-801230299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:52:57 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-cb0fd6b9-e8e8-4f8b-946d-0ff086cc4ef1 tempest-ProjectReaderTests-801230299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:52:57 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-cb0fd6b9-e8e8-4f8b-946d-0ff086cc4ef1 tempest-ProjectReaderTests-801230299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:52:57 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-cb0fd6b9-e8e8-4f8b-946d-0ff086cc4ef1 tempest-ProjectReaderTests-801230299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:52:57 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-cb0fd6b9-e8e8-4f8b-946d-0ff086cc4ef1 tempest-ProjectReaderTests-801230299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:52:57 devstack sudo[107478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:52:57 devstack sudo[107478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:52:57 devstack sudo[107476]: pam_unix(sudo:session): session closed for user root Sep 06 06:52:57 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-f4f3e74f-7b67-4f99-b36f-0cfa312d4ef3 tempest-ProjectMemberTests-77954883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba741e71-7e57-4f1a-a32d-d761762061cf -F qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-ba741e71-7e57-4f1a-a32d-d761762061cf.30868bcd-cb48-4201-9c88-0dd1de711553" returned: 0 in 0.367s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:52:57 devstack cinder-volume[87329]: WARNING cinder.volume.drivers.remotefs [None req-f4f3e74f-7b67-4f99-b36f-0cfa312d4ef3 tempest-ProjectMemberTests-77954883 None] /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-ba741e71-7e57-4f1a-a32d-d761762061cf.30868bcd-cb48-4201-9c88-0dd1de711553 is being set with open permissions: ugo+rw Sep 06 06:52:57 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-f4f3e74f-7b67-4f99-b36f-0cfa312d4ef3 tempest-ProjectMemberTests-77954883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-ba741e71-7e57-4f1a-a32d-d761762061cf.30868bcd-cb48-4201-9c88-0dd1de711553 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:52:57 devstack sudo[107485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-ba741e71-7e57-4f1a-a32d-d761762061cf.30868bcd-cb48-4201-9c88-0dd1de711553 Sep 06 06:52:57 devstack sudo[107485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:52:57 devstack sudo[107478]: pam_unix(sudo:session): session closed for user root Sep 06 06:52:57 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-cb0fd6b9-e8e8-4f8b-946d-0ff086cc4ef1 tempest-ProjectReaderTests-801230299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.323s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:52:57 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-cb0fd6b9-e8e8-4f8b-946d-0ff086cc4ef1 tempest-ProjectReaderTests-801230299 None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:52:57 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-cb0fd6b9-e8e8-4f8b-946d-0ff086cc4ef1 tempest-ProjectReaderTests-801230299 None] Deleted volume successfully. Sep 06 06:52:57 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-cb0fd6b9-e8e8-4f8b-946d-0ff086cc4ef1 tempest-ProjectReaderTests-801230299 None] Lock "cinder-67f2cb36-25a8-4feb-9d7f-9300589daa71-delete_volume" released by "delete_volume" :: held 1.410s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:52:57 devstack sudo[107485]: pam_unix(sudo:session): session closed for user root Sep 06 06:52:57 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-f4f3e74f-7b67-4f99-b36f-0cfa312d4ef3 tempest-ProjectMemberTests-77954883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-ba741e71-7e57-4f1a-a32d-d761762061cf.30868bcd-cb48-4201-9c88-0dd1de711553" returned: 0 in 0.313s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:52:57 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-f4f3e74f-7b67-4f99-b36f-0cfa312d4ef3 tempest-ProjectMemberTests-77954883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-ba741e71-7e57-4f1a-a32d-d761762061cf.info {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:52:57 devstack sudo[107488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-ba741e71-7e57-4f1a-a32d-d761762061cf.info Sep 06 06:52:57 devstack sudo[107488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:52:57 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-79e377e6-e900-4a1e-8189-bf3775d45715 tempest-ProjectReaderTests-801230299 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87329) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 06:52:57 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-79e377e6-e900-4a1e-8189-bf3775d45715 tempest-ProjectReaderTests-801230299 None] Flow 'volume_create_manager' (e7169ba6-0d1f-4c36-a545-9fbce04b7fba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:52:57 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-79e377e6-e900-4a1e-8189-bf3775d45715 tempest-ProjectReaderTests-801230299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c55eb6fb-04c2-4615-9d35-ae6ceee670b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:52:57 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-79e377e6-e900-4a1e-8189-bf3775d45715 tempest-ProjectReaderTests-801230299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c55eb6fb-04c2-4615-9d35-ae6ceee670b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:52:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-867633410',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b5d7241-20f7-4d18-abdb-5aeb9c5b0dc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e3094aeb03f4770b80420a4ce3147c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:52:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:52:58Z,use_quota=True,user_id='28acf64a08b34c72aad6ec6fec2c6c1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:52:57 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-79e377e6-e900-4a1e-8189-bf3775d45715 tempest-ProjectReaderTests-801230299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ab75ade-a017-40f2-9b8d-b6aad674998b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:52:57 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-79e377e6-e900-4a1e-8189-bf3775d45715 tempest-ProjectReaderTests-801230299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ab75ade-a017-40f2-9b8d-b6aad674998b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:52:57 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-79e377e6-e900-4a1e-8189-bf3775d45715 tempest-ProjectReaderTests-801230299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6e0fad8-3a67-4e3c-bca4-45c298ee5d1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:52:57 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-79e377e6-e900-4a1e-8189-bf3775d45715 tempest-ProjectReaderTests-801230299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6e0fad8-3a67-4e3c-bca4-45c298ee5d1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b5d7241-20f7-4d18-abdb-5aeb9c5b0dc4', 'volume_name': 'volume-6b5d7241-20f7-4d18-abdb-5aeb9c5b0dc4', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:52:57 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-79e377e6-e900-4a1e-8189-bf3775d45715 tempest-ProjectReaderTests-801230299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a113873-d030-471b-8ed4-5c2f5401f7f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:52:57 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-79e377e6-e900-4a1e-8189-bf3775d45715 tempest-ProjectReaderTests-801230299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a113873-d030-471b-8ed4-5c2f5401f7f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:52:57 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-79e377e6-e900-4a1e-8189-bf3775d45715 tempest-ProjectReaderTests-801230299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02faa227-811c-41e5-a5db-b2df699502fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:52:57 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-79e377e6-e900-4a1e-8189-bf3775d45715 tempest-ProjectReaderTests-801230299 None] Volume 6b5d7241-20f7-4d18-abdb-5aeb9c5b0dc4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b5d7241-20f7-4d18-abdb-5aeb9c5b0dc4', 'volume_size': 1} Sep 06 06:52:57 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-79e377e6-e900-4a1e-8189-bf3775d45715 tempest-ProjectReaderTests-801230299 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:52:57 devstack sudo[107488]: pam_unix(sudo:session): session closed for user root Sep 06 06:52:57 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-f4f3e74f-7b67-4f99-b36f-0cfa312d4ef3 tempest-ProjectMemberTests-77954883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-ba741e71-7e57-4f1a-a32d-d761762061cf.info" returned: 0 in 0.261s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:52:57 devstack cinder-volume[87329]: WARNING cinder.volume.drivers.remotefs [None req-f4f3e74f-7b67-4f99-b36f-0cfa312d4ef3 tempest-ProjectMemberTests-77954883 None] /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-ba741e71-7e57-4f1a-a32d-d761762061cf.info is being set with open permissions: ugo+rw Sep 06 06:52:57 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-f4f3e74f-7b67-4f99-b36f-0cfa312d4ef3 tempest-ProjectMemberTests-77954883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-ba741e71-7e57-4f1a-a32d-d761762061cf.info {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:52:57 devstack sudo[107491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-ba741e71-7e57-4f1a-a32d-d761762061cf.info Sep 06 06:52:57 devstack sudo[107491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:52:58 devstack sudo[107491]: pam_unix(sudo:session): session closed for user root Sep 06 06:52:58 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-f4f3e74f-7b67-4f99-b36f-0cfa312d4ef3 tempest-ProjectMemberTests-77954883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-ba741e71-7e57-4f1a-a32d-d761762061cf.info" returned: 0 in 0.279s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:52:58 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-f4f3e74f-7b67-4f99-b36f-0cfa312d4ef3 tempest-ProjectMemberTests-77954883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.216s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:52:58 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-79e377e6-e900-4a1e-8189-bf3775d45715 tempest-ProjectReaderTests-801230299 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.428s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:52:58 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-79e377e6-e900-4a1e-8189-bf3775d45715 tempest-ProjectReaderTests-801230299 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:52:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-867633410',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b5d7241-20f7-4d18-abdb-5aeb9c5b0dc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e3094aeb03f4770b80420a4ce3147c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:52:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:52:58Z,use_quota=True,user_id='28acf64a08b34c72aad6ec6fec2c6c1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)}" {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 06:52:58 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-79e377e6-e900-4a1e-8189-bf3775d45715 tempest-ProjectReaderTests-801230299 None] Creating volume 6b5d7241-20f7-4d18-abdb-5aeb9c5b0dc4 {{(pid=87329) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 06:52:58 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-79e377e6-e900-4a1e-8189-bf3775d45715 tempest-ProjectReaderTests-801230299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:52:58 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-79e377e6-e900-4a1e-8189-bf3775d45715 tempest-ProjectReaderTests-801230299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:52:58 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-79e377e6-e900-4a1e-8189-bf3775d45715 tempest-ProjectReaderTests-801230299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:52:58 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-79e377e6-e900-4a1e-8189-bf3775d45715 tempest-ProjectReaderTests-801230299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:52:58 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-79e377e6-e900-4a1e-8189-bf3775d45715 tempest-ProjectReaderTests-801230299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:52:58 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-79e377e6-e900-4a1e-8189-bf3775d45715 tempest-ProjectReaderTests-801230299 None] Selected osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 as target Quobyte volume. {{(pid=87329) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 06:52:58 devstack cinder-volume[87329]: INFO cinder.volume.drivers.remotefs [None req-79e377e6-e900-4a1e-8189-bf3775d45715 tempest-ProjectReaderTests-801230299 None] casted to osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 Sep 06 06:52:58 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-79e377e6-e900-4a1e-8189-bf3775d45715 tempest-ProjectReaderTests-801230299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6b5d7241-20f7-4d18-abdb-5aeb9c5b0dc4 1073741824 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:52:58 devstack sudo[107494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6b5d7241-20f7-4d18-abdb-5aeb9c5b0dc4 1073741824 Sep 06 06:52:58 devstack sudo[107494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:52:58 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-f4f3e74f-7b67-4f99-b36f-0cfa312d4ef3 tempest-ProjectMemberTests-77954883 None] Create snapshot completed successfully Sep 06 06:52:58 devstack sudo[107494]: pam_unix(sudo:session): session closed for user root Sep 06 06:52:58 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-79e377e6-e900-4a1e-8189-bf3775d45715 tempest-ProjectReaderTests-801230299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6b5d7241-20f7-4d18-abdb-5aeb9c5b0dc4 1073741824" returned: 0 in 0.435s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:52:58 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-79e377e6-e900-4a1e-8189-bf3775d45715 tempest-ProjectReaderTests-801230299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6b5d7241-20f7-4d18-abdb-5aeb9c5b0dc4 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:52:58 devstack sudo[107506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6b5d7241-20f7-4d18-abdb-5aeb9c5b0dc4 Sep 06 06:52:58 devstack sudo[107506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:52:58 devstack sudo[107506]: pam_unix(sudo:session): session closed for user root Sep 06 06:52:58 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-79e377e6-e900-4a1e-8189-bf3775d45715 tempest-ProjectReaderTests-801230299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6b5d7241-20f7-4d18-abdb-5aeb9c5b0dc4" returned: 0 in 0.237s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:52:58 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-79e377e6-e900-4a1e-8189-bf3775d45715 tempest-ProjectReaderTests-801230299 None] <== create_volume: return (717ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'} {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 06:52:58 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-79e377e6-e900-4a1e-8189-bf3775d45715 tempest-ProjectReaderTests-801230299 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.721s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:52:58 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-79e377e6-e900-4a1e-8189-bf3775d45715 tempest-ProjectReaderTests-801230299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02faa227-811c-41e5-a5db-b2df699502fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b5d7241-20f7-4d18-abdb-5aeb9c5b0dc4', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:52:58 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-79e377e6-e900-4a1e-8189-bf3775d45715 tempest-ProjectReaderTests-801230299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (071e9b8a-258f-44a7-b4b1-a5327ca87f82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:52:59 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-79e377e6-e900-4a1e-8189-bf3775d45715 tempest-ProjectReaderTests-801230299 None] Volume volume-6b5d7241-20f7-4d18-abdb-5aeb9c5b0dc4 (6b5d7241-20f7-4d18-abdb-5aeb9c5b0dc4): created successfully Sep 06 06:52:59 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-79e377e6-e900-4a1e-8189-bf3775d45715 tempest-ProjectReaderTests-801230299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (071e9b8a-258f-44a7-b4b1-a5327ca87f82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:52:59 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-79e377e6-e900-4a1e-8189-bf3775d45715 tempest-ProjectReaderTests-801230299 None] Flow 'volume_create_manager' (e7169ba6-0d1f-4c36-a545-9fbce04b7fba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:52:59 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-79e377e6-e900-4a1e-8189-bf3775d45715 tempest-ProjectReaderTests-801230299 None] Created volume successfully. Sep 06 06:52:59 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-a0b9d6a5-6bce-41da-9f78-84cfba04624e tempest-ProjectMemberTests-77954883 None] Acquiring lock "cinder-30868bcd-cb48-4201-9c88-0dd1de711553-delete_snapshot" by "delete_snapshot" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:52:59 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-a0b9d6a5-6bce-41da-9f78-84cfba04624e tempest-ProjectMemberTests-77954883 None] Lock "cinder-30868bcd-cb48-4201-9c88-0dd1de711553-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:52:59 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-a0b9d6a5-6bce-41da-9f78-84cfba04624e tempest-ProjectMemberTests-77954883 None] Acquiring lock "cinder-quobyte-ba741e71-7e57-4f1a-a32d-d761762061cf" by "delete_snapshot" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:52:59 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-a0b9d6a5-6bce-41da-9f78-84cfba04624e tempest-ProjectMemberTests-77954883 None] Lock "cinder-quobyte-ba741e71-7e57-4f1a-a32d-d761762061cf" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:52:59 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-a0b9d6a5-6bce-41da-9f78-84cfba04624e tempest-ProjectMemberTests-77954883 None] Acquiring lock "cinder-quobyte-30868bcd-cb48-4201-9c88-0dd1de711553" by "_delete_snapshot" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:52:59 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-a0b9d6a5-6bce-41da-9f78-84cfba04624e tempest-ProjectMemberTests-77954883 None] Lock "cinder-quobyte-30868bcd-cb48-4201-9c88-0dd1de711553" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:52:59 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-a0b9d6a5-6bce-41da-9f78-84cfba04624e tempest-ProjectMemberTests-77954883 None] Deleting offline snapshot 30868bcd-cb48-4201-9c88-0dd1de711553 of volume ba741e71-7e57-4f1a-a32d-d761762061cf {{(pid=87329) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 06 06:52:59 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-a0b9d6a5-6bce-41da-9f78-84cfba04624e tempest-ProjectMemberTests-77954883 None] snapshot_file for this snap is: volume-ba741e71-7e57-4f1a-a32d-d761762061cf.30868bcd-cb48-4201-9c88-0dd1de711553 {{(pid=87329) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 06 06:52:59 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[38419860-2c7b-42b6-889e-103470ca1afa]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:52:59 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-a0b9d6a5-6bce-41da-9f78-84cfba04624e tempest-ProjectMemberTests-77954883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-ba741e71-7e57-4f1a-a32d-d761762061cf.30868bcd-cb48-4201-9c88-0dd1de711553 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:52:59 devstack sudo[107509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-ba741e71-7e57-4f1a-a32d-d761762061cf.30868bcd-cb48-4201-9c88-0dd1de711553 Sep 06 06:52:59 devstack sudo[107509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:52:59 devstack sudo[107509]: pam_unix(sudo:session): session closed for user root Sep 06 06:52:59 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-a0b9d6a5-6bce-41da-9f78-84cfba04624e tempest-ProjectMemberTests-77954883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-ba741e71-7e57-4f1a-a32d-d761762061cf.30868bcd-cb48-4201-9c88-0dd1de711553" returned: 0 in 0.345s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:52:59 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-a0b9d6a5-6bce-41da-9f78-84cfba04624e tempest-ProjectMemberTests-77954883 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ba741e71-7e57-4f1a-a32d-d761762061cf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87329) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 06:52:59 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[578a3868-cb5b-4687-b9b9-4e8d59643203]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:52:59 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-a0b9d6a5-6bce-41da-9f78-84cfba04624e tempest-ProjectMemberTests-77954883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-ba741e71-7e57-4f1a-a32d-d761762061cf {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:52:59 devstack sudo[107515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-ba741e71-7e57-4f1a-a32d-d761762061cf Sep 06 06:52:59 devstack sudo[107515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:52:59 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-f1f3cd68-9c28-4548-bcf3-14f367776c97 tempest-ProjectReaderTests-801230299 None] Acquiring lock "cinder-6b5d7241-20f7-4d18-abdb-5aeb9c5b0dc4-delete_volume" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:52:59 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-f1f3cd68-9c28-4548-bcf3-14f367776c97 tempest-ProjectReaderTests-801230299 None] Lock "cinder-6b5d7241-20f7-4d18-abdb-5aeb9c5b0dc4-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:52:59 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-f1f3cd68-9c28-4548-bcf3-14f367776c97 tempest-ProjectReaderTests-801230299 None] Acquiring lock "cinder-quobyte-6b5d7241-20f7-4d18-abdb-5aeb9c5b0dc4" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:52:59 devstack sudo[107515]: pam_unix(sudo:session): session closed for user root Sep 06 06:52:59 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-f1f3cd68-9c28-4548-bcf3-14f367776c97 tempest-ProjectReaderTests-801230299 None] Lock "cinder-quobyte-6b5d7241-20f7-4d18-abdb-5aeb9c5b0dc4" acquired by "delete_volume" :: waited 0.018s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:52:59 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-a0b9d6a5-6bce-41da-9f78-84cfba04624e tempest-ProjectMemberTests-77954883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-ba741e71-7e57-4f1a-a32d-d761762061cf" returned: 0 in 0.389s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:52:59 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-a0b9d6a5-6bce-41da-9f78-84cfba04624e tempest-ProjectMemberTests-77954883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-ba741e71-7e57-4f1a-a32d-d761762061cf.30868bcd-cb48-4201-9c88-0dd1de711553 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:52:59 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[c877db92-eb7a-406f-8e79-eba8655b707e]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:52:59 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-f1f3cd68-9c28-4548-bcf3-14f367776c97 tempest-ProjectReaderTests-801230299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6b5d7241-20f7-4d18-abdb-5aeb9c5b0dc4 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:52:59 devstack sudo[107520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-ba741e71-7e57-4f1a-a32d-d761762061cf.30868bcd-cb48-4201-9c88-0dd1de711553 Sep 06 06:52:59 devstack sudo[107520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:53:00 devstack sudo[107521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6b5d7241-20f7-4d18-abdb-5aeb9c5b0dc4 Sep 06 06:53:00 devstack sudo[107521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:53:00 devstack sudo[107520]: pam_unix(sudo:session): session closed for user root Sep 06 06:53:00 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-a0b9d6a5-6bce-41da-9f78-84cfba04624e tempest-ProjectMemberTests-77954883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-ba741e71-7e57-4f1a-a32d-d761762061cf.30868bcd-cb48-4201-9c88-0dd1de711553" returned: 0 in 0.340s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:53:00 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-a0b9d6a5-6bce-41da-9f78-84cfba04624e tempest-ProjectMemberTests-77954883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-ba741e71-7e57-4f1a-a32d-d761762061cf.30868bcd-cb48-4201-9c88-0dd1de711553 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:53:00 devstack sudo[107531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-ba741e71-7e57-4f1a-a32d-d761762061cf.30868bcd-cb48-4201-9c88-0dd1de711553 Sep 06 06:53:00 devstack sudo[107531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:53:00 devstack sudo[107521]: pam_unix(sudo:session): session closed for user root Sep 06 06:53:00 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-f1f3cd68-9c28-4548-bcf3-14f367776c97 tempest-ProjectReaderTests-801230299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6b5d7241-20f7-4d18-abdb-5aeb9c5b0dc4" returned: 0 in 0.365s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:53:00 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-f1f3cd68-9c28-4548-bcf3-14f367776c97 tempest-ProjectReaderTests-801230299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6b5d7241-20f7-4d18-abdb-5aeb9c5b0dc4 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:53:00 devstack sudo[107533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6b5d7241-20f7-4d18-abdb-5aeb9c5b0dc4 Sep 06 06:53:00 devstack sudo[107533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:53:00 devstack sudo[107531]: pam_unix(sudo:session): session closed for user root Sep 06 06:53:00 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-a0b9d6a5-6bce-41da-9f78-84cfba04624e tempest-ProjectMemberTests-77954883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-ba741e71-7e57-4f1a-a32d-d761762061cf.30868bcd-cb48-4201-9c88-0dd1de711553" returned: 0 in 0.236s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:53:00 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-a0b9d6a5-6bce-41da-9f78-84cfba04624e tempest-ProjectMemberTests-77954883 None] Lock "cinder-quobyte-30868bcd-cb48-4201-9c88-0dd1de711553" released by "_delete_snapshot" :: held 1.403s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:53:00 devstack sudo[107533]: pam_unix(sudo:session): session closed for user root Sep 06 06:53:00 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-f1f3cd68-9c28-4548-bcf3-14f367776c97 tempest-ProjectReaderTests-801230299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6b5d7241-20f7-4d18-abdb-5aeb9c5b0dc4" returned: 0 in 0.239s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:53:00 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-a0b9d6a5-6bce-41da-9f78-84cfba04624e tempest-ProjectMemberTests-77954883 None] Lock "cinder-quobyte-ba741e71-7e57-4f1a-a32d-d761762061cf" released by "delete_snapshot" :: held 1.432s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:53:00 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-f1f3cd68-9c28-4548-bcf3-14f367776c97 tempest-ProjectReaderTests-801230299 None] Lock "cinder-quobyte-6b5d7241-20f7-4d18-abdb-5aeb9c5b0dc4" released by "delete_volume" :: held 0.650s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:53:00 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-f1f3cd68-9c28-4548-bcf3-14f367776c97 tempest-ProjectReaderTests-801230299 None] Created reservations ['c27317cd-8dd4-4a50-9e54-5d5c6565b7ec', '57246d62-2fd9-429f-907e-ed53804522a4', '81f2a182-17c5-4d7b-b5d7-a8f56095fccb', '069e384e-734a-434f-ad5a-a172a526b089'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:53:00 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-a0b9d6a5-6bce-41da-9f78-84cfba04624e tempest-ProjectMemberTests-77954883 None] Created reservations ['32b094be-fc64-4d8f-ad73-9e98e57df0f6', 'a263446e-a889-443d-846e-ee2585f870b7', '23aaa819-42bb-456f-93a2-a2ae4fdb34e3', '264298aa-93b4-4baf-840b-cc98180dc36d'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:53:00 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-f1f3cd68-9c28-4548-bcf3-14f367776c97 tempest-ProjectReaderTests-801230299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:53:00 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-f1f3cd68-9c28-4548-bcf3-14f367776c97 tempest-ProjectReaderTests-801230299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:53:00 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-f1f3cd68-9c28-4548-bcf3-14f367776c97 tempest-ProjectReaderTests-801230299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:53:00 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-f1f3cd68-9c28-4548-bcf3-14f367776c97 tempest-ProjectReaderTests-801230299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:53:00 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-f1f3cd68-9c28-4548-bcf3-14f367776c97 tempest-ProjectReaderTests-801230299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:53:00 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-f1f3cd68-9c28-4548-bcf3-14f367776c97 tempest-ProjectReaderTests-801230299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:53:00 devstack sudo[107537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:53:00 devstack sudo[107537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:53:00 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-a0b9d6a5-6bce-41da-9f78-84cfba04624e tempest-ProjectMemberTests-77954883 None] Delete snapshot completed successfully. Sep 06 06:53:00 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-a0b9d6a5-6bce-41da-9f78-84cfba04624e tempest-ProjectMemberTests-77954883 None] Lock "cinder-30868bcd-cb48-4201-9c88-0dd1de711553-delete_snapshot" released by "delete_snapshot" :: held 1.628s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:53:00 devstack sudo[107537]: pam_unix(sudo:session): session closed for user root Sep 06 06:53:00 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-f1f3cd68-9c28-4548-bcf3-14f367776c97 tempest-ProjectReaderTests-801230299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.240s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:53:00 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-f1f3cd68-9c28-4548-bcf3-14f367776c97 tempest-ProjectReaderTests-801230299 None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:53:00 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-f1f3cd68-9c28-4548-bcf3-14f367776c97 tempest-ProjectReaderTests-801230299 None] Deleted volume successfully. Sep 06 06:53:00 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-f1f3cd68-9c28-4548-bcf3-14f367776c97 tempest-ProjectReaderTests-801230299 None] Lock "cinder-6b5d7241-20f7-4d18-abdb-5aeb9c5b0dc4-delete_volume" released by "delete_volume" :: held 1.113s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:53:01 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-532c77be-97e2-4dd4-ba29-5ec888004528 tempest-ProjectMemberTests-77954883 None] Acquiring lock "cinder-ba741e71-7e57-4f1a-a32d-d761762061cf-delete_volume" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:53:01 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-532c77be-97e2-4dd4-ba29-5ec888004528 tempest-ProjectMemberTests-77954883 None] Lock "cinder-ba741e71-7e57-4f1a-a32d-d761762061cf-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:53:01 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-532c77be-97e2-4dd4-ba29-5ec888004528 tempest-ProjectMemberTests-77954883 None] Acquiring lock "cinder-quobyte-ba741e71-7e57-4f1a-a32d-d761762061cf" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:53:01 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-532c77be-97e2-4dd4-ba29-5ec888004528 tempest-ProjectMemberTests-77954883 None] Lock "cinder-quobyte-ba741e71-7e57-4f1a-a32d-d761762061cf" acquired by "delete_volume" :: waited 0.019s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:53:01 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[55ec4c87-50ea-473b-af35-c294c357d005]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:53:01 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-532c77be-97e2-4dd4-ba29-5ec888004528 tempest-ProjectMemberTests-77954883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-ba741e71-7e57-4f1a-a32d-d761762061cf {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:53:01 devstack sudo[107540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-ba741e71-7e57-4f1a-a32d-d761762061cf Sep 06 06:53:01 devstack sudo[107540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:53:01 devstack sudo[107540]: pam_unix(sudo:session): session closed for user root Sep 06 06:53:01 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-532c77be-97e2-4dd4-ba29-5ec888004528 tempest-ProjectMemberTests-77954883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-ba741e71-7e57-4f1a-a32d-d761762061cf" returned: 0 in 0.375s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:53:01 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-532c77be-97e2-4dd4-ba29-5ec888004528 tempest-ProjectMemberTests-77954883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-ba741e71-7e57-4f1a-a32d-d761762061cf {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:53:01 devstack sudo[107545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-ba741e71-7e57-4f1a-a32d-d761762061cf Sep 06 06:53:01 devstack sudo[107545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:53:02 devstack sudo[107545]: pam_unix(sudo:session): session closed for user root Sep 06 06:53:02 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-532c77be-97e2-4dd4-ba29-5ec888004528 tempest-ProjectMemberTests-77954883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-ba741e71-7e57-4f1a-a32d-d761762061cf" returned: 0 in 0.294s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:53:02 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-532c77be-97e2-4dd4-ba29-5ec888004528 tempest-ProjectMemberTests-77954883 None] Lock "cinder-quobyte-ba741e71-7e57-4f1a-a32d-d761762061cf" released by "delete_volume" :: held 0.739s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:53:02 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-532c77be-97e2-4dd4-ba29-5ec888004528 tempest-ProjectMemberTests-77954883 None] Created reservations ['7e646cdf-fdf1-4546-add1-aa3945e64e9c', '33419d8e-55c7-4155-aed4-e97559a27027', '4f44a0f4-4086-4678-81cb-340bf7389a13', '23bdc331-e63b-4c47-b49e-8db14ac8314b'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:53:02 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-532c77be-97e2-4dd4-ba29-5ec888004528 tempest-ProjectMemberTests-77954883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:53:02 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-532c77be-97e2-4dd4-ba29-5ec888004528 tempest-ProjectMemberTests-77954883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:53:02 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-532c77be-97e2-4dd4-ba29-5ec888004528 tempest-ProjectMemberTests-77954883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:53:02 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-532c77be-97e2-4dd4-ba29-5ec888004528 tempest-ProjectMemberTests-77954883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:53:02 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-532c77be-97e2-4dd4-ba29-5ec888004528 tempest-ProjectMemberTests-77954883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:53:02 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-532c77be-97e2-4dd4-ba29-5ec888004528 tempest-ProjectMemberTests-77954883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:53:02 devstack sudo[107549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:53:02 devstack sudo[107549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:53:02 devstack sudo[107549]: pam_unix(sudo:session): session closed for user root Sep 06 06:53:02 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-532c77be-97e2-4dd4-ba29-5ec888004528 tempest-ProjectMemberTests-77954883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.273s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:53:02 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-532c77be-97e2-4dd4-ba29-5ec888004528 tempest-ProjectMemberTests-77954883 None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:53:02 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-532c77be-97e2-4dd4-ba29-5ec888004528 tempest-ProjectMemberTests-77954883 None] Deleted volume successfully. Sep 06 06:53:02 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-532c77be-97e2-4dd4-ba29-5ec888004528 tempest-ProjectMemberTests-77954883 None] Lock "cinder-ba741e71-7e57-4f1a-a32d-d761762061cf-delete_volume" released by "delete_volume" :: held 1.221s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:53:02 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-dde171ab-11be-4f9f-be05-9354e28c96d8 tempest-ProjectMemberTests-77954883 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87329) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 06:53:02 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-dde171ab-11be-4f9f-be05-9354e28c96d8 tempest-ProjectMemberTests-77954883 None] Flow 'volume_create_manager' (fa1b9a1b-ac0a-44ae-9e0d-d5cd50015324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:53:02 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-dde171ab-11be-4f9f-be05-9354e28c96d8 tempest-ProjectMemberTests-77954883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f358ad91-1c74-47e8-aa6e-160ae639b29a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:53:03 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-dde171ab-11be-4f9f-be05-9354e28c96d8 tempest-ProjectMemberTests-77954883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f358ad91-1c74-47e8-aa6e-160ae639b29a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:53:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1570277486',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41a4c301-43b5-4b99-8f5a-2f00d5f65fba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9dc5436e8fa48389e888d8f19858d1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:53:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:53:03Z,use_quota=True,user_id='f9722e49a5da4ba7b028b07e73bfb4c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:53:03 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-dde171ab-11be-4f9f-be05-9354e28c96d8 tempest-ProjectMemberTests-77954883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (952371d4-0811-4650-89db-e9d3d108df75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:53:03 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-dde171ab-11be-4f9f-be05-9354e28c96d8 tempest-ProjectMemberTests-77954883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (952371d4-0811-4650-89db-e9d3d108df75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:53:03 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-dde171ab-11be-4f9f-be05-9354e28c96d8 tempest-ProjectMemberTests-77954883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (462c18d9-c619-43be-82b2-1187d51a2ecc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:53:03 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-dde171ab-11be-4f9f-be05-9354e28c96d8 tempest-ProjectMemberTests-77954883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (462c18d9-c619-43be-82b2-1187d51a2ecc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41a4c301-43b5-4b99-8f5a-2f00d5f65fba', 'volume_name': 'volume-41a4c301-43b5-4b99-8f5a-2f00d5f65fba', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:53:03 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-dde171ab-11be-4f9f-be05-9354e28c96d8 tempest-ProjectMemberTests-77954883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96a9995f-db6b-4dbc-af80-dec75d0b544a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:53:03 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-dde171ab-11be-4f9f-be05-9354e28c96d8 tempest-ProjectMemberTests-77954883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96a9995f-db6b-4dbc-af80-dec75d0b544a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:53:03 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-dde171ab-11be-4f9f-be05-9354e28c96d8 tempest-ProjectMemberTests-77954883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4962efb7-a1f6-4f0b-a4b7-56f0a033058f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:53:03 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-dde171ab-11be-4f9f-be05-9354e28c96d8 tempest-ProjectMemberTests-77954883 None] Volume 41a4c301-43b5-4b99-8f5a-2f00d5f65fba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41a4c301-43b5-4b99-8f5a-2f00d5f65fba', 'volume_size': 1} Sep 06 06:53:03 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-dde171ab-11be-4f9f-be05-9354e28c96d8 tempest-ProjectMemberTests-77954883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:53:03 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-dde171ab-11be-4f9f-be05-9354e28c96d8 tempest-ProjectMemberTests-77954883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:53:03 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-dde171ab-11be-4f9f-be05-9354e28c96d8 tempest-ProjectMemberTests-77954883 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:53:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1570277486',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41a4c301-43b5-4b99-8f5a-2f00d5f65fba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9dc5436e8fa48389e888d8f19858d1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:53:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:53:03Z,use_quota=True,user_id='f9722e49a5da4ba7b028b07e73bfb4c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)}" {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 06:53:03 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-dde171ab-11be-4f9f-be05-9354e28c96d8 tempest-ProjectMemberTests-77954883 None] Creating volume 41a4c301-43b5-4b99-8f5a-2f00d5f65fba {{(pid=87329) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 06:53:03 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-dde171ab-11be-4f9f-be05-9354e28c96d8 tempest-ProjectMemberTests-77954883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:53:03 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-dde171ab-11be-4f9f-be05-9354e28c96d8 tempest-ProjectMemberTests-77954883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:53:03 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-dde171ab-11be-4f9f-be05-9354e28c96d8 tempest-ProjectMemberTests-77954883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:53:03 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-dde171ab-11be-4f9f-be05-9354e28c96d8 tempest-ProjectMemberTests-77954883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:53:03 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-dde171ab-11be-4f9f-be05-9354e28c96d8 tempest-ProjectMemberTests-77954883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:53:03 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-dde171ab-11be-4f9f-be05-9354e28c96d8 tempest-ProjectMemberTests-77954883 None] Selected osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 as target Quobyte volume. {{(pid=87329) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 06:53:03 devstack cinder-volume[87329]: INFO cinder.volume.drivers.remotefs [None req-dde171ab-11be-4f9f-be05-9354e28c96d8 tempest-ProjectMemberTests-77954883 None] casted to osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 Sep 06 06:53:03 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-dde171ab-11be-4f9f-be05-9354e28c96d8 tempest-ProjectMemberTests-77954883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-41a4c301-43b5-4b99-8f5a-2f00d5f65fba 1073741824 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:53:03 devstack sudo[107552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-41a4c301-43b5-4b99-8f5a-2f00d5f65fba 1073741824 Sep 06 06:53:03 devstack sudo[107552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:53:03 devstack sudo[107552]: pam_unix(sudo:session): session closed for user root Sep 06 06:53:03 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-dde171ab-11be-4f9f-be05-9354e28c96d8 tempest-ProjectMemberTests-77954883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-41a4c301-43b5-4b99-8f5a-2f00d5f65fba 1073741824" returned: 0 in 0.420s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:53:03 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-dde171ab-11be-4f9f-be05-9354e28c96d8 tempest-ProjectMemberTests-77954883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-41a4c301-43b5-4b99-8f5a-2f00d5f65fba {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:53:03 devstack sudo[107558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-41a4c301-43b5-4b99-8f5a-2f00d5f65fba Sep 06 06:53:03 devstack sudo[107558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:53:03 devstack sudo[107558]: pam_unix(sudo:session): session closed for user root Sep 06 06:53:03 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-dde171ab-11be-4f9f-be05-9354e28c96d8 tempest-ProjectMemberTests-77954883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-41a4c301-43b5-4b99-8f5a-2f00d5f65fba" returned: 0 in 0.263s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:53:03 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-dde171ab-11be-4f9f-be05-9354e28c96d8 tempest-ProjectMemberTests-77954883 None] <== create_volume: return (728ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'} {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 06:53:03 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-dde171ab-11be-4f9f-be05-9354e28c96d8 tempest-ProjectMemberTests-77954883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.731s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:53:03 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-dde171ab-11be-4f9f-be05-9354e28c96d8 tempest-ProjectMemberTests-77954883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4962efb7-a1f6-4f0b-a4b7-56f0a033058f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41a4c301-43b5-4b99-8f5a-2f00d5f65fba', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:53:03 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-dde171ab-11be-4f9f-be05-9354e28c96d8 tempest-ProjectMemberTests-77954883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96ffbb57-e062-430a-8e0b-3f1555943f38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:53:03 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-dde171ab-11be-4f9f-be05-9354e28c96d8 tempest-ProjectMemberTests-77954883 None] Volume volume-41a4c301-43b5-4b99-8f5a-2f00d5f65fba (41a4c301-43b5-4b99-8f5a-2f00d5f65fba): created successfully Sep 06 06:53:03 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-dde171ab-11be-4f9f-be05-9354e28c96d8 tempest-ProjectMemberTests-77954883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96ffbb57-e062-430a-8e0b-3f1555943f38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:53:03 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-dde171ab-11be-4f9f-be05-9354e28c96d8 tempest-ProjectMemberTests-77954883 None] Flow 'volume_create_manager' (fa1b9a1b-ac0a-44ae-9e0d-d5cd50015324) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:53:03 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-dde171ab-11be-4f9f-be05-9354e28c96d8 tempest-ProjectMemberTests-77954883 None] Created volume successfully. Sep 06 06:53:04 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-3d0ad1b3-7049-43fe-bb85-86f7a66b70c0 tempest-ProjectMemberTests-77954883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:53:04 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-3d0ad1b3-7049-43fe-bb85-86f7a66b70c0 tempest-ProjectMemberTests-77954883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:53:04 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-3d0ad1b3-7049-43fe-bb85-86f7a66b70c0 tempest-ProjectMemberTests-77954883 None] Creating offline snapshot 66cdb628-bcf9-4c8b-8645-5a6f320b0b17 of volume 41a4c301-43b5-4b99-8f5a-2f00d5f65fba {{(pid=87329) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 06 06:53:04 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1849ca5-752c-407c-9dee-09d04a56dd4c]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:53:04 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-3d0ad1b3-7049-43fe-bb85-86f7a66b70c0 tempest-ProjectMemberTests-77954883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-41a4c301-43b5-4b99-8f5a-2f00d5f65fba {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:53:04 devstack sudo[107561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-41a4c301-43b5-4b99-8f5a-2f00d5f65fba Sep 06 06:53:04 devstack sudo[107561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:53:04 devstack sudo[107561]: pam_unix(sudo:session): session closed for user root Sep 06 06:53:04 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-3d0ad1b3-7049-43fe-bb85-86f7a66b70c0 tempest-ProjectMemberTests-77954883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-41a4c301-43b5-4b99-8f5a-2f00d5f65fba" returned: 0 in 0.374s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:53:04 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-3d0ad1b3-7049-43fe-bb85-86f7a66b70c0 tempest-ProjectMemberTests-77954883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-41a4c301-43b5-4b99-8f5a-2f00d5f65fba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-41a4c301-43b5-4b99-8f5a-2f00d5f65fba.66cdb628-bcf9-4c8b-8645-5a6f320b0b17 1G {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:53:04 devstack sudo[107566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-41a4c301-43b5-4b99-8f5a-2f00d5f65fba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-41a4c301-43b5-4b99-8f5a-2f00d5f65fba.66cdb628-bcf9-4c8b-8645-5a6f320b0b17 1G Sep 06 06:53:04 devstack sudo[107566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:53:04 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-853f7150-e9c6-4175-857a-982178182dd4 tempest-ProjectReaderTests-467621584 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87329) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 06:53:04 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-853f7150-e9c6-4175-857a-982178182dd4 tempest-ProjectReaderTests-467621584 None] Flow 'volume_create_manager' (bac40aa6-d327-48eb-a0df-45f843dd8bd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:53:04 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-853f7150-e9c6-4175-857a-982178182dd4 tempest-ProjectReaderTests-467621584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77db167b-0cd3-4823-8234-d04e20a1e549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:53:04 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-853f7150-e9c6-4175-857a-982178182dd4 tempest-ProjectReaderTests-467621584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77db167b-0cd3-4823-8234-d04e20a1e549) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:53:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-723660330',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0e8af3e-dd6b-42be-8bc1-f4bc6edbac15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4d93fb96cd34a409646af3000051b23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:53:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:53:05Z,use_quota=True,user_id='bb8e71dd35514c59b11598ab9faffc58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:53:04 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-853f7150-e9c6-4175-857a-982178182dd4 tempest-ProjectReaderTests-467621584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd42d9c4-be67-42e5-8cba-78815a020d7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:53:04 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-853f7150-e9c6-4175-857a-982178182dd4 tempest-ProjectReaderTests-467621584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd42d9c4-be67-42e5-8cba-78815a020d7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:53:04 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-853f7150-e9c6-4175-857a-982178182dd4 tempest-ProjectReaderTests-467621584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69788f74-d1e5-4fd4-bb2d-71d2623e65a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:53:04 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-853f7150-e9c6-4175-857a-982178182dd4 tempest-ProjectReaderTests-467621584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69788f74-d1e5-4fd4-bb2d-71d2623e65a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0e8af3e-dd6b-42be-8bc1-f4bc6edbac15', 'volume_name': 'volume-c0e8af3e-dd6b-42be-8bc1-f4bc6edbac15', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:53:04 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-853f7150-e9c6-4175-857a-982178182dd4 tempest-ProjectReaderTests-467621584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f6d6231-0711-4103-a8a6-5d2dc32d0d87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:53:04 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-853f7150-e9c6-4175-857a-982178182dd4 tempest-ProjectReaderTests-467621584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f6d6231-0711-4103-a8a6-5d2dc32d0d87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:53:04 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-853f7150-e9c6-4175-857a-982178182dd4 tempest-ProjectReaderTests-467621584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8174ac1-8339-46e6-b7ff-be455eb39b80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:53:04 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-853f7150-e9c6-4175-857a-982178182dd4 tempest-ProjectReaderTests-467621584 None] Volume c0e8af3e-dd6b-42be-8bc1-f4bc6edbac15: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0e8af3e-dd6b-42be-8bc1-f4bc6edbac15', 'volume_size': 1} Sep 06 06:53:04 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-853f7150-e9c6-4175-857a-982178182dd4 tempest-ProjectReaderTests-467621584 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:53:04 devstack sudo[107566]: pam_unix(sudo:session): session closed for user root Sep 06 06:53:04 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-3d0ad1b3-7049-43fe-bb85-86f7a66b70c0 tempest-ProjectMemberTests-77954883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-41a4c301-43b5-4b99-8f5a-2f00d5f65fba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-41a4c301-43b5-4b99-8f5a-2f00d5f65fba.66cdb628-bcf9-4c8b-8645-5a6f320b0b17 1G" returned: 0 in 0.393s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:53:04 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-3d0ad1b3-7049-43fe-bb85-86f7a66b70c0 tempest-ProjectMemberTests-77954883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-41a4c301-43b5-4b99-8f5a-2f00d5f65fba -F qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-41a4c301-43b5-4b99-8f5a-2f00d5f65fba.66cdb628-bcf9-4c8b-8645-5a6f320b0b17 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:53:05 devstack sudo[107574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-41a4c301-43b5-4b99-8f5a-2f00d5f65fba -F qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-41a4c301-43b5-4b99-8f5a-2f00d5f65fba.66cdb628-bcf9-4c8b-8645-5a6f320b0b17 Sep 06 06:53:05 devstack sudo[107574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:53:05 devstack sudo[107574]: pam_unix(sudo:session): session closed for user root Sep 06 06:53:05 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-3d0ad1b3-7049-43fe-bb85-86f7a66b70c0 tempest-ProjectMemberTests-77954883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-41a4c301-43b5-4b99-8f5a-2f00d5f65fba -F qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-41a4c301-43b5-4b99-8f5a-2f00d5f65fba.66cdb628-bcf9-4c8b-8645-5a6f320b0b17" returned: 0 in 0.284s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:53:05 devstack cinder-volume[87329]: WARNING cinder.volume.drivers.remotefs [None req-3d0ad1b3-7049-43fe-bb85-86f7a66b70c0 tempest-ProjectMemberTests-77954883 None] /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-41a4c301-43b5-4b99-8f5a-2f00d5f65fba.66cdb628-bcf9-4c8b-8645-5a6f320b0b17 is being set with open permissions: ugo+rw Sep 06 06:53:05 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-3d0ad1b3-7049-43fe-bb85-86f7a66b70c0 tempest-ProjectMemberTests-77954883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-41a4c301-43b5-4b99-8f5a-2f00d5f65fba.66cdb628-bcf9-4c8b-8645-5a6f320b0b17 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:53:05 devstack sudo[107579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-41a4c301-43b5-4b99-8f5a-2f00d5f65fba.66cdb628-bcf9-4c8b-8645-5a6f320b0b17 Sep 06 06:53:05 devstack sudo[107579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:53:05 devstack sudo[107579]: pam_unix(sudo:session): session closed for user root Sep 06 06:53:05 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-3d0ad1b3-7049-43fe-bb85-86f7a66b70c0 tempest-ProjectMemberTests-77954883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-41a4c301-43b5-4b99-8f5a-2f00d5f65fba.66cdb628-bcf9-4c8b-8645-5a6f320b0b17" returned: 0 in 0.230s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:53:05 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-3d0ad1b3-7049-43fe-bb85-86f7a66b70c0 tempest-ProjectMemberTests-77954883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-41a4c301-43b5-4b99-8f5a-2f00d5f65fba.info {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:53:05 devstack sudo[107582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-41a4c301-43b5-4b99-8f5a-2f00d5f65fba.info Sep 06 06:53:05 devstack sudo[107582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:53:05 devstack sudo[107582]: pam_unix(sudo:session): session closed for user root Sep 06 06:53:05 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-3d0ad1b3-7049-43fe-bb85-86f7a66b70c0 tempest-ProjectMemberTests-77954883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-41a4c301-43b5-4b99-8f5a-2f00d5f65fba.info" returned: 0 in 0.260s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:53:05 devstack cinder-volume[87329]: WARNING cinder.volume.drivers.remotefs [None req-3d0ad1b3-7049-43fe-bb85-86f7a66b70c0 tempest-ProjectMemberTests-77954883 None] /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-41a4c301-43b5-4b99-8f5a-2f00d5f65fba.info is being set with open permissions: ugo+rw Sep 06 06:53:05 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-3d0ad1b3-7049-43fe-bb85-86f7a66b70c0 tempest-ProjectMemberTests-77954883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-41a4c301-43b5-4b99-8f5a-2f00d5f65fba.info {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:53:05 devstack sudo[107585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-41a4c301-43b5-4b99-8f5a-2f00d5f65fba.info Sep 06 06:53:05 devstack sudo[107585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:53:06 devstack sudo[107585]: pam_unix(sudo:session): session closed for user root Sep 06 06:53:06 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-3d0ad1b3-7049-43fe-bb85-86f7a66b70c0 tempest-ProjectMemberTests-77954883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-41a4c301-43b5-4b99-8f5a-2f00d5f65fba.info" returned: 0 in 0.231s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:53:06 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-3d0ad1b3-7049-43fe-bb85-86f7a66b70c0 tempest-ProjectMemberTests-77954883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.851s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:53:06 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-853f7150-e9c6-4175-857a-982178182dd4 tempest-ProjectReaderTests-467621584 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.178s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:53:06 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-853f7150-e9c6-4175-857a-982178182dd4 tempest-ProjectReaderTests-467621584 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:53:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-723660330',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0e8af3e-dd6b-42be-8bc1-f4bc6edbac15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4d93fb96cd34a409646af3000051b23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:53:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:53:05Z,use_quota=True,user_id='bb8e71dd35514c59b11598ab9faffc58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)}" {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 06:53:06 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-853f7150-e9c6-4175-857a-982178182dd4 tempest-ProjectReaderTests-467621584 None] Creating volume c0e8af3e-dd6b-42be-8bc1-f4bc6edbac15 {{(pid=87329) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 06:53:06 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-853f7150-e9c6-4175-857a-982178182dd4 tempest-ProjectReaderTests-467621584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:53:06 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-853f7150-e9c6-4175-857a-982178182dd4 tempest-ProjectReaderTests-467621584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:53:06 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-853f7150-e9c6-4175-857a-982178182dd4 tempest-ProjectReaderTests-467621584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:53:06 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-853f7150-e9c6-4175-857a-982178182dd4 tempest-ProjectReaderTests-467621584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:53:06 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-853f7150-e9c6-4175-857a-982178182dd4 tempest-ProjectReaderTests-467621584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:53:06 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-853f7150-e9c6-4175-857a-982178182dd4 tempest-ProjectReaderTests-467621584 None] Selected osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 as target Quobyte volume. {{(pid=87329) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 06:53:06 devstack cinder-volume[87329]: INFO cinder.volume.drivers.remotefs [None req-853f7150-e9c6-4175-857a-982178182dd4 tempest-ProjectReaderTests-467621584 None] casted to osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 Sep 06 06:53:06 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-853f7150-e9c6-4175-857a-982178182dd4 tempest-ProjectReaderTests-467621584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-c0e8af3e-dd6b-42be-8bc1-f4bc6edbac15 1073741824 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:53:06 devstack sudo[107588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-c0e8af3e-dd6b-42be-8bc1-f4bc6edbac15 1073741824 Sep 06 06:53:06 devstack sudo[107588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:53:06 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-3d0ad1b3-7049-43fe-bb85-86f7a66b70c0 tempest-ProjectMemberTests-77954883 None] Create snapshot completed successfully Sep 06 06:53:06 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-855a2a99-6e85-45e1-bb43-32b22e9cf08a tempest-ProjectMemberTests-77954883 None] Acquiring lock "cinder-66cdb628-bcf9-4c8b-8645-5a6f320b0b17-delete_snapshot" by "delete_snapshot" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:53:06 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-855a2a99-6e85-45e1-bb43-32b22e9cf08a tempest-ProjectMemberTests-77954883 None] Lock "cinder-66cdb628-bcf9-4c8b-8645-5a6f320b0b17-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:53:06 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-855a2a99-6e85-45e1-bb43-32b22e9cf08a tempest-ProjectMemberTests-77954883 None] Acquiring lock "cinder-quobyte-41a4c301-43b5-4b99-8f5a-2f00d5f65fba" by "delete_snapshot" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:53:06 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-855a2a99-6e85-45e1-bb43-32b22e9cf08a tempest-ProjectMemberTests-77954883 None] Lock "cinder-quobyte-41a4c301-43b5-4b99-8f5a-2f00d5f65fba" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:53:06 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-855a2a99-6e85-45e1-bb43-32b22e9cf08a tempest-ProjectMemberTests-77954883 None] Acquiring lock "cinder-quobyte-66cdb628-bcf9-4c8b-8645-5a6f320b0b17" by "_delete_snapshot" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:53:06 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-855a2a99-6e85-45e1-bb43-32b22e9cf08a tempest-ProjectMemberTests-77954883 None] Lock "cinder-quobyte-66cdb628-bcf9-4c8b-8645-5a6f320b0b17" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:53:06 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-855a2a99-6e85-45e1-bb43-32b22e9cf08a tempest-ProjectMemberTests-77954883 None] Deleting offline snapshot 66cdb628-bcf9-4c8b-8645-5a6f320b0b17 of volume 41a4c301-43b5-4b99-8f5a-2f00d5f65fba {{(pid=87329) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 06 06:53:06 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-855a2a99-6e85-45e1-bb43-32b22e9cf08a tempest-ProjectMemberTests-77954883 None] snapshot_file for this snap is: volume-41a4c301-43b5-4b99-8f5a-2f00d5f65fba.66cdb628-bcf9-4c8b-8645-5a6f320b0b17 {{(pid=87329) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 06 06:53:06 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[e76c5ba8-5d23-4cbb-af92-0f2ca9ab36f3]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:53:06 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-855a2a99-6e85-45e1-bb43-32b22e9cf08a tempest-ProjectMemberTests-77954883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-41a4c301-43b5-4b99-8f5a-2f00d5f65fba.66cdb628-bcf9-4c8b-8645-5a6f320b0b17 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:53:06 devstack sudo[107588]: pam_unix(sudo:session): session closed for user root Sep 06 06:53:06 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-853f7150-e9c6-4175-857a-982178182dd4 tempest-ProjectReaderTests-467621584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-c0e8af3e-dd6b-42be-8bc1-f4bc6edbac15 1073741824" returned: 0 in 0.431s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:53:06 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-853f7150-e9c6-4175-857a-982178182dd4 tempest-ProjectReaderTests-467621584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-c0e8af3e-dd6b-42be-8bc1-f4bc6edbac15 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:53:06 devstack sudo[107594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-41a4c301-43b5-4b99-8f5a-2f00d5f65fba.66cdb628-bcf9-4c8b-8645-5a6f320b0b17 Sep 06 06:53:06 devstack sudo[107594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:53:06 devstack sudo[107595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-c0e8af3e-dd6b-42be-8bc1-f4bc6edbac15 Sep 06 06:53:06 devstack sudo[107595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:53:06 devstack sudo[107595]: pam_unix(sudo:session): session closed for user root Sep 06 06:53:06 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-853f7150-e9c6-4175-857a-982178182dd4 tempest-ProjectReaderTests-467621584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-c0e8af3e-dd6b-42be-8bc1-f4bc6edbac15" returned: 0 in 0.242s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:53:06 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-853f7150-e9c6-4175-857a-982178182dd4 tempest-ProjectReaderTests-467621584 None] <== create_volume: return (710ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'} {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 06:53:06 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-853f7150-e9c6-4175-857a-982178182dd4 tempest-ProjectReaderTests-467621584 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.713s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:53:06 devstack sudo[107594]: pam_unix(sudo:session): session closed for user root Sep 06 06:53:06 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-853f7150-e9c6-4175-857a-982178182dd4 tempest-ProjectReaderTests-467621584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8174ac1-8339-46e6-b7ff-be455eb39b80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0e8af3e-dd6b-42be-8bc1-f4bc6edbac15', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:53:06 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-853f7150-e9c6-4175-857a-982178182dd4 tempest-ProjectReaderTests-467621584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23caac66-90c5-4f8e-838d-d57b89fab9d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:53:06 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-855a2a99-6e85-45e1-bb43-32b22e9cf08a tempest-ProjectMemberTests-77954883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-41a4c301-43b5-4b99-8f5a-2f00d5f65fba.66cdb628-bcf9-4c8b-8645-5a6f320b0b17" returned: 0 in 0.386s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:53:06 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-855a2a99-6e85-45e1-bb43-32b22e9cf08a tempest-ProjectMemberTests-77954883 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-41a4c301-43b5-4b99-8f5a-2f00d5f65fba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87329) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 06:53:06 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-853f7150-e9c6-4175-857a-982178182dd4 tempest-ProjectReaderTests-467621584 None] Volume volume-c0e8af3e-dd6b-42be-8bc1-f4bc6edbac15 (c0e8af3e-dd6b-42be-8bc1-f4bc6edbac15): created successfully Sep 06 06:53:06 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-853f7150-e9c6-4175-857a-982178182dd4 tempest-ProjectReaderTests-467621584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23caac66-90c5-4f8e-838d-d57b89fab9d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:53:06 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-853f7150-e9c6-4175-857a-982178182dd4 tempest-ProjectReaderTests-467621584 None] Flow 'volume_create_manager' (bac40aa6-d327-48eb-a0df-45f843dd8bd2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:53:06 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a33fccf-4b5e-44ab-a216-ab85d92359b9]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:53:06 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-855a2a99-6e85-45e1-bb43-32b22e9cf08a tempest-ProjectMemberTests-77954883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-41a4c301-43b5-4b99-8f5a-2f00d5f65fba {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:53:06 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-853f7150-e9c6-4175-857a-982178182dd4 tempest-ProjectReaderTests-467621584 None] Created volume successfully. Sep 06 06:53:06 devstack sudo[107602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-41a4c301-43b5-4b99-8f5a-2f00d5f65fba Sep 06 06:53:06 devstack sudo[107602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:53:07 devstack sudo[107602]: pam_unix(sudo:session): session closed for user root Sep 06 06:53:07 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-855a2a99-6e85-45e1-bb43-32b22e9cf08a tempest-ProjectMemberTests-77954883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-41a4c301-43b5-4b99-8f5a-2f00d5f65fba" returned: 0 in 0.350s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:53:07 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-855a2a99-6e85-45e1-bb43-32b22e9cf08a tempest-ProjectMemberTests-77954883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-41a4c301-43b5-4b99-8f5a-2f00d5f65fba.66cdb628-bcf9-4c8b-8645-5a6f320b0b17 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:53:07 devstack sudo[107607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-41a4c301-43b5-4b99-8f5a-2f00d5f65fba.66cdb628-bcf9-4c8b-8645-5a6f320b0b17 Sep 06 06:53:07 devstack sudo[107607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:53:07 devstack sudo[107607]: pam_unix(sudo:session): session closed for user root Sep 06 06:53:07 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-855a2a99-6e85-45e1-bb43-32b22e9cf08a tempest-ProjectMemberTests-77954883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-41a4c301-43b5-4b99-8f5a-2f00d5f65fba.66cdb628-bcf9-4c8b-8645-5a6f320b0b17" returned: 0 in 0.319s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:53:07 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-855a2a99-6e85-45e1-bb43-32b22e9cf08a tempest-ProjectMemberTests-77954883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-41a4c301-43b5-4b99-8f5a-2f00d5f65fba.66cdb628-bcf9-4c8b-8645-5a6f320b0b17 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:53:07 devstack sudo[107612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-41a4c301-43b5-4b99-8f5a-2f00d5f65fba.66cdb628-bcf9-4c8b-8645-5a6f320b0b17 Sep 06 06:53:07 devstack sudo[107612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:53:07 devstack sudo[107612]: pam_unix(sudo:session): session closed for user root Sep 06 06:53:07 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-855a2a99-6e85-45e1-bb43-32b22e9cf08a tempest-ProjectMemberTests-77954883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-41a4c301-43b5-4b99-8f5a-2f00d5f65fba.66cdb628-bcf9-4c8b-8645-5a6f320b0b17" returned: 0 in 0.235s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:53:07 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-855a2a99-6e85-45e1-bb43-32b22e9cf08a tempest-ProjectMemberTests-77954883 None] Lock "cinder-quobyte-66cdb628-bcf9-4c8b-8645-5a6f320b0b17" released by "_delete_snapshot" :: held 1.394s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:53:07 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-855a2a99-6e85-45e1-bb43-32b22e9cf08a tempest-ProjectMemberTests-77954883 None] Lock "cinder-quobyte-41a4c301-43b5-4b99-8f5a-2f00d5f65fba" released by "delete_snapshot" :: held 1.419s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:53:07 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-855a2a99-6e85-45e1-bb43-32b22e9cf08a tempest-ProjectMemberTests-77954883 None] Created reservations ['410c5797-da5f-4627-8a60-2def15731898', '8eaffed8-3c81-4e37-9111-f4c9468e1744', '31f2ec92-e0bd-482f-b2d5-ddb6fd47f9dc', 'aae3a983-4865-4795-af1c-c0f31bb6c089'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:53:07 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-855a2a99-6e85-45e1-bb43-32b22e9cf08a tempest-ProjectMemberTests-77954883 None] Delete snapshot completed successfully. Sep 06 06:53:07 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-855a2a99-6e85-45e1-bb43-32b22e9cf08a tempest-ProjectMemberTests-77954883 None] Lock "cinder-66cdb628-bcf9-4c8b-8645-5a6f320b0b17-delete_snapshot" released by "delete_snapshot" :: held 1.572s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:53:08 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-46df2f4e-cb0a-4b2f-befd-00d76ffcfd4b tempest-ProjectReaderTests-467621584 None] Acquiring lock "cinder-c0e8af3e-dd6b-42be-8bc1-f4bc6edbac15-delete_volume" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:53:08 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-46df2f4e-cb0a-4b2f-befd-00d76ffcfd4b tempest-ProjectReaderTests-467621584 None] Lock "cinder-c0e8af3e-dd6b-42be-8bc1-f4bc6edbac15-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:53:08 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-46df2f4e-cb0a-4b2f-befd-00d76ffcfd4b tempest-ProjectReaderTests-467621584 None] Acquiring lock "cinder-quobyte-c0e8af3e-dd6b-42be-8bc1-f4bc6edbac15" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:53:08 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-46df2f4e-cb0a-4b2f-befd-00d76ffcfd4b tempest-ProjectReaderTests-467621584 None] Lock "cinder-quobyte-c0e8af3e-dd6b-42be-8bc1-f4bc6edbac15" acquired by "delete_volume" :: waited 0.019s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:53:08 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f831569-907a-474e-bc18-714713ebd43a]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:53:08 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-46df2f4e-cb0a-4b2f-befd-00d76ffcfd4b tempest-ProjectReaderTests-467621584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-c0e8af3e-dd6b-42be-8bc1-f4bc6edbac15 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:53:08 devstack sudo[107615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-c0e8af3e-dd6b-42be-8bc1-f4bc6edbac15 Sep 06 06:53:08 devstack sudo[107615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:53:08 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-fae2473d-1f22-4637-867e-cbb3ee8db375 tempest-ProjectMemberTests-77954883 None] Acquiring lock "cinder-41a4c301-43b5-4b99-8f5a-2f00d5f65fba-delete_volume" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:53:08 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-fae2473d-1f22-4637-867e-cbb3ee8db375 tempest-ProjectMemberTests-77954883 None] Lock "cinder-41a4c301-43b5-4b99-8f5a-2f00d5f65fba-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:53:08 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-fae2473d-1f22-4637-867e-cbb3ee8db375 tempest-ProjectMemberTests-77954883 None] Acquiring lock "cinder-quobyte-41a4c301-43b5-4b99-8f5a-2f00d5f65fba" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:53:08 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-fae2473d-1f22-4637-867e-cbb3ee8db375 tempest-ProjectMemberTests-77954883 None] Lock "cinder-quobyte-41a4c301-43b5-4b99-8f5a-2f00d5f65fba" acquired by "delete_volume" :: waited 0.017s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:53:08 devstack sudo[107615]: pam_unix(sudo:session): session closed for user root Sep 06 06:53:08 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-46df2f4e-cb0a-4b2f-befd-00d76ffcfd4b tempest-ProjectReaderTests-467621584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-c0e8af3e-dd6b-42be-8bc1-f4bc6edbac15" returned: 0 in 0.404s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:53:08 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-46df2f4e-cb0a-4b2f-befd-00d76ffcfd4b tempest-ProjectReaderTests-467621584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-c0e8af3e-dd6b-42be-8bc1-f4bc6edbac15 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:53:08 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[27d4636a-f677-49f1-961f-662153fbd66d]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:53:08 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-fae2473d-1f22-4637-867e-cbb3ee8db375 tempest-ProjectMemberTests-77954883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-41a4c301-43b5-4b99-8f5a-2f00d5f65fba {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:53:08 devstack sudo[107620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-c0e8af3e-dd6b-42be-8bc1-f4bc6edbac15 Sep 06 06:53:08 devstack sudo[107620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:53:08 devstack sudo[107621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-41a4c301-43b5-4b99-8f5a-2f00d5f65fba Sep 06 06:53:08 devstack sudo[107621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:53:08 devstack sudo[107620]: pam_unix(sudo:session): session closed for user root Sep 06 06:53:08 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-46df2f4e-cb0a-4b2f-befd-00d76ffcfd4b tempest-ProjectReaderTests-467621584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-c0e8af3e-dd6b-42be-8bc1-f4bc6edbac15" returned: 0 in 0.252s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:53:08 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-46df2f4e-cb0a-4b2f-befd-00d76ffcfd4b tempest-ProjectReaderTests-467621584 None] Lock "cinder-quobyte-c0e8af3e-dd6b-42be-8bc1-f4bc6edbac15" released by "delete_volume" :: held 0.697s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:53:08 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-46df2f4e-cb0a-4b2f-befd-00d76ffcfd4b tempest-ProjectReaderTests-467621584 None] Created reservations ['24d61885-484c-40b7-bfc1-9180c8adb72a', 'f5806719-6db1-49e7-a646-6b886523ba37', '6a17bc3a-3fd7-4e7e-9155-e3caab742dcc', '0e5e6c67-cff9-4bd0-b317-30345eb942dc'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:53:08 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-46df2f4e-cb0a-4b2f-befd-00d76ffcfd4b tempest-ProjectReaderTests-467621584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:53:08 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-46df2f4e-cb0a-4b2f-befd-00d76ffcfd4b tempest-ProjectReaderTests-467621584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:53:08 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-46df2f4e-cb0a-4b2f-befd-00d76ffcfd4b tempest-ProjectReaderTests-467621584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:53:08 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-46df2f4e-cb0a-4b2f-befd-00d76ffcfd4b tempest-ProjectReaderTests-467621584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:53:08 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-46df2f4e-cb0a-4b2f-befd-00d76ffcfd4b tempest-ProjectReaderTests-467621584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:53:08 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-46df2f4e-cb0a-4b2f-befd-00d76ffcfd4b tempest-ProjectReaderTests-467621584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:53:08 devstack sudo[107621]: pam_unix(sudo:session): session closed for user root Sep 06 06:53:08 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-fae2473d-1f22-4637-867e-cbb3ee8db375 tempest-ProjectMemberTests-77954883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-41a4c301-43b5-4b99-8f5a-2f00d5f65fba" returned: 0 in 0.390s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:53:08 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-fae2473d-1f22-4637-867e-cbb3ee8db375 tempest-ProjectMemberTests-77954883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-41a4c301-43b5-4b99-8f5a-2f00d5f65fba {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:53:08 devstack sudo[107628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:53:08 devstack sudo[107628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:53:09 devstack sudo[107630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-41a4c301-43b5-4b99-8f5a-2f00d5f65fba Sep 06 06:53:09 devstack sudo[107630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:53:09 devstack sudo[107628]: pam_unix(sudo:session): session closed for user root Sep 06 06:53:09 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-46df2f4e-cb0a-4b2f-befd-00d76ffcfd4b tempest-ProjectReaderTests-467621584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.244s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:53:09 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-46df2f4e-cb0a-4b2f-befd-00d76ffcfd4b tempest-ProjectReaderTests-467621584 None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:53:09 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-46df2f4e-cb0a-4b2f-befd-00d76ffcfd4b tempest-ProjectReaderTests-467621584 None] Deleted volume successfully. Sep 06 06:53:09 devstack sudo[107630]: pam_unix(sudo:session): session closed for user root Sep 06 06:53:09 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-46df2f4e-cb0a-4b2f-befd-00d76ffcfd4b tempest-ProjectReaderTests-467621584 None] Lock "cinder-c0e8af3e-dd6b-42be-8bc1-f4bc6edbac15-delete_volume" released by "delete_volume" :: held 1.150s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:53:09 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-fae2473d-1f22-4637-867e-cbb3ee8db375 tempest-ProjectMemberTests-77954883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-41a4c301-43b5-4b99-8f5a-2f00d5f65fba" returned: 0 in 0.265s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:53:09 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-fae2473d-1f22-4637-867e-cbb3ee8db375 tempest-ProjectMemberTests-77954883 None] Lock "cinder-quobyte-41a4c301-43b5-4b99-8f5a-2f00d5f65fba" released by "delete_volume" :: held 0.710s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:53:09 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-fae2473d-1f22-4637-867e-cbb3ee8db375 tempest-ProjectMemberTests-77954883 None] Created reservations ['23df65c7-d5c7-4b77-925e-90517f6334d9', '01fc930e-351b-44d6-a851-412841769ca3', '9a3ebc21-8b8c-4bd5-8094-9a62abbcf39d', '449e4e67-d6d3-4ad5-b5d1-037b96fe9f87'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:53:09 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-fae2473d-1f22-4637-867e-cbb3ee8db375 tempest-ProjectMemberTests-77954883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:53:09 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-fae2473d-1f22-4637-867e-cbb3ee8db375 tempest-ProjectMemberTests-77954883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:53:09 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-fae2473d-1f22-4637-867e-cbb3ee8db375 tempest-ProjectMemberTests-77954883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:53:09 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-fae2473d-1f22-4637-867e-cbb3ee8db375 tempest-ProjectMemberTests-77954883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:53:09 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-fae2473d-1f22-4637-867e-cbb3ee8db375 tempest-ProjectMemberTests-77954883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:53:09 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-fae2473d-1f22-4637-867e-cbb3ee8db375 tempest-ProjectMemberTests-77954883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:53:09 devstack sudo[107634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:53:09 devstack sudo[107634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:53:09 devstack sudo[107634]: pam_unix(sudo:session): session closed for user root Sep 06 06:53:09 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-fae2473d-1f22-4637-867e-cbb3ee8db375 tempest-ProjectMemberTests-77954883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.253s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:53:09 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-fae2473d-1f22-4637-867e-cbb3ee8db375 tempest-ProjectMemberTests-77954883 None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:53:09 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-fae2473d-1f22-4637-867e-cbb3ee8db375 tempest-ProjectMemberTests-77954883 None] Deleted volume successfully. Sep 06 06:53:09 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-fae2473d-1f22-4637-867e-cbb3ee8db375 tempest-ProjectMemberTests-77954883 None] Lock "cinder-41a4c301-43b5-4b99-8f5a-2f00d5f65fba-delete_volume" released by "delete_volume" :: held 1.160s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:53:10 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad6061b3-f928-45cb-9070-f002a69ef7fb tempest-ProjectReaderTests-467621584 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87329) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 06:53:10 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-ad6061b3-f928-45cb-9070-f002a69ef7fb tempest-ProjectReaderTests-467621584 None] Flow 'volume_create_manager' (6075e7f0-c0e5-4b25-9231-cab5ce8074eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:53:10 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-ad6061b3-f928-45cb-9070-f002a69ef7fb tempest-ProjectReaderTests-467621584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63dd3640-a79f-4d46-86df-fc138b8fad73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:53:10 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-ad6061b3-f928-45cb-9070-f002a69ef7fb tempest-ProjectReaderTests-467621584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63dd3640-a79f-4d46-86df-fc138b8fad73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:53:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-952707898',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aac92ae4-d9b8-4909-9900-1ead8a06611c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4d93fb96cd34a409646af3000051b23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:53:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:53:10Z,use_quota=True,user_id='bb8e71dd35514c59b11598ab9faffc58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:53:10 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-ad6061b3-f928-45cb-9070-f002a69ef7fb tempest-ProjectReaderTests-467621584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a434ea8-5dab-4019-995b-0120f28f4e3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:53:10 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-ad6061b3-f928-45cb-9070-f002a69ef7fb tempest-ProjectReaderTests-467621584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a434ea8-5dab-4019-995b-0120f28f4e3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:53:10 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-ad6061b3-f928-45cb-9070-f002a69ef7fb tempest-ProjectReaderTests-467621584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b78230f-521c-4815-a21c-448c18e064b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:53:10 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-ad6061b3-f928-45cb-9070-f002a69ef7fb tempest-ProjectReaderTests-467621584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b78230f-521c-4815-a21c-448c18e064b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aac92ae4-d9b8-4909-9900-1ead8a06611c', 'volume_name': 'volume-aac92ae4-d9b8-4909-9900-1ead8a06611c', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:53:10 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-ad6061b3-f928-45cb-9070-f002a69ef7fb tempest-ProjectReaderTests-467621584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d600c2f-b9f1-4dc7-9c1d-d639ac693756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:53:10 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-ad6061b3-f928-45cb-9070-f002a69ef7fb tempest-ProjectReaderTests-467621584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d600c2f-b9f1-4dc7-9c1d-d639ac693756) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:53:10 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-ad6061b3-f928-45cb-9070-f002a69ef7fb tempest-ProjectReaderTests-467621584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c816ab0-0140-464e-a6d3-2fef4a22ce4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:53:10 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-ad6061b3-f928-45cb-9070-f002a69ef7fb tempest-ProjectReaderTests-467621584 None] Volume aac92ae4-d9b8-4909-9900-1ead8a06611c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aac92ae4-d9b8-4909-9900-1ead8a06611c', 'volume_size': 1} Sep 06 06:53:10 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-ad6061b3-f928-45cb-9070-f002a69ef7fb tempest-ProjectReaderTests-467621584 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:53:10 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-ad6061b3-f928-45cb-9070-f002a69ef7fb tempest-ProjectReaderTests-467621584 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:53:10 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-ad6061b3-f928-45cb-9070-f002a69ef7fb tempest-ProjectReaderTests-467621584 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:53:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-952707898',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aac92ae4-d9b8-4909-9900-1ead8a06611c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4d93fb96cd34a409646af3000051b23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:53:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:53:10Z,use_quota=True,user_id='bb8e71dd35514c59b11598ab9faffc58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)}" {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 06:53:10 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-ad6061b3-f928-45cb-9070-f002a69ef7fb tempest-ProjectReaderTests-467621584 None] Creating volume aac92ae4-d9b8-4909-9900-1ead8a06611c {{(pid=87329) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 06:53:10 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-ad6061b3-f928-45cb-9070-f002a69ef7fb tempest-ProjectReaderTests-467621584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:53:10 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-ad6061b3-f928-45cb-9070-f002a69ef7fb tempest-ProjectReaderTests-467621584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:53:10 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-ad6061b3-f928-45cb-9070-f002a69ef7fb tempest-ProjectReaderTests-467621584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:53:10 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-ad6061b3-f928-45cb-9070-f002a69ef7fb tempest-ProjectReaderTests-467621584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:53:10 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-ad6061b3-f928-45cb-9070-f002a69ef7fb tempest-ProjectReaderTests-467621584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:53:10 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-ad6061b3-f928-45cb-9070-f002a69ef7fb tempest-ProjectReaderTests-467621584 None] Selected osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 as target Quobyte volume. {{(pid=87329) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 06:53:10 devstack cinder-volume[87329]: INFO cinder.volume.drivers.remotefs [None req-ad6061b3-f928-45cb-9070-f002a69ef7fb tempest-ProjectReaderTests-467621584 None] casted to osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 Sep 06 06:53:10 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-ad6061b3-f928-45cb-9070-f002a69ef7fb tempest-ProjectReaderTests-467621584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-aac92ae4-d9b8-4909-9900-1ead8a06611c 1073741824 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:53:10 devstack sudo[107638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-aac92ae4-d9b8-4909-9900-1ead8a06611c 1073741824 Sep 06 06:53:10 devstack sudo[107638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:53:10 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba2196a3-d194-428e-8232-fe637bd90507 tempest-ProjectMemberTests-77954883 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87329) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 06:53:10 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-ba2196a3-d194-428e-8232-fe637bd90507 tempest-ProjectMemberTests-77954883 None] Flow 'volume_create_manager' (cb830ced-04f1-4d53-a430-c553079df3c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:53:10 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-ba2196a3-d194-428e-8232-fe637bd90507 tempest-ProjectMemberTests-77954883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed501202-13ff-4197-8df5-a35df66e0ef1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:53:10 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-ba2196a3-d194-428e-8232-fe637bd90507 tempest-ProjectMemberTests-77954883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed501202-13ff-4197-8df5-a35df66e0ef1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:53:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1810689082',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=817cb56c-cef8-4725-b13f-ff24f97d73ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9dc5436e8fa48389e888d8f19858d1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:53:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:53:10Z,use_quota=True,user_id='f9722e49a5da4ba7b028b07e73bfb4c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:53:10 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-ba2196a3-d194-428e-8232-fe637bd90507 tempest-ProjectMemberTests-77954883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28d2e19f-5db9-4f65-badf-6e679d86e943) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:53:10 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-ba2196a3-d194-428e-8232-fe637bd90507 tempest-ProjectMemberTests-77954883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28d2e19f-5db9-4f65-badf-6e679d86e943) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:53:10 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-ba2196a3-d194-428e-8232-fe637bd90507 tempest-ProjectMemberTests-77954883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09c52347-b853-44fa-b114-59b41d20dba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:53:10 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-ba2196a3-d194-428e-8232-fe637bd90507 tempest-ProjectMemberTests-77954883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09c52347-b853-44fa-b114-59b41d20dba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '817cb56c-cef8-4725-b13f-ff24f97d73ba', 'volume_name': 'volume-817cb56c-cef8-4725-b13f-ff24f97d73ba', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:53:10 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-ba2196a3-d194-428e-8232-fe637bd90507 tempest-ProjectMemberTests-77954883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c53574f8-6669-4f86-ad5f-f0ff6f8f02d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:53:10 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-ba2196a3-d194-428e-8232-fe637bd90507 tempest-ProjectMemberTests-77954883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c53574f8-6669-4f86-ad5f-f0ff6f8f02d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:53:10 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-ba2196a3-d194-428e-8232-fe637bd90507 tempest-ProjectMemberTests-77954883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6794eb41-01ad-43e4-a025-02ae66fe5d44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:53:10 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-ba2196a3-d194-428e-8232-fe637bd90507 tempest-ProjectMemberTests-77954883 None] Volume 817cb56c-cef8-4725-b13f-ff24f97d73ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-817cb56c-cef8-4725-b13f-ff24f97d73ba', 'volume_size': 1} Sep 06 06:53:10 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-ba2196a3-d194-428e-8232-fe637bd90507 tempest-ProjectMemberTests-77954883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:53:10 devstack sudo[107638]: pam_unix(sudo:session): session closed for user root Sep 06 06:53:10 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-ad6061b3-f928-45cb-9070-f002a69ef7fb tempest-ProjectReaderTests-467621584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-aac92ae4-d9b8-4909-9900-1ead8a06611c 1073741824" returned: 0 in 0.393s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:53:10 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-ad6061b3-f928-45cb-9070-f002a69ef7fb tempest-ProjectReaderTests-467621584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-aac92ae4-d9b8-4909-9900-1ead8a06611c {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:53:10 devstack sudo[107643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-aac92ae4-d9b8-4909-9900-1ead8a06611c Sep 06 06:53:10 devstack sudo[107643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:53:10 devstack sudo[107643]: pam_unix(sudo:session): session closed for user root Sep 06 06:53:10 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-ad6061b3-f928-45cb-9070-f002a69ef7fb tempest-ProjectReaderTests-467621584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-aac92ae4-d9b8-4909-9900-1ead8a06611c" returned: 0 in 0.245s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:53:10 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-ad6061b3-f928-45cb-9070-f002a69ef7fb tempest-ProjectReaderTests-467621584 None] <== create_volume: return (674ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'} {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 06:53:10 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-ad6061b3-f928-45cb-9070-f002a69ef7fb tempest-ProjectReaderTests-467621584 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.677s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:53:10 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-ba2196a3-d194-428e-8232-fe637bd90507 tempest-ProjectMemberTests-77954883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.535s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:53:10 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-ba2196a3-d194-428e-8232-fe637bd90507 tempest-ProjectMemberTests-77954883 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:53:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1810689082',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=817cb56c-cef8-4725-b13f-ff24f97d73ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9dc5436e8fa48389e888d8f19858d1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:53:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:53:10Z,use_quota=True,user_id='f9722e49a5da4ba7b028b07e73bfb4c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)}" {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 06:53:10 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-ba2196a3-d194-428e-8232-fe637bd90507 tempest-ProjectMemberTests-77954883 None] Creating volume 817cb56c-cef8-4725-b13f-ff24f97d73ba {{(pid=87329) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 06:53:10 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-ba2196a3-d194-428e-8232-fe637bd90507 tempest-ProjectMemberTests-77954883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:53:10 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-ba2196a3-d194-428e-8232-fe637bd90507 tempest-ProjectMemberTests-77954883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:53:10 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-ba2196a3-d194-428e-8232-fe637bd90507 tempest-ProjectMemberTests-77954883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:53:10 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-ba2196a3-d194-428e-8232-fe637bd90507 tempest-ProjectMemberTests-77954883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:53:10 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-ba2196a3-d194-428e-8232-fe637bd90507 tempest-ProjectMemberTests-77954883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:53:10 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-ba2196a3-d194-428e-8232-fe637bd90507 tempest-ProjectMemberTests-77954883 None] Selected osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 as target Quobyte volume. {{(pid=87329) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 06:53:10 devstack cinder-volume[87329]: INFO cinder.volume.drivers.remotefs [None req-ba2196a3-d194-428e-8232-fe637bd90507 tempest-ProjectMemberTests-77954883 None] casted to osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 Sep 06 06:53:10 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-ba2196a3-d194-428e-8232-fe637bd90507 tempest-ProjectMemberTests-77954883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-817cb56c-cef8-4725-b13f-ff24f97d73ba 1073741824 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:53:10 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-ad6061b3-f928-45cb-9070-f002a69ef7fb tempest-ProjectReaderTests-467621584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c816ab0-0140-464e-a6d3-2fef4a22ce4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aac92ae4-d9b8-4909-9900-1ead8a06611c', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:53:10 devstack sudo[107646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-817cb56c-cef8-4725-b13f-ff24f97d73ba 1073741824 Sep 06 06:53:10 devstack sudo[107646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:53:10 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-ad6061b3-f928-45cb-9070-f002a69ef7fb tempest-ProjectReaderTests-467621584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d71f659-2a3c-423b-8640-1ac96ef1265f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:53:10 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-ad6061b3-f928-45cb-9070-f002a69ef7fb tempest-ProjectReaderTests-467621584 None] Volume volume-aac92ae4-d9b8-4909-9900-1ead8a06611c (aac92ae4-d9b8-4909-9900-1ead8a06611c): created successfully Sep 06 06:53:10 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-ad6061b3-f928-45cb-9070-f002a69ef7fb tempest-ProjectReaderTests-467621584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d71f659-2a3c-423b-8640-1ac96ef1265f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:53:10 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-ad6061b3-f928-45cb-9070-f002a69ef7fb tempest-ProjectReaderTests-467621584 None] Flow 'volume_create_manager' (6075e7f0-c0e5-4b25-9231-cab5ce8074eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:53:10 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-ad6061b3-f928-45cb-9070-f002a69ef7fb tempest-ProjectReaderTests-467621584 None] Created volume successfully. Sep 06 06:53:11 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-d49b6fb7-07cb-4e97-91d7-09f6e470d1d7 tempest-ProjectReaderTests-467621584 None] Acquiring lock "cinder-aac92ae4-d9b8-4909-9900-1ead8a06611c-delete_volume" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:53:11 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-d49b6fb7-07cb-4e97-91d7-09f6e470d1d7 tempest-ProjectReaderTests-467621584 None] Lock "cinder-aac92ae4-d9b8-4909-9900-1ead8a06611c-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:53:11 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-d49b6fb7-07cb-4e97-91d7-09f6e470d1d7 tempest-ProjectReaderTests-467621584 None] Acquiring lock "cinder-quobyte-aac92ae4-d9b8-4909-9900-1ead8a06611c" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:53:11 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-d49b6fb7-07cb-4e97-91d7-09f6e470d1d7 tempest-ProjectReaderTests-467621584 None] Lock "cinder-quobyte-aac92ae4-d9b8-4909-9900-1ead8a06611c" acquired by "delete_volume" :: waited 0.018s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:53:11 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4c7608b-3b0d-4c84-a227-02d16a203160]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:53:11 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-d49b6fb7-07cb-4e97-91d7-09f6e470d1d7 tempest-ProjectReaderTests-467621584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-aac92ae4-d9b8-4909-9900-1ead8a06611c {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:53:11 devstack sudo[107646]: pam_unix(sudo:session): session closed for user root Sep 06 06:53:11 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-ba2196a3-d194-428e-8232-fe637bd90507 tempest-ProjectMemberTests-77954883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-817cb56c-cef8-4725-b13f-ff24f97d73ba 1073741824" returned: 0 in 0.462s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:53:11 devstack sudo[107651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-aac92ae4-d9b8-4909-9900-1ead8a06611c Sep 06 06:53:11 devstack sudo[107651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:53:11 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-ba2196a3-d194-428e-8232-fe637bd90507 tempest-ProjectMemberTests-77954883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-817cb56c-cef8-4725-b13f-ff24f97d73ba {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:53:11 devstack sudo[107653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-817cb56c-cef8-4725-b13f-ff24f97d73ba Sep 06 06:53:11 devstack sudo[107653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:53:11 devstack sudo[107651]: pam_unix(sudo:session): session closed for user root Sep 06 06:53:11 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-d49b6fb7-07cb-4e97-91d7-09f6e470d1d7 tempest-ProjectReaderTests-467621584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-aac92ae4-d9b8-4909-9900-1ead8a06611c" returned: 0 in 0.366s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:53:11 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-d49b6fb7-07cb-4e97-91d7-09f6e470d1d7 tempest-ProjectReaderTests-467621584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-aac92ae4-d9b8-4909-9900-1ead8a06611c {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:53:11 devstack sudo[107653]: pam_unix(sudo:session): session closed for user root Sep 06 06:53:11 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-ba2196a3-d194-428e-8232-fe637bd90507 tempest-ProjectMemberTests-77954883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-817cb56c-cef8-4725-b13f-ff24f97d73ba" returned: 0 in 0.251s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:53:11 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-ba2196a3-d194-428e-8232-fe637bd90507 tempest-ProjectMemberTests-77954883 None] <== create_volume: return (753ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'} {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 06:53:11 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-ba2196a3-d194-428e-8232-fe637bd90507 tempest-ProjectMemberTests-77954883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.756s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:53:11 devstack sudo[107659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-aac92ae4-d9b8-4909-9900-1ead8a06611c Sep 06 06:53:11 devstack sudo[107659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:53:11 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-ba2196a3-d194-428e-8232-fe637bd90507 tempest-ProjectMemberTests-77954883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6794eb41-01ad-43e4-a025-02ae66fe5d44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-817cb56c-cef8-4725-b13f-ff24f97d73ba', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:53:11 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-ba2196a3-d194-428e-8232-fe637bd90507 tempest-ProjectMemberTests-77954883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ff09731-d408-4bec-83bf-7b5a6c0d1fd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:53:11 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-ba2196a3-d194-428e-8232-fe637bd90507 tempest-ProjectMemberTests-77954883 None] Volume volume-817cb56c-cef8-4725-b13f-ff24f97d73ba (817cb56c-cef8-4725-b13f-ff24f97d73ba): created successfully Sep 06 06:53:11 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-ba2196a3-d194-428e-8232-fe637bd90507 tempest-ProjectMemberTests-77954883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ff09731-d408-4bec-83bf-7b5a6c0d1fd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:53:11 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-ba2196a3-d194-428e-8232-fe637bd90507 tempest-ProjectMemberTests-77954883 None] Flow 'volume_create_manager' (cb830ced-04f1-4d53-a430-c553079df3c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:53:11 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-ba2196a3-d194-428e-8232-fe637bd90507 tempest-ProjectMemberTests-77954883 None] Created volume successfully. Sep 06 06:53:11 devstack sudo[107659]: pam_unix(sudo:session): session closed for user root Sep 06 06:53:11 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-d49b6fb7-07cb-4e97-91d7-09f6e470d1d7 tempest-ProjectReaderTests-467621584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-aac92ae4-d9b8-4909-9900-1ead8a06611c" returned: 0 in 0.244s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:53:11 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-d49b6fb7-07cb-4e97-91d7-09f6e470d1d7 tempest-ProjectReaderTests-467621584 None] Lock "cinder-quobyte-aac92ae4-d9b8-4909-9900-1ead8a06611c" released by "delete_volume" :: held 0.653s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:53:11 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-d49b6fb7-07cb-4e97-91d7-09f6e470d1d7 tempest-ProjectReaderTests-467621584 None] Created reservations ['5b80961a-5a8a-4a69-baf1-6bd3fc800048', 'c4fc1768-ca46-4018-9077-c47cc3c680a2', '0d65eef5-261a-4246-9468-7b4ba6efa203', '618edbe8-9ad0-4a6f-aad2-a7bd09060b9b'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:53:11 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-d49b6fb7-07cb-4e97-91d7-09f6e470d1d7 tempest-ProjectReaderTests-467621584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:53:11 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-d49b6fb7-07cb-4e97-91d7-09f6e470d1d7 tempest-ProjectReaderTests-467621584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:53:11 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-d49b6fb7-07cb-4e97-91d7-09f6e470d1d7 tempest-ProjectReaderTests-467621584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:53:11 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-d49b6fb7-07cb-4e97-91d7-09f6e470d1d7 tempest-ProjectReaderTests-467621584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:53:11 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-d49b6fb7-07cb-4e97-91d7-09f6e470d1d7 tempest-ProjectReaderTests-467621584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:53:11 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-d49b6fb7-07cb-4e97-91d7-09f6e470d1d7 tempest-ProjectReaderTests-467621584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:53:11 devstack sudo[107662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:53:11 devstack sudo[107662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:53:12 devstack sudo[107662]: pam_unix(sudo:session): session closed for user root Sep 06 06:53:12 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-d49b6fb7-07cb-4e97-91d7-09f6e470d1d7 tempest-ProjectReaderTests-467621584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.248s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:53:12 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-d49b6fb7-07cb-4e97-91d7-09f6e470d1d7 tempest-ProjectReaderTests-467621584 None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:53:12 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-d49b6fb7-07cb-4e97-91d7-09f6e470d1d7 tempest-ProjectReaderTests-467621584 None] Deleted volume successfully. Sep 06 06:53:12 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-d49b6fb7-07cb-4e97-91d7-09f6e470d1d7 tempest-ProjectReaderTests-467621584 None] Lock "cinder-aac92ae4-d9b8-4909-9900-1ead8a06611c-delete_volume" released by "delete_volume" :: held 1.100s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:53:12 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-bf2a18fb-fde8-46f4-b3ff-7eb32c5d1593 tempest-ProjectMemberTests-77954883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:53:12 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-bf2a18fb-fde8-46f4-b3ff-7eb32c5d1593 tempest-ProjectMemberTests-77954883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:53:12 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-bf2a18fb-fde8-46f4-b3ff-7eb32c5d1593 tempest-ProjectMemberTests-77954883 None] Creating offline snapshot bd21bdcf-565c-4c75-91d5-1c80fe937687 of volume 817cb56c-cef8-4725-b13f-ff24f97d73ba {{(pid=87329) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 06 06:53:12 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcfafef6-04ec-4bbf-8b50-84366da245e5]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:53:12 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-bf2a18fb-fde8-46f4-b3ff-7eb32c5d1593 tempest-ProjectMemberTests-77954883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-817cb56c-cef8-4725-b13f-ff24f97d73ba {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:53:12 devstack sudo[107666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-817cb56c-cef8-4725-b13f-ff24f97d73ba Sep 06 06:53:12 devstack sudo[107666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:53:12 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-9761bff9-2036-40a5-a520-2cf696f95150 tempest-ProjectReaderTests-467621584 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87329) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 06:53:12 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-9761bff9-2036-40a5-a520-2cf696f95150 tempest-ProjectReaderTests-467621584 None] Flow 'volume_create_manager' (f5221de0-40c1-4810-a630-712abff9de91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:53:12 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-9761bff9-2036-40a5-a520-2cf696f95150 tempest-ProjectReaderTests-467621584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54d2199d-93f8-4866-bff9-dbb6cbaef0ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:53:12 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-9761bff9-2036-40a5-a520-2cf696f95150 tempest-ProjectReaderTests-467621584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54d2199d-93f8-4866-bff9-dbb6cbaef0ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:53:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-863579779',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3f1330c-906f-47c3-8862-e5e4839effcb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4d93fb96cd34a409646af3000051b23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:53:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:53:13Z,use_quota=True,user_id='bb8e71dd35514c59b11598ab9faffc58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:53:12 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-9761bff9-2036-40a5-a520-2cf696f95150 tempest-ProjectReaderTests-467621584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19b2bef4-a47e-4312-aba1-0d59abd5603e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:53:12 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-9761bff9-2036-40a5-a520-2cf696f95150 tempest-ProjectReaderTests-467621584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19b2bef4-a47e-4312-aba1-0d59abd5603e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:53:12 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-9761bff9-2036-40a5-a520-2cf696f95150 tempest-ProjectReaderTests-467621584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e558cdd-fe42-4ab0-8639-0b1fd0d3d763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:53:12 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-9761bff9-2036-40a5-a520-2cf696f95150 tempest-ProjectReaderTests-467621584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e558cdd-fe42-4ab0-8639-0b1fd0d3d763) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c3f1330c-906f-47c3-8862-e5e4839effcb', 'volume_name': 'volume-c3f1330c-906f-47c3-8862-e5e4839effcb', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:53:12 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-9761bff9-2036-40a5-a520-2cf696f95150 tempest-ProjectReaderTests-467621584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d10b837c-2edb-4a48-809d-dc6fdd149a50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:53:12 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-9761bff9-2036-40a5-a520-2cf696f95150 tempest-ProjectReaderTests-467621584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d10b837c-2edb-4a48-809d-dc6fdd149a50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:53:12 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-9761bff9-2036-40a5-a520-2cf696f95150 tempest-ProjectReaderTests-467621584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27730904-ee76-431c-90bf-fb66b6793fb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:53:12 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-9761bff9-2036-40a5-a520-2cf696f95150 tempest-ProjectReaderTests-467621584 None] Volume c3f1330c-906f-47c3-8862-e5e4839effcb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c3f1330c-906f-47c3-8862-e5e4839effcb', 'volume_size': 1} Sep 06 06:53:12 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-9761bff9-2036-40a5-a520-2cf696f95150 tempest-ProjectReaderTests-467621584 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:53:12 devstack sudo[107666]: pam_unix(sudo:session): session closed for user root Sep 06 06:53:12 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-bf2a18fb-fde8-46f4-b3ff-7eb32c5d1593 tempest-ProjectMemberTests-77954883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-817cb56c-cef8-4725-b13f-ff24f97d73ba" returned: 0 in 0.366s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:53:12 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-bf2a18fb-fde8-46f4-b3ff-7eb32c5d1593 tempest-ProjectMemberTests-77954883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-817cb56c-cef8-4725-b13f-ff24f97d73ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-817cb56c-cef8-4725-b13f-ff24f97d73ba.bd21bdcf-565c-4c75-91d5-1c80fe937687 1G {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:53:12 devstack sudo[107671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-817cb56c-cef8-4725-b13f-ff24f97d73ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-817cb56c-cef8-4725-b13f-ff24f97d73ba.bd21bdcf-565c-4c75-91d5-1c80fe937687 1G Sep 06 06:53:12 devstack sudo[107671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:53:13 devstack sudo[107671]: pam_unix(sudo:session): session closed for user root Sep 06 06:53:13 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-bf2a18fb-fde8-46f4-b3ff-7eb32c5d1593 tempest-ProjectMemberTests-77954883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-817cb56c-cef8-4725-b13f-ff24f97d73ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-817cb56c-cef8-4725-b13f-ff24f97d73ba.bd21bdcf-565c-4c75-91d5-1c80fe937687 1G" returned: 0 in 0.364s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:53:13 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-bf2a18fb-fde8-46f4-b3ff-7eb32c5d1593 tempest-ProjectMemberTests-77954883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-817cb56c-cef8-4725-b13f-ff24f97d73ba -F qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-817cb56c-cef8-4725-b13f-ff24f97d73ba.bd21bdcf-565c-4c75-91d5-1c80fe937687 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:53:13 devstack sudo[107676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-817cb56c-cef8-4725-b13f-ff24f97d73ba -F qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-817cb56c-cef8-4725-b13f-ff24f97d73ba.bd21bdcf-565c-4c75-91d5-1c80fe937687 Sep 06 06:53:13 devstack sudo[107676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:53:13 devstack sudo[107676]: pam_unix(sudo:session): session closed for user root Sep 06 06:53:13 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-bf2a18fb-fde8-46f4-b3ff-7eb32c5d1593 tempest-ProjectMemberTests-77954883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-817cb56c-cef8-4725-b13f-ff24f97d73ba -F qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-817cb56c-cef8-4725-b13f-ff24f97d73ba.bd21bdcf-565c-4c75-91d5-1c80fe937687" returned: 0 in 0.279s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:53:13 devstack cinder-volume[87329]: WARNING cinder.volume.drivers.remotefs [None req-bf2a18fb-fde8-46f4-b3ff-7eb32c5d1593 tempest-ProjectMemberTests-77954883 None] /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-817cb56c-cef8-4725-b13f-ff24f97d73ba.bd21bdcf-565c-4c75-91d5-1c80fe937687 is being set with open permissions: ugo+rw Sep 06 06:53:13 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-bf2a18fb-fde8-46f4-b3ff-7eb32c5d1593 tempest-ProjectMemberTests-77954883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-817cb56c-cef8-4725-b13f-ff24f97d73ba.bd21bdcf-565c-4c75-91d5-1c80fe937687 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:53:13 devstack sudo[107681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-817cb56c-cef8-4725-b13f-ff24f97d73ba.bd21bdcf-565c-4c75-91d5-1c80fe937687 Sep 06 06:53:13 devstack sudo[107681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:53:13 devstack sudo[107681]: pam_unix(sudo:session): session closed for user root Sep 06 06:53:13 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-bf2a18fb-fde8-46f4-b3ff-7eb32c5d1593 tempest-ProjectMemberTests-77954883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-817cb56c-cef8-4725-b13f-ff24f97d73ba.bd21bdcf-565c-4c75-91d5-1c80fe937687" returned: 0 in 0.239s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:53:13 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-bf2a18fb-fde8-46f4-b3ff-7eb32c5d1593 tempest-ProjectMemberTests-77954883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-817cb56c-cef8-4725-b13f-ff24f97d73ba.info {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:53:13 devstack sudo[107684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-817cb56c-cef8-4725-b13f-ff24f97d73ba.info Sep 06 06:53:13 devstack sudo[107684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:53:13 devstack sudo[107684]: pam_unix(sudo:session): session closed for user root Sep 06 06:53:13 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-bf2a18fb-fde8-46f4-b3ff-7eb32c5d1593 tempest-ProjectMemberTests-77954883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-817cb56c-cef8-4725-b13f-ff24f97d73ba.info" returned: 0 in 0.248s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:53:13 devstack cinder-volume[87329]: WARNING cinder.volume.drivers.remotefs [None req-bf2a18fb-fde8-46f4-b3ff-7eb32c5d1593 tempest-ProjectMemberTests-77954883 None] /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-817cb56c-cef8-4725-b13f-ff24f97d73ba.info is being set with open permissions: ugo+rw Sep 06 06:53:13 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-bf2a18fb-fde8-46f4-b3ff-7eb32c5d1593 tempest-ProjectMemberTests-77954883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-817cb56c-cef8-4725-b13f-ff24f97d73ba.info {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:53:13 devstack sudo[107687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-817cb56c-cef8-4725-b13f-ff24f97d73ba.info Sep 06 06:53:13 devstack sudo[107687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:53:14 devstack sudo[107687]: pam_unix(sudo:session): session closed for user root Sep 06 06:53:14 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-bf2a18fb-fde8-46f4-b3ff-7eb32c5d1593 tempest-ProjectMemberTests-77954883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-817cb56c-cef8-4725-b13f-ff24f97d73ba.info" returned: 0 in 0.230s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:53:14 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-bf2a18fb-fde8-46f4-b3ff-7eb32c5d1593 tempest-ProjectMemberTests-77954883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.804s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:53:14 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-9761bff9-2036-40a5-a520-2cf696f95150 tempest-ProjectReaderTests-467621584 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.410s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:53:14 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-9761bff9-2036-40a5-a520-2cf696f95150 tempest-ProjectReaderTests-467621584 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:53:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-863579779',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3f1330c-906f-47c3-8862-e5e4839effcb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4d93fb96cd34a409646af3000051b23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:53:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:53:13Z,use_quota=True,user_id='bb8e71dd35514c59b11598ab9faffc58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)}" {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 06:53:14 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-9761bff9-2036-40a5-a520-2cf696f95150 tempest-ProjectReaderTests-467621584 None] Creating volume c3f1330c-906f-47c3-8862-e5e4839effcb {{(pid=87329) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 06:53:14 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-9761bff9-2036-40a5-a520-2cf696f95150 tempest-ProjectReaderTests-467621584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:53:14 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-9761bff9-2036-40a5-a520-2cf696f95150 tempest-ProjectReaderTests-467621584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:53:14 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-9761bff9-2036-40a5-a520-2cf696f95150 tempest-ProjectReaderTests-467621584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:53:14 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-9761bff9-2036-40a5-a520-2cf696f95150 tempest-ProjectReaderTests-467621584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:53:14 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-9761bff9-2036-40a5-a520-2cf696f95150 tempest-ProjectReaderTests-467621584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:53:14 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-9761bff9-2036-40a5-a520-2cf696f95150 tempest-ProjectReaderTests-467621584 None] Selected osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 as target Quobyte volume. {{(pid=87329) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 06:53:14 devstack cinder-volume[87329]: INFO cinder.volume.drivers.remotefs [None req-9761bff9-2036-40a5-a520-2cf696f95150 tempest-ProjectReaderTests-467621584 None] casted to osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 Sep 06 06:53:14 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-9761bff9-2036-40a5-a520-2cf696f95150 tempest-ProjectReaderTests-467621584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-c3f1330c-906f-47c3-8862-e5e4839effcb 1073741824 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:53:14 devstack sudo[107690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-c3f1330c-906f-47c3-8862-e5e4839effcb 1073741824 Sep 06 06:53:14 devstack sudo[107690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:53:14 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-bf2a18fb-fde8-46f4-b3ff-7eb32c5d1593 tempest-ProjectMemberTests-77954883 None] Create snapshot completed successfully Sep 06 06:53:14 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-2a5c16e0-7f92-4116-b5d2-4d8464867bd1 tempest-ProjectMemberTests-77954883 None] Acquiring lock "cinder-bd21bdcf-565c-4c75-91d5-1c80fe937687-delete_snapshot" by "delete_snapshot" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:53:14 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-2a5c16e0-7f92-4116-b5d2-4d8464867bd1 tempest-ProjectMemberTests-77954883 None] Lock "cinder-bd21bdcf-565c-4c75-91d5-1c80fe937687-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:53:14 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-2a5c16e0-7f92-4116-b5d2-4d8464867bd1 tempest-ProjectMemberTests-77954883 None] Acquiring lock "cinder-quobyte-817cb56c-cef8-4725-b13f-ff24f97d73ba" by "delete_snapshot" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:53:14 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-2a5c16e0-7f92-4116-b5d2-4d8464867bd1 tempest-ProjectMemberTests-77954883 None] Lock "cinder-quobyte-817cb56c-cef8-4725-b13f-ff24f97d73ba" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:53:14 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-2a5c16e0-7f92-4116-b5d2-4d8464867bd1 tempest-ProjectMemberTests-77954883 None] Acquiring lock "cinder-quobyte-bd21bdcf-565c-4c75-91d5-1c80fe937687" by "_delete_snapshot" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:53:14 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-2a5c16e0-7f92-4116-b5d2-4d8464867bd1 tempest-ProjectMemberTests-77954883 None] Lock "cinder-quobyte-bd21bdcf-565c-4c75-91d5-1c80fe937687" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:53:14 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-2a5c16e0-7f92-4116-b5d2-4d8464867bd1 tempest-ProjectMemberTests-77954883 None] Deleting offline snapshot bd21bdcf-565c-4c75-91d5-1c80fe937687 of volume 817cb56c-cef8-4725-b13f-ff24f97d73ba {{(pid=87329) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 06 06:53:14 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-2a5c16e0-7f92-4116-b5d2-4d8464867bd1 tempest-ProjectMemberTests-77954883 None] snapshot_file for this snap is: volume-817cb56c-cef8-4725-b13f-ff24f97d73ba.bd21bdcf-565c-4c75-91d5-1c80fe937687 {{(pid=87329) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 06 06:53:14 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6d9d9a7-daad-43cc-84df-ea8477d0328d]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:53:14 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-2a5c16e0-7f92-4116-b5d2-4d8464867bd1 tempest-ProjectMemberTests-77954883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-817cb56c-cef8-4725-b13f-ff24f97d73ba.bd21bdcf-565c-4c75-91d5-1c80fe937687 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:53:14 devstack sudo[107690]: pam_unix(sudo:session): session closed for user root Sep 06 06:53:14 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-9761bff9-2036-40a5-a520-2cf696f95150 tempest-ProjectReaderTests-467621584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-c3f1330c-906f-47c3-8862-e5e4839effcb 1073741824" returned: 0 in 0.464s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:53:14 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-9761bff9-2036-40a5-a520-2cf696f95150 tempest-ProjectReaderTests-467621584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-c3f1330c-906f-47c3-8862-e5e4839effcb {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:53:14 devstack sudo[107696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-817cb56c-cef8-4725-b13f-ff24f97d73ba.bd21bdcf-565c-4c75-91d5-1c80fe937687 Sep 06 06:53:14 devstack sudo[107696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:53:14 devstack sudo[107697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-c3f1330c-906f-47c3-8862-e5e4839effcb Sep 06 06:53:14 devstack sudo[107697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:53:14 devstack sudo[107697]: pam_unix(sudo:session): session closed for user root Sep 06 06:53:14 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-9761bff9-2036-40a5-a520-2cf696f95150 tempest-ProjectReaderTests-467621584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-c3f1330c-906f-47c3-8862-e5e4839effcb" returned: 0 in 0.257s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:53:14 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-9761bff9-2036-40a5-a520-2cf696f95150 tempest-ProjectReaderTests-467621584 None] <== create_volume: return (764ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'} {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 06:53:14 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-9761bff9-2036-40a5-a520-2cf696f95150 tempest-ProjectReaderTests-467621584 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.766s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:53:14 devstack sudo[107696]: pam_unix(sudo:session): session closed for user root Sep 06 06:53:14 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-2a5c16e0-7f92-4116-b5d2-4d8464867bd1 tempest-ProjectMemberTests-77954883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-817cb56c-cef8-4725-b13f-ff24f97d73ba.bd21bdcf-565c-4c75-91d5-1c80fe937687" returned: 0 in 0.374s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:53:14 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-2a5c16e0-7f92-4116-b5d2-4d8464867bd1 tempest-ProjectMemberTests-77954883 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-817cb56c-cef8-4725-b13f-ff24f97d73ba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87329) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 06:53:14 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-9761bff9-2036-40a5-a520-2cf696f95150 tempest-ProjectReaderTests-467621584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27730904-ee76-431c-90bf-fb66b6793fb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3f1330c-906f-47c3-8862-e5e4839effcb', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:53:14 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-9761bff9-2036-40a5-a520-2cf696f95150 tempest-ProjectReaderTests-467621584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc25b5ae-d69d-4524-8b2f-efdccbfc9081) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:53:14 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea292568-9f4b-4d0a-a9ae-d9edea3fb895]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:53:14 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-2a5c16e0-7f92-4116-b5d2-4d8464867bd1 tempest-ProjectMemberTests-77954883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-817cb56c-cef8-4725-b13f-ff24f97d73ba {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:53:15 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-9761bff9-2036-40a5-a520-2cf696f95150 tempest-ProjectReaderTests-467621584 None] Volume volume-c3f1330c-906f-47c3-8862-e5e4839effcb (c3f1330c-906f-47c3-8862-e5e4839effcb): created successfully Sep 06 06:53:15 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-9761bff9-2036-40a5-a520-2cf696f95150 tempest-ProjectReaderTests-467621584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc25b5ae-d69d-4524-8b2f-efdccbfc9081) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:53:15 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-9761bff9-2036-40a5-a520-2cf696f95150 tempest-ProjectReaderTests-467621584 None] Flow 'volume_create_manager' (f5221de0-40c1-4810-a630-712abff9de91) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:53:15 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-9761bff9-2036-40a5-a520-2cf696f95150 tempest-ProjectReaderTests-467621584 None] Created volume successfully. Sep 06 06:53:15 devstack sudo[107704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-817cb56c-cef8-4725-b13f-ff24f97d73ba Sep 06 06:53:15 devstack sudo[107704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:53:15 devstack sudo[107704]: pam_unix(sudo:session): session closed for user root Sep 06 06:53:15 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-2a5c16e0-7f92-4116-b5d2-4d8464867bd1 tempest-ProjectMemberTests-77954883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-817cb56c-cef8-4725-b13f-ff24f97d73ba" returned: 0 in 0.340s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:53:15 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-2a5c16e0-7f92-4116-b5d2-4d8464867bd1 tempest-ProjectMemberTests-77954883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-817cb56c-cef8-4725-b13f-ff24f97d73ba.bd21bdcf-565c-4c75-91d5-1c80fe937687 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:53:15 devstack sudo[107709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-817cb56c-cef8-4725-b13f-ff24f97d73ba.bd21bdcf-565c-4c75-91d5-1c80fe937687 Sep 06 06:53:15 devstack sudo[107709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:53:15 devstack sudo[107709]: pam_unix(sudo:session): session closed for user root Sep 06 06:53:15 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-2a5c16e0-7f92-4116-b5d2-4d8464867bd1 tempest-ProjectMemberTests-77954883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-817cb56c-cef8-4725-b13f-ff24f97d73ba.bd21bdcf-565c-4c75-91d5-1c80fe937687" returned: 0 in 0.313s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:53:15 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-2a5c16e0-7f92-4116-b5d2-4d8464867bd1 tempest-ProjectMemberTests-77954883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-817cb56c-cef8-4725-b13f-ff24f97d73ba.bd21bdcf-565c-4c75-91d5-1c80fe937687 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:53:15 devstack sudo[107714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-817cb56c-cef8-4725-b13f-ff24f97d73ba.bd21bdcf-565c-4c75-91d5-1c80fe937687 Sep 06 06:53:15 devstack sudo[107714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:53:15 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-641587e7-a791-4828-8ac4-13acb5917b2c tempest-ProjectReaderTests-467621584 None] Acquiring lock "cinder-c3f1330c-906f-47c3-8862-e5e4839effcb-delete_volume" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:53:15 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-641587e7-a791-4828-8ac4-13acb5917b2c tempest-ProjectReaderTests-467621584 None] Lock "cinder-c3f1330c-906f-47c3-8862-e5e4839effcb-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:53:15 devstack sudo[107714]: pam_unix(sudo:session): session closed for user root Sep 06 06:53:15 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-2a5c16e0-7f92-4116-b5d2-4d8464867bd1 tempest-ProjectMemberTests-77954883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-817cb56c-cef8-4725-b13f-ff24f97d73ba.bd21bdcf-565c-4c75-91d5-1c80fe937687" returned: 0 in 0.268s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:53:15 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-641587e7-a791-4828-8ac4-13acb5917b2c tempest-ProjectReaderTests-467621584 None] Acquiring lock "cinder-quobyte-c3f1330c-906f-47c3-8862-e5e4839effcb" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:53:15 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-2a5c16e0-7f92-4116-b5d2-4d8464867bd1 tempest-ProjectMemberTests-77954883 None] Lock "cinder-quobyte-bd21bdcf-565c-4c75-91d5-1c80fe937687" released by "_delete_snapshot" :: held 1.391s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:53:15 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-2a5c16e0-7f92-4116-b5d2-4d8464867bd1 tempest-ProjectMemberTests-77954883 None] Lock "cinder-quobyte-817cb56c-cef8-4725-b13f-ff24f97d73ba" released by "delete_snapshot" :: held 1.413s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:53:15 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-641587e7-a791-4828-8ac4-13acb5917b2c tempest-ProjectReaderTests-467621584 None] Lock "cinder-quobyte-c3f1330c-906f-47c3-8862-e5e4839effcb" acquired by "delete_volume" :: waited 0.022s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:53:15 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[66da38d3-c072-4f4c-be1e-ca85283e65fe]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:53:15 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-641587e7-a791-4828-8ac4-13acb5917b2c tempest-ProjectReaderTests-467621584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-c3f1330c-906f-47c3-8862-e5e4839effcb {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:53:16 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-2a5c16e0-7f92-4116-b5d2-4d8464867bd1 tempest-ProjectMemberTests-77954883 None] Created reservations ['d32ae503-88d3-43de-8dc9-2cd5b98496c2', 'c3f49897-63f6-4104-817f-50c9a7e1b969', '1e0575c9-c250-408b-9a71-3e9a661ea39b', 'd0ca5233-f21c-4ecb-88a5-f1c088884bff'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:53:16 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-2a5c16e0-7f92-4116-b5d2-4d8464867bd1 tempest-ProjectMemberTests-77954883 None] Delete snapshot completed successfully. Sep 06 06:53:16 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-2a5c16e0-7f92-4116-b5d2-4d8464867bd1 tempest-ProjectMemberTests-77954883 None] Lock "cinder-bd21bdcf-565c-4c75-91d5-1c80fe937687-delete_snapshot" released by "delete_snapshot" :: held 1.558s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:53:16 devstack sudo[107717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-c3f1330c-906f-47c3-8862-e5e4839effcb Sep 06 06:53:16 devstack sudo[107717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:53:16 devstack sudo[107717]: pam_unix(sudo:session): session closed for user root Sep 06 06:53:16 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-641587e7-a791-4828-8ac4-13acb5917b2c tempest-ProjectReaderTests-467621584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-c3f1330c-906f-47c3-8862-e5e4839effcb" returned: 0 in 0.360s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:53:16 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-641587e7-a791-4828-8ac4-13acb5917b2c tempest-ProjectReaderTests-467621584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-c3f1330c-906f-47c3-8862-e5e4839effcb {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:53:16 devstack sudo[107722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-c3f1330c-906f-47c3-8862-e5e4839effcb Sep 06 06:53:16 devstack sudo[107722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:53:16 devstack sudo[107722]: pam_unix(sudo:session): session closed for user root Sep 06 06:53:16 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-641587e7-a791-4828-8ac4-13acb5917b2c tempest-ProjectReaderTests-467621584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-c3f1330c-906f-47c3-8862-e5e4839effcb" returned: 0 in 0.242s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:53:16 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-641587e7-a791-4828-8ac4-13acb5917b2c tempest-ProjectReaderTests-467621584 None] Lock "cinder-quobyte-c3f1330c-906f-47c3-8862-e5e4839effcb" released by "delete_volume" :: held 0.642s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:53:16 devstack cinder-volume[87329]: DEBUG dbcounter [-] [87329] Writing DB stats cinder:SELECT=178,cinder:DELETE=16,cinder:UPDATE=224,cinder:INSERT=54 {{(pid=87329) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 06:53:16 devstack cinder-volume[87329]: DEBUG dbcounter [-] [87329] Writing DB stats cinder:SELECT=166,cinder:INSERT=62,cinder:UPDATE=215,cinder:DELETE=22 {{(pid=87329) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 06:53:16 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-641587e7-a791-4828-8ac4-13acb5917b2c tempest-ProjectReaderTests-467621584 None] Created reservations ['0650aeb2-74c2-4774-9dd9-3d416dd874ae', '8fff2309-1d3c-4b16-8cae-96cb7c9472ba', '58b4adea-983f-4186-822b-5fbfb8ab16e0', '807c8201-dc25-43fe-ac34-d52f8555fe3f'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:53:16 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-0d988bc2-029e-4577-b9d6-d8ce4057c8ca tempest-ProjectMemberTests-77954883 None] Acquiring lock "cinder-817cb56c-cef8-4725-b13f-ff24f97d73ba-delete_volume" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:53:16 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-0d988bc2-029e-4577-b9d6-d8ce4057c8ca tempest-ProjectMemberTests-77954883 None] Lock "cinder-817cb56c-cef8-4725-b13f-ff24f97d73ba-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:53:16 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-0d988bc2-029e-4577-b9d6-d8ce4057c8ca tempest-ProjectMemberTests-77954883 None] Acquiring lock "cinder-quobyte-817cb56c-cef8-4725-b13f-ff24f97d73ba" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:53:16 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-641587e7-a791-4828-8ac4-13acb5917b2c tempest-ProjectReaderTests-467621584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:53:16 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-641587e7-a791-4828-8ac4-13acb5917b2c tempest-ProjectReaderTests-467621584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:53:16 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-641587e7-a791-4828-8ac4-13acb5917b2c tempest-ProjectReaderTests-467621584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:53:16 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-641587e7-a791-4828-8ac4-13acb5917b2c tempest-ProjectReaderTests-467621584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:53:16 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-641587e7-a791-4828-8ac4-13acb5917b2c tempest-ProjectReaderTests-467621584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:53:16 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-641587e7-a791-4828-8ac4-13acb5917b2c tempest-ProjectReaderTests-467621584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:53:16 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-0d988bc2-029e-4577-b9d6-d8ce4057c8ca tempest-ProjectMemberTests-77954883 None] Lock "cinder-quobyte-817cb56c-cef8-4725-b13f-ff24f97d73ba" acquired by "delete_volume" :: waited 0.036s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:53:16 devstack sudo[107725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:53:16 devstack sudo[107725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:53:16 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[f02f49ca-dbea-4ddc-9246-901bbfed9aa6]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:53:16 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-0d988bc2-029e-4577-b9d6-d8ce4057c8ca tempest-ProjectMemberTests-77954883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-817cb56c-cef8-4725-b13f-ff24f97d73ba {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:53:16 devstack sudo[107727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-817cb56c-cef8-4725-b13f-ff24f97d73ba Sep 06 06:53:16 devstack sudo[107727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:53:17 devstack sudo[107725]: pam_unix(sudo:session): session closed for user root Sep 06 06:53:17 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-641587e7-a791-4828-8ac4-13acb5917b2c tempest-ProjectReaderTests-467621584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.250s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:53:17 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-641587e7-a791-4828-8ac4-13acb5917b2c tempest-ProjectReaderTests-467621584 None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:53:17 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-641587e7-a791-4828-8ac4-13acb5917b2c tempest-ProjectReaderTests-467621584 None] Deleted volume successfully. Sep 06 06:53:17 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-641587e7-a791-4828-8ac4-13acb5917b2c tempest-ProjectReaderTests-467621584 None] Lock "cinder-c3f1330c-906f-47c3-8862-e5e4839effcb-delete_volume" released by "delete_volume" :: held 1.162s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:53:17 devstack sudo[107727]: pam_unix(sudo:session): session closed for user root Sep 06 06:53:17 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-0d988bc2-029e-4577-b9d6-d8ce4057c8ca tempest-ProjectMemberTests-77954883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-817cb56c-cef8-4725-b13f-ff24f97d73ba" returned: 0 in 0.380s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:53:17 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-0d988bc2-029e-4577-b9d6-d8ce4057c8ca tempest-ProjectMemberTests-77954883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-817cb56c-cef8-4725-b13f-ff24f97d73ba {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:53:17 devstack sudo[107733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-817cb56c-cef8-4725-b13f-ff24f97d73ba Sep 06 06:53:17 devstack sudo[107733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:53:17 devstack sudo[107733]: pam_unix(sudo:session): session closed for user root Sep 06 06:53:17 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-0d988bc2-029e-4577-b9d6-d8ce4057c8ca tempest-ProjectMemberTests-77954883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-817cb56c-cef8-4725-b13f-ff24f97d73ba" returned: 0 in 0.272s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:53:17 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-0d988bc2-029e-4577-b9d6-d8ce4057c8ca tempest-ProjectMemberTests-77954883 None] Lock "cinder-quobyte-817cb56c-cef8-4725-b13f-ff24f97d73ba" released by "delete_volume" :: held 0.708s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:53:17 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b31b52b-60bb-42dd-b3f2-e747ba132020 tempest-ProjectReaderTests-467621584 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87329) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 06:53:17 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-0b31b52b-60bb-42dd-b3f2-e747ba132020 tempest-ProjectReaderTests-467621584 None] Flow 'volume_create_manager' (cb341b46-57ce-4290-ad57-bf3b75efa136) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:53:17 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-0b31b52b-60bb-42dd-b3f2-e747ba132020 tempest-ProjectReaderTests-467621584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5ff05f3-ea28-433d-9422-1664757e821d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:53:17 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-0b31b52b-60bb-42dd-b3f2-e747ba132020 tempest-ProjectReaderTests-467621584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5ff05f3-ea28-433d-9422-1664757e821d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:53:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-907173843',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4899f685-9dea-42f3-a408-968b79060fb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4d93fb96cd34a409646af3000051b23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:53:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:53:17Z,use_quota=True,user_id='bb8e71dd35514c59b11598ab9faffc58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:53:17 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-0b31b52b-60bb-42dd-b3f2-e747ba132020 tempest-ProjectReaderTests-467621584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (286c3603-6858-48bc-a155-50eccfb99e8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:53:17 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-0b31b52b-60bb-42dd-b3f2-e747ba132020 tempest-ProjectReaderTests-467621584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (286c3603-6858-48bc-a155-50eccfb99e8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:53:17 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-0b31b52b-60bb-42dd-b3f2-e747ba132020 tempest-ProjectReaderTests-467621584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf262576-00a8-4bb5-86f4-1c935fb05100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:53:17 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-0b31b52b-60bb-42dd-b3f2-e747ba132020 tempest-ProjectReaderTests-467621584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf262576-00a8-4bb5-86f4-1c935fb05100) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4899f685-9dea-42f3-a408-968b79060fb5', 'volume_name': 'volume-4899f685-9dea-42f3-a408-968b79060fb5', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:53:17 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-0b31b52b-60bb-42dd-b3f2-e747ba132020 tempest-ProjectReaderTests-467621584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7068309-c321-48a5-ae90-0c37471c9307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:53:17 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-0b31b52b-60bb-42dd-b3f2-e747ba132020 tempest-ProjectReaderTests-467621584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7068309-c321-48a5-ae90-0c37471c9307) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:53:17 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-0b31b52b-60bb-42dd-b3f2-e747ba132020 tempest-ProjectReaderTests-467621584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e71763b-6d57-439f-b7e1-22f6e86d0594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:53:17 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-0b31b52b-60bb-42dd-b3f2-e747ba132020 tempest-ProjectReaderTests-467621584 None] Volume 4899f685-9dea-42f3-a408-968b79060fb5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4899f685-9dea-42f3-a408-968b79060fb5', 'volume_size': 1} Sep 06 06:53:17 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-0b31b52b-60bb-42dd-b3f2-e747ba132020 tempest-ProjectReaderTests-467621584 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:53:17 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-0b31b52b-60bb-42dd-b3f2-e747ba132020 tempest-ProjectReaderTests-467621584 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:53:17 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-0b31b52b-60bb-42dd-b3f2-e747ba132020 tempest-ProjectReaderTests-467621584 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:53:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-907173843',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4899f685-9dea-42f3-a408-968b79060fb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4d93fb96cd34a409646af3000051b23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:53:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:53:17Z,use_quota=True,user_id='bb8e71dd35514c59b11598ab9faffc58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)}" {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 06:53:17 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-0b31b52b-60bb-42dd-b3f2-e747ba132020 tempest-ProjectReaderTests-467621584 None] Creating volume 4899f685-9dea-42f3-a408-968b79060fb5 {{(pid=87329) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 06:53:17 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-0b31b52b-60bb-42dd-b3f2-e747ba132020 tempest-ProjectReaderTests-467621584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:53:17 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-0b31b52b-60bb-42dd-b3f2-e747ba132020 tempest-ProjectReaderTests-467621584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:53:17 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-0b31b52b-60bb-42dd-b3f2-e747ba132020 tempest-ProjectReaderTests-467621584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:53:17 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-0b31b52b-60bb-42dd-b3f2-e747ba132020 tempest-ProjectReaderTests-467621584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:53:17 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-0b31b52b-60bb-42dd-b3f2-e747ba132020 tempest-ProjectReaderTests-467621584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:53:17 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-0b31b52b-60bb-42dd-b3f2-e747ba132020 tempest-ProjectReaderTests-467621584 None] Selected osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 as target Quobyte volume. {{(pid=87329) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 06:53:17 devstack cinder-volume[87329]: INFO cinder.volume.drivers.remotefs [None req-0b31b52b-60bb-42dd-b3f2-e747ba132020 tempest-ProjectReaderTests-467621584 None] casted to osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 Sep 06 06:53:17 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-0b31b52b-60bb-42dd-b3f2-e747ba132020 tempest-ProjectReaderTests-467621584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-4899f685-9dea-42f3-a408-968b79060fb5 1073741824 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:53:17 devstack sudo[107736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-4899f685-9dea-42f3-a408-968b79060fb5 1073741824 Sep 06 06:53:17 devstack sudo[107736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:53:17 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-0d988bc2-029e-4577-b9d6-d8ce4057c8ca tempest-ProjectMemberTests-77954883 None] Created reservations ['7c5dbdef-8e35-455a-8ded-0945b12e4882', 'cb5e934a-5281-40b0-a4dc-7f3ce6536d21', 'fe2b49a0-b429-4725-b284-5f8e6a3dace7', 'f2ee77bf-1e3f-48b3-aaa2-05b9ca1b1bd6'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:53:17 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-0d988bc2-029e-4577-b9d6-d8ce4057c8ca tempest-ProjectMemberTests-77954883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:53:17 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-0d988bc2-029e-4577-b9d6-d8ce4057c8ca tempest-ProjectMemberTests-77954883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:53:17 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-0d988bc2-029e-4577-b9d6-d8ce4057c8ca tempest-ProjectMemberTests-77954883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:53:17 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-0d988bc2-029e-4577-b9d6-d8ce4057c8ca tempest-ProjectMemberTests-77954883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:53:17 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-0d988bc2-029e-4577-b9d6-d8ce4057c8ca tempest-ProjectMemberTests-77954883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:53:17 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-0d988bc2-029e-4577-b9d6-d8ce4057c8ca tempest-ProjectMemberTests-77954883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:53:17 devstack sudo[107738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:53:17 devstack sudo[107738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:53:17 devstack sudo[107738]: pam_unix(sudo:session): session closed for user root Sep 06 06:53:17 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-0d988bc2-029e-4577-b9d6-d8ce4057c8ca tempest-ProjectMemberTests-77954883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.261s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:53:17 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-0d988bc2-029e-4577-b9d6-d8ce4057c8ca tempest-ProjectMemberTests-77954883 None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:53:17 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-0d988bc2-029e-4577-b9d6-d8ce4057c8ca tempest-ProjectMemberTests-77954883 None] Deleted volume successfully. Sep 06 06:53:17 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-0d988bc2-029e-4577-b9d6-d8ce4057c8ca tempest-ProjectMemberTests-77954883 None] Lock "cinder-817cb56c-cef8-4725-b13f-ff24f97d73ba-delete_volume" released by "delete_volume" :: held 1.291s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:53:18 devstack sudo[107736]: pam_unix(sudo:session): session closed for user root Sep 06 06:53:18 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-0b31b52b-60bb-42dd-b3f2-e747ba132020 tempest-ProjectReaderTests-467621584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-4899f685-9dea-42f3-a408-968b79060fb5 1073741824" returned: 0 in 0.467s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:53:18 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-0b31b52b-60bb-42dd-b3f2-e747ba132020 tempest-ProjectReaderTests-467621584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-4899f685-9dea-42f3-a408-968b79060fb5 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:53:18 devstack sudo[107746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-4899f685-9dea-42f3-a408-968b79060fb5 Sep 06 06:53:18 devstack sudo[107746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:53:18 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-982061bc-2000-472f-baac-ea83397860cf tempest-ProjectMemberTests-77954883 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87329) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 06:53:18 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-982061bc-2000-472f-baac-ea83397860cf tempest-ProjectMemberTests-77954883 None] Flow 'volume_create_manager' (f3d9eec9-0496-4a7e-8910-edc0787cd8a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:53:18 devstack sudo[107746]: pam_unix(sudo:session): session closed for user root Sep 06 06:53:18 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-982061bc-2000-472f-baac-ea83397860cf tempest-ProjectMemberTests-77954883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86a7d001-a55b-419c-95b6-84ed219a5dfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:53:18 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-0b31b52b-60bb-42dd-b3f2-e747ba132020 tempest-ProjectReaderTests-467621584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-4899f685-9dea-42f3-a408-968b79060fb5" returned: 0 in 0.253s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:53:18 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-0b31b52b-60bb-42dd-b3f2-e747ba132020 tempest-ProjectReaderTests-467621584 None] <== create_volume: return (762ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'} {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 06:53:18 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-0b31b52b-60bb-42dd-b3f2-e747ba132020 tempest-ProjectReaderTests-467621584 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.764s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:53:18 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-982061bc-2000-472f-baac-ea83397860cf tempest-ProjectMemberTests-77954883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86a7d001-a55b-419c-95b6-84ed219a5dfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:53:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1014030253',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4be350eb-8bb8-4f8e-a8ad-7454938b8c15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9dc5436e8fa48389e888d8f19858d1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:53:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:53:18Z,use_quota=True,user_id='f9722e49a5da4ba7b028b07e73bfb4c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:53:18 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-982061bc-2000-472f-baac-ea83397860cf tempest-ProjectMemberTests-77954883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e802234f-09f8-43ce-9fb5-5caee6df5cd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:53:18 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-982061bc-2000-472f-baac-ea83397860cf tempest-ProjectMemberTests-77954883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e802234f-09f8-43ce-9fb5-5caee6df5cd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:53:18 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-982061bc-2000-472f-baac-ea83397860cf tempest-ProjectMemberTests-77954883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54049fe8-79dc-4b1e-809c-9f470c7af487) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:53:18 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-982061bc-2000-472f-baac-ea83397860cf tempest-ProjectMemberTests-77954883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54049fe8-79dc-4b1e-809c-9f470c7af487) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4be350eb-8bb8-4f8e-a8ad-7454938b8c15', 'volume_name': 'volume-4be350eb-8bb8-4f8e-a8ad-7454938b8c15', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:53:18 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-982061bc-2000-472f-baac-ea83397860cf tempest-ProjectMemberTests-77954883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (807ceb4f-8a3b-4168-9fc5-13f5ef2df19a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:53:18 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-982061bc-2000-472f-baac-ea83397860cf tempest-ProjectMemberTests-77954883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (807ceb4f-8a3b-4168-9fc5-13f5ef2df19a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:53:18 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-982061bc-2000-472f-baac-ea83397860cf tempest-ProjectMemberTests-77954883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18628f36-7017-458e-8d50-6b694f414ac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:53:18 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-982061bc-2000-472f-baac-ea83397860cf tempest-ProjectMemberTests-77954883 None] Volume 4be350eb-8bb8-4f8e-a8ad-7454938b8c15: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4be350eb-8bb8-4f8e-a8ad-7454938b8c15', 'volume_size': 1} Sep 06 06:53:18 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-982061bc-2000-472f-baac-ea83397860cf tempest-ProjectMemberTests-77954883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:53:18 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-982061bc-2000-472f-baac-ea83397860cf tempest-ProjectMemberTests-77954883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:53:18 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-982061bc-2000-472f-baac-ea83397860cf tempest-ProjectMemberTests-77954883 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:53:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1014030253',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4be350eb-8bb8-4f8e-a8ad-7454938b8c15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9dc5436e8fa48389e888d8f19858d1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:53:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:53:18Z,use_quota=True,user_id='f9722e49a5da4ba7b028b07e73bfb4c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)}" {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 06:53:18 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-982061bc-2000-472f-baac-ea83397860cf tempest-ProjectMemberTests-77954883 None] Creating volume 4be350eb-8bb8-4f8e-a8ad-7454938b8c15 {{(pid=87329) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 06:53:18 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-982061bc-2000-472f-baac-ea83397860cf tempest-ProjectMemberTests-77954883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:53:18 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-982061bc-2000-472f-baac-ea83397860cf tempest-ProjectMemberTests-77954883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:53:18 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-982061bc-2000-472f-baac-ea83397860cf tempest-ProjectMemberTests-77954883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:53:18 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-982061bc-2000-472f-baac-ea83397860cf tempest-ProjectMemberTests-77954883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:53:18 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-982061bc-2000-472f-baac-ea83397860cf tempest-ProjectMemberTests-77954883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:53:18 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-982061bc-2000-472f-baac-ea83397860cf tempest-ProjectMemberTests-77954883 None] Selected osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 as target Quobyte volume. {{(pid=87329) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 06:53:18 devstack cinder-volume[87329]: INFO cinder.volume.drivers.remotefs [None req-982061bc-2000-472f-baac-ea83397860cf tempest-ProjectMemberTests-77954883 None] casted to osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 Sep 06 06:53:18 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-982061bc-2000-472f-baac-ea83397860cf tempest-ProjectMemberTests-77954883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-4be350eb-8bb8-4f8e-a8ad-7454938b8c15 1073741824 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:53:18 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-0b31b52b-60bb-42dd-b3f2-e747ba132020 tempest-ProjectReaderTests-467621584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e71763b-6d57-439f-b7e1-22f6e86d0594) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4899f685-9dea-42f3-a408-968b79060fb5', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:53:18 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-0b31b52b-60bb-42dd-b3f2-e747ba132020 tempest-ProjectReaderTests-467621584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99a37176-8c08-4af8-8605-ce3dfbf4908a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:53:18 devstack sudo[107749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-4be350eb-8bb8-4f8e-a8ad-7454938b8c15 1073741824 Sep 06 06:53:18 devstack sudo[107749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:53:18 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-0b31b52b-60bb-42dd-b3f2-e747ba132020 tempest-ProjectReaderTests-467621584 None] Volume volume-4899f685-9dea-42f3-a408-968b79060fb5 (4899f685-9dea-42f3-a408-968b79060fb5): created successfully Sep 06 06:53:18 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-0b31b52b-60bb-42dd-b3f2-e747ba132020 tempest-ProjectReaderTests-467621584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99a37176-8c08-4af8-8605-ce3dfbf4908a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:53:18 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-0b31b52b-60bb-42dd-b3f2-e747ba132020 tempest-ProjectReaderTests-467621584 None] Flow 'volume_create_manager' (cb341b46-57ce-4290-ad57-bf3b75efa136) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:53:18 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-0b31b52b-60bb-42dd-b3f2-e747ba132020 tempest-ProjectReaderTests-467621584 None] Created volume successfully. Sep 06 06:53:18 devstack sudo[107749]: pam_unix(sudo:session): session closed for user root Sep 06 06:53:18 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-982061bc-2000-472f-baac-ea83397860cf tempest-ProjectMemberTests-77954883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-4be350eb-8bb8-4f8e-a8ad-7454938b8c15 1073741824" returned: 0 in 0.412s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:53:18 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-982061bc-2000-472f-baac-ea83397860cf tempest-ProjectMemberTests-77954883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-4be350eb-8bb8-4f8e-a8ad-7454938b8c15 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:53:18 devstack sudo[107754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-4be350eb-8bb8-4f8e-a8ad-7454938b8c15 Sep 06 06:53:18 devstack sudo[107754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:53:19 devstack sudo[107754]: pam_unix(sudo:session): session closed for user root Sep 06 06:53:19 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-982061bc-2000-472f-baac-ea83397860cf tempest-ProjectMemberTests-77954883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-4be350eb-8bb8-4f8e-a8ad-7454938b8c15" returned: 0 in 0.248s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:53:19 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-982061bc-2000-472f-baac-ea83397860cf tempest-ProjectMemberTests-77954883 None] <== create_volume: return (698ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'} {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 06:53:19 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-982061bc-2000-472f-baac-ea83397860cf tempest-ProjectMemberTests-77954883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.700s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:53:19 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-982061bc-2000-472f-baac-ea83397860cf tempest-ProjectMemberTests-77954883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18628f36-7017-458e-8d50-6b694f414ac0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4be350eb-8bb8-4f8e-a8ad-7454938b8c15', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:53:19 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-982061bc-2000-472f-baac-ea83397860cf tempest-ProjectMemberTests-77954883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bde84308-bad0-4398-b3d7-a4483d031fd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:53:19 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-982061bc-2000-472f-baac-ea83397860cf tempest-ProjectMemberTests-77954883 None] Volume volume-4be350eb-8bb8-4f8e-a8ad-7454938b8c15 (4be350eb-8bb8-4f8e-a8ad-7454938b8c15): created successfully Sep 06 06:53:19 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-982061bc-2000-472f-baac-ea83397860cf tempest-ProjectMemberTests-77954883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bde84308-bad0-4398-b3d7-a4483d031fd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:53:19 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-982061bc-2000-472f-baac-ea83397860cf tempest-ProjectMemberTests-77954883 None] Flow 'volume_create_manager' (f3d9eec9-0496-4a7e-8910-edc0787cd8a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:53:19 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-982061bc-2000-472f-baac-ea83397860cf tempest-ProjectMemberTests-77954883 None] Created volume successfully. Sep 06 06:53:19 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-8f476104-ef3f-4609-a802-979151795709 tempest-ProjectMemberTests-77954883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:53:19 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-8f476104-ef3f-4609-a802-979151795709 tempest-ProjectMemberTests-77954883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:53:19 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-8f476104-ef3f-4609-a802-979151795709 tempest-ProjectMemberTests-77954883 None] Creating offline snapshot 7788a1c5-adbb-45f9-b6b9-1202207d4687 of volume 4be350eb-8bb8-4f8e-a8ad-7454938b8c15 {{(pid=87329) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 06 06:53:19 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[48eac84c-da11-4447-a547-ede1abacb6e0]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:53:19 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-8f476104-ef3f-4609-a802-979151795709 tempest-ProjectMemberTests-77954883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-4be350eb-8bb8-4f8e-a8ad-7454938b8c15 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:53:19 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-92e3439e-7c24-4e6d-8b92-7f1871d1bdaf tempest-ProjectReaderTests-467621584 None] Acquiring lock "cinder-4899f685-9dea-42f3-a408-968b79060fb5-delete_volume" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:53:19 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-92e3439e-7c24-4e6d-8b92-7f1871d1bdaf tempest-ProjectReaderTests-467621584 None] Lock "cinder-4899f685-9dea-42f3-a408-968b79060fb5-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:53:19 devstack sudo[107757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-4be350eb-8bb8-4f8e-a8ad-7454938b8c15 Sep 06 06:53:19 devstack sudo[107757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:53:19 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-92e3439e-7c24-4e6d-8b92-7f1871d1bdaf tempest-ProjectReaderTests-467621584 None] Acquiring lock "cinder-quobyte-4899f685-9dea-42f3-a408-968b79060fb5" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:53:19 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-92e3439e-7c24-4e6d-8b92-7f1871d1bdaf tempest-ProjectReaderTests-467621584 None] Lock "cinder-quobyte-4899f685-9dea-42f3-a408-968b79060fb5" acquired by "delete_volume" :: waited 0.015s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:53:19 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fd3ec4a-5986-4daf-9448-21ecef2acaaa]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:53:19 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-92e3439e-7c24-4e6d-8b92-7f1871d1bdaf tempest-ProjectReaderTests-467621584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-4899f685-9dea-42f3-a408-968b79060fb5 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:53:19 devstack sudo[107759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-4899f685-9dea-42f3-a408-968b79060fb5 Sep 06 06:53:19 devstack sudo[107759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:53:19 devstack sudo[107757]: pam_unix(sudo:session): session closed for user root Sep 06 06:53:19 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-8f476104-ef3f-4609-a802-979151795709 tempest-ProjectMemberTests-77954883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-4be350eb-8bb8-4f8e-a8ad-7454938b8c15" returned: 0 in 0.372s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:53:19 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-8f476104-ef3f-4609-a802-979151795709 tempest-ProjectMemberTests-77954883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-4be350eb-8bb8-4f8e-a8ad-7454938b8c15,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-4be350eb-8bb8-4f8e-a8ad-7454938b8c15.7788a1c5-adbb-45f9-b6b9-1202207d4687 1G {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:53:19 devstack sudo[107764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-4be350eb-8bb8-4f8e-a8ad-7454938b8c15,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-4be350eb-8bb8-4f8e-a8ad-7454938b8c15.7788a1c5-adbb-45f9-b6b9-1202207d4687 1G Sep 06 06:53:19 devstack sudo[107764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:53:20 devstack sudo[107759]: pam_unix(sudo:session): session closed for user root Sep 06 06:53:20 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-92e3439e-7c24-4e6d-8b92-7f1871d1bdaf tempest-ProjectReaderTests-467621584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-4899f685-9dea-42f3-a408-968b79060fb5" returned: 0 in 0.355s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:53:20 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-92e3439e-7c24-4e6d-8b92-7f1871d1bdaf tempest-ProjectReaderTests-467621584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-4899f685-9dea-42f3-a408-968b79060fb5 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:53:20 devstack sudo[107769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-4899f685-9dea-42f3-a408-968b79060fb5 Sep 06 06:53:20 devstack sudo[107769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:53:20 devstack sudo[107769]: pam_unix(sudo:session): session closed for user root Sep 06 06:53:20 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-92e3439e-7c24-4e6d-8b92-7f1871d1bdaf tempest-ProjectReaderTests-467621584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-4899f685-9dea-42f3-a408-968b79060fb5" returned: 0 in 0.271s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:53:20 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-92e3439e-7c24-4e6d-8b92-7f1871d1bdaf tempest-ProjectReaderTests-467621584 None] Lock "cinder-quobyte-4899f685-9dea-42f3-a408-968b79060fb5" released by "delete_volume" :: held 0.666s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:53:20 devstack sudo[107764]: pam_unix(sudo:session): session closed for user root Sep 06 06:53:20 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-8f476104-ef3f-4609-a802-979151795709 tempest-ProjectMemberTests-77954883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-4be350eb-8bb8-4f8e-a8ad-7454938b8c15,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-4be350eb-8bb8-4f8e-a8ad-7454938b8c15.7788a1c5-adbb-45f9-b6b9-1202207d4687 1G" returned: 0 in 0.461s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:53:20 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-8f476104-ef3f-4609-a802-979151795709 tempest-ProjectMemberTests-77954883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4be350eb-8bb8-4f8e-a8ad-7454938b8c15 -F qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-4be350eb-8bb8-4f8e-a8ad-7454938b8c15.7788a1c5-adbb-45f9-b6b9-1202207d4687 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:53:20 devstack sudo[107777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4be350eb-8bb8-4f8e-a8ad-7454938b8c15 -F qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-4be350eb-8bb8-4f8e-a8ad-7454938b8c15.7788a1c5-adbb-45f9-b6b9-1202207d4687 Sep 06 06:53:20 devstack sudo[107777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:53:20 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-92e3439e-7c24-4e6d-8b92-7f1871d1bdaf tempest-ProjectReaderTests-467621584 None] Created reservations ['6caac288-62fc-4af5-993c-8b744bbccb3e', '2ca52e99-fc2a-4e86-b892-9153670db8a9', 'a50f0f84-817f-48c4-b997-69207a6ec63e', 'eb355926-40c6-4a66-bf52-796c455cf527'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:53:20 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-92e3439e-7c24-4e6d-8b92-7f1871d1bdaf tempest-ProjectReaderTests-467621584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:53:20 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-92e3439e-7c24-4e6d-8b92-7f1871d1bdaf tempest-ProjectReaderTests-467621584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:53:20 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-92e3439e-7c24-4e6d-8b92-7f1871d1bdaf tempest-ProjectReaderTests-467621584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:53:20 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-92e3439e-7c24-4e6d-8b92-7f1871d1bdaf tempest-ProjectReaderTests-467621584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:53:20 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-92e3439e-7c24-4e6d-8b92-7f1871d1bdaf tempest-ProjectReaderTests-467621584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:53:20 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-92e3439e-7c24-4e6d-8b92-7f1871d1bdaf tempest-ProjectReaderTests-467621584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:53:20 devstack sudo[107779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:53:20 devstack sudo[107779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:53:20 devstack sudo[107777]: pam_unix(sudo:session): session closed for user root Sep 06 06:53:20 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-8f476104-ef3f-4609-a802-979151795709 tempest-ProjectMemberTests-77954883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4be350eb-8bb8-4f8e-a8ad-7454938b8c15 -F qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-4be350eb-8bb8-4f8e-a8ad-7454938b8c15.7788a1c5-adbb-45f9-b6b9-1202207d4687" returned: 0 in 0.288s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:53:20 devstack cinder-volume[87329]: WARNING cinder.volume.drivers.remotefs [None req-8f476104-ef3f-4609-a802-979151795709 tempest-ProjectMemberTests-77954883 None] /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-4be350eb-8bb8-4f8e-a8ad-7454938b8c15.7788a1c5-adbb-45f9-b6b9-1202207d4687 is being set with open permissions: ugo+rw Sep 06 06:53:20 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-8f476104-ef3f-4609-a802-979151795709 tempest-ProjectMemberTests-77954883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-4be350eb-8bb8-4f8e-a8ad-7454938b8c15.7788a1c5-adbb-45f9-b6b9-1202207d4687 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:53:20 devstack sudo[107784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-4be350eb-8bb8-4f8e-a8ad-7454938b8c15.7788a1c5-adbb-45f9-b6b9-1202207d4687 Sep 06 06:53:20 devstack sudo[107784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:53:20 devstack sudo[107779]: pam_unix(sudo:session): session closed for user root Sep 06 06:53:20 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-92e3439e-7c24-4e6d-8b92-7f1871d1bdaf tempest-ProjectReaderTests-467621584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.264s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:53:20 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-92e3439e-7c24-4e6d-8b92-7f1871d1bdaf tempest-ProjectReaderTests-467621584 None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:53:20 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-92e3439e-7c24-4e6d-8b92-7f1871d1bdaf tempest-ProjectReaderTests-467621584 None] Deleted volume successfully. Sep 06 06:53:20 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-92e3439e-7c24-4e6d-8b92-7f1871d1bdaf tempest-ProjectReaderTests-467621584 None] Lock "cinder-4899f685-9dea-42f3-a408-968b79060fb5-delete_volume" released by "delete_volume" :: held 1.164s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:53:20 devstack sudo[107784]: pam_unix(sudo:session): session closed for user root Sep 06 06:53:20 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-8f476104-ef3f-4609-a802-979151795709 tempest-ProjectMemberTests-77954883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-4be350eb-8bb8-4f8e-a8ad-7454938b8c15.7788a1c5-adbb-45f9-b6b9-1202207d4687" returned: 0 in 0.251s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:53:20 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-8f476104-ef3f-4609-a802-979151795709 tempest-ProjectMemberTests-77954883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-4be350eb-8bb8-4f8e-a8ad-7454938b8c15.info {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:53:20 devstack sudo[107788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-4be350eb-8bb8-4f8e-a8ad-7454938b8c15.info Sep 06 06:53:20 devstack sudo[107788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:53:21 devstack sudo[107788]: pam_unix(sudo:session): session closed for user root Sep 06 06:53:21 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-8f476104-ef3f-4609-a802-979151795709 tempest-ProjectMemberTests-77954883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-4be350eb-8bb8-4f8e-a8ad-7454938b8c15.info" returned: 0 in 0.248s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:53:21 devstack cinder-volume[87329]: WARNING cinder.volume.drivers.remotefs [None req-8f476104-ef3f-4609-a802-979151795709 tempest-ProjectMemberTests-77954883 None] /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-4be350eb-8bb8-4f8e-a8ad-7454938b8c15.info is being set with open permissions: ugo+rw Sep 06 06:53:21 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-8f476104-ef3f-4609-a802-979151795709 tempest-ProjectMemberTests-77954883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-4be350eb-8bb8-4f8e-a8ad-7454938b8c15.info {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:53:21 devstack sudo[107791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-4be350eb-8bb8-4f8e-a8ad-7454938b8c15.info Sep 06 06:53:21 devstack sudo[107791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:53:21 devstack sudo[107791]: pam_unix(sudo:session): session closed for user root Sep 06 06:53:21 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-8f476104-ef3f-4609-a802-979151795709 tempest-ProjectMemberTests-77954883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-4be350eb-8bb8-4f8e-a8ad-7454938b8c15.info" returned: 0 in 0.251s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:53:21 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-8f476104-ef3f-4609-a802-979151795709 tempest-ProjectMemberTests-77954883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.958s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:53:21 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-8f476104-ef3f-4609-a802-979151795709 tempest-ProjectMemberTests-77954883 None] Create snapshot completed successfully Sep 06 06:53:21 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-a5bfa785-b2fb-40ca-ae71-f05df96aac16 tempest-ProjectMemberTests-77954883 None] Acquiring lock "cinder-7788a1c5-adbb-45f9-b6b9-1202207d4687-delete_snapshot" by "delete_snapshot" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:53:21 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-a5bfa785-b2fb-40ca-ae71-f05df96aac16 tempest-ProjectMemberTests-77954883 None] Lock "cinder-7788a1c5-adbb-45f9-b6b9-1202207d4687-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:53:21 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-a5bfa785-b2fb-40ca-ae71-f05df96aac16 tempest-ProjectMemberTests-77954883 None] Acquiring lock "cinder-quobyte-4be350eb-8bb8-4f8e-a8ad-7454938b8c15" by "delete_snapshot" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:53:21 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-a5bfa785-b2fb-40ca-ae71-f05df96aac16 tempest-ProjectMemberTests-77954883 None] Lock "cinder-quobyte-4be350eb-8bb8-4f8e-a8ad-7454938b8c15" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:53:21 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-a5bfa785-b2fb-40ca-ae71-f05df96aac16 tempest-ProjectMemberTests-77954883 None] Acquiring lock "cinder-quobyte-7788a1c5-adbb-45f9-b6b9-1202207d4687" by "_delete_snapshot" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:53:21 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-a5bfa785-b2fb-40ca-ae71-f05df96aac16 tempest-ProjectMemberTests-77954883 None] Lock "cinder-quobyte-7788a1c5-adbb-45f9-b6b9-1202207d4687" acquired by "_delete_snapshot" :: waited 0.061s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:53:21 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-a5bfa785-b2fb-40ca-ae71-f05df96aac16 tempest-ProjectMemberTests-77954883 None] Deleting offline snapshot 7788a1c5-adbb-45f9-b6b9-1202207d4687 of volume 4be350eb-8bb8-4f8e-a8ad-7454938b8c15 {{(pid=87329) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 06 06:53:21 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-a5bfa785-b2fb-40ca-ae71-f05df96aac16 tempest-ProjectMemberTests-77954883 None] snapshot_file for this snap is: volume-4be350eb-8bb8-4f8e-a8ad-7454938b8c15.7788a1c5-adbb-45f9-b6b9-1202207d4687 {{(pid=87329) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 06 06:53:21 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[a82771c9-1d28-4b81-a7b9-a1ac5be42031]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:53:21 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-a5bfa785-b2fb-40ca-ae71-f05df96aac16 tempest-ProjectMemberTests-77954883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-4be350eb-8bb8-4f8e-a8ad-7454938b8c15.7788a1c5-adbb-45f9-b6b9-1202207d4687 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:53:21 devstack sudo[107794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-4be350eb-8bb8-4f8e-a8ad-7454938b8c15.7788a1c5-adbb-45f9-b6b9-1202207d4687 Sep 06 06:53:21 devstack sudo[107794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:53:22 devstack sudo[107794]: pam_unix(sudo:session): session closed for user root Sep 06 06:53:22 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-a5bfa785-b2fb-40ca-ae71-f05df96aac16 tempest-ProjectMemberTests-77954883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-4be350eb-8bb8-4f8e-a8ad-7454938b8c15.7788a1c5-adbb-45f9-b6b9-1202207d4687" returned: 0 in 0.402s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:53:22 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-a5bfa785-b2fb-40ca-ae71-f05df96aac16 tempest-ProjectMemberTests-77954883 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4be350eb-8bb8-4f8e-a8ad-7454938b8c15(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87329) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 06:53:22 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c0374c2-9d00-49d7-933f-6d36364944f0]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:53:22 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-a5bfa785-b2fb-40ca-ae71-f05df96aac16 tempest-ProjectMemberTests-77954883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-4be350eb-8bb8-4f8e-a8ad-7454938b8c15 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:53:22 devstack sudo[107800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-4be350eb-8bb8-4f8e-a8ad-7454938b8c15 Sep 06 06:53:22 devstack sudo[107800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:53:22 devstack sudo[107800]: pam_unix(sudo:session): session closed for user root Sep 06 06:53:22 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-a5bfa785-b2fb-40ca-ae71-f05df96aac16 tempest-ProjectMemberTests-77954883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-4be350eb-8bb8-4f8e-a8ad-7454938b8c15" returned: 0 in 0.359s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:53:22 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-a5bfa785-b2fb-40ca-ae71-f05df96aac16 tempest-ProjectMemberTests-77954883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-4be350eb-8bb8-4f8e-a8ad-7454938b8c15.7788a1c5-adbb-45f9-b6b9-1202207d4687 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:53:22 devstack sudo[107805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-4be350eb-8bb8-4f8e-a8ad-7454938b8c15.7788a1c5-adbb-45f9-b6b9-1202207d4687 Sep 06 06:53:22 devstack sudo[107805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:53:22 devstack sudo[107805]: pam_unix(sudo:session): session closed for user root Sep 06 06:53:22 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-a5bfa785-b2fb-40ca-ae71-f05df96aac16 tempest-ProjectMemberTests-77954883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-4be350eb-8bb8-4f8e-a8ad-7454938b8c15.7788a1c5-adbb-45f9-b6b9-1202207d4687" returned: 0 in 0.341s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:53:22 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-a5bfa785-b2fb-40ca-ae71-f05df96aac16 tempest-ProjectMemberTests-77954883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-4be350eb-8bb8-4f8e-a8ad-7454938b8c15.7788a1c5-adbb-45f9-b6b9-1202207d4687 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:53:22 devstack sudo[107811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-4be350eb-8bb8-4f8e-a8ad-7454938b8c15.7788a1c5-adbb-45f9-b6b9-1202207d4687 Sep 06 06:53:22 devstack sudo[107811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:53:23 devstack sudo[107811]: pam_unix(sudo:session): session closed for user root Sep 06 06:53:23 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-a5bfa785-b2fb-40ca-ae71-f05df96aac16 tempest-ProjectMemberTests-77954883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-4be350eb-8bb8-4f8e-a8ad-7454938b8c15.7788a1c5-adbb-45f9-b6b9-1202207d4687" returned: 0 in 0.244s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:53:23 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-a5bfa785-b2fb-40ca-ae71-f05df96aac16 tempest-ProjectMemberTests-77954883 None] Lock "cinder-quobyte-7788a1c5-adbb-45f9-b6b9-1202207d4687" released by "_delete_snapshot" :: held 1.439s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:53:23 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-a5bfa785-b2fb-40ca-ae71-f05df96aac16 tempest-ProjectMemberTests-77954883 None] Lock "cinder-quobyte-4be350eb-8bb8-4f8e-a8ad-7454938b8c15" released by "delete_snapshot" :: held 1.508s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:53:23 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-a5bfa785-b2fb-40ca-ae71-f05df96aac16 tempest-ProjectMemberTests-77954883 None] Created reservations ['d4526903-dd79-488e-981d-878e3cab1c06', 'e444de2d-b008-4f04-b702-7df48d39ef86', '38e20ec2-f8a5-437b-b129-5154392e1677', 'afc84b12-6d1d-4ce4-999f-c00ea4d85caa'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:53:23 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-a5bfa785-b2fb-40ca-ae71-f05df96aac16 tempest-ProjectMemberTests-77954883 None] Delete snapshot completed successfully. Sep 06 06:53:23 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-a5bfa785-b2fb-40ca-ae71-f05df96aac16 tempest-ProjectMemberTests-77954883 None] Lock "cinder-7788a1c5-adbb-45f9-b6b9-1202207d4687-delete_snapshot" released by "delete_snapshot" :: held 1.629s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:53:23 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-f2446dd3-e9a6-4863-95e5-82b7ac583b34 tempest-ProjectMemberTests-77954883 None] Acquiring lock "cinder-4be350eb-8bb8-4f8e-a8ad-7454938b8c15-delete_volume" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:53:23 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-f2446dd3-e9a6-4863-95e5-82b7ac583b34 tempest-ProjectMemberTests-77954883 None] Lock "cinder-4be350eb-8bb8-4f8e-a8ad-7454938b8c15-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:53:23 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-f2446dd3-e9a6-4863-95e5-82b7ac583b34 tempest-ProjectMemberTests-77954883 None] Acquiring lock "cinder-quobyte-4be350eb-8bb8-4f8e-a8ad-7454938b8c15" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:53:23 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-f2446dd3-e9a6-4863-95e5-82b7ac583b34 tempest-ProjectMemberTests-77954883 None] Lock "cinder-quobyte-4be350eb-8bb8-4f8e-a8ad-7454938b8c15" acquired by "delete_volume" :: waited 0.014s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:53:23 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3cb5bf8-10b8-4f49-bbca-c9c9c22ab5cf]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:53:23 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-f2446dd3-e9a6-4863-95e5-82b7ac583b34 tempest-ProjectMemberTests-77954883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-4be350eb-8bb8-4f8e-a8ad-7454938b8c15 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:53:23 devstack sudo[107814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-4be350eb-8bb8-4f8e-a8ad-7454938b8c15 Sep 06 06:53:23 devstack sudo[107814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:53:24 devstack sudo[107814]: pam_unix(sudo:session): session closed for user root Sep 06 06:53:24 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-f2446dd3-e9a6-4863-95e5-82b7ac583b34 tempest-ProjectMemberTests-77954883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-4be350eb-8bb8-4f8e-a8ad-7454938b8c15" returned: 0 in 0.352s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:53:24 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-f2446dd3-e9a6-4863-95e5-82b7ac583b34 tempest-ProjectMemberTests-77954883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-4be350eb-8bb8-4f8e-a8ad-7454938b8c15 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:53:24 devstack sudo[107819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-4be350eb-8bb8-4f8e-a8ad-7454938b8c15 Sep 06 06:53:24 devstack sudo[107819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:53:24 devstack sudo[107819]: pam_unix(sudo:session): session closed for user root Sep 06 06:53:24 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-f2446dd3-e9a6-4863-95e5-82b7ac583b34 tempest-ProjectMemberTests-77954883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-4be350eb-8bb8-4f8e-a8ad-7454938b8c15" returned: 0 in 0.232s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:53:24 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-f2446dd3-e9a6-4863-95e5-82b7ac583b34 tempest-ProjectMemberTests-77954883 None] Lock "cinder-quobyte-4be350eb-8bb8-4f8e-a8ad-7454938b8c15" released by "delete_volume" :: held 0.635s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:53:24 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-f2446dd3-e9a6-4863-95e5-82b7ac583b34 tempest-ProjectMemberTests-77954883 None] Created reservations ['14f60081-ff7f-4b3e-b4b5-5203fc3a9cd8', 'd0d83142-c241-4349-8a46-8feb88f07169', 'b9649c79-9a35-4ccd-96c8-c4579a3e6c9a', 'a03a7b27-ea92-4bdf-9c59-6dd20b131ec1'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:53:24 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-f2446dd3-e9a6-4863-95e5-82b7ac583b34 tempest-ProjectMemberTests-77954883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:53:24 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-f2446dd3-e9a6-4863-95e5-82b7ac583b34 tempest-ProjectMemberTests-77954883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:53:24 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-f2446dd3-e9a6-4863-95e5-82b7ac583b34 tempest-ProjectMemberTests-77954883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:53:24 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-f2446dd3-e9a6-4863-95e5-82b7ac583b34 tempest-ProjectMemberTests-77954883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:53:24 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-f2446dd3-e9a6-4863-95e5-82b7ac583b34 tempest-ProjectMemberTests-77954883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:53:24 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-f2446dd3-e9a6-4863-95e5-82b7ac583b34 tempest-ProjectMemberTests-77954883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:53:24 devstack sudo[107822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:53:24 devstack sudo[107822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:53:24 devstack sudo[107822]: pam_unix(sudo:session): session closed for user root Sep 06 06:53:24 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-f2446dd3-e9a6-4863-95e5-82b7ac583b34 tempest-ProjectMemberTests-77954883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.234s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:53:24 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-f2446dd3-e9a6-4863-95e5-82b7ac583b34 tempest-ProjectMemberTests-77954883 None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:53:24 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-f2446dd3-e9a6-4863-95e5-82b7ac583b34 tempest-ProjectMemberTests-77954883 None] Deleted volume successfully. Sep 06 06:53:24 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-f2446dd3-e9a6-4863-95e5-82b7ac583b34 tempest-ProjectMemberTests-77954883 None] Lock "cinder-4be350eb-8bb8-4f8e-a8ad-7454938b8c15-delete_volume" released by "delete_volume" :: held 1.045s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:53:25 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-94762067-111b-493d-8e27-ee556b84baab tempest-ProjectMemberTests-77954883 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87329) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 06:53:25 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-94762067-111b-493d-8e27-ee556b84baab tempest-ProjectMemberTests-77954883 None] Flow 'volume_create_manager' (93d34476-bc4e-4163-af52-1389a9a27fe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:53:25 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-94762067-111b-493d-8e27-ee556b84baab tempest-ProjectMemberTests-77954883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b99efe79-81ed-4d72-b18b-2d46f97b3c2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:53:25 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-94762067-111b-493d-8e27-ee556b84baab tempest-ProjectMemberTests-77954883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b99efe79-81ed-4d72-b18b-2d46f97b3c2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:53:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-275484136',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7e9bc58-340c-4e25-bec1-95f045c6c1c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9dc5436e8fa48389e888d8f19858d1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:53:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:53:25Z,use_quota=True,user_id='f9722e49a5da4ba7b028b07e73bfb4c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:53:25 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-94762067-111b-493d-8e27-ee556b84baab tempest-ProjectMemberTests-77954883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5287cb1e-d6dd-4d43-920c-c66146acc618) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:53:25 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-94762067-111b-493d-8e27-ee556b84baab tempest-ProjectMemberTests-77954883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5287cb1e-d6dd-4d43-920c-c66146acc618) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:53:25 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-94762067-111b-493d-8e27-ee556b84baab tempest-ProjectMemberTests-77954883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4642216-1d21-4d20-a984-2d06d98ada69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:53:25 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-94762067-111b-493d-8e27-ee556b84baab tempest-ProjectMemberTests-77954883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4642216-1d21-4d20-a984-2d06d98ada69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7e9bc58-340c-4e25-bec1-95f045c6c1c2', 'volume_name': 'volume-a7e9bc58-340c-4e25-bec1-95f045c6c1c2', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:53:25 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-94762067-111b-493d-8e27-ee556b84baab tempest-ProjectMemberTests-77954883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13396de2-cf75-4199-b186-57c85eee3f2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:53:25 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-94762067-111b-493d-8e27-ee556b84baab tempest-ProjectMemberTests-77954883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13396de2-cf75-4199-b186-57c85eee3f2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:53:25 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-94762067-111b-493d-8e27-ee556b84baab tempest-ProjectMemberTests-77954883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4352e556-04d1-4e38-95b4-a21b9448b44f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:53:25 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-94762067-111b-493d-8e27-ee556b84baab tempest-ProjectMemberTests-77954883 None] Volume a7e9bc58-340c-4e25-bec1-95f045c6c1c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7e9bc58-340c-4e25-bec1-95f045c6c1c2', 'volume_size': 1} Sep 06 06:53:25 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-94762067-111b-493d-8e27-ee556b84baab tempest-ProjectMemberTests-77954883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:53:25 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-94762067-111b-493d-8e27-ee556b84baab tempest-ProjectMemberTests-77954883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:53:25 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-94762067-111b-493d-8e27-ee556b84baab tempest-ProjectMemberTests-77954883 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:53:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-275484136',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7e9bc58-340c-4e25-bec1-95f045c6c1c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9dc5436e8fa48389e888d8f19858d1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:53:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:53:25Z,use_quota=True,user_id='f9722e49a5da4ba7b028b07e73bfb4c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)}" {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 06:53:25 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-94762067-111b-493d-8e27-ee556b84baab tempest-ProjectMemberTests-77954883 None] Creating volume a7e9bc58-340c-4e25-bec1-95f045c6c1c2 {{(pid=87329) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 06:53:25 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-94762067-111b-493d-8e27-ee556b84baab tempest-ProjectMemberTests-77954883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:53:25 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-94762067-111b-493d-8e27-ee556b84baab tempest-ProjectMemberTests-77954883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:53:25 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-94762067-111b-493d-8e27-ee556b84baab tempest-ProjectMemberTests-77954883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:53:25 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-94762067-111b-493d-8e27-ee556b84baab tempest-ProjectMemberTests-77954883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:53:25 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-94762067-111b-493d-8e27-ee556b84baab tempest-ProjectMemberTests-77954883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:53:25 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-94762067-111b-493d-8e27-ee556b84baab tempest-ProjectMemberTests-77954883 None] Selected osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 as target Quobyte volume. {{(pid=87329) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 06:53:25 devstack cinder-volume[87329]: INFO cinder.volume.drivers.remotefs [None req-94762067-111b-493d-8e27-ee556b84baab tempest-ProjectMemberTests-77954883 None] casted to osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 Sep 06 06:53:25 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-94762067-111b-493d-8e27-ee556b84baab tempest-ProjectMemberTests-77954883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-a7e9bc58-340c-4e25-bec1-95f045c6c1c2 1073741824 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:53:25 devstack sudo[107825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-a7e9bc58-340c-4e25-bec1-95f045c6c1c2 1073741824 Sep 06 06:53:25 devstack sudo[107825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:53:25 devstack sudo[107825]: pam_unix(sudo:session): session closed for user root Sep 06 06:53:25 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-94762067-111b-493d-8e27-ee556b84baab tempest-ProjectMemberTests-77954883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-a7e9bc58-340c-4e25-bec1-95f045c6c1c2 1073741824" returned: 0 in 0.390s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:53:25 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-94762067-111b-493d-8e27-ee556b84baab tempest-ProjectMemberTests-77954883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-a7e9bc58-340c-4e25-bec1-95f045c6c1c2 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:53:25 devstack sudo[107831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-a7e9bc58-340c-4e25-bec1-95f045c6c1c2 Sep 06 06:53:25 devstack sudo[107831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:53:26 devstack sudo[107831]: pam_unix(sudo:session): session closed for user root Sep 06 06:53:26 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-94762067-111b-493d-8e27-ee556b84baab tempest-ProjectMemberTests-77954883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-a7e9bc58-340c-4e25-bec1-95f045c6c1c2" returned: 0 in 0.239s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:53:26 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-94762067-111b-493d-8e27-ee556b84baab tempest-ProjectMemberTests-77954883 None] <== create_volume: return (668ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'} {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 06:53:26 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-94762067-111b-493d-8e27-ee556b84baab tempest-ProjectMemberTests-77954883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.670s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:53:26 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-94762067-111b-493d-8e27-ee556b84baab tempest-ProjectMemberTests-77954883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4352e556-04d1-4e38-95b4-a21b9448b44f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7e9bc58-340c-4e25-bec1-95f045c6c1c2', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:53:26 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-94762067-111b-493d-8e27-ee556b84baab tempest-ProjectMemberTests-77954883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25538d8c-215b-4b61-b6c7-dc84672eb39e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:53:26 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-94762067-111b-493d-8e27-ee556b84baab tempest-ProjectMemberTests-77954883 None] Volume volume-a7e9bc58-340c-4e25-bec1-95f045c6c1c2 (a7e9bc58-340c-4e25-bec1-95f045c6c1c2): created successfully Sep 06 06:53:26 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-94762067-111b-493d-8e27-ee556b84baab tempest-ProjectMemberTests-77954883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25538d8c-215b-4b61-b6c7-dc84672eb39e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:53:26 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-94762067-111b-493d-8e27-ee556b84baab tempest-ProjectMemberTests-77954883 None] Flow 'volume_create_manager' (93d34476-bc4e-4163-af52-1389a9a27fe0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:53:26 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-94762067-111b-493d-8e27-ee556b84baab tempest-ProjectMemberTests-77954883 None] Created volume successfully. Sep 06 06:53:26 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-3d3356eb-9933-4cc7-911d-7904ad6f6d66 tempest-ProjectMemberTests-77954883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:53:26 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-3d3356eb-9933-4cc7-911d-7904ad6f6d66 tempest-ProjectMemberTests-77954883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:53:26 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-3d3356eb-9933-4cc7-911d-7904ad6f6d66 tempest-ProjectMemberTests-77954883 None] Creating offline snapshot 51e174f0-273a-40c1-91ff-1e5e85c7c38a of volume a7e9bc58-340c-4e25-bec1-95f045c6c1c2 {{(pid=87329) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 06 06:53:26 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a6e2503-bc41-46e0-a158-3723d0087d34]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:53:26 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-3d3356eb-9933-4cc7-911d-7904ad6f6d66 tempest-ProjectMemberTests-77954883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-a7e9bc58-340c-4e25-bec1-95f045c6c1c2 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:53:26 devstack sudo[107834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-a7e9bc58-340c-4e25-bec1-95f045c6c1c2 Sep 06 06:53:26 devstack sudo[107834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:53:26 devstack sudo[107834]: pam_unix(sudo:session): session closed for user root Sep 06 06:53:26 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-3d3356eb-9933-4cc7-911d-7904ad6f6d66 tempest-ProjectMemberTests-77954883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-a7e9bc58-340c-4e25-bec1-95f045c6c1c2" returned: 0 in 0.343s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:53:26 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-3d3356eb-9933-4cc7-911d-7904ad6f6d66 tempest-ProjectMemberTests-77954883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-a7e9bc58-340c-4e25-bec1-95f045c6c1c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-a7e9bc58-340c-4e25-bec1-95f045c6c1c2.51e174f0-273a-40c1-91ff-1e5e85c7c38a 1G {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:53:26 devstack sudo[107839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-a7e9bc58-340c-4e25-bec1-95f045c6c1c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-a7e9bc58-340c-4e25-bec1-95f045c6c1c2.51e174f0-273a-40c1-91ff-1e5e85c7c38a 1G Sep 06 06:53:26 devstack sudo[107839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:53:27 devstack sudo[107839]: pam_unix(sudo:session): session closed for user root Sep 06 06:53:27 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-3d3356eb-9933-4cc7-911d-7904ad6f6d66 tempest-ProjectMemberTests-77954883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-a7e9bc58-340c-4e25-bec1-95f045c6c1c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-a7e9bc58-340c-4e25-bec1-95f045c6c1c2.51e174f0-273a-40c1-91ff-1e5e85c7c38a 1G" returned: 0 in 0.375s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:53:27 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-3d3356eb-9933-4cc7-911d-7904ad6f6d66 tempest-ProjectMemberTests-77954883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7e9bc58-340c-4e25-bec1-95f045c6c1c2 -F qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-a7e9bc58-340c-4e25-bec1-95f045c6c1c2.51e174f0-273a-40c1-91ff-1e5e85c7c38a {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:53:27 devstack sudo[107845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7e9bc58-340c-4e25-bec1-95f045c6c1c2 -F qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-a7e9bc58-340c-4e25-bec1-95f045c6c1c2.51e174f0-273a-40c1-91ff-1e5e85c7c38a Sep 06 06:53:27 devstack sudo[107845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:53:27 devstack sudo[107845]: pam_unix(sudo:session): session closed for user root Sep 06 06:53:27 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-3d3356eb-9933-4cc7-911d-7904ad6f6d66 tempest-ProjectMemberTests-77954883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7e9bc58-340c-4e25-bec1-95f045c6c1c2 -F qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-a7e9bc58-340c-4e25-bec1-95f045c6c1c2.51e174f0-273a-40c1-91ff-1e5e85c7c38a" returned: 0 in 0.274s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:53:27 devstack cinder-volume[87329]: WARNING cinder.volume.drivers.remotefs [None req-3d3356eb-9933-4cc7-911d-7904ad6f6d66 tempest-ProjectMemberTests-77954883 None] /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-a7e9bc58-340c-4e25-bec1-95f045c6c1c2.51e174f0-273a-40c1-91ff-1e5e85c7c38a is being set with open permissions: ugo+rw Sep 06 06:53:27 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-3d3356eb-9933-4cc7-911d-7904ad6f6d66 tempest-ProjectMemberTests-77954883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-a7e9bc58-340c-4e25-bec1-95f045c6c1c2.51e174f0-273a-40c1-91ff-1e5e85c7c38a {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:53:27 devstack sudo[107851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-a7e9bc58-340c-4e25-bec1-95f045c6c1c2.51e174f0-273a-40c1-91ff-1e5e85c7c38a Sep 06 06:53:27 devstack sudo[107851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:53:27 devstack sudo[107851]: pam_unix(sudo:session): session closed for user root Sep 06 06:53:27 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-3d3356eb-9933-4cc7-911d-7904ad6f6d66 tempest-ProjectMemberTests-77954883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-a7e9bc58-340c-4e25-bec1-95f045c6c1c2.51e174f0-273a-40c1-91ff-1e5e85c7c38a" returned: 0 in 0.233s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:53:27 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-3d3356eb-9933-4cc7-911d-7904ad6f6d66 tempest-ProjectMemberTests-77954883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-a7e9bc58-340c-4e25-bec1-95f045c6c1c2.info {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:53:27 devstack sudo[107854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-a7e9bc58-340c-4e25-bec1-95f045c6c1c2.info Sep 06 06:53:27 devstack sudo[107854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:53:28 devstack sudo[107854]: pam_unix(sudo:session): session closed for user root Sep 06 06:53:28 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-3d3356eb-9933-4cc7-911d-7904ad6f6d66 tempest-ProjectMemberTests-77954883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-a7e9bc58-340c-4e25-bec1-95f045c6c1c2.info" returned: 0 in 0.246s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:53:28 devstack cinder-volume[87329]: WARNING cinder.volume.drivers.remotefs [None req-3d3356eb-9933-4cc7-911d-7904ad6f6d66 tempest-ProjectMemberTests-77954883 None] /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-a7e9bc58-340c-4e25-bec1-95f045c6c1c2.info is being set with open permissions: ugo+rw Sep 06 06:53:28 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-3d3356eb-9933-4cc7-911d-7904ad6f6d66 tempest-ProjectMemberTests-77954883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-a7e9bc58-340c-4e25-bec1-95f045c6c1c2.info {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:53:28 devstack sudo[107857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-a7e9bc58-340c-4e25-bec1-95f045c6c1c2.info Sep 06 06:53:28 devstack sudo[107857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:53:28 devstack sudo[107857]: pam_unix(sudo:session): session closed for user root Sep 06 06:53:28 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-3d3356eb-9933-4cc7-911d-7904ad6f6d66 tempest-ProjectMemberTests-77954883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-a7e9bc58-340c-4e25-bec1-95f045c6c1c2.info" returned: 0 in 0.249s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:53:28 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-3d3356eb-9933-4cc7-911d-7904ad6f6d66 tempest-ProjectMemberTests-77954883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.798s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:53:28 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-3d3356eb-9933-4cc7-911d-7904ad6f6d66 tempest-ProjectMemberTests-77954883 None] Create snapshot completed successfully Sep 06 06:53:28 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-8b7095b9-7e31-4fde-b0d2-8e6aa8a15df9 tempest-ProjectMemberTests-77954883 None] Acquiring lock "cinder-51e174f0-273a-40c1-91ff-1e5e85c7c38a-delete_snapshot" by "delete_snapshot" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:53:28 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-8b7095b9-7e31-4fde-b0d2-8e6aa8a15df9 tempest-ProjectMemberTests-77954883 None] Lock "cinder-51e174f0-273a-40c1-91ff-1e5e85c7c38a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:53:28 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-8b7095b9-7e31-4fde-b0d2-8e6aa8a15df9 tempest-ProjectMemberTests-77954883 None] Acquiring lock "cinder-quobyte-a7e9bc58-340c-4e25-bec1-95f045c6c1c2" by "delete_snapshot" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:53:28 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-8b7095b9-7e31-4fde-b0d2-8e6aa8a15df9 tempest-ProjectMemberTests-77954883 None] Lock "cinder-quobyte-a7e9bc58-340c-4e25-bec1-95f045c6c1c2" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:53:28 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-8b7095b9-7e31-4fde-b0d2-8e6aa8a15df9 tempest-ProjectMemberTests-77954883 None] Acquiring lock "cinder-quobyte-51e174f0-273a-40c1-91ff-1e5e85c7c38a" by "_delete_snapshot" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:53:28 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-8b7095b9-7e31-4fde-b0d2-8e6aa8a15df9 tempest-ProjectMemberTests-77954883 None] Lock "cinder-quobyte-51e174f0-273a-40c1-91ff-1e5e85c7c38a" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:53:28 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-8b7095b9-7e31-4fde-b0d2-8e6aa8a15df9 tempest-ProjectMemberTests-77954883 None] Deleting offline snapshot 51e174f0-273a-40c1-91ff-1e5e85c7c38a of volume a7e9bc58-340c-4e25-bec1-95f045c6c1c2 {{(pid=87329) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 06 06:53:28 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-8b7095b9-7e31-4fde-b0d2-8e6aa8a15df9 tempest-ProjectMemberTests-77954883 None] snapshot_file for this snap is: volume-a7e9bc58-340c-4e25-bec1-95f045c6c1c2.51e174f0-273a-40c1-91ff-1e5e85c7c38a {{(pid=87329) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 06 06:53:28 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a1df55a-ab3c-4752-8dbb-d35c5b10034e]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:53:28 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-8b7095b9-7e31-4fde-b0d2-8e6aa8a15df9 tempest-ProjectMemberTests-77954883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-a7e9bc58-340c-4e25-bec1-95f045c6c1c2.51e174f0-273a-40c1-91ff-1e5e85c7c38a {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:53:28 devstack sudo[107860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-a7e9bc58-340c-4e25-bec1-95f045c6c1c2.51e174f0-273a-40c1-91ff-1e5e85c7c38a Sep 06 06:53:28 devstack sudo[107860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:53:29 devstack sudo[107860]: pam_unix(sudo:session): session closed for user root Sep 06 06:53:29 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-8b7095b9-7e31-4fde-b0d2-8e6aa8a15df9 tempest-ProjectMemberTests-77954883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-a7e9bc58-340c-4e25-bec1-95f045c6c1c2.51e174f0-273a-40c1-91ff-1e5e85c7c38a" returned: 0 in 0.352s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:53:29 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-8b7095b9-7e31-4fde-b0d2-8e6aa8a15df9 tempest-ProjectMemberTests-77954883 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a7e9bc58-340c-4e25-bec1-95f045c6c1c2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87329) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 06:53:29 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[847566ee-cdc5-42de-9d19-1478367401d4]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:53:29 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-8b7095b9-7e31-4fde-b0d2-8e6aa8a15df9 tempest-ProjectMemberTests-77954883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-a7e9bc58-340c-4e25-bec1-95f045c6c1c2 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:53:29 devstack sudo[107865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-a7e9bc58-340c-4e25-bec1-95f045c6c1c2 Sep 06 06:53:29 devstack sudo[107865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:53:29 devstack sudo[107865]: pam_unix(sudo:session): session closed for user root Sep 06 06:53:29 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-8b7095b9-7e31-4fde-b0d2-8e6aa8a15df9 tempest-ProjectMemberTests-77954883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-a7e9bc58-340c-4e25-bec1-95f045c6c1c2" returned: 0 in 0.348s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:53:29 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-8b7095b9-7e31-4fde-b0d2-8e6aa8a15df9 tempest-ProjectMemberTests-77954883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-a7e9bc58-340c-4e25-bec1-95f045c6c1c2.51e174f0-273a-40c1-91ff-1e5e85c7c38a {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:53:29 devstack sudo[107870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-a7e9bc58-340c-4e25-bec1-95f045c6c1c2.51e174f0-273a-40c1-91ff-1e5e85c7c38a Sep 06 06:53:29 devstack sudo[107870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:53:29 devstack sudo[107870]: pam_unix(sudo:session): session closed for user root Sep 06 06:53:29 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-8b7095b9-7e31-4fde-b0d2-8e6aa8a15df9 tempest-ProjectMemberTests-77954883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-a7e9bc58-340c-4e25-bec1-95f045c6c1c2.51e174f0-273a-40c1-91ff-1e5e85c7c38a" returned: 0 in 0.319s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:53:29 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-8b7095b9-7e31-4fde-b0d2-8e6aa8a15df9 tempest-ProjectMemberTests-77954883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-a7e9bc58-340c-4e25-bec1-95f045c6c1c2.51e174f0-273a-40c1-91ff-1e5e85c7c38a {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:53:29 devstack sudo[107875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-a7e9bc58-340c-4e25-bec1-95f045c6c1c2.51e174f0-273a-40c1-91ff-1e5e85c7c38a Sep 06 06:53:29 devstack sudo[107875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:53:29 devstack sudo[107875]: pam_unix(sudo:session): session closed for user root Sep 06 06:53:29 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-8b7095b9-7e31-4fde-b0d2-8e6aa8a15df9 tempest-ProjectMemberTests-77954883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-a7e9bc58-340c-4e25-bec1-95f045c6c1c2.51e174f0-273a-40c1-91ff-1e5e85c7c38a" returned: 0 in 0.245s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:53:29 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-8b7095b9-7e31-4fde-b0d2-8e6aa8a15df9 tempest-ProjectMemberTests-77954883 None] Lock "cinder-quobyte-51e174f0-273a-40c1-91ff-1e5e85c7c38a" released by "_delete_snapshot" :: held 1.343s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:53:29 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-8b7095b9-7e31-4fde-b0d2-8e6aa8a15df9 tempest-ProjectMemberTests-77954883 None] Lock "cinder-quobyte-a7e9bc58-340c-4e25-bec1-95f045c6c1c2" released by "delete_snapshot" :: held 1.364s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:53:30 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-8b7095b9-7e31-4fde-b0d2-8e6aa8a15df9 tempest-ProjectMemberTests-77954883 None] Created reservations ['1c283a53-4b0f-4f6e-8a58-de2ba3166cc8', '95ed048a-63dd-444f-a764-deaeceaa5849', '85356a0e-4376-45e5-ba03-51b9e206a0be', '8f5cbc9a-796c-4ae7-a429-1371652bd9f5'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:53:30 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-8b7095b9-7e31-4fde-b0d2-8e6aa8a15df9 tempest-ProjectMemberTests-77954883 None] Delete snapshot completed successfully. Sep 06 06:53:30 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-8b7095b9-7e31-4fde-b0d2-8e6aa8a15df9 tempest-ProjectMemberTests-77954883 None] Lock "cinder-51e174f0-273a-40c1-91ff-1e5e85c7c38a-delete_snapshot" released by "delete_snapshot" :: held 1.498s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:53:30 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-4372fc1f-18d3-4d70-bdf5-ac937ccae2b1 tempest-ProjectMemberTests-77954883 None] Acquiring lock "cinder-a7e9bc58-340c-4e25-bec1-95f045c6c1c2-delete_volume" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:53:30 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-4372fc1f-18d3-4d70-bdf5-ac937ccae2b1 tempest-ProjectMemberTests-77954883 None] Lock "cinder-a7e9bc58-340c-4e25-bec1-95f045c6c1c2-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:53:30 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-4372fc1f-18d3-4d70-bdf5-ac937ccae2b1 tempest-ProjectMemberTests-77954883 None] Acquiring lock "cinder-quobyte-a7e9bc58-340c-4e25-bec1-95f045c6c1c2" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:53:30 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-4372fc1f-18d3-4d70-bdf5-ac937ccae2b1 tempest-ProjectMemberTests-77954883 None] Lock "cinder-quobyte-a7e9bc58-340c-4e25-bec1-95f045c6c1c2" acquired by "delete_volume" :: waited 0.016s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:53:30 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[4803e534-f9bc-483c-a402-249b49d8723a]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:53:30 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-4372fc1f-18d3-4d70-bdf5-ac937ccae2b1 tempest-ProjectMemberTests-77954883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-a7e9bc58-340c-4e25-bec1-95f045c6c1c2 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:53:30 devstack sudo[107879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-a7e9bc58-340c-4e25-bec1-95f045c6c1c2 Sep 06 06:53:30 devstack sudo[107879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:53:31 devstack sudo[107879]: pam_unix(sudo:session): session closed for user root Sep 06 06:53:31 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-4372fc1f-18d3-4d70-bdf5-ac937ccae2b1 tempest-ProjectMemberTests-77954883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-a7e9bc58-340c-4e25-bec1-95f045c6c1c2" returned: 0 in 0.343s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:53:31 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-4372fc1f-18d3-4d70-bdf5-ac937ccae2b1 tempest-ProjectMemberTests-77954883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-a7e9bc58-340c-4e25-bec1-95f045c6c1c2 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:53:31 devstack sudo[107884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-a7e9bc58-340c-4e25-bec1-95f045c6c1c2 Sep 06 06:53:31 devstack sudo[107884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:53:31 devstack sudo[107884]: pam_unix(sudo:session): session closed for user root Sep 06 06:53:31 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-4372fc1f-18d3-4d70-bdf5-ac937ccae2b1 tempest-ProjectMemberTests-77954883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-a7e9bc58-340c-4e25-bec1-95f045c6c1c2" returned: 0 in 0.241s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:53:31 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-4372fc1f-18d3-4d70-bdf5-ac937ccae2b1 tempest-ProjectMemberTests-77954883 None] Lock "cinder-quobyte-a7e9bc58-340c-4e25-bec1-95f045c6c1c2" released by "delete_volume" :: held 0.635s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:53:31 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-4372fc1f-18d3-4d70-bdf5-ac937ccae2b1 tempest-ProjectMemberTests-77954883 None] Created reservations ['cca45548-f9a9-461c-8921-6d5933fa7ec8', 'bf1beb73-b1a2-4ff2-84b6-77c6c35e17ba', '3f7c56b3-e99c-455d-bf0c-33681ab118d2', 'e28d8b57-68bd-4c03-825b-c1181d234858'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:53:31 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-4372fc1f-18d3-4d70-bdf5-ac937ccae2b1 tempest-ProjectMemberTests-77954883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:53:31 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-4372fc1f-18d3-4d70-bdf5-ac937ccae2b1 tempest-ProjectMemberTests-77954883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:53:31 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-4372fc1f-18d3-4d70-bdf5-ac937ccae2b1 tempest-ProjectMemberTests-77954883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:53:31 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-4372fc1f-18d3-4d70-bdf5-ac937ccae2b1 tempest-ProjectMemberTests-77954883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:53:31 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-4372fc1f-18d3-4d70-bdf5-ac937ccae2b1 tempest-ProjectMemberTests-77954883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:53:31 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-4372fc1f-18d3-4d70-bdf5-ac937ccae2b1 tempest-ProjectMemberTests-77954883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:53:31 devstack sudo[107887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:53:31 devstack sudo[107887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:53:31 devstack sudo[107887]: pam_unix(sudo:session): session closed for user root Sep 06 06:53:31 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-4372fc1f-18d3-4d70-bdf5-ac937ccae2b1 tempest-ProjectMemberTests-77954883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.236s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:53:31 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-4372fc1f-18d3-4d70-bdf5-ac937ccae2b1 tempest-ProjectMemberTests-77954883 None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:53:31 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-4372fc1f-18d3-4d70-bdf5-ac937ccae2b1 tempest-ProjectMemberTests-77954883 None] Deleted volume successfully. Sep 06 06:53:31 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-4372fc1f-18d3-4d70-bdf5-ac937ccae2b1 tempest-ProjectMemberTests-77954883 None] Lock "cinder-a7e9bc58-340c-4e25-bec1-95f045c6c1c2-delete_volume" released by "delete_volume" :: held 1.049s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:53:32 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-00e1275d-c6ee-42a5-b316-9fc9e64d0774 tempest-ProjectMemberTests-77954883 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87329) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 06:53:32 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-00e1275d-c6ee-42a5-b316-9fc9e64d0774 tempest-ProjectMemberTests-77954883 None] Flow 'volume_create_manager' (3f9876a6-a667-41b2-9e54-17375332e0b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:53:32 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-00e1275d-c6ee-42a5-b316-9fc9e64d0774 tempest-ProjectMemberTests-77954883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfa79d6a-1755-4f8a-8a23-92aadde98a59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:53:32 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-00e1275d-c6ee-42a5-b316-9fc9e64d0774 tempest-ProjectMemberTests-77954883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfa79d6a-1755-4f8a-8a23-92aadde98a59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:53:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-245926127',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e1a4b91-287b-4bd7-b7d6-8f77a87b3cb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9dc5436e8fa48389e888d8f19858d1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:53:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:53:32Z,use_quota=True,user_id='f9722e49a5da4ba7b028b07e73bfb4c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:53:32 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-00e1275d-c6ee-42a5-b316-9fc9e64d0774 tempest-ProjectMemberTests-77954883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46f15349-1b73-4fd9-b2b4-a81c8e5333ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:53:32 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-00e1275d-c6ee-42a5-b316-9fc9e64d0774 tempest-ProjectMemberTests-77954883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46f15349-1b73-4fd9-b2b4-a81c8e5333ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:53:32 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-00e1275d-c6ee-42a5-b316-9fc9e64d0774 tempest-ProjectMemberTests-77954883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6dc1dfb8-3ccf-46f9-b842-d5572e28f028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:53:32 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-00e1275d-c6ee-42a5-b316-9fc9e64d0774 tempest-ProjectMemberTests-77954883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6dc1dfb8-3ccf-46f9-b842-d5572e28f028) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e1a4b91-287b-4bd7-b7d6-8f77a87b3cb1', 'volume_name': 'volume-6e1a4b91-287b-4bd7-b7d6-8f77a87b3cb1', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:53:32 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-00e1275d-c6ee-42a5-b316-9fc9e64d0774 tempest-ProjectMemberTests-77954883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c9f2953-5cc0-4b65-8d13-42f2c9e3cd89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:53:32 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-00e1275d-c6ee-42a5-b316-9fc9e64d0774 tempest-ProjectMemberTests-77954883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c9f2953-5cc0-4b65-8d13-42f2c9e3cd89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:53:32 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-00e1275d-c6ee-42a5-b316-9fc9e64d0774 tempest-ProjectMemberTests-77954883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7935fad7-7734-4270-a576-3e9f836b939b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:53:32 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-00e1275d-c6ee-42a5-b316-9fc9e64d0774 tempest-ProjectMemberTests-77954883 None] Volume 6e1a4b91-287b-4bd7-b7d6-8f77a87b3cb1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e1a4b91-287b-4bd7-b7d6-8f77a87b3cb1', 'volume_size': 1} Sep 06 06:53:32 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-00e1275d-c6ee-42a5-b316-9fc9e64d0774 tempest-ProjectMemberTests-77954883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:53:32 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-00e1275d-c6ee-42a5-b316-9fc9e64d0774 tempest-ProjectMemberTests-77954883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:53:32 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-00e1275d-c6ee-42a5-b316-9fc9e64d0774 tempest-ProjectMemberTests-77954883 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:53:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-245926127',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e1a4b91-287b-4bd7-b7d6-8f77a87b3cb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9dc5436e8fa48389e888d8f19858d1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:53:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:53:32Z,use_quota=True,user_id='f9722e49a5da4ba7b028b07e73bfb4c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)}" {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 06:53:32 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-00e1275d-c6ee-42a5-b316-9fc9e64d0774 tempest-ProjectMemberTests-77954883 None] Creating volume 6e1a4b91-287b-4bd7-b7d6-8f77a87b3cb1 {{(pid=87329) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 06:53:32 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-00e1275d-c6ee-42a5-b316-9fc9e64d0774 tempest-ProjectMemberTests-77954883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:53:32 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-00e1275d-c6ee-42a5-b316-9fc9e64d0774 tempest-ProjectMemberTests-77954883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:53:32 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-00e1275d-c6ee-42a5-b316-9fc9e64d0774 tempest-ProjectMemberTests-77954883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:53:32 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-00e1275d-c6ee-42a5-b316-9fc9e64d0774 tempest-ProjectMemberTests-77954883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:53:32 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-00e1275d-c6ee-42a5-b316-9fc9e64d0774 tempest-ProjectMemberTests-77954883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:53:32 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-00e1275d-c6ee-42a5-b316-9fc9e64d0774 tempest-ProjectMemberTests-77954883 None] Selected osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 as target Quobyte volume. {{(pid=87329) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 06:53:32 devstack cinder-volume[87329]: INFO cinder.volume.drivers.remotefs [None req-00e1275d-c6ee-42a5-b316-9fc9e64d0774 tempest-ProjectMemberTests-77954883 None] casted to osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 Sep 06 06:53:32 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-00e1275d-c6ee-42a5-b316-9fc9e64d0774 tempest-ProjectMemberTests-77954883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6e1a4b91-287b-4bd7-b7d6-8f77a87b3cb1 1073741824 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:53:32 devstack sudo[107890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6e1a4b91-287b-4bd7-b7d6-8f77a87b3cb1 1073741824 Sep 06 06:53:32 devstack sudo[107890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:53:32 devstack sudo[107890]: pam_unix(sudo:session): session closed for user root Sep 06 06:53:32 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-00e1275d-c6ee-42a5-b316-9fc9e64d0774 tempest-ProjectMemberTests-77954883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6e1a4b91-287b-4bd7-b7d6-8f77a87b3cb1 1073741824" returned: 0 in 0.399s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:53:32 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-00e1275d-c6ee-42a5-b316-9fc9e64d0774 tempest-ProjectMemberTests-77954883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6e1a4b91-287b-4bd7-b7d6-8f77a87b3cb1 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:53:32 devstack sudo[107896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6e1a4b91-287b-4bd7-b7d6-8f77a87b3cb1 Sep 06 06:53:32 devstack sudo[107896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:53:33 devstack sudo[107896]: pam_unix(sudo:session): session closed for user root Sep 06 06:53:33 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-00e1275d-c6ee-42a5-b316-9fc9e64d0774 tempest-ProjectMemberTests-77954883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6e1a4b91-287b-4bd7-b7d6-8f77a87b3cb1" returned: 0 in 0.243s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:53:33 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-00e1275d-c6ee-42a5-b316-9fc9e64d0774 tempest-ProjectMemberTests-77954883 None] <== create_volume: return (680ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'} {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 06:53:33 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-00e1275d-c6ee-42a5-b316-9fc9e64d0774 tempest-ProjectMemberTests-77954883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.682s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:53:33 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-00e1275d-c6ee-42a5-b316-9fc9e64d0774 tempest-ProjectMemberTests-77954883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7935fad7-7734-4270-a576-3e9f836b939b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e1a4b91-287b-4bd7-b7d6-8f77a87b3cb1', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:53:33 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-00e1275d-c6ee-42a5-b316-9fc9e64d0774 tempest-ProjectMemberTests-77954883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e66dce91-140d-4302-82b0-651edd723285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:53:33 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-00e1275d-c6ee-42a5-b316-9fc9e64d0774 tempest-ProjectMemberTests-77954883 None] Volume volume-6e1a4b91-287b-4bd7-b7d6-8f77a87b3cb1 (6e1a4b91-287b-4bd7-b7d6-8f77a87b3cb1): created successfully Sep 06 06:53:33 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-00e1275d-c6ee-42a5-b316-9fc9e64d0774 tempest-ProjectMemberTests-77954883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e66dce91-140d-4302-82b0-651edd723285) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:53:33 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-00e1275d-c6ee-42a5-b316-9fc9e64d0774 tempest-ProjectMemberTests-77954883 None] Flow 'volume_create_manager' (3f9876a6-a667-41b2-9e54-17375332e0b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:53:33 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-00e1275d-c6ee-42a5-b316-9fc9e64d0774 tempest-ProjectMemberTests-77954883 None] Created volume successfully. Sep 06 06:53:33 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-22468934-7713-46d3-9dba-2dd3bbc30ec3 tempest-ProjectMemberTests-77954883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:53:33 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-22468934-7713-46d3-9dba-2dd3bbc30ec3 tempest-ProjectMemberTests-77954883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:53:33 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-22468934-7713-46d3-9dba-2dd3bbc30ec3 tempest-ProjectMemberTests-77954883 None] Creating offline snapshot 88c1705f-c051-4d08-8887-f5b32efd523f of volume 6e1a4b91-287b-4bd7-b7d6-8f77a87b3cb1 {{(pid=87329) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 06 06:53:33 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[51ac28bd-4008-420a-ad2d-5c9b93eb7070]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:53:33 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-22468934-7713-46d3-9dba-2dd3bbc30ec3 tempest-ProjectMemberTests-77954883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6e1a4b91-287b-4bd7-b7d6-8f77a87b3cb1 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:53:33 devstack sudo[107899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6e1a4b91-287b-4bd7-b7d6-8f77a87b3cb1 Sep 06 06:53:33 devstack sudo[107899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:53:33 devstack sudo[107899]: pam_unix(sudo:session): session closed for user root Sep 06 06:53:33 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-22468934-7713-46d3-9dba-2dd3bbc30ec3 tempest-ProjectMemberTests-77954883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6e1a4b91-287b-4bd7-b7d6-8f77a87b3cb1" returned: 0 in 0.353s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:53:33 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-22468934-7713-46d3-9dba-2dd3bbc30ec3 tempest-ProjectMemberTests-77954883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6e1a4b91-287b-4bd7-b7d6-8f77a87b3cb1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6e1a4b91-287b-4bd7-b7d6-8f77a87b3cb1.88c1705f-c051-4d08-8887-f5b32efd523f 1G {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:53:33 devstack sudo[107904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6e1a4b91-287b-4bd7-b7d6-8f77a87b3cb1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6e1a4b91-287b-4bd7-b7d6-8f77a87b3cb1.88c1705f-c051-4d08-8887-f5b32efd523f 1G Sep 06 06:53:33 devstack sudo[107904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:53:34 devstack sudo[107904]: pam_unix(sudo:session): session closed for user root Sep 06 06:53:34 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-22468934-7713-46d3-9dba-2dd3bbc30ec3 tempest-ProjectMemberTests-77954883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6e1a4b91-287b-4bd7-b7d6-8f77a87b3cb1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6e1a4b91-287b-4bd7-b7d6-8f77a87b3cb1.88c1705f-c051-4d08-8887-f5b32efd523f 1G" returned: 0 in 0.368s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:53:34 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-22468934-7713-46d3-9dba-2dd3bbc30ec3 tempest-ProjectMemberTests-77954883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e1a4b91-287b-4bd7-b7d6-8f77a87b3cb1 -F qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6e1a4b91-287b-4bd7-b7d6-8f77a87b3cb1.88c1705f-c051-4d08-8887-f5b32efd523f {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:53:34 devstack sudo[107909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e1a4b91-287b-4bd7-b7d6-8f77a87b3cb1 -F qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6e1a4b91-287b-4bd7-b7d6-8f77a87b3cb1.88c1705f-c051-4d08-8887-f5b32efd523f Sep 06 06:53:34 devstack sudo[107909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:53:34 devstack sudo[107909]: pam_unix(sudo:session): session closed for user root Sep 06 06:53:34 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-22468934-7713-46d3-9dba-2dd3bbc30ec3 tempest-ProjectMemberTests-77954883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e1a4b91-287b-4bd7-b7d6-8f77a87b3cb1 -F qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6e1a4b91-287b-4bd7-b7d6-8f77a87b3cb1.88c1705f-c051-4d08-8887-f5b32efd523f" returned: 0 in 0.282s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:53:34 devstack cinder-volume[87329]: WARNING cinder.volume.drivers.remotefs [None req-22468934-7713-46d3-9dba-2dd3bbc30ec3 tempest-ProjectMemberTests-77954883 None] /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6e1a4b91-287b-4bd7-b7d6-8f77a87b3cb1.88c1705f-c051-4d08-8887-f5b32efd523f is being set with open permissions: ugo+rw Sep 06 06:53:34 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-22468934-7713-46d3-9dba-2dd3bbc30ec3 tempest-ProjectMemberTests-77954883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6e1a4b91-287b-4bd7-b7d6-8f77a87b3cb1.88c1705f-c051-4d08-8887-f5b32efd523f {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:53:34 devstack sudo[107914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6e1a4b91-287b-4bd7-b7d6-8f77a87b3cb1.88c1705f-c051-4d08-8887-f5b32efd523f Sep 06 06:53:34 devstack sudo[107914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:53:34 devstack sudo[107914]: pam_unix(sudo:session): session closed for user root Sep 06 06:53:34 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-22468934-7713-46d3-9dba-2dd3bbc30ec3 tempest-ProjectMemberTests-77954883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6e1a4b91-287b-4bd7-b7d6-8f77a87b3cb1.88c1705f-c051-4d08-8887-f5b32efd523f" returned: 0 in 0.238s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:53:34 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-22468934-7713-46d3-9dba-2dd3bbc30ec3 tempest-ProjectMemberTests-77954883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6e1a4b91-287b-4bd7-b7d6-8f77a87b3cb1.info {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:53:34 devstack sudo[107917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6e1a4b91-287b-4bd7-b7d6-8f77a87b3cb1.info Sep 06 06:53:34 devstack sudo[107917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:53:34 devstack sudo[107917]: pam_unix(sudo:session): session closed for user root Sep 06 06:53:35 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-22468934-7713-46d3-9dba-2dd3bbc30ec3 tempest-ProjectMemberTests-77954883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6e1a4b91-287b-4bd7-b7d6-8f77a87b3cb1.info" returned: 0 in 0.244s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:53:35 devstack cinder-volume[87329]: WARNING cinder.volume.drivers.remotefs [None req-22468934-7713-46d3-9dba-2dd3bbc30ec3 tempest-ProjectMemberTests-77954883 None] /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6e1a4b91-287b-4bd7-b7d6-8f77a87b3cb1.info is being set with open permissions: ugo+rw Sep 06 06:53:35 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-22468934-7713-46d3-9dba-2dd3bbc30ec3 tempest-ProjectMemberTests-77954883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6e1a4b91-287b-4bd7-b7d6-8f77a87b3cb1.info {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:53:35 devstack sudo[107920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6e1a4b91-287b-4bd7-b7d6-8f77a87b3cb1.info Sep 06 06:53:35 devstack sudo[107920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:53:35 devstack sudo[107920]: pam_unix(sudo:session): session closed for user root Sep 06 06:53:35 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-22468934-7713-46d3-9dba-2dd3bbc30ec3 tempest-ProjectMemberTests-77954883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6e1a4b91-287b-4bd7-b7d6-8f77a87b3cb1.info" returned: 0 in 0.249s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:53:35 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-22468934-7713-46d3-9dba-2dd3bbc30ec3 tempest-ProjectMemberTests-77954883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.807s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:53:35 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-22468934-7713-46d3-9dba-2dd3bbc30ec3 tempest-ProjectMemberTests-77954883 None] Create snapshot completed successfully Sep 06 06:53:35 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-8ff428f1-2c1b-43cd-85dd-b17d66767eba tempest-ProjectMemberTests-77954883 None] Acquiring lock "cinder-88c1705f-c051-4d08-8887-f5b32efd523f-delete_snapshot" by "delete_snapshot" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:53:35 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-8ff428f1-2c1b-43cd-85dd-b17d66767eba tempest-ProjectMemberTests-77954883 None] Lock "cinder-88c1705f-c051-4d08-8887-f5b32efd523f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:53:35 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-8ff428f1-2c1b-43cd-85dd-b17d66767eba tempest-ProjectMemberTests-77954883 None] Acquiring lock "cinder-quobyte-6e1a4b91-287b-4bd7-b7d6-8f77a87b3cb1" by "delete_snapshot" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:53:35 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-8ff428f1-2c1b-43cd-85dd-b17d66767eba tempest-ProjectMemberTests-77954883 None] Lock "cinder-quobyte-6e1a4b91-287b-4bd7-b7d6-8f77a87b3cb1" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:53:35 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-8ff428f1-2c1b-43cd-85dd-b17d66767eba tempest-ProjectMemberTests-77954883 None] Acquiring lock "cinder-quobyte-88c1705f-c051-4d08-8887-f5b32efd523f" by "_delete_snapshot" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:53:35 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-8ff428f1-2c1b-43cd-85dd-b17d66767eba tempest-ProjectMemberTests-77954883 None] Lock "cinder-quobyte-88c1705f-c051-4d08-8887-f5b32efd523f" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:53:35 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-8ff428f1-2c1b-43cd-85dd-b17d66767eba tempest-ProjectMemberTests-77954883 None] Deleting offline snapshot 88c1705f-c051-4d08-8887-f5b32efd523f of volume 6e1a4b91-287b-4bd7-b7d6-8f77a87b3cb1 {{(pid=87329) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 06 06:53:35 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-8ff428f1-2c1b-43cd-85dd-b17d66767eba tempest-ProjectMemberTests-77954883 None] snapshot_file for this snap is: volume-6e1a4b91-287b-4bd7-b7d6-8f77a87b3cb1.88c1705f-c051-4d08-8887-f5b32efd523f {{(pid=87329) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 06 06:53:35 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[b78e11d3-ea32-4fc0-9145-a9d839310cb7]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:53:35 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-8ff428f1-2c1b-43cd-85dd-b17d66767eba tempest-ProjectMemberTests-77954883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6e1a4b91-287b-4bd7-b7d6-8f77a87b3cb1.88c1705f-c051-4d08-8887-f5b32efd523f {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:53:35 devstack sudo[107923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6e1a4b91-287b-4bd7-b7d6-8f77a87b3cb1.88c1705f-c051-4d08-8887-f5b32efd523f Sep 06 06:53:35 devstack sudo[107923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:53:35 devstack sudo[107923]: pam_unix(sudo:session): session closed for user root Sep 06 06:53:35 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-8ff428f1-2c1b-43cd-85dd-b17d66767eba tempest-ProjectMemberTests-77954883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6e1a4b91-287b-4bd7-b7d6-8f77a87b3cb1.88c1705f-c051-4d08-8887-f5b32efd523f" returned: 0 in 0.345s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:53:35 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-8ff428f1-2c1b-43cd-85dd-b17d66767eba tempest-ProjectMemberTests-77954883 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6e1a4b91-287b-4bd7-b7d6-8f77a87b3cb1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87329) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 06:53:36 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdd98fa0-520d-466d-959e-31b34f463609]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:53:36 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-8ff428f1-2c1b-43cd-85dd-b17d66767eba tempest-ProjectMemberTests-77954883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6e1a4b91-287b-4bd7-b7d6-8f77a87b3cb1 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:53:36 devstack sudo[107928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6e1a4b91-287b-4bd7-b7d6-8f77a87b3cb1 Sep 06 06:53:36 devstack sudo[107928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:53:36 devstack sudo[107928]: pam_unix(sudo:session): session closed for user root Sep 06 06:53:36 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-8ff428f1-2c1b-43cd-85dd-b17d66767eba tempest-ProjectMemberTests-77954883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6e1a4b91-287b-4bd7-b7d6-8f77a87b3cb1" returned: 0 in 0.348s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:53:36 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-8ff428f1-2c1b-43cd-85dd-b17d66767eba tempest-ProjectMemberTests-77954883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6e1a4b91-287b-4bd7-b7d6-8f77a87b3cb1.88c1705f-c051-4d08-8887-f5b32efd523f {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:53:36 devstack sudo[107933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6e1a4b91-287b-4bd7-b7d6-8f77a87b3cb1.88c1705f-c051-4d08-8887-f5b32efd523f Sep 06 06:53:36 devstack sudo[107933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:53:36 devstack sudo[107933]: pam_unix(sudo:session): session closed for user root Sep 06 06:53:36 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-8ff428f1-2c1b-43cd-85dd-b17d66767eba tempest-ProjectMemberTests-77954883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6e1a4b91-287b-4bd7-b7d6-8f77a87b3cb1.88c1705f-c051-4d08-8887-f5b32efd523f" returned: 0 in 0.312s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:53:36 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-8ff428f1-2c1b-43cd-85dd-b17d66767eba tempest-ProjectMemberTests-77954883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6e1a4b91-287b-4bd7-b7d6-8f77a87b3cb1.88c1705f-c051-4d08-8887-f5b32efd523f {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:53:36 devstack sudo[107938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6e1a4b91-287b-4bd7-b7d6-8f77a87b3cb1.88c1705f-c051-4d08-8887-f5b32efd523f Sep 06 06:53:36 devstack sudo[107938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:53:36 devstack sudo[107938]: pam_unix(sudo:session): session closed for user root Sep 06 06:53:36 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-8ff428f1-2c1b-43cd-85dd-b17d66767eba tempest-ProjectMemberTests-77954883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6e1a4b91-287b-4bd7-b7d6-8f77a87b3cb1.88c1705f-c051-4d08-8887-f5b32efd523f" returned: 0 in 0.243s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:53:36 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-8ff428f1-2c1b-43cd-85dd-b17d66767eba tempest-ProjectMemberTests-77954883 None] Lock "cinder-quobyte-88c1705f-c051-4d08-8887-f5b32efd523f" released by "_delete_snapshot" :: held 1.329s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:53:36 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-8ff428f1-2c1b-43cd-85dd-b17d66767eba tempest-ProjectMemberTests-77954883 None] Lock "cinder-quobyte-6e1a4b91-287b-4bd7-b7d6-8f77a87b3cb1" released by "delete_snapshot" :: held 1.349s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:53:37 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-8ff428f1-2c1b-43cd-85dd-b17d66767eba tempest-ProjectMemberTests-77954883 None] Created reservations ['d40ef782-2776-4847-a5f7-1049481b5223', 'dea8b8ee-8c1a-4212-ae33-67971f1be48b', '7eb58a28-1583-4f96-bb34-42950860ddab', '6a05996b-8ae1-46ad-9e57-8e5a00e1dedc'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:53:37 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-8ff428f1-2c1b-43cd-85dd-b17d66767eba tempest-ProjectMemberTests-77954883 None] Delete snapshot completed successfully. Sep 06 06:53:37 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-8ff428f1-2c1b-43cd-85dd-b17d66767eba tempest-ProjectMemberTests-77954883 None] Lock "cinder-88c1705f-c051-4d08-8887-f5b32efd523f-delete_snapshot" released by "delete_snapshot" :: held 1.473s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:53:37 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-f0804f1e-5921-4f08-b344-085f3751145e tempest-ProjectMemberTests-77954883 None] Acquiring lock "cinder-6e1a4b91-287b-4bd7-b7d6-8f77a87b3cb1-delete_volume" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:53:37 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-f0804f1e-5921-4f08-b344-085f3751145e tempest-ProjectMemberTests-77954883 None] Lock "cinder-6e1a4b91-287b-4bd7-b7d6-8f77a87b3cb1-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:53:37 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-f0804f1e-5921-4f08-b344-085f3751145e tempest-ProjectMemberTests-77954883 None] Acquiring lock "cinder-quobyte-6e1a4b91-287b-4bd7-b7d6-8f77a87b3cb1" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:53:37 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-f0804f1e-5921-4f08-b344-085f3751145e tempest-ProjectMemberTests-77954883 None] Lock "cinder-quobyte-6e1a4b91-287b-4bd7-b7d6-8f77a87b3cb1" acquired by "delete_volume" :: waited 0.015s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:53:37 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[fed25062-43ef-4a24-a635-70c0d315da97]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:53:37 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-f0804f1e-5921-4f08-b344-085f3751145e tempest-ProjectMemberTests-77954883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6e1a4b91-287b-4bd7-b7d6-8f77a87b3cb1 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:53:37 devstack sudo[107941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6e1a4b91-287b-4bd7-b7d6-8f77a87b3cb1 Sep 06 06:53:37 devstack sudo[107941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:53:38 devstack sudo[107941]: pam_unix(sudo:session): session closed for user root Sep 06 06:53:38 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-f0804f1e-5921-4f08-b344-085f3751145e tempest-ProjectMemberTests-77954883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6e1a4b91-287b-4bd7-b7d6-8f77a87b3cb1" returned: 0 in 0.353s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:53:38 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-f0804f1e-5921-4f08-b344-085f3751145e tempest-ProjectMemberTests-77954883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6e1a4b91-287b-4bd7-b7d6-8f77a87b3cb1 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:53:38 devstack sudo[107946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6e1a4b91-287b-4bd7-b7d6-8f77a87b3cb1 Sep 06 06:53:38 devstack sudo[107946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:53:38 devstack sudo[107946]: pam_unix(sudo:session): session closed for user root Sep 06 06:53:38 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-f0804f1e-5921-4f08-b344-085f3751145e tempest-ProjectMemberTests-77954883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-6e1a4b91-287b-4bd7-b7d6-8f77a87b3cb1" returned: 0 in 0.240s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:53:38 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-f0804f1e-5921-4f08-b344-085f3751145e tempest-ProjectMemberTests-77954883 None] Lock "cinder-quobyte-6e1a4b91-287b-4bd7-b7d6-8f77a87b3cb1" released by "delete_volume" :: held 0.651s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:53:38 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-f0804f1e-5921-4f08-b344-085f3751145e tempest-ProjectMemberTests-77954883 None] Created reservations ['de7499db-5ab7-47cc-96c8-c9dc63e5503c', 'bceddb64-de38-415f-9d89-a0b56674199f', '72441cf3-b92d-4754-bdcd-1fc4c8cefc3e', 'c37f92e1-260f-4873-b4c8-e09e5eec3959'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:53:38 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-f0804f1e-5921-4f08-b344-085f3751145e tempest-ProjectMemberTests-77954883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:53:38 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-f0804f1e-5921-4f08-b344-085f3751145e tempest-ProjectMemberTests-77954883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:53:38 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-f0804f1e-5921-4f08-b344-085f3751145e tempest-ProjectMemberTests-77954883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:53:38 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-f0804f1e-5921-4f08-b344-085f3751145e tempest-ProjectMemberTests-77954883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:53:38 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-f0804f1e-5921-4f08-b344-085f3751145e tempest-ProjectMemberTests-77954883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:53:38 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-f0804f1e-5921-4f08-b344-085f3751145e tempest-ProjectMemberTests-77954883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:53:38 devstack sudo[107949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:53:38 devstack sudo[107949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:53:38 devstack sudo[107949]: pam_unix(sudo:session): session closed for user root Sep 06 06:53:38 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-f0804f1e-5921-4f08-b344-085f3751145e tempest-ProjectMemberTests-77954883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.243s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:53:38 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-f0804f1e-5921-4f08-b344-085f3751145e tempest-ProjectMemberTests-77954883 None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:53:38 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-f0804f1e-5921-4f08-b344-085f3751145e tempest-ProjectMemberTests-77954883 None] Deleted volume successfully. Sep 06 06:53:38 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-f0804f1e-5921-4f08-b344-085f3751145e tempest-ProjectMemberTests-77954883 None] Lock "cinder-6e1a4b91-287b-4bd7-b7d6-8f77a87b3cb1-delete_volume" released by "delete_volume" :: held 1.080s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:53:39 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-6da7d7bf-ed9c-46e7-a7f7-a2dc1d1a8a6c tempest-ProjectMemberTests-77954883 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87329) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 06:53:39 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-6da7d7bf-ed9c-46e7-a7f7-a2dc1d1a8a6c tempest-ProjectMemberTests-77954883 None] Flow 'volume_create_manager' (454874e9-df36-4e78-adce-3b9fe9e602ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:53:39 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-6da7d7bf-ed9c-46e7-a7f7-a2dc1d1a8a6c tempest-ProjectMemberTests-77954883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b56a3c8-9b9c-4e0b-95e7-3b904bc5574e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:53:39 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-6da7d7bf-ed9c-46e7-a7f7-a2dc1d1a8a6c tempest-ProjectMemberTests-77954883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b56a3c8-9b9c-4e0b-95e7-3b904bc5574e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:53:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-69197465',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b2aad2e-08db-4abe-a585-d0dfc7dba100,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9dc5436e8fa48389e888d8f19858d1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:53:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:53:39Z,use_quota=True,user_id='f9722e49a5da4ba7b028b07e73bfb4c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:53:39 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-6da7d7bf-ed9c-46e7-a7f7-a2dc1d1a8a6c tempest-ProjectMemberTests-77954883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (989ee893-812b-41b7-9593-9a9cd6caa5a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:53:39 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-6da7d7bf-ed9c-46e7-a7f7-a2dc1d1a8a6c tempest-ProjectMemberTests-77954883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (989ee893-812b-41b7-9593-9a9cd6caa5a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:53:39 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-6da7d7bf-ed9c-46e7-a7f7-a2dc1d1a8a6c tempest-ProjectMemberTests-77954883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d86fdd7a-336d-4ecd-85f2-d03a07f54733) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:53:39 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-6da7d7bf-ed9c-46e7-a7f7-a2dc1d1a8a6c tempest-ProjectMemberTests-77954883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d86fdd7a-336d-4ecd-85f2-d03a07f54733) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b2aad2e-08db-4abe-a585-d0dfc7dba100', 'volume_name': 'volume-5b2aad2e-08db-4abe-a585-d0dfc7dba100', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:53:39 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-6da7d7bf-ed9c-46e7-a7f7-a2dc1d1a8a6c tempest-ProjectMemberTests-77954883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f543eb2f-a512-4b5f-bbf9-0bd166a75ac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:53:39 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-6da7d7bf-ed9c-46e7-a7f7-a2dc1d1a8a6c tempest-ProjectMemberTests-77954883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f543eb2f-a512-4b5f-bbf9-0bd166a75ac0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:53:39 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-6da7d7bf-ed9c-46e7-a7f7-a2dc1d1a8a6c tempest-ProjectMemberTests-77954883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3192d941-1601-4bca-809d-be153462e263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:53:39 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-6da7d7bf-ed9c-46e7-a7f7-a2dc1d1a8a6c tempest-ProjectMemberTests-77954883 None] Volume 5b2aad2e-08db-4abe-a585-d0dfc7dba100: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b2aad2e-08db-4abe-a585-d0dfc7dba100', 'volume_size': 1} Sep 06 06:53:39 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-6da7d7bf-ed9c-46e7-a7f7-a2dc1d1a8a6c tempest-ProjectMemberTests-77954883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:53:39 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-6da7d7bf-ed9c-46e7-a7f7-a2dc1d1a8a6c tempest-ProjectMemberTests-77954883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:53:39 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-6da7d7bf-ed9c-46e7-a7f7-a2dc1d1a8a6c tempest-ProjectMemberTests-77954883 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:53:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-69197465',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b2aad2e-08db-4abe-a585-d0dfc7dba100,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9dc5436e8fa48389e888d8f19858d1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:53:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:53:39Z,use_quota=True,user_id='f9722e49a5da4ba7b028b07e73bfb4c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)}" {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 06:53:39 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-6da7d7bf-ed9c-46e7-a7f7-a2dc1d1a8a6c tempest-ProjectMemberTests-77954883 None] Creating volume 5b2aad2e-08db-4abe-a585-d0dfc7dba100 {{(pid=87329) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 06:53:39 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-6da7d7bf-ed9c-46e7-a7f7-a2dc1d1a8a6c tempest-ProjectMemberTests-77954883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:53:39 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-6da7d7bf-ed9c-46e7-a7f7-a2dc1d1a8a6c tempest-ProjectMemberTests-77954883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:53:39 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-6da7d7bf-ed9c-46e7-a7f7-a2dc1d1a8a6c tempest-ProjectMemberTests-77954883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:53:39 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-6da7d7bf-ed9c-46e7-a7f7-a2dc1d1a8a6c tempest-ProjectMemberTests-77954883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:53:39 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-6da7d7bf-ed9c-46e7-a7f7-a2dc1d1a8a6c tempest-ProjectMemberTests-77954883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:53:39 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-6da7d7bf-ed9c-46e7-a7f7-a2dc1d1a8a6c tempest-ProjectMemberTests-77954883 None] Selected osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 as target Quobyte volume. {{(pid=87329) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 06:53:39 devstack cinder-volume[87329]: INFO cinder.volume.drivers.remotefs [None req-6da7d7bf-ed9c-46e7-a7f7-a2dc1d1a8a6c tempest-ProjectMemberTests-77954883 None] casted to osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 Sep 06 06:53:39 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-6da7d7bf-ed9c-46e7-a7f7-a2dc1d1a8a6c tempest-ProjectMemberTests-77954883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-5b2aad2e-08db-4abe-a585-d0dfc7dba100 1073741824 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:53:39 devstack sudo[107952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-5b2aad2e-08db-4abe-a585-d0dfc7dba100 1073741824 Sep 06 06:53:39 devstack sudo[107952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:53:39 devstack sudo[107952]: pam_unix(sudo:session): session closed for user root Sep 06 06:53:39 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-6da7d7bf-ed9c-46e7-a7f7-a2dc1d1a8a6c tempest-ProjectMemberTests-77954883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-5b2aad2e-08db-4abe-a585-d0dfc7dba100 1073741824" returned: 0 in 0.416s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:53:39 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-6da7d7bf-ed9c-46e7-a7f7-a2dc1d1a8a6c tempest-ProjectMemberTests-77954883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-5b2aad2e-08db-4abe-a585-d0dfc7dba100 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:53:39 devstack sudo[107958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-5b2aad2e-08db-4abe-a585-d0dfc7dba100 Sep 06 06:53:39 devstack sudo[107958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:53:40 devstack sudo[107958]: pam_unix(sudo:session): session closed for user root Sep 06 06:53:40 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-6da7d7bf-ed9c-46e7-a7f7-a2dc1d1a8a6c tempest-ProjectMemberTests-77954883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-5b2aad2e-08db-4abe-a585-d0dfc7dba100" returned: 0 in 0.277s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:53:40 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-6da7d7bf-ed9c-46e7-a7f7-a2dc1d1a8a6c tempest-ProjectMemberTests-77954883 None] <== create_volume: return (732ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'} {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 06:53:40 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-6da7d7bf-ed9c-46e7-a7f7-a2dc1d1a8a6c tempest-ProjectMemberTests-77954883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.734s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:53:40 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-6da7d7bf-ed9c-46e7-a7f7-a2dc1d1a8a6c tempest-ProjectMemberTests-77954883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3192d941-1601-4bca-809d-be153462e263) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b2aad2e-08db-4abe-a585-d0dfc7dba100', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:53:40 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-6da7d7bf-ed9c-46e7-a7f7-a2dc1d1a8a6c tempest-ProjectMemberTests-77954883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8303b599-f338-4898-a3a4-f8661371c2ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:53:40 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-6da7d7bf-ed9c-46e7-a7f7-a2dc1d1a8a6c tempest-ProjectMemberTests-77954883 None] Volume volume-5b2aad2e-08db-4abe-a585-d0dfc7dba100 (5b2aad2e-08db-4abe-a585-d0dfc7dba100): created successfully Sep 06 06:53:40 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-6da7d7bf-ed9c-46e7-a7f7-a2dc1d1a8a6c tempest-ProjectMemberTests-77954883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8303b599-f338-4898-a3a4-f8661371c2ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:53:40 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-6da7d7bf-ed9c-46e7-a7f7-a2dc1d1a8a6c tempest-ProjectMemberTests-77954883 None] Flow 'volume_create_manager' (454874e9-df36-4e78-adce-3b9fe9e602ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:53:40 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-6da7d7bf-ed9c-46e7-a7f7-a2dc1d1a8a6c tempest-ProjectMemberTests-77954883 None] Created volume successfully. Sep 06 06:53:40 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-97dbd32e-e518-404d-a21d-648a0f6b1b42 tempest-ProjectMemberTests-77954883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:53:40 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-97dbd32e-e518-404d-a21d-648a0f6b1b42 tempest-ProjectMemberTests-77954883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:53:40 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-97dbd32e-e518-404d-a21d-648a0f6b1b42 tempest-ProjectMemberTests-77954883 None] Creating offline snapshot 7d8a25f1-723c-4380-bdf8-a468d4ef58cb of volume 5b2aad2e-08db-4abe-a585-d0dfc7dba100 {{(pid=87329) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 06 06:53:40 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[c056e10e-317a-40e6-9932-e143511ea658]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:53:40 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-97dbd32e-e518-404d-a21d-648a0f6b1b42 tempest-ProjectMemberTests-77954883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-5b2aad2e-08db-4abe-a585-d0dfc7dba100 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:53:40 devstack sudo[107962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-5b2aad2e-08db-4abe-a585-d0dfc7dba100 Sep 06 06:53:40 devstack sudo[107962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:53:40 devstack sudo[107962]: pam_unix(sudo:session): session closed for user root Sep 06 06:53:40 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-97dbd32e-e518-404d-a21d-648a0f6b1b42 tempest-ProjectMemberTests-77954883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-5b2aad2e-08db-4abe-a585-d0dfc7dba100" returned: 0 in 0.349s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:53:40 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-97dbd32e-e518-404d-a21d-648a0f6b1b42 tempest-ProjectMemberTests-77954883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-5b2aad2e-08db-4abe-a585-d0dfc7dba100,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-5b2aad2e-08db-4abe-a585-d0dfc7dba100.7d8a25f1-723c-4380-bdf8-a468d4ef58cb 1G {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:53:40 devstack sudo[107967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-5b2aad2e-08db-4abe-a585-d0dfc7dba100,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-5b2aad2e-08db-4abe-a585-d0dfc7dba100.7d8a25f1-723c-4380-bdf8-a468d4ef58cb 1G Sep 06 06:53:40 devstack sudo[107967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:53:41 devstack sudo[107967]: pam_unix(sudo:session): session closed for user root Sep 06 06:53:41 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-97dbd32e-e518-404d-a21d-648a0f6b1b42 tempest-ProjectMemberTests-77954883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-5b2aad2e-08db-4abe-a585-d0dfc7dba100,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-5b2aad2e-08db-4abe-a585-d0dfc7dba100.7d8a25f1-723c-4380-bdf8-a468d4ef58cb 1G" returned: 0 in 0.374s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:53:41 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-97dbd32e-e518-404d-a21d-648a0f6b1b42 tempest-ProjectMemberTests-77954883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b2aad2e-08db-4abe-a585-d0dfc7dba100 -F qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-5b2aad2e-08db-4abe-a585-d0dfc7dba100.7d8a25f1-723c-4380-bdf8-a468d4ef58cb {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:53:41 devstack sudo[107972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b2aad2e-08db-4abe-a585-d0dfc7dba100 -F qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-5b2aad2e-08db-4abe-a585-d0dfc7dba100.7d8a25f1-723c-4380-bdf8-a468d4ef58cb Sep 06 06:53:41 devstack sudo[107972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:53:41 devstack sudo[107972]: pam_unix(sudo:session): session closed for user root Sep 06 06:53:41 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-97dbd32e-e518-404d-a21d-648a0f6b1b42 tempest-ProjectMemberTests-77954883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b2aad2e-08db-4abe-a585-d0dfc7dba100 -F qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-5b2aad2e-08db-4abe-a585-d0dfc7dba100.7d8a25f1-723c-4380-bdf8-a468d4ef58cb" returned: 0 in 0.285s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:53:41 devstack cinder-volume[87329]: WARNING cinder.volume.drivers.remotefs [None req-97dbd32e-e518-404d-a21d-648a0f6b1b42 tempest-ProjectMemberTests-77954883 None] /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-5b2aad2e-08db-4abe-a585-d0dfc7dba100.7d8a25f1-723c-4380-bdf8-a468d4ef58cb is being set with open permissions: ugo+rw Sep 06 06:53:41 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-97dbd32e-e518-404d-a21d-648a0f6b1b42 tempest-ProjectMemberTests-77954883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-5b2aad2e-08db-4abe-a585-d0dfc7dba100.7d8a25f1-723c-4380-bdf8-a468d4ef58cb {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:53:41 devstack sudo[107977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-5b2aad2e-08db-4abe-a585-d0dfc7dba100.7d8a25f1-723c-4380-bdf8-a468d4ef58cb Sep 06 06:53:41 devstack sudo[107977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:53:41 devstack sudo[107977]: pam_unix(sudo:session): session closed for user root Sep 06 06:53:41 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-97dbd32e-e518-404d-a21d-648a0f6b1b42 tempest-ProjectMemberTests-77954883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-5b2aad2e-08db-4abe-a585-d0dfc7dba100.7d8a25f1-723c-4380-bdf8-a468d4ef58cb" returned: 0 in 0.231s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:53:41 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-97dbd32e-e518-404d-a21d-648a0f6b1b42 tempest-ProjectMemberTests-77954883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-5b2aad2e-08db-4abe-a585-d0dfc7dba100.info {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:53:41 devstack sudo[107980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-5b2aad2e-08db-4abe-a585-d0dfc7dba100.info Sep 06 06:53:41 devstack sudo[107980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:53:41 devstack sudo[107980]: pam_unix(sudo:session): session closed for user root Sep 06 06:53:41 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-97dbd32e-e518-404d-a21d-648a0f6b1b42 tempest-ProjectMemberTests-77954883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-5b2aad2e-08db-4abe-a585-d0dfc7dba100.info" returned: 0 in 0.247s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:53:41 devstack cinder-volume[87329]: WARNING cinder.volume.drivers.remotefs [None req-97dbd32e-e518-404d-a21d-648a0f6b1b42 tempest-ProjectMemberTests-77954883 None] /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-5b2aad2e-08db-4abe-a585-d0dfc7dba100.info is being set with open permissions: ugo+rw Sep 06 06:53:41 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-97dbd32e-e518-404d-a21d-648a0f6b1b42 tempest-ProjectMemberTests-77954883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-5b2aad2e-08db-4abe-a585-d0dfc7dba100.info {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:53:41 devstack sudo[107983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-5b2aad2e-08db-4abe-a585-d0dfc7dba100.info Sep 06 06:53:41 devstack sudo[107983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:53:42 devstack sudo[107983]: pam_unix(sudo:session): session closed for user root Sep 06 06:53:42 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-97dbd32e-e518-404d-a21d-648a0f6b1b42 tempest-ProjectMemberTests-77954883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-5b2aad2e-08db-4abe-a585-d0dfc7dba100.info" returned: 0 in 0.234s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:53:42 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-97dbd32e-e518-404d-a21d-648a0f6b1b42 tempest-ProjectMemberTests-77954883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.789s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:53:42 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-97dbd32e-e518-404d-a21d-648a0f6b1b42 tempest-ProjectMemberTests-77954883 None] Create snapshot completed successfully Sep 06 06:53:42 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-855cab16-ac66-467a-be62-5874b1bfc94d tempest-ProjectMemberTests-77954883 None] Acquiring lock "cinder-7d8a25f1-723c-4380-bdf8-a468d4ef58cb-delete_snapshot" by "delete_snapshot" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:53:42 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-855cab16-ac66-467a-be62-5874b1bfc94d tempest-ProjectMemberTests-77954883 None] Lock "cinder-7d8a25f1-723c-4380-bdf8-a468d4ef58cb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:53:42 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-855cab16-ac66-467a-be62-5874b1bfc94d tempest-ProjectMemberTests-77954883 None] Acquiring lock "cinder-quobyte-5b2aad2e-08db-4abe-a585-d0dfc7dba100" by "delete_snapshot" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:53:42 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-855cab16-ac66-467a-be62-5874b1bfc94d tempest-ProjectMemberTests-77954883 None] Lock "cinder-quobyte-5b2aad2e-08db-4abe-a585-d0dfc7dba100" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:53:42 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-855cab16-ac66-467a-be62-5874b1bfc94d tempest-ProjectMemberTests-77954883 None] Acquiring lock "cinder-quobyte-7d8a25f1-723c-4380-bdf8-a468d4ef58cb" by "_delete_snapshot" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:53:42 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-855cab16-ac66-467a-be62-5874b1bfc94d tempest-ProjectMemberTests-77954883 None] Lock "cinder-quobyte-7d8a25f1-723c-4380-bdf8-a468d4ef58cb" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:53:42 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-855cab16-ac66-467a-be62-5874b1bfc94d tempest-ProjectMemberTests-77954883 None] Deleting offline snapshot 7d8a25f1-723c-4380-bdf8-a468d4ef58cb of volume 5b2aad2e-08db-4abe-a585-d0dfc7dba100 {{(pid=87329) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 06 06:53:42 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-855cab16-ac66-467a-be62-5874b1bfc94d tempest-ProjectMemberTests-77954883 None] snapshot_file for this snap is: volume-5b2aad2e-08db-4abe-a585-d0dfc7dba100.7d8a25f1-723c-4380-bdf8-a468d4ef58cb {{(pid=87329) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 06 06:53:42 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[a25b88ab-48ef-4d0a-8b57-c481f9f427c7]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:53:42 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-855cab16-ac66-467a-be62-5874b1bfc94d tempest-ProjectMemberTests-77954883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-5b2aad2e-08db-4abe-a585-d0dfc7dba100.7d8a25f1-723c-4380-bdf8-a468d4ef58cb {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:53:42 devstack sudo[107986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-5b2aad2e-08db-4abe-a585-d0dfc7dba100.7d8a25f1-723c-4380-bdf8-a468d4ef58cb Sep 06 06:53:42 devstack sudo[107986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:53:42 devstack sudo[107986]: pam_unix(sudo:session): session closed for user root Sep 06 06:53:42 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-855cab16-ac66-467a-be62-5874b1bfc94d tempest-ProjectMemberTests-77954883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-5b2aad2e-08db-4abe-a585-d0dfc7dba100.7d8a25f1-723c-4380-bdf8-a468d4ef58cb" returned: 0 in 0.352s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:53:42 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-855cab16-ac66-467a-be62-5874b1bfc94d tempest-ProjectMemberTests-77954883 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5b2aad2e-08db-4abe-a585-d0dfc7dba100(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87329) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 06:53:43 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c893482-9e04-42ac-8024-0219117c8801]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:53:43 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-855cab16-ac66-467a-be62-5874b1bfc94d tempest-ProjectMemberTests-77954883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-5b2aad2e-08db-4abe-a585-d0dfc7dba100 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:53:43 devstack sudo[107992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-5b2aad2e-08db-4abe-a585-d0dfc7dba100 Sep 06 06:53:43 devstack sudo[107992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:53:43 devstack sudo[107992]: pam_unix(sudo:session): session closed for user root Sep 06 06:53:43 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-855cab16-ac66-467a-be62-5874b1bfc94d tempest-ProjectMemberTests-77954883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-5b2aad2e-08db-4abe-a585-d0dfc7dba100" returned: 0 in 0.339s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:53:43 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-855cab16-ac66-467a-be62-5874b1bfc94d tempest-ProjectMemberTests-77954883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-5b2aad2e-08db-4abe-a585-d0dfc7dba100.7d8a25f1-723c-4380-bdf8-a468d4ef58cb {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:53:43 devstack sudo[107997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-5b2aad2e-08db-4abe-a585-d0dfc7dba100.7d8a25f1-723c-4380-bdf8-a468d4ef58cb Sep 06 06:53:43 devstack sudo[107997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:53:43 devstack sudo[107997]: pam_unix(sudo:session): session closed for user root Sep 06 06:53:43 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-855cab16-ac66-467a-be62-5874b1bfc94d tempest-ProjectMemberTests-77954883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-5b2aad2e-08db-4abe-a585-d0dfc7dba100.7d8a25f1-723c-4380-bdf8-a468d4ef58cb" returned: 0 in 0.321s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:53:43 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-855cab16-ac66-467a-be62-5874b1bfc94d tempest-ProjectMemberTests-77954883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-5b2aad2e-08db-4abe-a585-d0dfc7dba100.7d8a25f1-723c-4380-bdf8-a468d4ef58cb {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:53:43 devstack sudo[108002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-5b2aad2e-08db-4abe-a585-d0dfc7dba100.7d8a25f1-723c-4380-bdf8-a468d4ef58cb Sep 06 06:53:43 devstack sudo[108002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:53:43 devstack sudo[108002]: pam_unix(sudo:session): session closed for user root Sep 06 06:53:43 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-855cab16-ac66-467a-be62-5874b1bfc94d tempest-ProjectMemberTests-77954883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-5b2aad2e-08db-4abe-a585-d0dfc7dba100.7d8a25f1-723c-4380-bdf8-a468d4ef58cb" returned: 0 in 0.236s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:53:43 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-855cab16-ac66-467a-be62-5874b1bfc94d tempest-ProjectMemberTests-77954883 None] Lock "cinder-quobyte-7d8a25f1-723c-4380-bdf8-a468d4ef58cb" released by "_delete_snapshot" :: held 1.329s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:53:43 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-855cab16-ac66-467a-be62-5874b1bfc94d tempest-ProjectMemberTests-77954883 None] Lock "cinder-quobyte-5b2aad2e-08db-4abe-a585-d0dfc7dba100" released by "delete_snapshot" :: held 1.351s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:53:43 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-855cab16-ac66-467a-be62-5874b1bfc94d tempest-ProjectMemberTests-77954883 None] Created reservations ['05d862ee-a071-47f0-a92e-cc2d67c55883', 'ae81163f-203f-4cf0-b708-4f9feb6601de', 'c2e9696e-c5f7-4be5-91a8-ca4ffdf6e222', '54186965-c4cc-4578-9858-4321bcce05fb'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:53:44 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-855cab16-ac66-467a-be62-5874b1bfc94d tempest-ProjectMemberTests-77954883 None] Delete snapshot completed successfully. Sep 06 06:53:44 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-855cab16-ac66-467a-be62-5874b1bfc94d tempest-ProjectMemberTests-77954883 None] Lock "cinder-7d8a25f1-723c-4380-bdf8-a468d4ef58cb-delete_snapshot" released by "delete_snapshot" :: held 1.480s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:53:44 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-3f41c59e-6db9-4a2b-a60c-3eca0bcfb536 tempest-ProjectMemberTests-77954883 None] Acquiring lock "cinder-5b2aad2e-08db-4abe-a585-d0dfc7dba100-delete_volume" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:53:44 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-3f41c59e-6db9-4a2b-a60c-3eca0bcfb536 tempest-ProjectMemberTests-77954883 None] Lock "cinder-5b2aad2e-08db-4abe-a585-d0dfc7dba100-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:53:44 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-3f41c59e-6db9-4a2b-a60c-3eca0bcfb536 tempest-ProjectMemberTests-77954883 None] Acquiring lock "cinder-quobyte-5b2aad2e-08db-4abe-a585-d0dfc7dba100" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:53:44 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-3f41c59e-6db9-4a2b-a60c-3eca0bcfb536 tempest-ProjectMemberTests-77954883 None] Lock "cinder-quobyte-5b2aad2e-08db-4abe-a585-d0dfc7dba100" acquired by "delete_volume" :: waited 0.016s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:53:44 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8796b53-7eff-4fcb-bc94-3c53f8abdb71]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:53:44 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-3f41c59e-6db9-4a2b-a60c-3eca0bcfb536 tempest-ProjectMemberTests-77954883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-5b2aad2e-08db-4abe-a585-d0dfc7dba100 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:53:44 devstack sudo[108005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-5b2aad2e-08db-4abe-a585-d0dfc7dba100 Sep 06 06:53:44 devstack sudo[108005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:53:45 devstack sudo[108005]: pam_unix(sudo:session): session closed for user root Sep 06 06:53:45 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-3f41c59e-6db9-4a2b-a60c-3eca0bcfb536 tempest-ProjectMemberTests-77954883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-5b2aad2e-08db-4abe-a585-d0dfc7dba100" returned: 0 in 0.342s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:53:45 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-3f41c59e-6db9-4a2b-a60c-3eca0bcfb536 tempest-ProjectMemberTests-77954883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-5b2aad2e-08db-4abe-a585-d0dfc7dba100 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:53:45 devstack sudo[108010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-5b2aad2e-08db-4abe-a585-d0dfc7dba100 Sep 06 06:53:45 devstack sudo[108010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:53:45 devstack sudo[108010]: pam_unix(sudo:session): session closed for user root Sep 06 06:53:45 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-3f41c59e-6db9-4a2b-a60c-3eca0bcfb536 tempest-ProjectMemberTests-77954883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-5b2aad2e-08db-4abe-a585-d0dfc7dba100" returned: 0 in 0.235s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:53:45 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-3f41c59e-6db9-4a2b-a60c-3eca0bcfb536 tempest-ProjectMemberTests-77954883 None] Lock "cinder-quobyte-5b2aad2e-08db-4abe-a585-d0dfc7dba100" released by "delete_volume" :: held 0.629s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:53:45 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-3f41c59e-6db9-4a2b-a60c-3eca0bcfb536 tempest-ProjectMemberTests-77954883 None] Created reservations ['60f186f6-f7a8-4688-8b26-57bff6b09a34', 'f2bed63c-91bc-4f1e-9747-eab494e7a09e', '215d763d-ae44-4d06-a3d7-28c38f14dd65', '0f0cbaea-6ceb-4a19-9a6c-e0372c6b7816'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:53:45 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-3f41c59e-6db9-4a2b-a60c-3eca0bcfb536 tempest-ProjectMemberTests-77954883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:53:45 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-3f41c59e-6db9-4a2b-a60c-3eca0bcfb536 tempest-ProjectMemberTests-77954883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:53:45 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-3f41c59e-6db9-4a2b-a60c-3eca0bcfb536 tempest-ProjectMemberTests-77954883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:53:45 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-3f41c59e-6db9-4a2b-a60c-3eca0bcfb536 tempest-ProjectMemberTests-77954883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:53:45 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-3f41c59e-6db9-4a2b-a60c-3eca0bcfb536 tempest-ProjectMemberTests-77954883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:53:45 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-3f41c59e-6db9-4a2b-a60c-3eca0bcfb536 tempest-ProjectMemberTests-77954883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:53:45 devstack sudo[108027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:53:45 devstack sudo[108027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:53:45 devstack sudo[108027]: pam_unix(sudo:session): session closed for user root Sep 06 06:53:45 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-3f41c59e-6db9-4a2b-a60c-3eca0bcfb536 tempest-ProjectMemberTests-77954883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.245s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:53:45 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-3f41c59e-6db9-4a2b-a60c-3eca0bcfb536 tempest-ProjectMemberTests-77954883 None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:53:45 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-3f41c59e-6db9-4a2b-a60c-3eca0bcfb536 tempest-ProjectMemberTests-77954883 None] Deleted volume successfully. Sep 06 06:53:45 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-3f41c59e-6db9-4a2b-a60c-3eca0bcfb536 tempest-ProjectMemberTests-77954883 None] Lock "cinder-5b2aad2e-08db-4abe-a585-d0dfc7dba100-delete_volume" released by "delete_volume" :: held 1.078s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:53:46 devstack cinder-volume[87329]: DEBUG cinder.volume.flows.manager.create_volume [None req-139cbc31-3a7e-42ae-8aeb-456da9c096ce tempest-ProjectMemberTests-77954883 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87329) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 06 06:53:46 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-139cbc31-3a7e-42ae-8aeb-456da9c096ce tempest-ProjectMemberTests-77954883 None] Flow 'volume_create_manager' (a8ffffe4-2805-4bd0-9696-96d2e041bc1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:53:46 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-139cbc31-3a7e-42ae-8aeb-456da9c096ce tempest-ProjectMemberTests-77954883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (943d74dd-bcca-4a4a-91a7-63e55b8c0db5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:53:46 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-139cbc31-3a7e-42ae-8aeb-456da9c096ce tempest-ProjectMemberTests-77954883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (943d74dd-bcca-4a4a-91a7-63e55b8c0db5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:53:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-677021176',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02a173eb-c0f4-4c8f-8a04-0d50d902c314,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9dc5436e8fa48389e888d8f19858d1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:53:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:53:46Z,use_quota=True,user_id='f9722e49a5da4ba7b028b07e73bfb4c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:53:46 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-139cbc31-3a7e-42ae-8aeb-456da9c096ce tempest-ProjectMemberTests-77954883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (703896d1-c204-4eea-8ecd-28d46e6daed6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:53:46 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-139cbc31-3a7e-42ae-8aeb-456da9c096ce tempest-ProjectMemberTests-77954883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (703896d1-c204-4eea-8ecd-28d46e6daed6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:53:46 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-139cbc31-3a7e-42ae-8aeb-456da9c096ce tempest-ProjectMemberTests-77954883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68a80770-03f7-4aab-98fa-96c098047988) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:53:46 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-139cbc31-3a7e-42ae-8aeb-456da9c096ce tempest-ProjectMemberTests-77954883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68a80770-03f7-4aab-98fa-96c098047988) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '02a173eb-c0f4-4c8f-8a04-0d50d902c314', 'volume_name': 'volume-02a173eb-c0f4-4c8f-8a04-0d50d902c314', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:53:46 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-139cbc31-3a7e-42ae-8aeb-456da9c096ce tempest-ProjectMemberTests-77954883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91b20fad-734f-41b9-9e6c-6fef9bcd3d87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:53:46 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-139cbc31-3a7e-42ae-8aeb-456da9c096ce tempest-ProjectMemberTests-77954883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91b20fad-734f-41b9-9e6c-6fef9bcd3d87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:53:46 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-139cbc31-3a7e-42ae-8aeb-456da9c096ce tempest-ProjectMemberTests-77954883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64a135f1-d05e-4d1a-bf37-80e4d82d575a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:53:46 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-139cbc31-3a7e-42ae-8aeb-456da9c096ce tempest-ProjectMemberTests-77954883 None] Volume 02a173eb-c0f4-4c8f-8a04-0d50d902c314: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-02a173eb-c0f4-4c8f-8a04-0d50d902c314', 'volume_size': 1} Sep 06 06:53:46 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-139cbc31-3a7e-42ae-8aeb-456da9c096ce tempest-ProjectMemberTests-77954883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:53:46 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-139cbc31-3a7e-42ae-8aeb-456da9c096ce tempest-ProjectMemberTests-77954883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:53:46 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-139cbc31-3a7e-42ae-8aeb-456da9c096ce tempest-ProjectMemberTests-77954883 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-06T04:53:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-677021176',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02a173eb-c0f4-4c8f-8a04-0d50d902c314,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9dc5436e8fa48389e888d8f19858d1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-06T04:53:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-06T04:53:46Z,use_quota=True,user_id='f9722e49a5da4ba7b028b07e73bfb4c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01f0d4ee-9120-4626-b18a-928d9ca83113),volume_type_id=01f0d4ee-9120-4626-b18a-928d9ca83113)}" {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 06 06:53:46 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-139cbc31-3a7e-42ae-8aeb-456da9c096ce tempest-ProjectMemberTests-77954883 None] Creating volume 02a173eb-c0f4-4c8f-8a04-0d50d902c314 {{(pid=87329) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 06 06:53:46 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-139cbc31-3a7e-42ae-8aeb-456da9c096ce tempest-ProjectMemberTests-77954883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:53:46 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-139cbc31-3a7e-42ae-8aeb-456da9c096ce tempest-ProjectMemberTests-77954883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:53:46 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-139cbc31-3a7e-42ae-8aeb-456da9c096ce tempest-ProjectMemberTests-77954883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:53:46 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-139cbc31-3a7e-42ae-8aeb-456da9c096ce tempest-ProjectMemberTests-77954883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:53:46 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-139cbc31-3a7e-42ae-8aeb-456da9c096ce tempest-ProjectMemberTests-77954883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:53:46 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-139cbc31-3a7e-42ae-8aeb-456da9c096ce tempest-ProjectMemberTests-77954883 None] Selected osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 as target Quobyte volume. {{(pid=87329) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 06 06:53:46 devstack cinder-volume[87329]: INFO cinder.volume.drivers.remotefs [None req-139cbc31-3a7e-42ae-8aeb-456da9c096ce tempest-ProjectMemberTests-77954883 None] casted to osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6 Sep 06 06:53:46 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-139cbc31-3a7e-42ae-8aeb-456da9c096ce tempest-ProjectMemberTests-77954883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-02a173eb-c0f4-4c8f-8a04-0d50d902c314 1073741824 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:53:46 devstack sudo[108052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-02a173eb-c0f4-4c8f-8a04-0d50d902c314 1073741824 Sep 06 06:53:46 devstack sudo[108052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:53:46 devstack sudo[108052]: pam_unix(sudo:session): session closed for user root Sep 06 06:53:46 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-139cbc31-3a7e-42ae-8aeb-456da9c096ce tempest-ProjectMemberTests-77954883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-02a173eb-c0f4-4c8f-8a04-0d50d902c314 1073741824" returned: 0 in 0.394s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:53:46 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-139cbc31-3a7e-42ae-8aeb-456da9c096ce tempest-ProjectMemberTests-77954883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-02a173eb-c0f4-4c8f-8a04-0d50d902c314 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:53:46 devstack sudo[108057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-02a173eb-c0f4-4c8f-8a04-0d50d902c314 Sep 06 06:53:46 devstack sudo[108057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:53:47 devstack sudo[108057]: pam_unix(sudo:session): session closed for user root Sep 06 06:53:47 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-139cbc31-3a7e-42ae-8aeb-456da9c096ce tempest-ProjectMemberTests-77954883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-02a173eb-c0f4-4c8f-8a04-0d50d902c314" returned: 0 in 0.239s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:53:47 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-139cbc31-3a7e-42ae-8aeb-456da9c096ce tempest-ProjectMemberTests-77954883 None] <== create_volume: return (671ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'} {{(pid=87329) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 06 06:53:47 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-139cbc31-3a7e-42ae-8aeb-456da9c096ce tempest-ProjectMemberTests-77954883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.674s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:53:47 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-139cbc31-3a7e-42ae-8aeb-456da9c096ce tempest-ProjectMemberTests-77954883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64a135f1-d05e-4d1a-bf37-80e4d82d575a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02a173eb-c0f4-4c8f-8a04-0d50d902c314', 'volume_size': 1}' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:53:47 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-139cbc31-3a7e-42ae-8aeb-456da9c096ce tempest-ProjectMemberTests-77954883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d469983f-0fe4-4d69-849b-0e59cb067ee3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 06 06:53:47 devstack cinder-volume[87329]: INFO cinder.volume.flows.manager.create_volume [None req-139cbc31-3a7e-42ae-8aeb-456da9c096ce tempest-ProjectMemberTests-77954883 None] Volume volume-02a173eb-c0f4-4c8f-8a04-0d50d902c314 (02a173eb-c0f4-4c8f-8a04-0d50d902c314): created successfully Sep 06 06:53:47 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-139cbc31-3a7e-42ae-8aeb-456da9c096ce tempest-ProjectMemberTests-77954883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d469983f-0fe4-4d69-849b-0e59cb067ee3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87329) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 06 06:53:47 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-139cbc31-3a7e-42ae-8aeb-456da9c096ce tempest-ProjectMemberTests-77954883 None] Flow 'volume_create_manager' (a8ffffe4-2805-4bd0-9696-96d2e041bc1d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87329) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 06 06:53:47 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-139cbc31-3a7e-42ae-8aeb-456da9c096ce tempest-ProjectMemberTests-77954883 None] Created volume successfully. Sep 06 06:53:47 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-49967703-2a98-412e-b2be-4e9422ae17c3 tempest-ProjectMemberTests-77954883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:53:47 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-49967703-2a98-412e-b2be-4e9422ae17c3 tempest-ProjectMemberTests-77954883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:53:47 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-49967703-2a98-412e-b2be-4e9422ae17c3 tempest-ProjectMemberTests-77954883 None] Creating offline snapshot 9c353341-24c8-42b6-a712-d31b62ebb964 of volume 02a173eb-c0f4-4c8f-8a04-0d50d902c314 {{(pid=87329) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 06 06:53:47 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[a10c16cc-7eb3-41b8-8009-a38cce6aeb37]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:53:47 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-49967703-2a98-412e-b2be-4e9422ae17c3 tempest-ProjectMemberTests-77954883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-02a173eb-c0f4-4c8f-8a04-0d50d902c314 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:53:47 devstack sudo[108060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-02a173eb-c0f4-4c8f-8a04-0d50d902c314 Sep 06 06:53:47 devstack sudo[108060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:53:47 devstack sudo[108060]: pam_unix(sudo:session): session closed for user root Sep 06 06:53:47 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-49967703-2a98-412e-b2be-4e9422ae17c3 tempest-ProjectMemberTests-77954883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-02a173eb-c0f4-4c8f-8a04-0d50d902c314" returned: 0 in 0.348s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:53:47 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-49967703-2a98-412e-b2be-4e9422ae17c3 tempest-ProjectMemberTests-77954883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-02a173eb-c0f4-4c8f-8a04-0d50d902c314,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-02a173eb-c0f4-4c8f-8a04-0d50d902c314.9c353341-24c8-42b6-a712-d31b62ebb964 1G {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:53:47 devstack sudo[108065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-02a173eb-c0f4-4c8f-8a04-0d50d902c314,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-02a173eb-c0f4-4c8f-8a04-0d50d902c314.9c353341-24c8-42b6-a712-d31b62ebb964 1G Sep 06 06:53:47 devstack sudo[108065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:53:48 devstack sudo[108065]: pam_unix(sudo:session): session closed for user root Sep 06 06:53:48 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-49967703-2a98-412e-b2be-4e9422ae17c3 tempest-ProjectMemberTests-77954883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-02a173eb-c0f4-4c8f-8a04-0d50d902c314,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-02a173eb-c0f4-4c8f-8a04-0d50d902c314.9c353341-24c8-42b6-a712-d31b62ebb964 1G" returned: 0 in 0.370s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:53:48 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-49967703-2a98-412e-b2be-4e9422ae17c3 tempest-ProjectMemberTests-77954883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-02a173eb-c0f4-4c8f-8a04-0d50d902c314 -F qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-02a173eb-c0f4-4c8f-8a04-0d50d902c314.9c353341-24c8-42b6-a712-d31b62ebb964 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:53:48 devstack sudo[108070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-02a173eb-c0f4-4c8f-8a04-0d50d902c314 -F qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-02a173eb-c0f4-4c8f-8a04-0d50d902c314.9c353341-24c8-42b6-a712-d31b62ebb964 Sep 06 06:53:48 devstack sudo[108070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:53:48 devstack cinder-volume[87329]: DEBUG oslo_service.periodic_task [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87329) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 06 06:53:48 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:53:48 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:53:48 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:53:48 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:53:48 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:53:48 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:53:48 devstack sudo[108080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:53:48 devstack sudo[108080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:53:48 devstack sudo[108070]: pam_unix(sudo:session): session closed for user root Sep 06 06:53:48 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-49967703-2a98-412e-b2be-4e9422ae17c3 tempest-ProjectMemberTests-77954883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-02a173eb-c0f4-4c8f-8a04-0d50d902c314 -F qcow2 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-02a173eb-c0f4-4c8f-8a04-0d50d902c314.9c353341-24c8-42b6-a712-d31b62ebb964" returned: 0 in 0.298s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:53:48 devstack cinder-volume[87329]: WARNING cinder.volume.drivers.remotefs [None req-49967703-2a98-412e-b2be-4e9422ae17c3 tempest-ProjectMemberTests-77954883 None] /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-02a173eb-c0f4-4c8f-8a04-0d50d902c314.9c353341-24c8-42b6-a712-d31b62ebb964 is being set with open permissions: ugo+rw Sep 06 06:53:48 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-49967703-2a98-412e-b2be-4e9422ae17c3 tempest-ProjectMemberTests-77954883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-02a173eb-c0f4-4c8f-8a04-0d50d902c314.9c353341-24c8-42b6-a712-d31b62ebb964 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:53:48 devstack sudo[108082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-02a173eb-c0f4-4c8f-8a04-0d50d902c314.9c353341-24c8-42b6-a712-d31b62ebb964 Sep 06 06:53:48 devstack sudo[108082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:53:48 devstack sudo[108080]: pam_unix(sudo:session): session closed for user root Sep 06 06:53:48 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.243s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:53:48 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:53:48 devstack cinder-volume[87329]: DEBUG oslo_service.periodic_task [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] Running periodic task VolumeManager._thread_info {{(pid=87329) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 06 06:53:48 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] thread count: 28 {{(pid=87329) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 06 06:53:48 devstack cinder-volume[87329]: DEBUG cinder.volume.manager [None req-ce26f409-16e1-4610-9dd0-7c1b5ea52071 None None] thread info: [<_MainThread(MainThread, started 126855043821696)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87329) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 06 06:53:48 devstack sudo[108082]: pam_unix(sudo:session): session closed for user root Sep 06 06:53:48 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-49967703-2a98-412e-b2be-4e9422ae17c3 tempest-ProjectMemberTests-77954883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-02a173eb-c0f4-4c8f-8a04-0d50d902c314.9c353341-24c8-42b6-a712-d31b62ebb964" returned: 0 in 0.250s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:53:48 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-49967703-2a98-412e-b2be-4e9422ae17c3 tempest-ProjectMemberTests-77954883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-02a173eb-c0f4-4c8f-8a04-0d50d902c314.info {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:53:48 devstack sudo[108086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-02a173eb-c0f4-4c8f-8a04-0d50d902c314.info Sep 06 06:53:48 devstack sudo[108086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:53:49 devstack sudo[108086]: pam_unix(sudo:session): session closed for user root Sep 06 06:53:49 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-49967703-2a98-412e-b2be-4e9422ae17c3 tempest-ProjectMemberTests-77954883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-02a173eb-c0f4-4c8f-8a04-0d50d902c314.info" returned: 0 in 0.241s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:53:49 devstack cinder-volume[87329]: WARNING cinder.volume.drivers.remotefs [None req-49967703-2a98-412e-b2be-4e9422ae17c3 tempest-ProjectMemberTests-77954883 None] /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-02a173eb-c0f4-4c8f-8a04-0d50d902c314.info is being set with open permissions: ugo+rw Sep 06 06:53:49 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-49967703-2a98-412e-b2be-4e9422ae17c3 tempest-ProjectMemberTests-77954883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-02a173eb-c0f4-4c8f-8a04-0d50d902c314.info {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:53:49 devstack sudo[108089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-02a173eb-c0f4-4c8f-8a04-0d50d902c314.info Sep 06 06:53:49 devstack sudo[108089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:53:49 devstack sudo[108089]: pam_unix(sudo:session): session closed for user root Sep 06 06:53:49 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-49967703-2a98-412e-b2be-4e9422ae17c3 tempest-ProjectMemberTests-77954883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-02a173eb-c0f4-4c8f-8a04-0d50d902c314.info" returned: 0 in 0.233s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:53:49 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-49967703-2a98-412e-b2be-4e9422ae17c3 tempest-ProjectMemberTests-77954883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.814s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:53:49 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-49967703-2a98-412e-b2be-4e9422ae17c3 tempest-ProjectMemberTests-77954883 None] Create snapshot completed successfully Sep 06 06:53:49 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-613cdbe8-8efd-4528-ae17-bf04da13d483 tempest-ProjectMemberTests-77954883 None] Acquiring lock "cinder-9c353341-24c8-42b6-a712-d31b62ebb964-delete_snapshot" by "delete_snapshot" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:53:49 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-613cdbe8-8efd-4528-ae17-bf04da13d483 tempest-ProjectMemberTests-77954883 None] Lock "cinder-9c353341-24c8-42b6-a712-d31b62ebb964-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:53:49 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-613cdbe8-8efd-4528-ae17-bf04da13d483 tempest-ProjectMemberTests-77954883 None] Acquiring lock "cinder-quobyte-02a173eb-c0f4-4c8f-8a04-0d50d902c314" by "delete_snapshot" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:53:49 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-613cdbe8-8efd-4528-ae17-bf04da13d483 tempest-ProjectMemberTests-77954883 None] Lock "cinder-quobyte-02a173eb-c0f4-4c8f-8a04-0d50d902c314" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:53:49 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-613cdbe8-8efd-4528-ae17-bf04da13d483 tempest-ProjectMemberTests-77954883 None] Acquiring lock "cinder-quobyte-9c353341-24c8-42b6-a712-d31b62ebb964" by "_delete_snapshot" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:53:49 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-613cdbe8-8efd-4528-ae17-bf04da13d483 tempest-ProjectMemberTests-77954883 None] Lock "cinder-quobyte-9c353341-24c8-42b6-a712-d31b62ebb964" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:53:49 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-613cdbe8-8efd-4528-ae17-bf04da13d483 tempest-ProjectMemberTests-77954883 None] Deleting offline snapshot 9c353341-24c8-42b6-a712-d31b62ebb964 of volume 02a173eb-c0f4-4c8f-8a04-0d50d902c314 {{(pid=87329) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 06 06:53:49 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-613cdbe8-8efd-4528-ae17-bf04da13d483 tempest-ProjectMemberTests-77954883 None] snapshot_file for this snap is: volume-02a173eb-c0f4-4c8f-8a04-0d50d902c314.9c353341-24c8-42b6-a712-d31b62ebb964 {{(pid=87329) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 06 06:53:49 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[c454359f-bd61-4e42-b1ee-216b9693984d]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:53:49 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-613cdbe8-8efd-4528-ae17-bf04da13d483 tempest-ProjectMemberTests-77954883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-02a173eb-c0f4-4c8f-8a04-0d50d902c314.9c353341-24c8-42b6-a712-d31b62ebb964 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:53:49 devstack sudo[108092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-02a173eb-c0f4-4c8f-8a04-0d50d902c314.9c353341-24c8-42b6-a712-d31b62ebb964 Sep 06 06:53:49 devstack sudo[108092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:53:50 devstack sudo[108092]: pam_unix(sudo:session): session closed for user root Sep 06 06:53:50 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-613cdbe8-8efd-4528-ae17-bf04da13d483 tempest-ProjectMemberTests-77954883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-02a173eb-c0f4-4c8f-8a04-0d50d902c314.9c353341-24c8-42b6-a712-d31b62ebb964" returned: 0 in 0.345s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:53:50 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.remotefs [None req-613cdbe8-8efd-4528-ae17-bf04da13d483 tempest-ProjectMemberTests-77954883 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-02a173eb-c0f4-4c8f-8a04-0d50d902c314(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87329) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 06 06:53:50 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce89c3f2-b95c-4422-81fc-78e93a0deeca]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:53:50 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-613cdbe8-8efd-4528-ae17-bf04da13d483 tempest-ProjectMemberTests-77954883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-02a173eb-c0f4-4c8f-8a04-0d50d902c314 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:53:50 devstack sudo[108099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-02a173eb-c0f4-4c8f-8a04-0d50d902c314 Sep 06 06:53:50 devstack sudo[108099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:53:50 devstack sudo[108099]: pam_unix(sudo:session): session closed for user root Sep 06 06:53:50 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-613cdbe8-8efd-4528-ae17-bf04da13d483 tempest-ProjectMemberTests-77954883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-02a173eb-c0f4-4c8f-8a04-0d50d902c314" returned: 0 in 0.341s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:53:50 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-613cdbe8-8efd-4528-ae17-bf04da13d483 tempest-ProjectMemberTests-77954883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-02a173eb-c0f4-4c8f-8a04-0d50d902c314.9c353341-24c8-42b6-a712-d31b62ebb964 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:53:50 devstack sudo[108105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-02a173eb-c0f4-4c8f-8a04-0d50d902c314.9c353341-24c8-42b6-a712-d31b62ebb964 Sep 06 06:53:50 devstack sudo[108105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:53:50 devstack sudo[108105]: pam_unix(sudo:session): session closed for user root Sep 06 06:53:50 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-613cdbe8-8efd-4528-ae17-bf04da13d483 tempest-ProjectMemberTests-77954883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-02a173eb-c0f4-4c8f-8a04-0d50d902c314.9c353341-24c8-42b6-a712-d31b62ebb964" returned: 0 in 0.306s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:53:50 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-613cdbe8-8efd-4528-ae17-bf04da13d483 tempest-ProjectMemberTests-77954883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-02a173eb-c0f4-4c8f-8a04-0d50d902c314.9c353341-24c8-42b6-a712-d31b62ebb964 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:53:50 devstack sudo[108110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-02a173eb-c0f4-4c8f-8a04-0d50d902c314.9c353341-24c8-42b6-a712-d31b62ebb964 Sep 06 06:53:50 devstack sudo[108110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:53:50 devstack sudo[108110]: pam_unix(sudo:session): session closed for user root Sep 06 06:53:50 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-613cdbe8-8efd-4528-ae17-bf04da13d483 tempest-ProjectMemberTests-77954883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-02a173eb-c0f4-4c8f-8a04-0d50d902c314.9c353341-24c8-42b6-a712-d31b62ebb964" returned: 0 in 0.236s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:53:51 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-613cdbe8-8efd-4528-ae17-bf04da13d483 tempest-ProjectMemberTests-77954883 None] Lock "cinder-quobyte-9c353341-24c8-42b6-a712-d31b62ebb964" released by "_delete_snapshot" :: held 1.308s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:53:51 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-613cdbe8-8efd-4528-ae17-bf04da13d483 tempest-ProjectMemberTests-77954883 None] Lock "cinder-quobyte-02a173eb-c0f4-4c8f-8a04-0d50d902c314" released by "delete_snapshot" :: held 1.332s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:53:51 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-613cdbe8-8efd-4528-ae17-bf04da13d483 tempest-ProjectMemberTests-77954883 None] Created reservations ['3fb1b85c-6028-4647-b5c7-1d3cc22bb3a0', 'c767ab33-1c6a-43c5-b0e0-01b7bcbd07f3', '171161bf-7614-4f7e-98c5-6be61e6a195a', '112ab3fa-43d9-432a-8efd-cb6a8211011f'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:53:51 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-613cdbe8-8efd-4528-ae17-bf04da13d483 tempest-ProjectMemberTests-77954883 None] Delete snapshot completed successfully. Sep 06 06:53:51 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-613cdbe8-8efd-4528-ae17-bf04da13d483 tempest-ProjectMemberTests-77954883 None] Lock "cinder-9c353341-24c8-42b6-a712-d31b62ebb964-delete_snapshot" released by "delete_snapshot" :: held 1.469s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:53:51 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-e40a94af-5789-4286-bf65-16fe487451a0 tempest-ProjectMemberTests-77954883 None] Acquiring lock "cinder-02a173eb-c0f4-4c8f-8a04-0d50d902c314-delete_volume" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:53:51 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-e40a94af-5789-4286-bf65-16fe487451a0 tempest-ProjectMemberTests-77954883 None] Lock "cinder-02a173eb-c0f4-4c8f-8a04-0d50d902c314-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:53:51 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-e40a94af-5789-4286-bf65-16fe487451a0 tempest-ProjectMemberTests-77954883 None] Acquiring lock "cinder-quobyte-02a173eb-c0f4-4c8f-8a04-0d50d902c314" by "delete_volume" {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 06 06:53:51 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-e40a94af-5789-4286-bf65-16fe487451a0 tempest-ProjectMemberTests-77954883 None] Lock "cinder-quobyte-02a173eb-c0f4-4c8f-8a04-0d50d902c314" acquired by "delete_volume" :: waited 0.013s {{(pid=87329) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 06 06:53:51 devstack cinder-volume[87329]: DEBUG oslo.privsep.daemon [-] privsep: reply[73c0d976-47c8-4c18-9ed1-2ae53f124abf]: (4, 'qcow2') {{(pid=88651) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 06 06:53:51 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-e40a94af-5789-4286-bf65-16fe487451a0 tempest-ProjectMemberTests-77954883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-02a173eb-c0f4-4c8f-8a04-0d50d902c314 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:53:52 devstack sudo[108113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-02a173eb-c0f4-4c8f-8a04-0d50d902c314 Sep 06 06:53:52 devstack sudo[108113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:53:52 devstack sudo[108113]: pam_unix(sudo:session): session closed for user root Sep 06 06:53:52 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-e40a94af-5789-4286-bf65-16fe487451a0 tempest-ProjectMemberTests-77954883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-02a173eb-c0f4-4c8f-8a04-0d50d902c314" returned: 0 in 0.358s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:53:52 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-e40a94af-5789-4286-bf65-16fe487451a0 tempest-ProjectMemberTests-77954883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-02a173eb-c0f4-4c8f-8a04-0d50d902c314 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:53:52 devstack sudo[108118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-02a173eb-c0f4-4c8f-8a04-0d50d902c314 Sep 06 06:53:52 devstack sudo[108118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:53:52 devstack sudo[108118]: pam_unix(sudo:session): session closed for user root Sep 06 06:53:52 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-e40a94af-5789-4286-bf65-16fe487451a0 tempest-ProjectMemberTests-77954883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132/volume-02a173eb-c0f4-4c8f-8a04-0d50d902c314" returned: 0 in 0.246s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:53:52 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-e40a94af-5789-4286-bf65-16fe487451a0 tempest-ProjectMemberTests-77954883 None] Lock "cinder-quobyte-02a173eb-c0f4-4c8f-8a04-0d50d902c314" released by "delete_volume" :: held 0.656s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:53:52 devstack cinder-volume[87329]: DEBUG cinder.quota [None req-e40a94af-5789-4286-bf65-16fe487451a0 tempest-ProjectMemberTests-77954883 None] Created reservations ['83a69b8e-9592-4a5a-9f79-519b5027ecd4', '2c2f1c54-5917-4bab-8331-af9bdede7f89', 'e9c10f36-b2f3-446b-8676-25aa246e7665', 'c6bcf33a-06e9-478d-9d02-37935e9d4d39'] {{(pid=87329) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 06 06:53:52 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-e40a94af-5789-4286-bf65-16fe487451a0 tempest-ProjectMemberTests-77954883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 06 06:53:52 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-e40a94af-5789-4286-bf65-16fe487451a0 tempest-ProjectMemberTests-77954883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 06 06:53:52 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-e40a94af-5789-4286-bf65-16fe487451a0 tempest-ProjectMemberTests-77954883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6': None} {{(pid=87329) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 06 06:53:52 devstack cinder-volume[87329]: DEBUG cinder.volume.drivers.quobyte [None req-e40a94af-5789-4286-bf65-16fe487451a0 tempest-ProjectMemberTests-77954883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cec44f8f-46f1-426c-be91-5d32ca2877d6'] {{(pid=87329) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 06 06:53:52 devstack cinder-volume[87329]: DEBUG oslo_concurrency.lockutils [None req-e40a94af-5789-4286-bf65-16fe487451a0 tempest-ProjectMemberTests-77954883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87329) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 06 06:53:52 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-e40a94af-5789-4286-bf65-16fe487451a0 tempest-ProjectMemberTests-77954883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 06 06:53:52 devstack sudo[108121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132 Sep 06 06:53:52 devstack sudo[108121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 06 06:53:52 devstack sudo[108121]: pam_unix(sudo:session): session closed for user root Sep 06 06:53:52 devstack cinder-volume[87329]: DEBUG oslo_concurrency.processutils [None req-e40a94af-5789-4286-bf65-16fe487451a0 tempest-ProjectMemberTests-77954883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8a05412b818d472ece0faf0dd2b6a132" returned: 0 in 0.248s {{(pid=87329) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 06 06:53:52 devstack cinder-volume[87329]: DEBUG cinder.manager [None req-e40a94af-5789-4286-bf65-16fe487451a0 tempest-ProjectMemberTests-77954883 None] Notifying Schedulers of capabilities ... {{(pid=87329) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 06 06:53:52 devstack cinder-volume[87329]: INFO cinder.volume.manager [None req-e40a94af-5789-4286-bf65-16fe487451a0 tempest-ProjectMemberTests-77954883 None] Deleted volume successfully. Sep 06 06:53:52 devstack cinder-volume[87329]: DEBUG cinder.coordination [None req-e40a94af-5789-4286-bf65-16fe487451a0 tempest-ProjectMemberTests-77954883 None] Lock "cinder-02a173eb-c0f4-4c8f-8a04-0d50d902c314-delete_volume" released by "delete_volume" :: held 1.099s {{(pid=87329) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 06 06:54:02 devstack cinder-volume[87329]: DEBUG dbcounter [-] [87329] Writing DB stats cinder:UPDATE=125,cinder:SELECT=75,cinder:INSERT=31,cinder:DELETE=5 {{(pid=87329) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 06 06:54:02 devstack cinder-volume[87329]: DEBUG dbcounter [-] [87329] Writing DB stats cinder:SELECT=95,cinder:INSERT=32,cinder:UPDATE=108,cinder:DELETE=14 {{(pid=87329) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}